Skip to main content
Erschienen in: Pattern Analysis and Applications 4/2017

27.04.2016 | Theoretical Advances

Double-fold localized multiple matrix learning machine with Universum

verfasst von: Changming Zhu

Erschienen in: Pattern Analysis and Applications | Ausgabe 4/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Matrix learning, multiple-view learning, Universum learning, and local learning are four hot spots of present research. Matrix learning aims to design feasible machines to process matrix patterns directly. Multiple-view learning takes pattern information from multiple aspects, i.e., multiple-view information into account. Universum learning can reflect priori knowledge about application domain and improve classification performances. A good local learning approach is important to the finding of local structures and pattern information. Our previous proposed learning machine, double-fold localized multiple matrix learning machine is a one with multiple-view information, local structures, and matrix learning. But this machine does not take Universum learning into account. Thus, this paper proposes a double-fold localized multiple matrix learning machine with Universum (Uni-DLMMLM) so as to improve the performance of a learning machine. Experimental results have validated that Uni-DLMMLM (1) makes full use of the domain knowledge of whole data distribution as well as inherits the advantages of matrix learning; (2) combines Universum learning with matrix learning so as to capture more global knowledge; (3) has a good ability to process different kinds of data sets; (4) has a superior classification performance and leads to a low empirical generation risk bound.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Duda RO, Hart PE, Stork DG (2001) Pattern classification. Wiley-Interscience Press, New YorkMATH Duda RO, Hart PE, Stork DG (2001) Pattern classification. Wiley-Interscience Press, New YorkMATH
2.
Zurück zum Zitat Vapnik VN (1998) Statistical learning theory. Wiley-Interscience Press, New YorkMATH Vapnik VN (1998) Statistical learning theory. Wiley-Interscience Press, New YorkMATH
3.
Zurück zum Zitat Wang H, Ahuja N (2005) Rank-r approximation of tensors using image-as-matrix representation. IEEE Comp Soc Conf Comp Vision Patt Recogn 2:346–353 Wang H, Ahuja N (2005) Rank-r approximation of tensors using image-as-matrix representation. IEEE Comp Soc Conf Comp Vision Patt Recogn 2:346–353
4.
Zurück zum Zitat Yang J, Zhang D, Frangi AF, Yang J (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Patt Anal Mach Intell 26(1):131–137CrossRef Yang J, Zhang D, Frangi AF, Yang J (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Patt Anal Mach Intell 26(1):131–137CrossRef
5.
Zurück zum Zitat Li M, Yuan B (2005) 2D-LDA: a novel statistical linear discriminant analysis for image matrix. Patt Recogn Lett 26(5):527–532CrossRef Li M, Yuan B (2005) 2D-LDA: a novel statistical linear discriminant analysis for image matrix. Patt Recogn Lett 26(5):527–532CrossRef
6.
Zurück zum Zitat Chen SC, Wang Z, Tian YJ (2007) Matrix-pattern-oriented ho-kashyap classifier with regularization learning. Patt Recogn 40(5):1533–1543CrossRefMATH Chen SC, Wang Z, Tian YJ (2007) Matrix-pattern-oriented ho-kashyap classifier with regularization learning. Patt Recogn 40(5):1533–1543CrossRefMATH
7.
Zurück zum Zitat Ye JP (2005) Generalized low rank approximations of matrices. Mach Learn 61(1):167–191CrossRefMATH Ye JP (2005) Generalized low rank approximations of matrices. Mach Learn 61(1):167–191CrossRefMATH
8.
Zurück zum Zitat Chen SC, Zhu Y, Zhang D, Yang JY (2005) Feature extraction approaches based on matrix pattern: Mat-PCA and Mat-FLDA. Patt Recogn Lett 26(8):1157–1167CrossRef Chen SC, Zhu Y, Zhang D, Yang JY (2005) Feature extraction approaches based on matrix pattern: Mat-PCA and Mat-FLDA. Patt Recogn Lett 26(8):1157–1167CrossRef
9.
Zurück zum Zitat Wang Z, Chen SC (2007) New least squares support vector machines based on matrix patterns. Neural Process Lett 26(1):41–56CrossRefMathSciNet Wang Z, Chen SC (2007) New least squares support vector machines based on matrix patterns. Neural Process Lett 26(1):41–56CrossRefMathSciNet
10.
Zurück zum Zitat Yan Y, Wang Q, Ni G, Pan Z, Kong R (2012) One-class support vector machines based on matrix patterns. Int Conf Inform Cyber Comp Eng pp 223–231 Yan Y, Wang Q, Ni G, Pan Z, Kong R (2012) One-class support vector machines based on matrix patterns. Int Conf Inform Cyber Comp Eng pp 223–231
11.
Zurück zum Zitat Tang Y, Yan PK, Yuan Y, Li XL (2011) Single-image super-resolution via local learning. Int J Mach Learn Cyber 2(1):15–23CrossRef Tang Y, Yan PK, Yuan Y, Li XL (2011) Single-image super-resolution via local learning. Int J Mach Learn Cyber 2(1):15–23CrossRef
12.
Zurück zum Zitat Wang Z, Zhu CM, Gao DQ, Chen SC (2013) Three-fold structured classifier design based on matrix pattern. Patt Recogn 46(6):1532–1555CrossRefMATH Wang Z, Zhu CM, Gao DQ, Chen SC (2013) Three-fold structured classifier design based on matrix pattern. Patt Recogn 46(6):1532–1555CrossRefMATH
13.
Zurück zum Zitat Sen D, Gupta N, Pal SK (2013) Incorporating local image structure in normalized cut based graph partitioning for grouping of pixels. Inform Sci 248:214–238CrossRefMathSciNet Sen D, Gupta N, Pal SK (2013) Incorporating local image structure in normalized cut based graph partitioning for grouping of pixels. Inform Sci 248:214–238CrossRefMathSciNet
14.
Zurück zum Zitat Yeung DS, Chan PPK, Ng WWY, Lin CM, Liu JNK (2012) Dynamic fusion method using localized generalization error model. Inform Sci 217:1–20CrossRef Yeung DS, Chan PPK, Ng WWY, Lin CM, Liu JNK (2012) Dynamic fusion method using localized generalization error model. Inform Sci 217:1–20CrossRef
15.
Zurück zum Zitat Yeung DS, Chan PPK, Ng WWY (2009) Radial Basis Function network learning using localized generalization error bound. Inform Sci 179(19):3127–3199CrossRefMATHMathSciNet Yeung DS, Chan PPK, Ng WWY (2009) Radial Basis Function network learning using localized generalization error bound. Inform Sci 179(19):3127–3199CrossRefMATHMathSciNet
16.
Zurück zum Zitat Wang Z, Xu J, Gao DQ, Fu Y (2013) Multiple empirical kernel learning based on local information. Neural Comp Appl 23:2113–2120CrossRef Wang Z, Xu J, Gao DQ, Fu Y (2013) Multiple empirical kernel learning based on local information. Neural Comp Appl 23:2113–2120CrossRef
17.
Zurück zum Zitat Wang Z, Chen SC, Gao DQ (2011) A novel multi-view learning developed from single-view patterns. Patt Recogn 44(10–11):2395–2413CrossRefMATH Wang Z, Chen SC, Gao DQ (2011) A novel multi-view learning developed from single-view patterns. Patt Recogn 44(10–11):2395–2413CrossRefMATH
18.
Zurück zum Zitat Wang Z, Xu J, Chen SC, Gao DQ (2012) Regularized multi-view machine based on response surface technique. Neurocomputing 97:201–213CrossRef Wang Z, Xu J, Chen SC, Gao DQ (2012) Regularized multi-view machine based on response surface technique. Neurocomputing 97:201–213CrossRef
19.
Zurück zum Zitat Zhu CM, Wang Z, Gao DQ, Feng X (2015) Double-fold localized multiple matrixized learning machine. Inform Sci 295:196–220CrossRefMATH Zhu CM, Wang Z, Gao DQ, Feng X (2015) Double-fold localized multiple matrixized learning machine. Inform Sci 295:196–220CrossRefMATH
20.
Zurück zum Zitat Xu C, Tao DC, Xu C (2015) Multi-view intact space learning. IEEE Trans Patt Anal Mach Intell 37(12):2531–2544CrossRef Xu C, Tao DC, Xu C (2015) Multi-view intact space learning. IEEE Trans Patt Anal Mach Intell 37(12):2531–2544CrossRef
21.
Zurück zum Zitat Luo Y, Tao DC, Wen YG, Ramamohanarao K, Xu C (2015) Tensor canonical correlation analysis for multi-view dimension reduction. IEEE Trans Know Data Eng 27(11):3111–3124CrossRef Luo Y, Tao DC, Wen YG, Ramamohanarao K, Xu C (2015) Tensor canonical correlation analysis for multi-view dimension reduction. IEEE Trans Know Data Eng 27(11):3111–3124CrossRef
22.
Zurück zum Zitat Zhang LF, Zhang Q, Zhang LP, Tao DC, Huang X, Du B (2015) Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding. Patt Recogn 48(10):3102–3112CrossRef Zhang LF, Zhang Q, Zhang LP, Tao DC, Huang X, Du B (2015) Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding. Patt Recogn 48(10):3102–3112CrossRef
23.
Zurück zum Zitat Vapnik V, Kotz S (1982) Estimation of dependences based on empirical data. Springer Vapnik V, Kotz S (1982) Estimation of dependences based on empirical data. Springer
24.
Zurück zum Zitat Cherkassky V, Dai WY (2009) Empirical Study of the Universum SVM learning for high-dimensional data. Lect Notes Comp Sci 5768:932–941CrossRef Cherkassky V, Dai WY (2009) Empirical Study of the Universum SVM learning for high-dimensional data. Lect Notes Comp Sci 5768:932–941CrossRef
25.
Zurück zum Zitat Liu DL, Tian YJ, Bie RF, Shi Y (2014) Self-Universum support vector machine. Person Ubiquitous Comp 18:1813–1819CrossRef Liu DL, Tian YJ, Bie RF, Shi Y (2014) Self-Universum support vector machine. Person Ubiquitous Comp 18:1813–1819CrossRef
26.
Zurück zum Zitat Chen S, Zhang CS (2009) Selecting informative universum sample for semi-supervised learning. Int Jont Conf Art Intell pp 1016–1021 Chen S, Zhang CS (2009) Selecting informative universum sample for semi-supervised learning. Int Jont Conf Art Intell pp 1016–1021
27.
Zurück zum Zitat Zhang D, Wang J, Si L (2001) Document clustering with universum. Int Conf Res Dev Inform Retr pp 873–882 Zhang D, Wang J, Si L (2001) Document clustering with universum. Int Conf Res Dev Inform Retr pp 873–882
28.
Zurück zum Zitat Peng B, Qian G, Ma YQ (2008) View-invariant pose recognition using multilinear analysis and the universum. Adv Visual Comp 5359:581–591CrossRef Peng B, Qian G, Ma YQ (2008) View-invariant pose recognition using multilinear analysis and the universum. Adv Visual Comp 5359:581–591CrossRef
29.
Zurück zum Zitat Shen C, Wang P, Shen F, Wang H (2012) Uboost: boosting with the universum. IEEE Trans Patt Anal Mach Intell 34(4):825–832CrossRef Shen C, Wang P, Shen F, Wang H (2012) Uboost: boosting with the universum. IEEE Trans Patt Anal Mach Intell 34(4):825–832CrossRef
30.
Zurück zum Zitat Chen XH, Chen SC, Xue H (2012) Universum linear discriminant analysis. Electr Lett 48(22):1407–1409CrossRef Chen XH, Chen SC, Xue H (2012) Universum linear discriminant analysis. Electr Lett 48(22):1407–1409CrossRef
31.
Zurück zum Zitat Wang Z, Zhu YJ, Liu WW, Chen ZH, Gao DQ (2014) Multi-view learning with universum. Know Based Syst 70:376–391CrossRef Wang Z, Zhu YJ, Liu WW, Chen ZH, Gao DQ (2014) Multi-view learning with universum. Know Based Syst 70:376–391CrossRef
32.
Zurück zum Zitat Leski J (2003) Ho-kashyap classifier with generalization control. Patt Recogn Lett 24(14):2281–2290CrossRefMATH Leski J (2003) Ho-kashyap classifier with generalization control. Patt Recogn Lett 24(14):2281–2290CrossRefMATH
33.
Zurück zum Zitat Blake CL, Newman DJ, Hettich S, Merz CJ (2012) UCI repository of machine learning databases Blake CL, Newman DJ, Hettich S, Merz CJ (2012) UCI repository of machine learning databases
34.
Zurück zum Zitat Wang N, Wang J, Yeung DY (2013) Online robust non-negative dictionary learning for visual tracking. Int Conf Comp Vision Wang N, Wang J, Yeung DY (2013) Online robust non-negative dictionary learning for visual tracking. Int Conf Comp Vision
35.
Zurück zum Zitat Wang N, Yeung DY (2013) Learning a deep compact image representation for visual tracking. Neural Inform Process Syst Wang N, Yeung DY (2013) Learning a deep compact image representation for visual tracking. Neural Inform Process Syst
36.
Zurück zum Zitat Milgram J, Cheriet M, Sabourin R (2013) “One Against One” or “One Against All”: Which one is better for handwriting recognition with SVMs?. In: Tenth International Workshop on Frontiers in Handwriting Recognition Milgram J, Cheriet M, Sabourin R (2013) “One Against One” or “One Against All”: Which one is better for handwriting recognition with SVMs?. In: Tenth International Workshop on Frontiers in Handwriting Recognition
37.
Zurück zum Zitat Debnath R, Takahide N, Takahashi H (2004) A decision based one-against-one method for multi-class support vector machine. Patt Anal Appl 7(2):164–175CrossRefMathSciNet Debnath R, Takahide N, Takahashi H (2004) A decision based one-against-one method for multi-class support vector machine. Patt Anal Appl 7(2):164–175CrossRefMathSciNet
38.
Zurück zum Zitat Hsu CW, Lin CJ (2002) A comparison of methods for multiclass support vector machines. IEEE Trans Neural Networks 13(2):415–425CrossRef Hsu CW, Lin CJ (2002) A comparison of methods for multiclass support vector machines. IEEE Trans Neural Networks 13(2):415–425CrossRef
39.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support vector machine. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support vector machine. Mach Learn 20(3):273–297MATH
40.
Zurück zum Zitat Cawley GC, Talbot NLC (2010) On over-fitting in model selection and subsequent selection bias in performance evaluation. J Mach Learn Res 11:2079–2107MATHMathSciNet Cawley GC, Talbot NLC (2010) On over-fitting in model selection and subsequent selection bias in performance evaluation. J Mach Learn Res 11:2079–2107MATHMathSciNet
41.
Zurück zum Zitat Bartlett P, Boucheron S, Lugosi G (2002) Model selection and error estimation. Mach Learn 48:85–113CrossRefMATH Bartlett P, Boucheron S, Lugosi G (2002) Model selection and error estimation. Mach Learn 48:85–113CrossRefMATH
42.
43.
Zurück zum Zitat Koltchinskii V, Panchenko D (2000) Rademacher processes and bounding the risk of function learning. High Dimens Probab II:443–459CrossRefMATHMathSciNet Koltchinskii V, Panchenko D (2000) Rademacher processes and bounding the risk of function learning. High Dimens Probab II:443–459CrossRefMATHMathSciNet
44.
Zurück zum Zitat Mendelson S (2002) Rademacher averages and phase transitions in glivenko-cantelli classes. IEEE Trans Inform Theory 48(1):251–263CrossRefMATHMathSciNet Mendelson S (2002) Rademacher averages and phase transitions in glivenko-cantelli classes. IEEE Trans Inform Theory 48(1):251–263CrossRefMATHMathSciNet
45.
Zurück zum Zitat Wang Z, Zhu CM, Niu ZX, Gao DQ, Feng X (2014) Multi-kernel classification machine with reduced complexity. Know Based Syst 65:83–95CrossRef Wang Z, Zhu CM, Niu ZX, Gao DQ, Feng X (2014) Multi-kernel classification machine with reduced complexity. Know Based Syst 65:83–95CrossRef
46.
Zurück zum Zitat Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MATHMathSciNet Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MATHMathSciNet
Metadaten
Titel
Double-fold localized multiple matrix learning machine with Universum
verfasst von
Changming Zhu
Publikationsdatum
27.04.2016
Verlag
Springer London
Erschienen in
Pattern Analysis and Applications / Ausgabe 4/2017
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-016-0548-9

Weitere Artikel der Ausgabe 4/2017

Pattern Analysis and Applications 4/2017 Zur Ausgabe

Industrial and Commercial Application

Arabic document layout analysis

Premium Partner