Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 10/2020

06.03.2020 | Original Article

An adaptive kernel sparse representation-based classification

verfasst von: Xuejun Wang, Wenjian Wang, Changqian Men

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 10/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In recent years, scholars have attached increasing attention to sparse representation. Based on compressed sensing and machine learning, sparse representation-based classification (SRC) has been extensively in classification. However, SRC is not suitable for samples with non-linear structures which arise in many practical applications. Meanwhile, sparsity is overemphasized by SRC, but the correlation information which is of great importance in classification is overlooked. To address these shortcomings, this study puts forward an adaptive kernel sparse representation-based classification (AKSRC). First, the samples were mapped to a high-dimensional feature space from the original feature space. Second, after selecting a suitable kernel function, a sample is represented as the linear combination of training samples of same class. Further more, the trace norm is adopted in AKSRC which is different from general approaches. It’s adaptive to the structure of dictionary which means that a better linear representation which has the most discriminative samples can be obtained. Therefore, AKSRC has more powerful classification ability. Finally, the advancement and effectiveness of the proposed AKSRC are verified by carrying out experiments on benchmark data sets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell 22(1):4–37CrossRef Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell 22(1):4–37CrossRef
2.
Zurück zum Zitat Kotsiantis Sotiris B, Zaharakis I, Pintelas P (2007) Supervised machine learning: a review of classification techniques. Emerging artificial intelligence applications in computer engineering 160(3):3–24MathSciNet Kotsiantis Sotiris B, Zaharakis I, Pintelas P (2007) Supervised machine learning: a review of classification techniques. Emerging artificial intelligence applications in computer engineering 160(3):3–24MathSciNet
3.
Zurück zum Zitat Schölkopf B, Smola A, Müller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef Schölkopf B, Smola A, Müller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef
4.
Zurück zum Zitat Mika S, Ratsch G, Weston J et al (1999) Fisher discriminant analysis with kernels. In: Proceedings of the IEEE signal processing society workshop, pp 41–48 Mika S, Ratsch G, Weston J et al (1999) Fisher discriminant analysis with kernels. In: Proceedings of the IEEE signal processing society workshop, pp 41–48
5.
Zurück zum Zitat Yu K, Ji L, Zhang X (2002) Kernel nearest-neighbor algorithm. Neural Process Lett 15(2):147–156CrossRef Yu K, Ji L, Zhang X (2002) Kernel nearest-neighbor algorithm. Neural Process Lett 15(2):147–156CrossRef
6.
Zurück zum Zitat Sallee P, Olshausen BA (2003) Learning sparse multiscale image representations. Adv Neural Inf Process Syst 16:1351–1358 Sallee P, Olshausen BA (2003) Learning sparse multiscale image representations. Adv Neural Inf Process Syst 16:1351–1358
7.
Zurück zum Zitat Rao S R, Tron R, Vidal R, et al. (2008) Motion segmentation via robust subspace separation in the presence of outlying, incomplete, or corrupted trajectories. In: IEEE conference on computer vision and pattern recognition Rao S R, Tron R, Vidal R, et al. (2008) Motion segmentation via robust subspace separation in the presence of outlying, incomplete, or corrupted trajectories. In: IEEE conference on computer vision and pattern recognition
8.
Zurück zum Zitat Yang J, Wright J, Huang T, et al. (2008) Image super-resolution as sparse representation of raw image patches. In: IEEE conference on computer vision and pattern recognition Yang J, Wright J, Huang T, et al. (2008) Image super-resolution as sparse representation of raw image patches. In: IEEE conference on computer vision and pattern recognition
9.
Zurück zum Zitat Wright J, Yang AY, Ganesh A et al (2008) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef Wright J, Yang AY, Ganesh A et al (2008) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef
10.
Zurück zum Zitat Zhang Z, Xu Y, Yang J et al (2015) A survey of sparse representation: algorithms and applications. IEEE Access 3:490–530CrossRef Zhang Z, Xu Y, Yang J et al (2015) A survey of sparse representation: algorithms and applications. IEEE Access 3:490–530CrossRef
11.
Zurück zum Zitat Yin J, Liu Z, Jin Z et al (2012) Kernel sparse representation based classification. Neurocomputing 77(1):120–128CrossRef Yin J, Liu Z, Jin Z et al (2012) Kernel sparse representation based classification. Neurocomputing 77(1):120–128CrossRef
12.
Zurück zum Zitat Wang J, Lu C, Wang M et al (2014) Robust face recognition via adaptive sparse representation. IEEE Trans Cybern 44(12):2368–2378MathSciNetCrossRef Wang J, Lu C, Wang M et al (2014) Robust face recognition via adaptive sparse representation. IEEE Trans Cybern 44(12):2368–2378MathSciNetCrossRef
13.
Zurück zum Zitat Yang Y, Ma Z, Hauptmann AG et al (2012) Feature selection for multimedia analysis by sharing information among multiple tasks. IEEE Trans Multim 15(3):661–669CrossRef Yang Y, Ma Z, Hauptmann AG et al (2012) Feature selection for multimedia analysis by sharing information among multiple tasks. IEEE Trans Multim 15(3):661–669CrossRef
14.
Zurück zum Zitat Qian W, Cao F (2019) Adaptive algorithms for low-rank and sparse matrix recovery with truncated nuclear norm. Int J Mach Learn Cybern 10(6):1341–1355CrossRef Qian W, Cao F (2019) Adaptive algorithms for low-rank and sparse matrix recovery with truncated nuclear norm. Int J Mach Learn Cybern 10(6):1341–1355CrossRef
15.
Zurück zum Zitat Ma Z, Yang Y, Cai Y, et al. (2012) Knowledge adaptation for ad hoc multimedia event detection with few exemplars. In: Proceedings of the 20th ACM international conference on multimedia, pp 469–478 Ma Z, Yang Y, Cai Y, et al. (2012) Knowledge adaptation for ad hoc multimedia event detection with few exemplars. In: Proceedings of the 20th ACM international conference on multimedia, pp 469–478
16.
Zurück zum Zitat Amaldi E, Kann V (1998) On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems. Theor Comput Sci 209(1):237–260MathSciNetCrossRef Amaldi E, Kann V (1998) On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems. Theor Comput Sci 209(1):237–260MathSciNetCrossRef
17.
Zurück zum Zitat Candès EJ, Romberg JK, Tao T (2006) Stable signal recovery from incomplete and inaccurate measurements. Commun Pure Appl Math 59(8):1207–1223MathSciNetCrossRef Candès EJ, Romberg JK, Tao T (2006) Stable signal recovery from incomplete and inaccurate measurements. Commun Pure Appl Math 59(8):1207–1223MathSciNetCrossRef
18.
Zurück zum Zitat Donoho DL (2006) For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution. Commun Pure Appl Math 59(6):797–829MathSciNetCrossRef Donoho DL (2006) For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution. Commun Pure Appl Math 59(6):797–829MathSciNetCrossRef
19.
Zurück zum Zitat Candès EJ, Tao T (2006) Near-optimal signal recovery from random projections: universal encoding strategies? IEEE Trans Inf Theory 52(12):5406–5425MathSciNetCrossRef Candès EJ, Tao T (2006) Near-optimal signal recovery from random projections: universal encoding strategies? IEEE Trans Inf Theory 52(12):5406–5425MathSciNetCrossRef
20.
21.
Zurück zum Zitat Lin Z, Liu R, Su Z (2011) Linearized alternating direction method with adaptive penalty for low rank representation. Adv Neural Inf Process Syst 24:612–620 Lin Z, Liu R, Su Z (2011) Linearized alternating direction method with adaptive penalty for low rank representation. Adv Neural Inf Process Syst 24:612–620
22.
Zurück zum Zitat Cai JF, Candès EJ, Shen Z (2010) A singular value thresholding algorithm for matrix completion. SIAM J Optim 20(4):1956–1982MathSciNetCrossRef Cai JF, Candès EJ, Shen Z (2010) A singular value thresholding algorithm for matrix completion. SIAM J Optim 20(4):1956–1982MathSciNetCrossRef
23.
Zurück zum Zitat Hale ET, Yin W, Zhang Y (2008) Fixed-point continuation for ‘1minimization: methodology and convergence. SIAM J Optim 19(3):1107–1130MathSciNetCrossRef Hale ET, Yin W, Zhang Y (2008) Fixed-point continuation for ‘1minimization: methodology and convergence. SIAM J Optim 19(3):1107–1130MathSciNetCrossRef
24.
Zurück zum Zitat Boyd S, Parikh N, Chu E et al (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1–122CrossRef Boyd S, Parikh N, Chu E et al (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1–122CrossRef
25.
Zurück zum Zitat Jiang X, Lai J (2014) Sparse and dense hybrid representation via dictionary decomposition for face recognition. IEEE Trans Pattern Anal Mach Intell 37(5):1067–1079CrossRef Jiang X, Lai J (2014) Sparse and dense hybrid representation via dictionary decomposition for face recognition. IEEE Trans Pattern Anal Mach Intell 37(5):1067–1079CrossRef
26.
Zurück zum Zitat Phillips PJ, Moon H, Rizvi SA et al (2000) The FERET evaluation methodology for face-recognition algorithms. IEEE Trans Pattern Anal Mach Intell 22(10):1090–1104CrossRef Phillips PJ, Moon H, Rizvi SA et al (2000) The FERET evaluation methodology for face-recognition algorithms. IEEE Trans Pattern Anal Mach Intell 22(10):1090–1104CrossRef
27.
Zurück zum Zitat Martínez A, Benavente R (1998) The AR face database. Cvc Technical Report, 24 Martínez A, Benavente R (1998) The AR face database. Cvc Technical Report, 24
28.
Zurück zum Zitat Muller K-R, Mika S, Ratsch G et al (2001) An introduction to kernel-based learning algorithms. IEEE Trans Neural Netw 12(2):181–201CrossRef Muller K-R, Mika S, Ratsch G et al (2001) An introduction to kernel-based learning algorithms. IEEE Trans Neural Netw 12(2):181–201CrossRef
29.
Zurück zum Zitat Hollander MW, Wolf DA, Chicken E (2013) Nonparametric statistical methods. Wiley, New York, pp 84–90 Hollander MW, Wolf DA, Chicken E (2013) Nonparametric statistical methods. Wiley, New York, pp 84–90
Metadaten
Titel
An adaptive kernel sparse representation-based classification
verfasst von
Xuejun Wang
Wenjian Wang
Changqian Men
Publikationsdatum
06.03.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 10/2020
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-020-01110-w

Weitere Artikel der Ausgabe 10/2020

International Journal of Machine Learning and Cybernetics 10/2020 Zur Ausgabe

Neuer Inhalt