Skip to main content
Erschienen in: Neural Computing and Applications 1/2017

28.08.2015 | Original Article

Supervised learning of sparse context reconstruction coefficients for data representation and classification

verfasst von: Xuejie Liu, Jingbin Wang, Ming Yin, Benjamin Edwards, Peijuan Xu

Erschienen in: Neural Computing and Applications | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Context of data points, which is usually defined as the other data points in a data set, has been found to paly important roles in data representation and classification. In this paper, we study the problem of using context of a data point for its classification problem. Our work is inspired by the observation that actually only very few data points are critical in the context of a data point for its representation and classification. We propose to represent a data point as the sparse linear combination of its context and learn the sparse context in a supervised way to increase its discriminative ability. To this end, we proposed a novel formulation for context learning, by modeling the learning of context parameter and classifier in a unified objective, and optimizing it with an alternative strategy in an iterative algorithm. Experiments on three benchmark data set show its advantage over state-of-the-art context-based data representation and classification methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Agerri R, Artola X, Beloki Z, Rigau G, Soroa A (2015) Big data for natural language processing: a streaming approach. Knowl Based Syst 79:36–42CrossRef Agerri R, Artola X, Beloki Z, Rigau G, Soroa A (2015) Big data for natural language processing: a streaming approach. Knowl Based Syst 79:36–42CrossRef
2.
Zurück zum Zitat Ahn WH, Nah SP, Seo BS (2015) Automatic classification of digitally modulated signals based on k-nearest neighbor. Lect Notes Electr Eng 329:63–69CrossRef Ahn WH, Nah SP, Seo BS (2015) Automatic classification of digitally modulated signals based on k-nearest neighbor. Lect Notes Electr Eng 329:63–69CrossRef
3.
Zurück zum Zitat Aldea R, Fira M, Lazar A (2014) Classifications of motor imagery tasks using k-nearest neighbors. In: 2014 12th Symposium on neural network applications in electrical engineering (NEUREL). IEEE, pp 115–120 Aldea R, Fira M, Lazar A (2014) Classifications of motor imagery tasks using k-nearest neighbors. In: 2014 12th Symposium on neural network applications in electrical engineering (NEUREL). IEEE, pp 115–120
5.
Zurück zum Zitat Dessí N, Pes B (2015) Similarity of feature selection methods: an empirical study across data intensive classification tasks. Expert Syst Appl 42(10):4632–4642CrossRef Dessí N, Pes B (2015) Similarity of feature selection methods: an empirical study across data intensive classification tasks. Expert Syst Appl 42(10):4632–4642CrossRef
6.
Zurück zum Zitat Duan Y, Stien L, Thorsen A, Karlsen Ø, Sandlund N, Li D, Fu Z, Meier S (2015) An automatic counting system for transparent pelagic fish eggs based on computer vision. Aquac Eng 67:8–13CrossRef Duan Y, Stien L, Thorsen A, Karlsen Ø, Sandlund N, Li D, Fu Z, Meier S (2015) An automatic counting system for transparent pelagic fish eggs based on computer vision. Aquac Eng 67:8–13CrossRef
7.
Zurück zum Zitat Feng Q, Pan T, Pan J, Tang L (2015) Improved mean representation based classification for face recognition. Lect Notes Electr Eng 330:1407–1412CrossRef Feng Q, Pan T, Pan J, Tang L (2015) Improved mean representation based classification for face recognition. Lect Notes Electr Eng 330:1407–1412CrossRef
8.
Zurück zum Zitat Gao S, Tsang IH, Chia LT (2013) Laplacian sparse coding, hypergraph laplacian sparse coding, and applications. IEEE Trans Pattern Anal Mach Intell 35(1):92–104CrossRef Gao S, Tsang IH, Chia LT (2013) Laplacian sparse coding, hypergraph laplacian sparse coding, and applications. IEEE Trans Pattern Anal Mach Intell 35(1):92–104CrossRef
9.
Zurück zum Zitat Gao S, Tsang IW, Chia LT, Zhao P (2010) Local features are not lonely—Laplacian sparse coding for image classification. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3555–3561 Gao S, Tsang IW, Chia LT, Zhao P (2010) Local features are not lonely—Laplacian sparse coding for image classification. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3555–3561
10.
Zurück zum Zitat Garanina N, Sidorova E (2015) Ontology population as algebraic information system processing based on multi-agent natural language text analysis algorithms. Program Comput Softw 41(3):140–148MathSciNetCrossRefMATH Garanina N, Sidorova E (2015) Ontology population as algebraic information system processing based on multi-agent natural language text analysis algorithms. Program Comput Softw 41(3):140–148MathSciNetCrossRefMATH
11.
Zurück zum Zitat Greving H, Sassenberg K (2015) Counter-regulation online: threat biases retrieval of information during internet search. Comput Hum Behav 50:291–298CrossRef Greving H, Sassenberg K (2015) Counter-regulation online: threat biases retrieval of information during internet search. Comput Hum Behav 50:291–298CrossRef
12.
Zurück zum Zitat Guerreiro A, Souza J, Rufino J (2014) Improving ns-2 network simulator to evaluate IEEE 802.15.4 wireless networks under error conditions. pp 213–220 Guerreiro A, Souza J, Rufino J (2014) Improving ns-2 network simulator to evaluate IEEE 802.15.4 wireless networks under error conditions. pp 213–220
13.
Zurück zum Zitat Guo Z, Li Q, You J, Zhang D, Liu W (2012) Local directional derivative pattern for rotation invariant texture classification. Neural Comput Appl 21(8):1893–1904CrossRef Guo Z, Li Q, You J, Zhang D, Liu W (2012) Local directional derivative pattern for rotation invariant texture classification. Neural Comput Appl 21(8):1893–1904CrossRef
14.
Zurück zum Zitat He Y, Sang N (2013) Multi-ring local binary patterns for rotation invariant texture classification. Neural Comput Appl 22(3–4):793–802CrossRef He Y, Sang N (2013) Multi-ring local binary patterns for rotation invariant texture classification. Neural Comput Appl 22(3–4):793–802CrossRef
15.
Zurück zum Zitat Huang F, Li C, Lin L (2014) Identifying gender of microblog users based on message mining. In: Lecture notes in computer science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol 8485. LNCS, pp 488–493 Huang F, Li C, Lin L (2014) Identifying gender of microblog users based on message mining. In: Lecture notes in computer science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol 8485. LNCS, pp 488–493
16.
Zurück zum Zitat Jasiewicz J, Netzel P, Stepinski T (2015) Geopat: a toolbox for pattern-based information retrieval from large geospatial databases. Comput Geosci 80:62–73CrossRef Jasiewicz J, Netzel P, Stepinski T (2015) Geopat: a toolbox for pattern-based information retrieval from large geospatial databases. Comput Geosci 80:62–73CrossRef
17.
Zurück zum Zitat Jin C, Jin SW (2015) Automatic image annotation using feature selection based on improving quantum particle swarm optimization. Signal Process 109:172–181CrossRef Jin C, Jin SW (2015) Automatic image annotation using feature selection based on improving quantum particle swarm optimization. Signal Process 109:172–181CrossRef
18.
Zurück zum Zitat Kang M, Kim J, Kim JM, Tan A, Kim E, Choi BK (2015) Reliable fault diagnosis for low-speed bearings using individually trained support vector machines with kernel discriminative feature analysis. IEEE Trans Power Electron 30(5):2786–2797CrossRef Kang M, Kim J, Kim JM, Tan A, Kim E, Choi BK (2015) Reliable fault diagnosis for low-speed bearings using individually trained support vector machines with kernel discriminative feature analysis. IEEE Trans Power Electron 30(5):2786–2797CrossRef
19.
Zurück zum Zitat Karad A, Joshi R (2015) Rule based chunk extraction from PDF documents using regular expressions and natural language processing. Int J Appl Eng Res 10(3):7721–7726 Karad A, Joshi R (2015) Rule based chunk extraction from PDF documents using regular expressions and natural language processing. Int J Appl Eng Res 10(3):7721–7726
20.
Zurück zum Zitat Kim S, Yu Z, Kil R, Lee M (2015) Deep learning of support vector machines with class probability output networks. Neural Netw 64:19–28CrossRefMATH Kim S, Yu Z, Kil R, Lee M (2015) Deep learning of support vector machines with class probability output networks. Neural Netw 64:19–28CrossRefMATH
21.
Zurück zum Zitat Li H, Federico M, He X, Meng H, Trancoso I (2015) Introduction to the special section on continuous space and related methods in natural language processing. IEEE Trans Audio Speech Lang Process 23(3):427–430CrossRef Li H, Federico M, He X, Meng H, Trancoso I (2015) Introduction to the special section on continuous space and related methods in natural language processing. IEEE Trans Audio Speech Lang Process 23(3):427–430CrossRef
22.
Zurück zum Zitat Li Z, Gong D, Li X, Tao D (2015) Learning compact feature descriptor and adaptive matching framework for face recognition. IEEE Trans Image Process 24(9):2736–2745MathSciNetCrossRef Li Z, Gong D, Li X, Tao D (2015) Learning compact feature descriptor and adaptive matching framework for face recognition. IEEE Trans Image Process 24(9):2736–2745MathSciNetCrossRef
23.
Zurück zum Zitat Liu T, Wang G, Wang L, Chan K (2015) Visual tracking via temporally smooth sparse coding. IEEE Signal Process Lett 22(9):1452–1456CrossRef Liu T, Wang G, Wang L, Chan K (2015) Visual tracking via temporally smooth sparse coding. IEEE Signal Process Lett 22(9):1452–1456CrossRef
24.
Zurück zum Zitat Lu J, Liong V, Wang G, Moulin P (2015) Joint feature learning for face recognition. IEEE Trans Inf Forensics Secur 10(7):1371–1383CrossRef Lu J, Liong V, Wang G, Moulin P (2015) Joint feature learning for face recognition. IEEE Trans Inf Forensics Secur 10(7):1371–1383CrossRef
25.
Zurück zum Zitat Melacci S, Belkin M (2011) Laplacian support vector machines trained in the primal. J Mach Learn Res 12:1149–1184MathSciNetMATH Melacci S, Belkin M (2011) Laplacian support vector machines trained in the primal. J Mach Learn Res 12:1149–1184MathSciNetMATH
26.
Zurück zum Zitat Nayak M, Nayak A (2015) Odia running text recognition using moment-based feature extraction and mean distance classification technique. In: Advances in intelligent systems and computing 309 AISC, vol 2, pp 497–506 Nayak M, Nayak A (2015) Odia running text recognition using moment-based feature extraction and mean distance classification technique. In: Advances in intelligent systems and computing 309 AISC, vol 2, pp 497–506
27.
Zurück zum Zitat Pouria Z, Mathews E, Havinga P, Stojanovski S, Sisinni E, Ferrari P (2014) Implementation of wirelesshart in the ns-2 simulator and validation of its correctness. Sensors (Switzerland) 14(5):8633–8668CrossRef Pouria Z, Mathews E, Havinga P, Stojanovski S, Sisinni E, Ferrari P (2014) Implementation of wirelesshart in the ns-2 simulator and validation of its correctness. Sensors (Switzerland) 14(5):8633–8668CrossRef
28.
Zurück zum Zitat Sheydaei N, Saraee M, Shahgholian A (2015) A novel feature selection method for text classification using association rules and clustering. J Inf Sci 41(1):3–15CrossRef Sheydaei N, Saraee M, Shahgholian A (2015) A novel feature selection method for text classification using association rules and clustering. J Inf Sci 41(1):3–15CrossRef
29.
Zurück zum Zitat Staglianó A, Noceti N, Verri A, Odone F (2015) Online space-variant background modeling with sparse coding. IEEE Trans Image Process 24(8):2415–2428MathSciNetCrossRef Staglianó A, Noceti N, Verri A, Odone F (2015) Online space-variant background modeling with sparse coding. IEEE Trans Image Process 24(8):2415–2428MathSciNetCrossRef
30.
Zurück zum Zitat Tian Y, Zhang Q, Liu D (2014) v-Nonparallel support vector machine for pattern classification. Neural Comput Appl 25(5):1007–1020CrossRef Tian Y, Zhang Q, Liu D (2014) v-Nonparallel support vector machine for pattern classification. Neural Comput Appl 25(5):1007–1020CrossRef
31.
Zurück zum Zitat Tomé A, Kuipers M, Pinheiro T, Nunes M, Heitor T (2015) Space-use analysis through computer vision. Autom Constr 57:80–97CrossRef Tomé A, Kuipers M, Pinheiro T, Nunes M, Heitor T (2015) Space-use analysis through computer vision. Autom Constr 57:80–97CrossRef
32.
Zurück zum Zitat Wang H, Wang J (2014) An effective image representation method using kernel classification. In: 2014 IEEE 26th international conference on tools with artificial intelligence (ICTAI), pp 853–858 Wang H, Wang J (2014) An effective image representation method using kernel classification. In: 2014 IEEE 26th international conference on tools with artificial intelligence (ICTAI), pp 853–858
33.
Zurück zum Zitat Wang J, Gao X, Wang Q, Li Y (2013) Prodis-contshc: learning protein dissimilarity measures and hierarchical context coherently for protein-protein comparison in protein database retrieval. BMC Bioinform 13(Suppl 7):S2CrossRef Wang J, Gao X, Wang Q, Li Y (2013) Prodis-contshc: learning protein dissimilarity measures and hierarchical context coherently for protein-protein comparison in protein database retrieval. BMC Bioinform 13(Suppl 7):S2CrossRef
34.
Zurück zum Zitat Wang J, Li Y, Wang Q, You X, Man J, Wang C, Gao X (2012) Proclusensem: predicting membrane protein types by fusing different modes of pseudo amino acid composition. Comput Biol Med 42(5):564–574CrossRef Wang J, Li Y, Wang Q, You X, Man J, Wang C, Gao X (2012) Proclusensem: predicting membrane protein types by fusing different modes of pseudo amino acid composition. Comput Biol Med 42(5):564–574CrossRef
35.
Zurück zum Zitat Wang JJY, Bensmail H, Gao X (2012) Multiple graph regularized protein domain ranking. BMC Bioinform 13(1):307CrossRef Wang JJY, Bensmail H, Gao X (2012) Multiple graph regularized protein domain ranking. BMC Bioinform 13(1):307CrossRef
36.
Zurück zum Zitat Wang JJY, Bensmail H, Gao X (2013) Joint learning and weighting of visual vocabulary for bag-of-feature based tissue classification. Pattern Recognit 46(12):3249–3255CrossRef Wang JJY, Bensmail H, Gao X (2013) Joint learning and weighting of visual vocabulary for bag-of-feature based tissue classification. Pattern Recognit 46(12):3249–3255CrossRef
37.
Zurück zum Zitat Wang JJY, Bensmail H, Gao X (2014) Feature selection and multi-kernel learning for sparse representation on a manifold. Neural Netw 51:9–16CrossRefMATH Wang JJY, Bensmail H, Gao X (2014) Feature selection and multi-kernel learning for sparse representation on a manifold. Neural Netw 51:9–16CrossRefMATH
38.
Zurück zum Zitat Wang JJY, Bensmail H, Yao N, Gao X (2013) Discriminative sparse coding on multi-manifolds. Knowl Based Syst 54:199–206CrossRef Wang JJY, Bensmail H, Yao N, Gao X (2013) Discriminative sparse coding on multi-manifolds. Knowl Based Syst 54:199–206CrossRef
39.
Zurück zum Zitat Wang JJY, Gao X (2014) Semi-supervised sparse coding. In: Proceedings of the international joint conference on neural networks, pp 1630–1637 Wang JJY, Gao X (2014) Semi-supervised sparse coding. In: Proceedings of the international joint conference on neural networks, pp 1630–1637
40.
Zurück zum Zitat Wang JJY, Gao X (2015) Max–min distance nonnegative matrix factorization. Neural Netw 61:75–84CrossRefMATH Wang JJY, Gao X (2015) Max–min distance nonnegative matrix factorization. Neural Netw 61:75–84CrossRefMATH
41.
Zurück zum Zitat Wang JJY, Sun Y, Gao X (2014) Sparse structure regularized ranking. Multimed Tools Appl 74(2):635–654CrossRef Wang JJY, Sun Y, Gao X (2014) Sparse structure regularized ranking. Multimed Tools Appl 74(2):635–654CrossRef
42.
Zurück zum Zitat Wang JJY, Wang X, Gao X (2013) Non-negative matrix factorization by maximizing correntropy for cancer clustering. BMC Bioinform 14:107CrossRef Wang JJY, Wang X, Gao X (2013) Non-negative matrix factorization by maximizing correntropy for cancer clustering. BMC Bioinform 14:107CrossRef
43.
Zurück zum Zitat Wang JJY, Wang Y, Jing BY, Gao X (2015) Regularized maximum correntropy machine. Neurocomputing 160:85–92CrossRef Wang JJY, Wang Y, Jing BY, Gao X (2015) Regularized maximum correntropy machine. Neurocomputing 160:85–92CrossRef
44.
Zurück zum Zitat Wang JJY, Wang Y, Zhao S, Gao X (2015) Maximum mutual information regularized classification. Eng Appl Artif Intell 37:1–8CrossRef Wang JJY, Wang Y, Zhao S, Gao X (2015) Maximum mutual information regularized classification. Eng Appl Artif Intell 37:1–8CrossRef
45.
Zurück zum Zitat Wang JY, Almasri I, Gao X (2012) Adaptive graph regularized nonnegative matrix factorization via feature selection. In: Proceedings—international conference on pattern recognition, pp 963–966 Wang JY, Almasri I, Gao X (2012) Adaptive graph regularized nonnegative matrix factorization via feature selection. In: Proceedings—international conference on pattern recognition, pp 963–966
46.
Zurück zum Zitat Wang JY, Almasri I, Shi Y, Gao X (2014) Semi-supervised transductive hot spot predictor working on multiple assumptions. Curr Bioinform 9(3):258–267CrossRef Wang JY, Almasri I, Shi Y, Gao X (2014) Semi-supervised transductive hot spot predictor working on multiple assumptions. Curr Bioinform 9(3):258–267CrossRef
47.
Zurück zum Zitat Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef
48.
Zurück zum Zitat Xu Y, Fang X, You J, Chen Y, Liu H (2015) Noise-free representation based classification and face recognition experiments. Neurocomputing 147(1):307–314CrossRef Xu Y, Fang X, You J, Chen Y, Liu H (2015) Noise-free representation based classification and face recognition experiments. Neurocomputing 147(1):307–314CrossRef
49.
Zurück zum Zitat Xu Y, Shen F, Zhao J (2012) An incremental learning vector quantization algorithm for pattern classification. Neural Comput Appl 21(6):1205–1215CrossRef Xu Y, Shen F, Zhao J (2012) An incremental learning vector quantization algorithm for pattern classification. Neural Comput Appl 21(6):1205–1215CrossRef
50.
Zurück zum Zitat Zhao S, Hu ZP (2015) A modular weighted sparse representation based on fisher discriminant and sparse residual for face recognition with occlusion. Inf Process Lett 115(9):677–683MathSciNetCrossRefMATH Zhao S, Hu ZP (2015) A modular weighted sparse representation based on fisher discriminant and sparse residual for face recognition with occlusion. Inf Process Lett 115(9):677–683MathSciNetCrossRefMATH
Metadaten
Titel
Supervised learning of sparse context reconstruction coefficients for data representation and classification
verfasst von
Xuejie Liu
Jingbin Wang
Ming Yin
Benjamin Edwards
Peijuan Xu
Publikationsdatum
28.08.2015
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 1/2017
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-015-2042-5

Weitere Artikel der Ausgabe 1/2017

Neural Computing and Applications 1/2017 Zur Ausgabe