Skip to main content
Erschienen in: Cognitive Computation 3/2014

01.09.2014

Fast Image Recognition Based on Independent Component Analysis and Extreme Learning Machine

verfasst von: Shujing Zhang, Bo He, Rui Nian, Jing Wang, Bo Han, Amaury Lendasse, Guang Yuan

Erschienen in: Cognitive Computation | Ausgabe 3/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nowadays, image recognition has become a highly active research topic in cognitive computation community, due to its many potential applications. Generally, the image recognition task involves two subtasks: image representation and image classification. Most feature extraction approaches for image representation developed so far regard independent component analysis (ICA) as one of the essential means. However, ICA has been hampered by its extremely expensive computational cost in real-time implementation. To address this problem, a fast cognitive computational scheme for image recognition is presented in this paper, which combines ICA and the extreme learning machine (ELM) algorithm. It tries to solve the image recognition problem at a much faster speed by using ELM not only in image classification but also in feature extraction for image representation. As an example, our proposed approach is applied to the face image recognition with detailed analysis. Firstly, common feature hypothesis is introduced to extract the common visual features from universal images by the traditional ICA model in the offline recognition process, and then ELM is used to simulate ICA for the purpose of facial feature extraction in the online recognition process. Lastly, the resulting independent feature representation of the face images extracted by ELM rather than ICA will be fed into the ELM classifier, which is composed of numerous single hidden layer feed-forward networks. Experimental results on Yale face database and MNIST digit database have shown the good performance of our proposed approach, which could be comparable to the state-of-the-art techniques at a much faster speed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
Literatur
1.
2.
Zurück zum Zitat Cambria E, Hussain A. Sentic Computing: Techniques, Tools, and Applications. Springer Briefs in Cogn Comput. Dordrecht, Netherlands: Springer 2012. Cambria E, Hussain A. Sentic Computing: Techniques, Tools, and Applications. Springer Briefs in Cogn Comput. Dordrecht, Netherlands: Springer 2012.
3.
Zurück zum Zitat Wang QF, Cambria E, Liu CL, Hussain A. Common sense knowledge for handwritten Chinese recognition. Cogn Comput. 2013;5(2):234–42.CrossRef Wang QF, Cambria E, Liu CL, Hussain A. Common sense knowledge for handwritten Chinese recognition. Cogn Comput. 2013;5(2):234–42.CrossRef
4.
Zurück zum Zitat Rakover SŚ, Cahlon B. Face recognition: cognitive and computational processes. Amsterdam: John Benjamins; 2001.CrossRef Rakover SŚ, Cahlon B. Face recognition: cognitive and computational processes. Amsterdam: John Benjamins; 2001.CrossRef
5.
Zurück zum Zitat Jain AK, Duin RPW, Mao J. Statistical pattern recognition: a review. IEEE Trans Pattern Anal. 2000;22:4–37.CrossRef Jain AK, Duin RPW, Mao J. Statistical pattern recognition: a review. IEEE Trans Pattern Anal. 2000;22:4–37.CrossRef
6.
Zurück zum Zitat Zhao W, Chellappa R, Phillips PJ, Rosenfeld A. Face recognition: a literature survey. ACM Comput Surv. 2003;35:399–458.CrossRef Zhao W, Chellappa R, Phillips PJ, Rosenfeld A. Face recognition: a literature survey. ACM Comput Surv. 2003;35:399–458.CrossRef
7.
Zurück zum Zitat Yambor WS. Analysis of PCA-based and Fisher discriminant-based image recognition algorithms. Master Thesis, Colorado State University, 2000. Yambor WS. Analysis of PCA-based and Fisher discriminant-based image recognition algorithms. Master Thesis, Colorado State University, 2000.
8.
Zurück zum Zitat Shakhnarovich G, Moghaddam B. Face recognition in subspaces. In handbook of face recognition. New York: Springer; 2011. Shakhnarovich G, Moghaddam B. Face recognition in subspaces. In handbook of face recognition. New York: Springer; 2011.
9.
Zurück zum Zitat Wang X, Tang X. A unified framework for subspace face recognition. IEEE Trans Pattern Anal. 2004;26:1222–8.CrossRef Wang X, Tang X. A unified framework for subspace face recognition. IEEE Trans Pattern Anal. 2004;26:1222–8.CrossRef
10.
Zurück zum Zitat Vasilescu MAO, Terzopoulos D. Multilinear subspace analysis of image ensembles. In: 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2003, p. II-93–99. Vasilescu MAO, Terzopoulos D. Multilinear subspace analysis of image ensembles. In: 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2003, p. II-93–99.
11.
Zurück zum Zitat Brunelli R, Poggio T. Face recognition: features versus templates. IEEE Trans Pattern Anal. 1993;15:1042–52.CrossRef Brunelli R, Poggio T. Face recognition: features versus templates. IEEE Trans Pattern Anal. 1993;15:1042–52.CrossRef
12.
Zurück zum Zitat Liu C, Wechsler H. Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans Image Process. 2002;1:467–76. Liu C, Wechsler H. Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans Image Process. 2002;1:467–76.
13.
Zurück zum Zitat Hjelmås E. Feature-based face recognition. In: Proceedings norwegian image processing and pattern recognition conference, 2000. Hjelmås E. Feature-based face recognition. In: Proceedings norwegian image processing and pattern recognition conference, 2000.
14.
Zurück zum Zitat Jutten C, Herault J. Blind separation of sources, part I: an adaptive algorithm based on neuromimetic architecture. Signal Process. 1991;24:1–10.CrossRef Jutten C, Herault J. Blind separation of sources, part I: an adaptive algorithm based on neuromimetic architecture. Signal Process. 1991;24:1–10.CrossRef
15.
Zurück zum Zitat Comon P. Independent component analysis, a new concept. Signal Process. 1994;36:287–314.CrossRef Comon P. Independent component analysis, a new concept. Signal Process. 1994;36:287–314.CrossRef
16.
Zurück zum Zitat Te-Won L. Independent component analysis, theory and applications. Boston: Kluwer Academic; 1998. Te-Won L. Independent component analysis, theory and applications. Boston: Kluwer Academic; 1998.
17.
Zurück zum Zitat Hyvärinen A, Oja E. Independent component analysis: algorithms and applications. Neural Netw. 2000;13:411–30.PubMedCrossRef Hyvärinen A, Oja E. Independent component analysis: algorithms and applications. Neural Netw. 2000;13:411–30.PubMedCrossRef
18.
Zurück zum Zitat Jolliffe IT. Principal component analysis. New York: Springer; 2002. Jolliffe IT. Principal component analysis. New York: Springer; 2002.
19.
Zurück zum Zitat Shlens J. A tutorial on principal component analysis. In: Technical report, systems neurobiology laboratory, University of California at San Diego; 2005. Shlens J. A tutorial on principal component analysis. In: Technical report, systems neurobiology laboratory, University of California at San Diego; 2005.
20.
Zurück zum Zitat Zou H, Hastie T, Tibshirani R. Sparse principal component analysis. J Comput Graph Stat. 2006;15:265–86.CrossRef Zou H, Hastie T, Tibshirani R. Sparse principal component analysis. J Comput Graph Stat. 2006;15:265–86.CrossRef
21.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK. Extreme learning machine: theory and applications. Neurocomputing. 2006;70:489–501.CrossRef Huang GB, Zhu QY, Siew CK. Extreme learning machine: theory and applications. Neurocomputing. 2006;70:489–501.CrossRef
22.
Zurück zum Zitat Huang GB, Wang DH, Lan Y. Extreme learning machines: a survey. Int J Mach Learn Cybern. 2011;2:107–22.CrossRef Huang GB, Wang DH, Lan Y. Extreme learning machines: a survey. Int J Mach Learn Cybern. 2011;2:107–22.CrossRef
23.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK. Extreme learning machine: a new learning scheme of feed forward neural networks. In: Proc. Int. Joint Conf. Neural Netw. (IJCNN2004), Budapest, Hungary; 2004: 985–990. Huang GB, Zhu QY, Siew CK. Extreme learning machine: a new learning scheme of feed forward neural networks. In: Proc. Int. Joint Conf. Neural Netw. (IJCNN2004), Budapest, Hungary; 2004: 985–990.
24.
Zurück zum Zitat Huang GB, Chen L, Siew CK. Universal approximation using incremental constructive feed forward networks with random hidden nodes. IEEE Trans Neural Netw. 2006;17(4):879–92.PubMedCrossRef Huang GB, Chen L, Siew CK. Universal approximation using incremental constructive feed forward networks with random hidden nodes. IEEE Trans Neural Netw. 2006;17(4):879–92.PubMedCrossRef
25.
Zurück zum Zitat Huang GB, Chen L. Convex incremental extreme learning machine. Neurocomputing. 2007;70:3056–62.CrossRef Huang GB, Chen L. Convex incremental extreme learning machine. Neurocomputing. 2007;70:3056–62.CrossRef
26.
Zurück zum Zitat Huang GB, Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing. 2008;71:3460–8.CrossRef Huang GB, Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing. 2008;71:3460–8.CrossRef
27.
Zurück zum Zitat Huang GB, Zhou H, Ding X, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern. 2012;42(2):513–29.CrossRef Huang GB, Zhou H, Ding X, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern. 2012;42(2):513–29.CrossRef
28.
Zurück zum Zitat Huang GB, Li MB, Chen L, Siew CK. Incremental extreme learning machine with fully complex hidden nodes. Neurocomputing. 2008;71:576–83.CrossRef Huang GB, Li MB, Chen L, Siew CK. Incremental extreme learning machine with fully complex hidden nodes. Neurocomputing. 2008;71:576–83.CrossRef
29.
Zurück zum Zitat Liang NY, Huang GB, Saratchandran P, Sundararajan N. A fast and accurate online sequential learning algorithm for feed forward networks. IEEE Trans Neural Netw. 2006;17(6):1411–23.PubMedCrossRef Liang NY, Huang GB, Saratchandran P, Sundararajan N. A fast and accurate online sequential learning algorithm for feed forward networks. IEEE Trans Neural Netw. 2006;17(6):1411–23.PubMedCrossRef
30.
Zurück zum Zitat Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A. OP-ELM: optimally pruned extreme learning machine. IEEE Trans Neural Netw. 2010;21(1):158–62.PubMedCrossRef Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A. OP-ELM: optimally pruned extreme learning machine. IEEE Trans Neural Netw. 2010;21(1):158–62.PubMedCrossRef
31.
Zurück zum Zitat Zhao Z, Liu B, Li W. Image classification based on extreme learning machine. IEIT J Adapt Dynam Comput. 2012;1:5–11.CrossRef Zhao Z, Liu B, Li W. Image classification based on extreme learning machine. IEIT J Adapt Dynam Comput. 2012;1:5–11.CrossRef
32.
33.
Zurück zum Zitat Marques I, Graña M. Face recognition with lattice independent component analysis and extreme learning machines. Soft Comput. 2012;16:1525–37.CrossRef Marques I, Graña M. Face recognition with lattice independent component analysis and extreme learning machines. Soft Comput. 2012;16:1525–37.CrossRef
34.
Zurück zum Zitat Olshausen BA. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature. 1996;381:607–9.PubMedCrossRef Olshausen BA. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature. 1996;381:607–9.PubMedCrossRef
35.
Zurück zum Zitat Field DJ. What is the goal of sensory coding? Neural Comput. 1994;6:559–601.CrossRef Field DJ. What is the goal of sensory coding? Neural Comput. 1994;6:559–601.CrossRef
36.
Zurück zum Zitat Bartlett MS. Face image analysis by unsupervised learning. Dordrecht: Kluwer Academic; 2001.CrossRef Bartlett MS. Face image analysis by unsupervised learning. Dordrecht: Kluwer Academic; 2001.CrossRef
37.
38.
39.
Zurück zum Zitat Hyvärinen A, Oja E. A fast fixed-point algorithm for independent component analysis. Neural Comput. 1997;9:1483–92.CrossRef Hyvärinen A, Oja E. A fast fixed-point algorithm for independent component analysis. Neural Comput. 1997;9:1483–92.CrossRef
40.
Zurück zum Zitat Hansen LK, Salamon P. Neural network ensemble. IEEE Trans Pattern Anal Mach Intell. 1990;12(10):993–1001.CrossRef Hansen LK, Salamon P. Neural network ensemble. IEEE Trans Pattern Anal Mach Intell. 1990;12(10):993–1001.CrossRef
41.
Zurück zum Zitat Cai D, He X, Hu Y, Han J, Huang T. Learning a spatially smooth subspace for face recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2007: 1–7. Cai D, He X, Hu Y, Han J, Huang T. Learning a spatially smooth subspace for face recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2007: 1–7.
42.
Zurück zum Zitat Mankiewicz R. The story of mathematics. Princeton: Princeton Univ. Press; 2004. Mankiewicz R. The story of mathematics. Princeton: Princeton Univ. Press; 2004.
43.
Zurück zum Zitat Chow SL. Statistical significance: rationale, validity and utility. London, UK: Sage; 1996. Chow SL. Statistical significance: rationale, validity and utility. London, UK: Sage; 1996.
Metadaten
Titel
Fast Image Recognition Based on Independent Component Analysis and Extreme Learning Machine
verfasst von
Shujing Zhang
Bo He
Rui Nian
Jing Wang
Bo Han
Amaury Lendasse
Guang Yuan
Publikationsdatum
01.09.2014
Verlag
Springer US
Erschienen in
Cognitive Computation / Ausgabe 3/2014
Print ISSN: 1866-9956
Elektronische ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-014-9245-4

Weitere Artikel der Ausgabe 3/2014

Cognitive Computation 3/2014 Zur Ausgabe