Skip to main content
Top

2016 | OriginalPaper | Chapter

Local Invariance Representation Learning Algorithm with Multi-layer Extreme Learning Machine

Authors : Xibin Jia, Xiaobo Li, Hua Du, Bir Bhanu

Published in: Neural Information Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multi-layer extreme learning machine (ML-ELM) is a stacked extreme learning machine based auto-encoding (ELM-AE). It provides an effective solution for deep feature extraction with higher training efficiency. To enhance the local-input invariance of feature extraction, we propose a contractive multi-layer extreme learning machine (C-ML-ELM) by adding a penalty term in the optimization function to minimize derivative of output to input at each hidden layer. In this way, the extracted feature is supposed to keep consecutiveness attribution of an image. The experiments have been done on MNIST handwriting dataset and face expression dataset CAFÉ. The results show that it outperforms several state-of-art classification algorithms with less error and higher training efficiency.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kumar, G., Bhatia, P.K.: A detailed review of feature extraction in image processing systems. In: IEEE Fourth International Conference on Advanced Computing and Communication Technologies, pp. 5–12 (2014) Kumar, G., Bhatia, P.K.: A detailed review of feature extraction in image processing systems. In: IEEE Fourth International Conference on Advanced Computing and Communication Technologies, pp. 5–12 (2014)
2.
go back to reference Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)CrossRefMATH Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)CrossRefMATH
3.
go back to reference Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2013) Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2013)
4.
go back to reference Jia, X., Zhang, Y., Powers, D., Ali, H.B.: Multi-classifier fusion based facial expression recognition approach. KSII Trans. Internet Inf. Syst. 8(1), 196–212 (2014)CrossRef Jia, X., Zhang, Y., Powers, D., Ali, H.B.: Multi-classifier fusion based facial expression recognition approach. KSII Trans. Internet Inf. Syst. 8(1), 196–212 (2014)CrossRef
5.
go back to reference Zavaschi, T.H.H., Britto Jr., A.S., Oliveira, L.E.S., Koerich, A.L.: Fusion of feature sets and classifiers for facial expression recognition. Expert Syst. Appl. 40(2), 646–655 (2013)CrossRef Zavaschi, T.H.H., Britto Jr., A.S., Oliveira, L.E.S., Koerich, A.L.: Fusion of feature sets and classifiers for facial expression recognition. Expert Syst. Appl. 40(2), 646–655 (2013)CrossRef
6.
go back to reference Jing, P., Bhanu, B.: Delayed reinforcement learning for adaptive image segmentation and feature extraction. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 28(3), 482–488 (1998)CrossRef Jing, P., Bhanu, B.: Delayed reinforcement learning for adaptive image segmentation and feature extraction. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 28(3), 482–488 (1998)CrossRef
7.
go back to reference Liu, S., Bai, X.: Discriminative features for image classification and retrieval. In: IEEE International Conference on Image and Graphics, pp. 744–751 (2011) Liu, S., Bai, X.: Discriminative features for image classification and retrieval. In: IEEE International Conference on Image and Graphics, pp. 744–751 (2011)
8.
go back to reference Chen, M., Zhang, L., Allebach, J.P.: Learning deep features for image emotion classification. In: IEEE International Conference on Image Processing. IEEE (2015) Chen, M., Zhang, L., Allebach, J.P.: Learning deep features for image emotion classification. In: IEEE International Conference on Image Processing. IEEE (2015)
9.
go back to reference Kasun, L.L.C., Zhou, H., Huang, G.-B., Vong, C.M.: Representational learning with extreme learning machine for big data. IEEE Intell. Syst. 28(6), 31–34 (2013) Kasun, L.L.C., Zhou, H., Huang, G.-B., Vong, C.M.: Representational learning with extreme learning machine for big data. IEEE Intell. Syst. 28(6), 31–34 (2013)
10.
go back to reference Vincent, P., et al.: Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11(6), 3371–3408 (2010)MathSciNetMATH Vincent, P., et al.: Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11(6), 3371–3408 (2010)MathSciNetMATH
11.
12.
go back to reference Rifai, S., Vincent, P., Muller, X., et al.: Contractive auto-encoders: explicit invariance during feature extraction. In: Proceedings of the 28th International Conference on Machine Learning (ICML-2011), Bellevue, WA, USA, pp. 833–840 (2011) Rifai, S., Vincent, P., Muller, X., et al.: Contractive auto-encoders: explicit invariance during feature extraction. In: Proceedings of the 28th International Conference on Machine Learning (ICML-2011), Bellevue, WA, USA, pp. 833–840 (2011)
13.
go back to reference LeCun, Y., Bottou, L., Bengio, Y., et al.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef LeCun, Y., Bottou, L., Bengio, Y., et al.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef
Metadata
Title
Local Invariance Representation Learning Algorithm with Multi-layer Extreme Learning Machine
Authors
Xibin Jia
Xiaobo Li
Hua Du
Bir Bhanu
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-46681-1_60

Premium Partner