Skip to main content
Top

2016 | OriginalPaper | Chapter

Self-organizing Maps as Feature Detectors for Supervised Neural Network Pattern Recognition

Authors : Macario O. Cordel II, Arren Matthew C. Antioquia, Arnulfo P. Azcarraga

Published in: Neural Information Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Convolutional neural network (CNN)-based works show that learned features, rather than handpicked features, produce more desirable performance in pattern recognition. This learning approach is based on higher organisms visual system which are developed based on the input environment. However, the feature detectors of CNN are trained using an error-correcting teacher as opposed to the natural competition to build node connections. As such, a neural network model using self-organizing map (SOM) as feature detector is proposed in this work. As proof of concept, the handwritten digits dataset is used to test the performance of the proposed architecture. The size of the feature detector as well as the different arrangement of receptive fields are considered to benchmark the performance of the proposed network. The performance for the proposed architecture achieved comparable performance to vanilla MLP, being 96.93 % using 4\(\times \)4 SOM and six receptive field regions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Arevalo, J., Cruz-Roa, A., Arias, V., Romero, E., Gonzalez, F.: An unsupervised feature learning framework for basal cell carcinoma image analysis. Artif. Intell. Med. 64(2), 131–145 (2015)CrossRef Arevalo, J., Cruz-Roa, A., Arias, V., Romero, E., Gonzalez, F.: An unsupervised feature learning framework for basal cell carcinoma image analysis. Artif. Intell. Med. 64(2), 131–145 (2015)CrossRef
2.
go back to reference Dong, Z., Wu, Y., Pei, M., Jia, Y.: Vehicle type classification using semisupervised convolutional neural network. IEEE Trans. Intell. Transp. Syst. 16(4), 2247–2256 (2015)CrossRef Dong, Z., Wu, Y., Pei, M., Jia, Y.: Vehicle type classification using semisupervised convolutional neural network. IEEE Trans. Intell. Transp. Syst. 16(4), 2247–2256 (2015)CrossRef
3.
go back to reference Fukushima, K.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193–202 (1980)CrossRefMATH Fukushima, K.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193–202 (1980)CrossRefMATH
4.
go back to reference Hubel, D.H., Wiesel, T.N.: Receptive fields, binocular interaction, and functional architecture in the cat’s visual cortex. J. Physiol. 106, 106–154 (1962)CrossRef Hubel, D.H., Wiesel, T.N.: Receptive fields, binocular interaction, and functional architecture in the cat’s visual cortex. J. Physiol. 106, 106–154 (1962)CrossRef
6.
go back to reference LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRef LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRef
7.
go back to reference LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998)CrossRef LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998)CrossRef
9.
go back to reference Mohebi, E., Bagirov, A.: A convolutional recursive modified Self Organizing Map for handwritten digits recognition. Neural Netw. 60, 104–115 (2014)CrossRefMATH Mohebi, E., Bagirov, A.: A convolutional recursive modified Self Organizing Map for handwritten digits recognition. Neural Netw. 60, 104–115 (2014)CrossRefMATH
10.
go back to reference Omatu, S., Yano, M.: E-nose system by using neural networks. Neurocomputing 172, 394–398 (2015)CrossRef Omatu, S., Yano, M.: E-nose system by using neural networks. Neurocomputing 172, 394–398 (2015)CrossRef
11.
go back to reference Pomerleau, D.A.: ALVINN: An autonomous land vehicle in a neural network. In: Advances in Neural Information Processing Systems 1. Denver, Colorado, USA (1988) Pomerleau, D.A.: ALVINN: An autonomous land vehicle in a neural network. In: Advances in Neural Information Processing Systems 1. Denver, Colorado, USA (1988)
12.
go back to reference Ramirez-Quintana, J.A., Chacon-Murguia, M.I.: Self-adaptive SOM-CNN neural sys-tem for dynamic object detection in normal and complex scenarios. Pattern Recogn. 48(4), 1137–1149 (2015)CrossRef Ramirez-Quintana, J.A., Chacon-Murguia, M.I.: Self-adaptive SOM-CNN neural sys-tem for dynamic object detection in normal and complex scenarios. Pattern Recogn. 48(4), 1137–1149 (2015)CrossRef
13.
go back to reference Ramirez-Quintana, J.A., Chacon-Murguia, M.I.: Self-organizing retinotopic maps applied to background modeling for dynamic object segmentation in video sequences. In: Proceedings International Joint Conference on Neural Networks, Dallas (2013) Ramirez-Quintana, J.A., Chacon-Murguia, M.I.: Self-organizing retinotopic maps applied to background modeling for dynamic object segmentation in video sequences. In: Proceedings International Joint Conference on Neural Networks, Dallas (2013)
14.
go back to reference Shahamiri, S.R., Salim, S.S.B.: Real-time frequency-based noise-robust automatic speech recognition using multi-nets artificial neural network. Neurocomputing 129, 199–207 (2014)CrossRef Shahamiri, S.R., Salim, S.S.B.: Real-time frequency-based noise-robust automatic speech recognition using multi-nets artificial neural network. Neurocomputing 129, 199–207 (2014)CrossRef
15.
go back to reference Siniscalchi, S.M., Svendsen, T., Lee, C.H.: An artificial neural network approach to automatic speech processing. Neurocomputing 140, 326–338 (2014)CrossRef Siniscalchi, S.M., Svendsen, T., Lee, C.H.: An artificial neural network approach to automatic speech processing. Neurocomputing 140, 326–338 (2014)CrossRef
Metadata
Title
Self-organizing Maps as Feature Detectors for Supervised Neural Network Pattern Recognition
Authors
Macario O. Cordel II
Arren Matthew C. Antioquia
Arnulfo P. Azcarraga
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-46681-1_73

Premium Partner