Skip to main content

2016 | OriginalPaper | Buchkapitel

Self-organizing Maps as Feature Detectors for Supervised Neural Network Pattern Recognition

verfasst von : Macario O. Cordel II, Arren Matthew C. Antioquia, Arnulfo P. Azcarraga

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Convolutional neural network (CNN)-based works show that learned features, rather than handpicked features, produce more desirable performance in pattern recognition. This learning approach is based on higher organisms visual system which are developed based on the input environment. However, the feature detectors of CNN are trained using an error-correcting teacher as opposed to the natural competition to build node connections. As such, a neural network model using self-organizing map (SOM) as feature detector is proposed in this work. As proof of concept, the handwritten digits dataset is used to test the performance of the proposed architecture. The size of the feature detector as well as the different arrangement of receptive fields are considered to benchmark the performance of the proposed network. The performance for the proposed architecture achieved comparable performance to vanilla MLP, being 96.93 % using 4\(\times \)4 SOM and six receptive field regions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Arevalo, J., Cruz-Roa, A., Arias, V., Romero, E., Gonzalez, F.: An unsupervised feature learning framework for basal cell carcinoma image analysis. Artif. Intell. Med. 64(2), 131–145 (2015)CrossRef Arevalo, J., Cruz-Roa, A., Arias, V., Romero, E., Gonzalez, F.: An unsupervised feature learning framework for basal cell carcinoma image analysis. Artif. Intell. Med. 64(2), 131–145 (2015)CrossRef
2.
Zurück zum Zitat Dong, Z., Wu, Y., Pei, M., Jia, Y.: Vehicle type classification using semisupervised convolutional neural network. IEEE Trans. Intell. Transp. Syst. 16(4), 2247–2256 (2015)CrossRef Dong, Z., Wu, Y., Pei, M., Jia, Y.: Vehicle type classification using semisupervised convolutional neural network. IEEE Trans. Intell. Transp. Syst. 16(4), 2247–2256 (2015)CrossRef
3.
Zurück zum Zitat Fukushima, K.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193–202 (1980)CrossRefMATH Fukushima, K.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193–202 (1980)CrossRefMATH
4.
Zurück zum Zitat Hubel, D.H., Wiesel, T.N.: Receptive fields, binocular interaction, and functional architecture in the cat’s visual cortex. J. Physiol. 106, 106–154 (1962)CrossRef Hubel, D.H., Wiesel, T.N.: Receptive fields, binocular interaction, and functional architecture in the cat’s visual cortex. J. Physiol. 106, 106–154 (1962)CrossRef
6.
Zurück zum Zitat LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRef LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRef
7.
Zurück zum Zitat LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998)CrossRef LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998)CrossRef
9.
Zurück zum Zitat Mohebi, E., Bagirov, A.: A convolutional recursive modified Self Organizing Map for handwritten digits recognition. Neural Netw. 60, 104–115 (2014)CrossRefMATH Mohebi, E., Bagirov, A.: A convolutional recursive modified Self Organizing Map for handwritten digits recognition. Neural Netw. 60, 104–115 (2014)CrossRefMATH
10.
Zurück zum Zitat Omatu, S., Yano, M.: E-nose system by using neural networks. Neurocomputing 172, 394–398 (2015)CrossRef Omatu, S., Yano, M.: E-nose system by using neural networks. Neurocomputing 172, 394–398 (2015)CrossRef
11.
Zurück zum Zitat Pomerleau, D.A.: ALVINN: An autonomous land vehicle in a neural network. In: Advances in Neural Information Processing Systems 1. Denver, Colorado, USA (1988) Pomerleau, D.A.: ALVINN: An autonomous land vehicle in a neural network. In: Advances in Neural Information Processing Systems 1. Denver, Colorado, USA (1988)
12.
Zurück zum Zitat Ramirez-Quintana, J.A., Chacon-Murguia, M.I.: Self-adaptive SOM-CNN neural sys-tem for dynamic object detection in normal and complex scenarios. Pattern Recogn. 48(4), 1137–1149 (2015)CrossRef Ramirez-Quintana, J.A., Chacon-Murguia, M.I.: Self-adaptive SOM-CNN neural sys-tem for dynamic object detection in normal and complex scenarios. Pattern Recogn. 48(4), 1137–1149 (2015)CrossRef
13.
Zurück zum Zitat Ramirez-Quintana, J.A., Chacon-Murguia, M.I.: Self-organizing retinotopic maps applied to background modeling for dynamic object segmentation in video sequences. In: Proceedings International Joint Conference on Neural Networks, Dallas (2013) Ramirez-Quintana, J.A., Chacon-Murguia, M.I.: Self-organizing retinotopic maps applied to background modeling for dynamic object segmentation in video sequences. In: Proceedings International Joint Conference on Neural Networks, Dallas (2013)
14.
Zurück zum Zitat Shahamiri, S.R., Salim, S.S.B.: Real-time frequency-based noise-robust automatic speech recognition using multi-nets artificial neural network. Neurocomputing 129, 199–207 (2014)CrossRef Shahamiri, S.R., Salim, S.S.B.: Real-time frequency-based noise-robust automatic speech recognition using multi-nets artificial neural network. Neurocomputing 129, 199–207 (2014)CrossRef
15.
Zurück zum Zitat Siniscalchi, S.M., Svendsen, T., Lee, C.H.: An artificial neural network approach to automatic speech processing. Neurocomputing 140, 326–338 (2014)CrossRef Siniscalchi, S.M., Svendsen, T., Lee, C.H.: An artificial neural network approach to automatic speech processing. Neurocomputing 140, 326–338 (2014)CrossRef
Metadaten
Titel
Self-organizing Maps as Feature Detectors for Supervised Neural Network Pattern Recognition
verfasst von
Macario O. Cordel II
Arren Matthew C. Antioquia
Arnulfo P. Azcarraga
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46681-1_73