Skip to main content
Top

2016 | OriginalPaper | Chapter

Automatic Design of Neural Network Structures Using AiS

Authors : Toshisada Mariyama, Kunihiko Fukushima, Wataru Matsumoto

Published in: Neural Information Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Structures of neural networks are usually designed by experts to fit target problems. This study proposes a method to automate small network design for a regression problem based on the Add-if-Silent (AiS) function used in the neocognitron. Because the original AiS is designed for image pattern recognition, this study modifies the intermediate function to be Radial Basis Function (RBF). This study shows that the proposed method can determine an optimized network structure using the Bike Sharing Dataset as one case study. The generalization performance is also shown.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Fukushima, K.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36(4), 193–202 (1980)CrossRefMATH Fukushima, K.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36(4), 193–202 (1980)CrossRefMATH
2.
4.
go back to reference Fukushima, K.: Artificial vision by multi-layered neural networks: neocognitron and its advances. Neural Netw. 37, 103–109 (2013)CrossRef Fukushima, K.: Artificial vision by multi-layered neural networks: neocognitron and its advances. Neural Netw. 37, 103–109 (2013)CrossRef
5.
go back to reference Fukushima, K., Shouno, H.: Deep convolutional network neocognitron: improved interpolating-vector. In: International Joint Conference on Neural Networks 2015, Killarney, Ireland, pp. 1603–1610 (2015) Fukushima, K., Shouno, H.: Deep convolutional network neocognitron: improved interpolating-vector. In: International Joint Conference on Neural Networks 2015, Killarney, Ireland, pp. 1603–1610 (2015)
6.
go back to reference Hadi, F., Joao, G.: Event labeling combining ensemble detectors and background knowledge. Prog. Artif. Intell. 2, 1–15 (2013). Springer, HeidelbergCrossRef Hadi, F., Joao, G.: Event labeling combining ensemble detectors and background knowledge. Prog. Artif. Intell. 2, 1–15 (2013). Springer, HeidelbergCrossRef
7.
go back to reference Akaike, H.: Information theory and an extension of the maximum likelihood principle. In: Proceedings of the 2nd Informational Symposium on Information Theory, Akadimiai Kiado, Budapest, pp. 267–281 (1973) Akaike, H.: Information theory and an extension of the maximum likelihood principle. In: Proceedings of the 2nd Informational Symposium on Information Theory, Akadimiai Kiado, Budapest, pp. 267–281 (1973)
8.
go back to reference Kim, S., Tadesse, M.G., Vannucci, M.: Variable selection in clustering via Dirichlet mixture models. Biometrika 93(4), 877–893 (2006)MathSciNetCrossRefMATH Kim, S., Tadesse, M.G., Vannucci, M.: Variable selection in clustering via Dirichlet mixture models. Biometrika 93(4), 877–893 (2006)MathSciNetCrossRefMATH
9.
go back to reference Kurihara, K., Welling, M., Vlassis, N.: Accelerated variational dirichlet process mixtures. In: NIPS (2006) Kurihara, K., Welling, M., Vlassis, N.: Accelerated variational dirichlet process mixtures. In: NIPS (2006)
10.
go back to reference Hagiwara, K., Toda, N., Usui, S.: On the problem of applying AIC to determine the structure of a layered feedforward neural network. In: Proceedings of 1993 International Joint Conference on Neural Networks, Nagoya, pp. 2263–2266 (1993) Hagiwara, K., Toda, N., Usui, S.: On the problem of applying AIC to determine the structure of a layered feedforward neural network. In: Proceedings of 1993 International Joint Conference on Neural Networks, Nagoya, pp. 2263–2266 (1993)
Metadata
Title
Automatic Design of Neural Network Structures Using AiS
Authors
Toshisada Mariyama
Kunihiko Fukushima
Wataru Matsumoto
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-46672-9_32

Premium Partner