Skip to main content

2016 | OriginalPaper | Buchkapitel

An Implementation of Working Memory Using Stacked Half Restricted Boltzmann Machine

Toward to Restricted Boltzmann Machine-Based Cognitive Architecture

verfasst von : Masahiko Osawa, Hiroshi Yamakawa, Michita Imai

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cognition, judgment, action, and expression acquisition have been widely treated in studies on recently developed deep learning. However, although each study has been specialised for specific tasks and goals, cognitive architecture that integrates many different functions remains necessary for the realisation of artificial general intelligence. To that end, a cognitive architecture fully described with restricted Boltzmann machines (RBMs) in a unified way are promising, and we have begun to implement various cognitive functions with an RBM base. In this paper, we propose new stacked half RBMs (SHRBMs) made from layered half RBMs (HRBMs) that handle working memory. We show that an ability to solve maze problems that requires working memory improves drastically when SHRBMs in the agent’s judgment area are used instead of HRBMs or other RBM-based models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Mnih, V., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)CrossRef Mnih, V., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)CrossRef
2.
Zurück zum Zitat Miri, H.: CernoCAMAL: a probabilistic computational cognitive architecture. Ph.D. thesis, University of Hull (2012) Miri, H.: CernoCAMAL: a probabilistic computational cognitive architecture. Ph.D. thesis, University of Hull (2012)
3.
Zurück zum Zitat Laird, J.E.: The Soar Cognitive Architecture. MIT Press, Cambridge (2012) Laird, J.E.: The Soar Cognitive Architecture. MIT Press, Cambridge (2012)
4.
Zurück zum Zitat Anderson, J.R., Lebiere, C.: The newell test for a theory of cognition. Behav. Brain Sci. 26(05), 587–601 (2003) Anderson, J.R., Lebiere, C.: The newell test for a theory of cognition. Behav. Brain Sci. 26(05), 587–601 (2003)
5.
Zurück zum Zitat Goertzel, B.: The Hidden Pattern. Brown Walker, Boca Raton (2006) Goertzel, B.: The Hidden Pattern. Brown Walker, Boca Raton (2006)
6.
Zurück zum Zitat Goertzel, B.: Opencog prime: a cognitive synergy based architecture for embodied artificial general intelligence. In: 8th IEEE International Conference on Cognitive Informatics, pp. 60–68 (2009) Goertzel, B.: Opencog prime: a cognitive synergy based architecture for embodied artificial general intelligence. In: 8th IEEE International Conference on Cognitive Informatics, pp. 60–68 (2009)
7.
Zurück zum Zitat Eliasmith, C., Stewart, T.C., Choo, X., Bekolay, T., DeWolf, T., Tang, Y., Rasmussen, D.: A large-scale model of the functioning brain. Science 338(6111), 1202–1205 (2012)CrossRef Eliasmith, C., Stewart, T.C., Choo, X., Bekolay, T., DeWolf, T., Tang, Y., Rasmussen, D.: A large-scale model of the functioning brain. Science 338(6111), 1202–1205 (2012)CrossRef
8.
Zurück zum Zitat Sutskever, I., Hinton, G.E.: Learning multilevel distributed representations for high-dimensional sequences. In: International Conference on Artificial Intelligence and Statistics (2007) Sutskever, I., Hinton, G.E.: Learning multilevel distributed representations for high-dimensional sequences. In: International Conference on Artificial Intelligence and Statistics (2007)
9.
Zurück zum Zitat Yu, Y., Masahiko, O., Masafumi, H.: A learning method for echo state networks using RBM. In: International Symposium on Advanced Intelligent Systems (2015) Yu, Y., Masahiko, O., Masafumi, H.: A learning method for echo state networks using RBM. In: International Symposium on Advanced Intelligent Systems (2015)
10.
Zurück zum Zitat Sutskever, I., Hinton, G.E., Taylor, G.W.: The recurrent temporal restricted Boltzmann machine. In: Advances in Neural Information Processing Systems (2009) Sutskever, I., Hinton, G.E., Taylor, G.W.: The recurrent temporal restricted Boltzmann machine. In: Advances in Neural Information Processing Systems (2009)
11.
Zurück zum Zitat Boulanger-Lewandowski, N., Bengio, Y., Vincent, P.: Modeling temporal dependencies in high-dimensional sequences: application to polyphonic music generation and transcription. In: Proceedings of the 29th International Conference on Machine Learning (2012) Boulanger-Lewandowski, N., Bengio, Y., Vincent, P.: Modeling temporal dependencies in high-dimensional sequences: application to polyphonic music generation and transcription. In: Proceedings of the 29th International Conference on Machine Learning (2012)
12.
Zurück zum Zitat Osawa, M., Hagiwara, M.: A proposal of novel data detection method and its application to incremental learning for RBMs. IEICE Technical report, ME and Bio Cybernetics, vol. 114, no. 259, pp 283–288 (2015). (In Japanese) Osawa, M., Hagiwara, M.: A proposal of novel data detection method and its application to incremental learning for RBMs. IEICE Technical report, ME and Bio Cybernetics, vol. 114, no. 259, pp 283–288 (2015). (In Japanese)
Metadaten
Titel
An Implementation of Working Memory Using Stacked Half Restricted Boltzmann Machine
verfasst von
Masahiko Osawa
Hiroshi Yamakawa
Michita Imai
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46687-3_38

Premium Partner