Skip to main content
Erschienen in:
Buchtitelbild

2017 | OriginalPaper | Buchkapitel

Spiking Convolutional Deep Belief Networks

verfasst von : Jacques Kaiser, David Zimmerer, J. Camilo Vasquez Tieck, Stefan Ulbrich, Arne Roennau, Rüdiger Dillmann

Erschienen in: Artificial Neural Networks and Machine Learning – ICANN 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Understanding visual input as perceived by humans is a challenging task for machines. Today, most successful methods work by learning features from static images. Based on classical artificial neural networks, those methods are not adapted to process event streams as provided by the Dynamic Vision Sensor (DVS). Recently, an unsupervised learning rule to train Spiking Restricted Boltzmann Machines has been presented [9]. Relying on synaptic plasticity, it can learn features directly from event streams. In this paper, we extend this method by adding convolutions, lateral inhibitions and multiple layers. We evaluate our method on a self-recorded DVS dataset as well as the Poker-DVS dataset. Our results show that our convolutional method performs better and needs less parameters. It also achieves comparable results to previous event-based classification methods while learning features in an unsupervised fashion.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bengio, Y., Lee, D.H., Bornschein, J., Lin, Z.: Towards Biologically Plausible Deep Learning. arXiv preprint arXiv:1502.0415, p. 18 (2015) Bengio, Y., Lee, D.H., Bornschein, J., Lin, Z.: Towards Biologically Plausible Deep Learning. arXiv preprint arXiv:​1502.​0415, p. 18 (2015)
2.
Zurück zum Zitat Buesing, L., et al.: Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons. PLoS Comput. Biol. 7(11), e1002211 (2011)CrossRefMathSciNet Buesing, L., et al.: Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons. PLoS Comput. Biol. 7(11), e1002211 (2011)CrossRefMathSciNet
3.
Zurück zum Zitat Desjardins, G., et al.: Empirical evaluation of convolutional RBMs for vision. Technical report 1327, Département d’Informatique et de Recherche Opérationnelle, Université de Montréal (2008) Desjardins, G., et al.: Empirical evaluation of convolutional RBMs for vision. Technical report 1327, Département d’Informatique et de Recherche Opérationnelle, Université de Montréal (2008)
4.
Zurück zum Zitat Diehl, P.U., et al.: Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing. In: International Joint Conference on Neural Networks (IJCNN), vol. 2015 (2015) Diehl, P.U., et al.: Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing. In: International Joint Conference on Neural Networks (IJCNN), vol. 2015 (2015)
5.
Zurück zum Zitat Griffiths, T.L., Kemp, C., Tenenbaum, J.B.: Bayesian models of cognition. In: Sun, R. (ed.) Cambridge Handbook of Computational Cognitive Modeling. Cambridge University Press, Cambridge (2008) Griffiths, T.L., Kemp, C., Tenenbaum, J.B.: Bayesian models of cognition. In: Sun, R. (ed.) Cambridge Handbook of Computational Cognitive Modeling. Cambridge University Press, Cambridge (2008)
6.
Zurück zum Zitat Lee, H., et al.: Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In: International Conference on Machine Learning, pp. 609–616 (2009) Lee, H., et al.: Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In: International Conference on Machine Learning, pp. 609–616 (2009)
7.
Zurück zum Zitat Lee, T.S., Mumford, D.: Hierarchical Bayesian inference in the visual cortex. J. Opt. Soc. Am. 20(7), 1434–1448 (2003)CrossRef Lee, T.S., Mumford, D.: Hierarchical Bayesian inference in the visual cortex. J. Opt. Soc. Am. 20(7), 1434–1448 (2003)CrossRef
8.
Zurück zum Zitat Lichtsteiner, P., et al.: A 128 \(\times \) 128 120 dB 15us latency asynchronous temporal contrast vision sensor. IEEE J. Solid-state Circuits 43(2), 566–576 (2008)CrossRef Lichtsteiner, P., et al.: A 128 \(\times \) 128 120 dB 15us latency asynchronous temporal contrast vision sensor. IEEE J. Solid-state Circuits 43(2), 566–576 (2008)CrossRef
9.
Zurück zum Zitat Neftci, E., et al.: Event-driven contrastive divergence for spiking neuromorphic systems. Front. Neurosci. 7, 1–14 (2014)CrossRef Neftci, E., et al.: Event-driven contrastive divergence for spiking neuromorphic systems. Front. Neurosci. 7, 1–14 (2014)CrossRef
10.
Zurück zum Zitat Norouzi, M., Ranjbar, M., Mori, G.: Stacks of convolutional restricted boltzmann machines for shift-invariant feature learning. In: Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2735–2742. IEEE (2009) Norouzi, M., Ranjbar, M., Mori, G.: Stacks of convolutional restricted boltzmann machines for shift-invariant feature learning. In: Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2735–2742. IEEE (2009)
11.
Zurück zum Zitat Petrovici, M.A.: Form Versus Function: Theory and Models for Neuronal Substrates. Springer, New York (2016)CrossRef Petrovici, M.A.: Form Versus Function: Theory and Models for Neuronal Substrates. Springer, New York (2016)CrossRef
12.
Zurück zum Zitat Serrano-Gotarredona, T., et al.: Poker-DVS and MNIST-DVS: Their history, how they were made, and other details. Front. Neurosci. 9, 1–10 (2015)CrossRef Serrano-Gotarredona, T., et al.: Poker-DVS and MNIST-DVS: Their history, how they were made, and other details. Front. Neurosci. 9, 1–10 (2015)CrossRef
13.
Zurück zum Zitat Vasquez Tieck, J.C., et al.: Towards grasping with spiking neural networks for an anthropomorphic robot hand. In: International Conference on Artificial Neural Networks (ICANN) (2017) Vasquez Tieck, J.C., et al.: Towards grasping with spiking neural networks for an anthropomorphic robot hand. In: International Conference on Artificial Neural Networks (ICANN) (2017)
14.
Zurück zum Zitat Yang, T., Shadlen, M.N.: Probabilistic reasoning by neurons. Nature 447(7148), 1075–1080 (2007)CrossRef Yang, T., Shadlen, M.N.: Probabilistic reasoning by neurons. Nature 447(7148), 1075–1080 (2007)CrossRef
Metadaten
Titel
Spiking Convolutional Deep Belief Networks
verfasst von
Jacques Kaiser
David Zimmerer
J. Camilo Vasquez Tieck
Stefan Ulbrich
Arne Roennau
Rüdiger Dillmann
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-68612-7_1