Skip to main content
Top

2017 | OriginalPaper | Chapter

A Scalable Neuro-inspired Robot Controller Integrating a Machine Learning Algorithm and a Spiking Cerebellar-Like Network

Authors : Ismael Baira Ojeda, Silvia Tolu, Henrik H. Lund

Published in: Biomimetic and Biohybrid Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Combining Fable robot, a modular robot, with a neuroinspired controller, we present the proof of principle of a system that can scale to several neurally controlled compliant modules. The motor control and learning of a robot module are carried out by a Unit Learning Machine (ULM) that embeds the Locally Weighted Projection Regression algorithm (LWPR) and a spiking cerebellar-like microcircuit. The LWPR guarantees both an optimized representation of the input space and the learning of the dynamic internal model (IM) of the robot. However, the cerebellar-like sub-circuit integrates LWPR input-driven contributions to deliver accurate corrective commands to the global IM. This article extends the earlier work by including the Deep Cerebellar Nuclei (DCN) and by reproducing the Purkinje and the DCN layers using a spiking neural network (SNN) implemented on the neuromorphic SpiNNaker platform. The performance and robustness outcomes from the real robot tests are promising for neural control scalability.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Flash, T., Sejnowski, T.J.: Computational approaches to motor control. Curr. Opin. Neurobiol. 6(11), 655–662 (2001)CrossRef Flash, T., Sejnowski, T.J.: Computational approaches to motor control. Curr. Opin. Neurobiol. 6(11), 655–662 (2001)CrossRef
2.
go back to reference Furber, S.B., Galluppi, F., Temple, S., Plana, L.A.: The spinnaker project. Proc. IEEE 102(5), 652–665 (2014)CrossRef Furber, S.B., Galluppi, F., Temple, S., Plana, L.A.: The spinnaker project. Proc. IEEE 102(5), 652–665 (2014)CrossRef
3.
go back to reference Vijayakumar, S., D’souza, A., Schaal, S.: Incremental online learning in high dimensions. Neural Comput. 17(12), 2602–2634 (2005)MathSciNetCrossRef Vijayakumar, S., D’souza, A., Schaal, S.: Incremental online learning in high dimensions. Neural Comput. 17(12), 2602–2634 (2005)MathSciNetCrossRef
4.
go back to reference Ito, M.: Cerebellar circuitry as a neuronal machine. Prog. Neurobiol. 78(3), 272–303 (2006)CrossRef Ito, M.: Cerebellar circuitry as a neuronal machine. Prog. Neurobiol. 78(3), 272–303 (2006)CrossRef
5.
go back to reference Ito, M.: Control of mental activities by internal models in the cerebellum. Nat. Rev. Neurosci. 9(4), 304–313 (2008)CrossRef Ito, M.: Control of mental activities by internal models in the cerebellum. Nat. Rev. Neurosci. 9(4), 304–313 (2008)CrossRef
6.
go back to reference Dean, P., Porrill, J., Ekerot, C.-F., Jörntell, H.: The cerebellar microcircuit as an adaptive filter: experimental and computational evidence. Nat. Rev. Neurosci. 11(1), 30–43 (2010)CrossRef Dean, P., Porrill, J., Ekerot, C.-F., Jörntell, H.: The cerebellar microcircuit as an adaptive filter: experimental and computational evidence. Nat. Rev. Neurosci. 11(1), 30–43 (2010)CrossRef
7.
go back to reference Verduzco-Flores, S.O., O’Reilly, R.C.: How the credit assignment problems in motor control could be solved after the cerebellum predicts increases in error. Front. Comput. Neurosci. 9 (2015) Verduzco-Flores, S.O., O’Reilly, R.C.: How the credit assignment problems in motor control could be solved after the cerebellum predicts increases in error. Front. Comput. Neurosci. 9 (2015)
8.
go back to reference Albus, J.S.: A theory of cerebellar function. Math. Biosci. 10(1), 25–61 (1971)CrossRef Albus, J.S.: A theory of cerebellar function. Math. Biosci. 10(1), 25–61 (1971)CrossRef
9.
go back to reference Marr, D., Thach, W.T.: A theory of cerebellar cortex. In: Vaina, L. (ed.) From the Retina to the Neocortex, pp. 11–50. Springer, Boston (1991)CrossRef Marr, D., Thach, W.T.: A theory of cerebellar cortex. In: Vaina, L. (ed.) From the Retina to the Neocortex, pp. 11–50. Springer, Boston (1991)CrossRef
11.
go back to reference Byadarhaly, K.V., Perdoor, M.C., Minai, A.A.: A modular neural model of motor synergies. Neural Networks 32, 96–108 (2012)CrossRef Byadarhaly, K.V., Perdoor, M.C., Minai, A.A.: A modular neural model of motor synergies. Neural Networks 32, 96–108 (2012)CrossRef
12.
go back to reference Luque, N.R., Garrido, J.A., Carrillo, R.R., Coenen, O.J., Ros, E.: Cerebellar input configuration toward object model abstraction in manipulation tasks. IEEE Trans. Neural Networks 22(8), 1321–1328 (2011)CrossRef Luque, N.R., Garrido, J.A., Carrillo, R.R., Coenen, O.J., Ros, E.: Cerebellar input configuration toward object model abstraction in manipulation tasks. IEEE Trans. Neural Networks 22(8), 1321–1328 (2011)CrossRef
13.
go back to reference Luque, N.R., Garrido, J.A., Carrillo, R.R., Tolu, S., Ros, E.: Adaptive cerebellar spiking model embedded in the control loop: context switching and robustness against noise. Int. J. Neural Syst. 21(05), 385–401 (2011)CrossRef Luque, N.R., Garrido, J.A., Carrillo, R.R., Tolu, S., Ros, E.: Adaptive cerebellar spiking model embedded in the control loop: context switching and robustness against noise. Int. J. Neural Syst. 21(05), 385–401 (2011)CrossRef
14.
go back to reference Garrido, J.A., Luque, N.R., D’Angelo, E., Ros, E.: Distributed cerebellar plasticity implements adaptable gain control in a manipulation task: a closed-loop robotic simulation (2013) Garrido, J.A., Luque, N.R., D’Angelo, E., Ros, E.: Distributed cerebellar plasticity implements adaptable gain control in a manipulation task: a closed-loop robotic simulation (2013)
15.
go back to reference Vannucci, L., Ambrosano, A., Cauli, N., Albanese, U., Falotico, E., Ulbrich, S., Pfotzer, L., Hinkel, G., Denninger, O., Peppicelli, D., Guyot, L., Arnim, A.V., Deser, S., Maier, P., Dillman, R., Klinker, G., Levi, P., Knoll, A., Gewaltig, M.O., Laschi, C.: A visual tracking model implemented on the icub robot as a use case for a novel neurorobotic toolkit integrating brain and physics simulation. In: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), pp. 1179–1184 (2015) Vannucci, L., Ambrosano, A., Cauli, N., Albanese, U., Falotico, E., Ulbrich, S., Pfotzer, L., Hinkel, G., Denninger, O., Peppicelli, D., Guyot, L., Arnim, A.V., Deser, S., Maier, P., Dillman, R., Klinker, G., Levi, P., Knoll, A., Gewaltig, M.O., Laschi, C.: A visual tracking model implemented on the icub robot as a use case for a novel neurorobotic toolkit integrating brain and physics simulation. In: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), pp. 1179–1184 (2015)
16.
go back to reference Tolu, S., Vanegas, M., Luque, N.R., Garrido, J.A., Ros, E.: Bio-inspired adaptive feedback error learning architecture for motor control. Biol. Cybern. 106, 507–522 (2012)CrossRef Tolu, S., Vanegas, M., Luque, N.R., Garrido, J.A., Ros, E.: Bio-inspired adaptive feedback error learning architecture for motor control. Biol. Cybern. 106, 507–522 (2012)CrossRef
17.
go back to reference Porrill, J., Dean, P.: Recurrent cerebellar loops simplify adaptive control of redundant and nonlinear motor systems. Neural Comput. 19(1), 170–193 (2007)CrossRefMATH Porrill, J., Dean, P.: Recurrent cerebellar loops simplify adaptive control of redundant and nonlinear motor systems. Neural Comput. 19(1), 170–193 (2007)CrossRefMATH
18.
go back to reference Tolu, S., Vanegas, M., Garrido, J.A., Luque, N.R., Ros, E.: Adaptive and predictive control of a simulated robot ARM. Int. J. Neural Syst. 23(03), 1350010 (2013)CrossRef Tolu, S., Vanegas, M., Garrido, J.A., Luque, N.R., Ros, E.: Adaptive and predictive control of a simulated robot ARM. Int. J. Neural Syst. 23(03), 1350010 (2013)CrossRef
19.
go back to reference Su, F., Wang, J., Deng, B., Wei, X.-L., Chen, Y.-Y., Liu, C., Li, H.-Y.: Adaptive control of parkinson039;s state based on a nonlinear computational model with unknown parameters. Int. J. Neural Syst. 25(01), 1450030 (2015)CrossRef Su, F., Wang, J., Deng, B., Wei, X.-L., Chen, Y.-Y., Liu, C., Li, H.-Y.: Adaptive control of parkinson039;s state based on a nonlinear computational model with unknown parameters. Int. J. Neural Syst. 25(01), 1450030 (2015)CrossRef
20.
go back to reference Yamazaki, T., Igarashi, J.: Realtime cerebellum: a large-scale spiking network model of the cerebellum that runs in realtime using a graphics processing unit. Neural Networks 47, 103–111 (2013)CrossRef Yamazaki, T., Igarashi, J.: Realtime cerebellum: a large-scale spiking network model of the cerebellum that runs in realtime using a graphics processing unit. Neural Networks 47, 103–111 (2013)CrossRef
21.
go back to reference Casellato, C., Antonietti, A., Garrido, J.A., Carrillo, R.R., Luque, N.R., Ros, E., Pedrocchi, A., D’Angelo, E.: Adaptive robotic control driven by a versatile spiking cerebellar network. PLOS ONE 9(11), 1–17 (2014)CrossRef Casellato, C., Antonietti, A., Garrido, J.A., Carrillo, R.R., Luque, N.R., Ros, E., Pedrocchi, A., D’Angelo, E.: Adaptive robotic control driven by a versatile spiking cerebellar network. PLOS ONE 9(11), 1–17 (2014)CrossRef
22.
go back to reference Richter, C., Jentzsch, S., Hostettler, R., Garrido, J.A., Ros, E., Knoll, A., Rohrbein, F., van der Smagt, P., Conradt, J.: Musculoskeletal robots: scalability in neural control. IEEE Robot. Autom. Mag. 23(4), 128–137 (2016)CrossRef Richter, C., Jentzsch, S., Hostettler, R., Garrido, J.A., Ros, E., Knoll, A., Rohrbein, F., van der Smagt, P., Conradt, J.: Musculoskeletal robots: scalability in neural control. IEEE Robot. Autom. Mag. 23(4), 128–137 (2016)CrossRef
23.
go back to reference Pacheco, M., Fogh, R., Lund, H.H., Christensen, D.J.: Fable: A modular robot for students, makers and researchers. In: Proceedings of the IROS workshop on Modular and Swarm Systems: from Nature to Robotics (2014) Pacheco, M., Fogh, R., Lund, H.H., Christensen, D.J.: Fable: A modular robot for students, makers and researchers. In: Proceedings of the IROS workshop on Modular and Swarm Systems: from Nature to Robotics (2014)
24.
go back to reference Schweighofer, N., Doya, K., Lay, F.: Unsupervised learning of granule cell sparse codes enhances cerebellar adaptive control. Neuroscience 103(1), 35–50 (2001)CrossRef Schweighofer, N., Doya, K., Lay, F.: Unsupervised learning of granule cell sparse codes enhances cerebellar adaptive control. Neuroscience 103(1), 35–50 (2001)CrossRef
25.
go back to reference Sjöström, J., Gerstner, W.: Spike-timing dependent plasticity. Spike-timing dependent plasticity, p. 35 (2010) Sjöström, J., Gerstner, W.: Spike-timing dependent plasticity. Spike-timing dependent plasticity, p. 35 (2010)
26.
go back to reference Davison, A., Brüderle, D., Kremkow, J., Muller, E., Pecevski, D., Perrinet, L., Yger, P.: PYNN: a common interface for neuronal network simulators (2009) Davison, A., Brüderle, D., Kremkow, J., Muller, E., Pecevski, D., Perrinet, L., Yger, P.: PYNN: a common interface for neuronal network simulators (2009)
Metadata
Title
A Scalable Neuro-inspired Robot Controller Integrating a Machine Learning Algorithm and a Spiking Cerebellar-Like Network
Authors
Ismael Baira Ojeda
Silvia Tolu
Henrik H. Lund
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-63537-8_31

Premium Partner