Skip to main content
Top

2014 | OriginalPaper | Chapter

13. A Dynamic Neural Field Approach to Natural and Efficient Human-Robot Collaboration

Authors : Wolfram Erlhagen, Estela Bicho

Published in: Neural Fields

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A major challenge in modern robotics is the design of autonomous robots that are able to cooperate with people in their daily tasks in a human-like way. We address the challenge of natural human-robot interactions by using the theoretical framework of Dynamic Neural Fields (DNFs) to develop processing architectures that are based on neuro-cognitive mechanisms supporting human joint action. By explaining the emergence of self-stabilized activity in neuronal populations, Dynamic Field Theory provides a systematic way to endow a robot with crucial cognitive functions such as working memory, prediction and decision making. The DNF architecture for joint action is organized as a large scale network of reciprocally connected neuronal populations that encode in their firing patterns specific motor behaviors, action goals, contextual cues and shared task knowledge. Ultimately, it implements a context-dependent mapping from observed actions of the human onto adequate complementary behaviors that takes into account the inferred goal of the co-actor. We present results of flexible and fluent human-robot cooperation in a task in which the team has to assemble a toy object from its components.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Alami, R., Clodic, A., Montreuil, V., Sisbot, E.A., Chatila, R.: Task planning for human-robot interaction. In: Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence, Genoble. ACM International Conference Proceeding Series, vol. 121, pp. 81–85 (2005) Alami, R., Clodic, A., Montreuil, V., Sisbot, E.A., Chatila, R.: Task planning for human-robot interaction. In: Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence, Genoble. ACM International Conference Proceeding Series, vol. 121, pp. 81–85 (2005)
3.
go back to reference Bicho, E., Mallet, P., Schöner, G.: Target representation on an autonomous vehicle with low-level sensors. Int. J. Robot. Res. 19, 424–447 (2000)CrossRef Bicho, E., Mallet, P., Schöner, G.: Target representation on an autonomous vehicle with low-level sensors. Int. J. Robot. Res. 19, 424–447 (2000)CrossRef
4.
go back to reference Bicho, E., Louro, L., Erlhagen, W.: Integrating verbal and nonverbal communication in a dynamic neural field architecture for human-robot interaction. Front. Neurorobotics (2010). doi:10.3389/fnbot.2010.0005 Bicho, E., Louro, L., Erlhagen, W.: Integrating verbal and nonverbal communication in a dynamic neural field architecture for human-robot interaction. Front. Neurorobotics (2010). doi:10.3389/fnbot.2010.0005
5.
go back to reference Bicho, E., Erlhagen, W., Louro, L., Costa e Silva, E.: Neuro-cognitive mechanisms of decision making in joint action: a human-robot interaction study. Hum. Mov. Sci. 30, 846–868 (2011a) Bicho, E., Erlhagen, W., Louro, L., Costa e Silva, E.: Neuro-cognitive mechanisms of decision making in joint action: a human-robot interaction study. Hum. Mov. Sci. 30, 846–868 (2011a)
6.
go back to reference Bicho, E., Erlhagen, W., Louro, L., Costa e Silva, E., Silva, R., Hipolito, N.: A dynamic field approach to goal inference, error detection and anticipatory action selection in human-robot collaboration. In: Dautenhahn, K., Saunders, J. (eds.) New Frontiers in Human-Robot Interaction, pp. 135–164. John Benjamins, Amsterdam (2011b) Bicho, E., Erlhagen, W., Louro, L., Costa e Silva, E., Silva, R., Hipolito, N.: A dynamic field approach to goal inference, error detection and anticipatory action selection in human-robot collaboration. In: Dautenhahn, K., Saunders, J. (eds.) New Frontiers in Human-Robot Interaction, pp. 135–164. John Benjamins, Amsterdam (2011b)
7.
go back to reference Cisek, P.: Cortical mechanisms of action selection: the affordance competition hypothesis. Philos. Trans. R. Soc. B 362, 1585–1599 (2007)CrossRef Cisek, P.: Cortical mechanisms of action selection: the affordance competition hypothesis. Philos. Trans. R. Soc. B 362, 1585–1599 (2007)CrossRef
10.
go back to reference Costa e Silva, E., Costa, F., Bicho, E., Erlhagen, W.: Nonlinear optimization for human-like movements of a high degree of freedom robotics arm-hand system. In: Murante, B. (ed.) Computational Science and Its Applications – ICCSA 2011. Lecture Notes in Computer Science, vol. 6794, Part III, pp. 327–342. Springer, Berlin/Heidelberg (2011) Costa e Silva, E., Costa, F., Bicho, E., Erlhagen, W.: Nonlinear optimization for human-like movements of a high degree of freedom robotics arm-hand system. In: Murante, B. (ed.) Computational Science and Its Applications – ICCSA 2011. Lecture Notes in Computer Science, vol. 6794, Part III, pp. 327–342. Springer, Berlin/Heidelberg (2011)
11.
go back to reference Eliasmith, C., Stewart, T.C., Choo, X., Bekolay, T., DeWolf, T., Tang, Y., Rasmussen, D.: A large scale model of the functioning brain. Science 338, 1202–1205 (2012)CrossRef Eliasmith, C., Stewart, T.C., Choo, X., Bekolay, T., DeWolf, T., Tang, Y., Rasmussen, D.: A large scale model of the functioning brain. Science 338, 1202–1205 (2012)CrossRef
12.
go back to reference Erlhagen, W., Bicho, E.: The dynamic neural field approach to cognitive robotics. J. Neural Eng. 3, R36–R54 (2006)CrossRef Erlhagen, W., Bicho, E.: The dynamic neural field approach to cognitive robotics. J. Neural Eng. 3, R36–R54 (2006)CrossRef
13.
go back to reference Erlhagen, W., Schöner, G.: Dynamic field theory of movement preparation. Psychol. Rev. 109, 545–572 (2002)CrossRef Erlhagen, W., Schöner, G.: Dynamic field theory of movement preparation. Psychol. Rev. 109, 545–572 (2002)CrossRef
14.
go back to reference Erlhagen, W., Bastian, A., Jancke, D., Riehle, A., Schöner, G.: The distribution of neuronal population activation as a tool to study interaction and integration in cortical representations. J. Neurosci. Methods 94, 53–66 (1999)CrossRef Erlhagen, W., Bastian, A., Jancke, D., Riehle, A., Schöner, G.: The distribution of neuronal population activation as a tool to study interaction and integration in cortical representations. J. Neurosci. Methods 94, 53–66 (1999)CrossRef
15.
go back to reference Erlhagen, W., Mukovskiy, A., Bicho, E.: A dynamic model for action understanding and goal-directed imitation. Brain Res. 1083, 174–188 (2006)CrossRef Erlhagen, W., Mukovskiy, A., Bicho, E.: A dynamic model for action understanding and goal-directed imitation. Brain Res. 1083, 174–188 (2006)CrossRef
16.
go back to reference Erlhagen, W., Mukovskiy, A., Chersi, F., Bicho, E.: On the development of intention understanding for joint action tasks. In: 6th IEEE International Conference on Development and Learning, Imperial College London, pp. 140–145 (2007) Erlhagen, W., Mukovskiy, A., Chersi, F., Bicho, E.: On the development of intention understanding for joint action tasks. In: 6th IEEE International Conference on Development and Learning, Imperial College London, pp. 140–145 (2007)
17.
go back to reference Ferreira, F., Erlhagen, W., Bicho, E.: A dynamic field model of ordinal and timing properties of sequential events. In: Honkela, T., Duch, W., Giorlami, M., Kaski, S. (eds.) Artificial Neural Networks and Machine Learning – ICANN 2011. Lecture Notes in Computer Science vol. 6792, Part II, pp. 325–332. Springer, Berlin/Heidelberg (2011) Ferreira, F., Erlhagen, W., Bicho, E.: A dynamic field model of ordinal and timing properties of sequential events. In: Honkela, T., Duch, W., Giorlami, M., Kaski, S. (eds.) Artificial Neural Networks and Machine Learning – ICANN 2011. Lecture Notes in Computer Science vol. 6792, Part II, pp. 325–332. Springer, Berlin/Heidelberg (2011)
18.
go back to reference Flanagan, J.R., Bowman, M.C., Johansson, R.S.: Control strategies in object manipulation tasks. Curr. Opin. Neurobiol. 16, 650–659 (2006)CrossRef Flanagan, J.R., Bowman, M.C., Johansson, R.S.: Control strategies in object manipulation tasks. Curr. Opin. Neurobiol. 16, 650–659 (2006)CrossRef
19.
go back to reference Fogassi, L., Ferrari, P.F., Gesierich, B., Rozzi, S., Chersi, F., Rizzolatti, G.: Parietal lobe: from action organization to intention understanding. Science 308, 662–667 (2005)CrossRef Fogassi, L., Ferrari, P.F., Gesierich, B., Rozzi, S., Chersi, F., Rizzolatti, G.: Parietal lobe: from action organization to intention understanding. Science 308, 662–667 (2005)CrossRef
20.
go back to reference Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robot. Auton. Syst. 42, 143–166 (2003)CrossRefMATH Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robot. Auton. Syst. 42, 143–166 (2003)CrossRefMATH
21.
go back to reference Fuster, J.M.: A cognit: a network model of cortical representation. Int. J. Psychophysiol. 60, 125–132 (2006)CrossRef Fuster, J.M.: A cognit: a network model of cortical representation. Int. J. Psychophysiol. 60, 125–132 (2006)CrossRef
22.
go back to reference Genovesio, A., Brasted, P.J., Wise, P.: Representation of future and previous spatial goals by separate neural populations in prefrontal cortex. J. Neurosci. 26(27), 7305–7316 (2006)CrossRef Genovesio, A., Brasted, P.J., Wise, P.: Representation of future and previous spatial goals by separate neural populations in prefrontal cortex. J. Neurosci. 26(27), 7305–7316 (2006)CrossRef
23.
go back to reference Gerstner, W., Kistler, W.M.: Mathematical formulations of Hebbian learning. Biol. Cybern. 87, 404–415 (2002)CrossRefMATH Gerstner, W., Kistler, W.M.: Mathematical formulations of Hebbian learning. Biol. Cybern. 87, 404–415 (2002)CrossRefMATH
24.
go back to reference Gibbson, J.J.: The Ecological Approach to Visual Perception. Houghton Mifflin, Boston (1979) Gibbson, J.J.: The Ecological Approach to Visual Perception. Houghton Mifflin, Boston (1979)
25.
go back to reference Gold, J.I., Shadlen, M.: The neural basis of decision making. Ann. Rev. Neurosci. 30, 535–574 (2007)CrossRef Gold, J.I., Shadlen, M.: The neural basis of decision making. Ann. Rev. Neurosci. 30, 535–574 (2007)CrossRef
26.
go back to reference Haazebroek, P., van Dantzig, A., Hommel, B.: A computational model of perception and action for cognitive robots. Cognit. Process 12, 355–365 (2011)CrossRef Haazebroek, P., van Dantzig, A., Hommel, B.: A computational model of perception and action for cognitive robots. Cognit. Process 12, 355–365 (2011)CrossRef
27.
go back to reference Hebb, D.O.: The Organization of Behavior. Wiley, New York (1949) Hebb, D.O.: The Organization of Behavior. Wiley, New York (1949)
28.
go back to reference Hoffman, G., Breazeal, C.: Cost-based anticipatory action selection for human-robot fluency. IEEE Trans. Robot. 23, 952–961 (2007)CrossRef Hoffman, G., Breazeal, C.: Cost-based anticipatory action selection for human-robot fluency. IEEE Trans. Robot. 23, 952–961 (2007)CrossRef
29.
go back to reference Kishimoto, K., Amari, S.: Existence and stability of local excitations in homogeneous neural fields. J. Math. Biol. 7, 303–318 (1979)CrossRefMATHMathSciNet Kishimoto, K., Amari, S.: Existence and stability of local excitations in homogeneous neural fields. J. Math. Biol. 7, 303–318 (1979)CrossRefMATHMathSciNet
30.
go back to reference Kozma, R.: Intentional systems: review of neurodynamics, modelling, and robotics implementations. Phys. Life Rev. 5, 1–21 (2008)CrossRef Kozma, R.: Intentional systems: review of neurodynamics, modelling, and robotics implementations. Phys. Life Rev. 5, 1–21 (2008)CrossRef
31.
go back to reference Laing, C.R., Troy, W.C., Gutkin, B., Ermentrout, G.B.: Multiple bumps in a neuronal model of working memory. SIAM J. Appl. Math 63, 62–97 (2002)CrossRefMATHMathSciNet Laing, C.R., Troy, W.C., Gutkin, B., Ermentrout, G.B.: Multiple bumps in a neuronal model of working memory. SIAM J. Appl. Math 63, 62–97 (2002)CrossRefMATHMathSciNet
32.
go back to reference Levesque, H., Lakemeyer, G.: Cognitive robotics. In: van Harmelen, F., Lifschitz, V., Porter, B. (eds.) Handbook of Knowledge Representation, pp. 869–886. Elsevier B. V., Amsterdam (2008)CrossRef Levesque, H., Lakemeyer, G.: Cognitive robotics. In: van Harmelen, F., Lifschitz, V., Porter, B. (eds.) Handbook of Knowledge Representation, pp. 869–886. Elsevier B. V., Amsterdam (2008)CrossRef
33.
go back to reference Newman-Norlund, R.D., van Schie, H.T., van Zuijlen, A.M.J., Bekkering, H.: The mirror neuron system is more active during complementary compared with imitative action. Nat. Neurosci. 10, 817–818 (2007)CrossRef Newman-Norlund, R.D., van Schie, H.T., van Zuijlen, A.M.J., Bekkering, H.: The mirror neuron system is more active during complementary compared with imitative action. Nat. Neurosci. 10, 817–818 (2007)CrossRef
34.
go back to reference Pinheiro, M., Bicho, E., Erlhagen, W.: A dynamic neural field architecture for a pro-active assistant robot. In: Proceedings of the 3rd IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics (IEEE BioRob 2010), Tokyo, pp. 777–784 (2010) Pinheiro, M., Bicho, E., Erlhagen, W.: A dynamic neural field architecture for a pro-active assistant robot. In: Proceedings of the 3rd IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics (IEEE BioRob 2010), Tokyo, pp. 777–784 (2010)
35.
go back to reference Rizzolatti, G., Luppino, G.: The cortical motor system. Neuron 31, 889–901 (2001)CrossRef Rizzolatti, G., Luppino, G.: The cortical motor system. Neuron 31, 889–901 (2001)CrossRef
36.
go back to reference Rizzolatti, G., Sinigaglia, C.: The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations. Nat. Rev. Neurosci. 11, 264–274 (2010)CrossRef Rizzolatti, G., Sinigaglia, C.: The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations. Nat. Rev. Neurosci. 11, 264–274 (2010)CrossRef
37.
go back to reference Sandamirskaya, Y., Schöner, G.: An embodied account for serial order: how instabilities drive sequence generation. Neural Netw. 23, 1164–1179 (2010)CrossRef Sandamirskaya, Y., Schöner, G.: An embodied account for serial order: how instabilities drive sequence generation. Neural Netw. 23, 1164–1179 (2010)CrossRef
38.
go back to reference Schaal, S.: The new robotics: towards human-centered machines. HFSP J. 1, 115–126 (2007)CrossRef Schaal, S.: The new robotics: towards human-centered machines. HFSP J. 1, 115–126 (2007)CrossRef
39.
go back to reference Schöner, G.: Dynamical systems approaches to cognition. In: Sun, R. (ed.) The Cambridge Handbook of Computational Psychology, pp. 101–125. Cambridge University Press, Cambridge (2008)CrossRef Schöner, G.: Dynamical systems approaches to cognition. In: Sun, R. (ed.) The Cambridge Handbook of Computational Psychology, pp. 101–125. Cambridge University Press, Cambridge (2008)CrossRef
40.
go back to reference Sebanz, N., Bekkering, H., Knoblich, G.: Joint action: bodies and minds moving together. Trends Cognit. Sci. 10, 70–76 (2006)CrossRef Sebanz, N., Bekkering, H., Knoblich, G.: Joint action: bodies and minds moving together. Trends Cognit. Sci. 10, 70–76 (2006)CrossRef
41.
42.
go back to reference Steil, J.J., Röthling, F., Haschke, R., Ritter, H.: Situated robot learning for multi-modal instruction and imitation of grasping. Robot. Auton. Syst. 47, 129–141 (2004)CrossRef Steil, J.J., Röthling, F., Haschke, R., Ritter, H.: Situated robot learning for multi-modal instruction and imitation of grasping. Robot. Auton. Syst. 47, 129–141 (2004)CrossRef
43.
go back to reference Tanji, J., Shima, K., Mushiake, H.: Concept-based behavioural planning and the lateral prefrontal cortex. Trends Cognit. Sci. 11, 528–534 (2007)CrossRef Tanji, J., Shima, K., Mushiake, H.: Concept-based behavioural planning and the lateral prefrontal cortex. Trends Cognit. Sci. 11, 528–534 (2007)CrossRef
44.
go back to reference Trappenbeg, T., Standage, D.I.: Multi-packet regions in stabilized continuous attractor networks. Neurocomputing 65–66, 617–625 (2005)CrossRef Trappenbeg, T., Standage, D.I.: Multi-packet regions in stabilized continuous attractor networks. Neurocomputing 65–66, 617–625 (2005)CrossRef
45.
go back to reference Umiltà, M.A., Kohler, E., Gallese, V., Fogassi, L., Fadiga, L., Keysers, C., Rizzolatti, G.: I know what you are doing: a neurophysiological study. Neuron 31, 155–165 (2001)CrossRef Umiltà, M.A., Kohler, E., Gallese, V., Fogassi, L., Fadiga, L., Keysers, C., Rizzolatti, G.: I know what you are doing: a neurophysiological study. Neuron 31, 155–165 (2001)CrossRef
46.
go back to reference Vernon, D., Metta, G., Sandini, G.: A survey of artificial cognitive systems: implications for the autonomous development of mental capabilities in computational agents. IEEE Trans. Evol. Comput. 2, 151–181 (2007)CrossRef Vernon, D., Metta, G., Sandini, G.: A survey of artificial cognitive systems: implications for the autonomous development of mental capabilities in computational agents. IEEE Trans. Evol. Comput. 2, 151–181 (2007)CrossRef
47.
go back to reference Westphal, G., von der Malsburg, C., Würtz, R.P.: Feature-driven emergence of model graphs for object recognition and categorization. In: Bunke, H., Kandel, A., Last, M. (eds.) Applied Pattern Recognition. Sudies in Computational Intelligence, vol. 91, pp. 155–199. Springer, Berlin (2008) Westphal, G., von der Malsburg, C., Würtz, R.P.: Feature-driven emergence of model graphs for object recognition and categorization. In: Bunke, H., Kandel, A., Last, M. (eds.) Applied Pattern Recognition. Sudies in Computational Intelligence, vol. 91, pp. 155–199. Springer, Berlin (2008)
48.
go back to reference Wilson, H.R., Cowan, J.D.: A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik 13, 55–80 (1973)CrossRefMATH Wilson, H.R., Cowan, J.D.: A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik 13, 55–80 (1973)CrossRefMATH
Metadata
Title
A Dynamic Neural Field Approach to Natural and Efficient Human-Robot Collaboration
Authors
Wolfram Erlhagen
Estela Bicho
Copyright Year
2014
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-54593-1_13

Premium Partner