Skip to main content
Erschienen in: Autonomous Robots 3/2017

10.03.2016

Probabilistic movement primitives for coordination of multiple human–robot collaborative tasks

verfasst von: Guilherme J. Maeda, Gerhard Neumann, Marco Ewerton, Rudolf Lioutikov, Oliver Kroemer, Jan Peters

Erschienen in: Autonomous Robots | Ausgabe 3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes an interaction learning method for collaborative and assistive robots based on movement primitives. The method allows for both action recognition and human–robot movement coordination. It uses imitation learning to construct a mixture model of human–robot interaction primitives. This probabilistic model allows the assistive trajectory of the robot to be inferred from human observations. The method is scalable in relation to the number of tasks and can learn nonlinear correlations between the trajectories that describe the human–robot interaction. We evaluated the method experimentally with a lightweight robot arm in a variety of assistive scenarios, including the coordinated handover of a bottle to a human, and the collaborative assembly of a toolbox. Potential applications of the method are personal caregiver robots, control of intelligent prosthetic devices, and robot coworkers in factories.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
For example, a rate of 1.25 acts as a surrogate for a human that moves 25 % slower than the time-aligned interaction model.
 
Literatur
Zurück zum Zitat Ben Amor, H., Neumann, G., Kamthe, S., Kroemer, O., & Peters, J. (2014). Interaction primitives for human–robot cooperation tasks. In: Proceedings of the IEEE international conference on robotics and automation (ICRA). Ben Amor, H., Neumann, G., Kamthe, S., Kroemer, O., & Peters, J. (2014). Interaction primitives for human–robot cooperation tasks. In: Proceedings of the IEEE international conference on robotics and automation (ICRA).
Zurück zum Zitat Ben Amor, H., Vogt, D., Ewerton, M., Berger, E., Jung, B., & Peters, J. (2013). Learning responsive robot behavior by imitation. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 3257–3264). Ben Amor, H., Vogt, D., Ewerton, M., Berger, E., Jung, B., & Peters, J. (2013). Learning responsive robot behavior by imitation. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 3257–3264).
Zurück zum Zitat Bishop, C. (2006). Pattern recognition and machine learning (Vol. 4(4)). New York: Springer.MATH Bishop, C. (2006). Pattern recognition and machine learning (Vol. 4(4)). New York: Springer.MATH
Zurück zum Zitat Bonilla, B. L., & Asada, H. H. (2014). A robot on the shoulder: Coordinated human-wearable robot control using coloured petri nets and partial least squares predictions. In: Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 119–125). Bonilla, B. L., & Asada, H. H. (2014). A robot on the shoulder: Coordinated human-wearable robot control using coloured petri nets and partial least squares predictions. In: Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 119–125).
Zurück zum Zitat Cakmak, M., Srinivasa, S. S., Lee, M. K., Forlizzi, J., & Kiesler, S. (2011). Human preferences for robothuman hand-over configurations. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 1986–1993). Cakmak, M., Srinivasa, S. S., Lee, M. K., Forlizzi, J., & Kiesler, S. (2011). Human preferences for robothuman hand-over configurations. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 1986–1993).
Zurück zum Zitat Calinon, S., & Billard, A. (2009). Statistical learning by imitation of competing constraints in joint space and task space. Advanced Robotics, 23(15), 2059–2076.CrossRef Calinon, S., & Billard, A. (2009). Statistical learning by imitation of competing constraints in joint space and task space. Advanced Robotics, 23(15), 2059–2076.CrossRef
Zurück zum Zitat Calinon, S., D’halluin, F., Sauser, E. L., Caldwell, D. G., & Billard, A. G. (2010). Learning and reproduction of gestures by imitation. IEEE Robotics & Automation Magazine, 17(2), 44–54.CrossRef Calinon, S., D’halluin, F., Sauser, E. L., Caldwell, D. G., & Billard, A. G. (2010). Learning and reproduction of gestures by imitation. IEEE Robotics & Automation Magazine, 17(2), 44–54.CrossRef
Zurück zum Zitat Calinon, S., Li, Z., Alizadeh, T., Tsagarakis, N. G., & Caldwell, D. G. (2012). Statistical dynamical systems for skills acquisition in humanoids. In: Proceedings of the international conference on humanoid robots (HUMANOIDS) (pp. 323–329). Calinon, S., Li, Z., Alizadeh, T., Tsagarakis, N. G., & Caldwell, D. G. (2012). Statistical dynamical systems for skills acquisition in humanoids. In: Proceedings of the international conference on humanoid robots (HUMANOIDS) (pp. 323–329).
Zurück zum Zitat Englert, P., & Toussaint, M. (2014). Reactive phase and task space adaptation for robust motion execution. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 109–116). Englert, P., & Toussaint, M. (2014). Reactive phase and task space adaptation for robust motion execution. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 109–116).
Zurück zum Zitat Ewerton, M., Maeda, G., Peters, J., & Neumann, G. (2015). Learning motor skills from partially observed movements executed at different speeds. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 456–463). Ewerton, M., Maeda, G., Peters, J., & Neumann, G. (2015). Learning motor skills from partially observed movements executed at different speeds. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 456–463).
Zurück zum Zitat Ewerton, M., Neumann, G., Lioutikov, R., Ben Amor, H., Peters, J., & Maeda, G. (2015). Learning multiple collaborative tasks with a mixture of interaction primitives. In: Accepted: Proceedings of the IEEE international conference on robotics and automation (ICRA). Ewerton, M., Neumann, G., Lioutikov, R., Ben Amor, H., Peters, J., & Maeda, G. (2015). Learning multiple collaborative tasks with a mixture of interaction primitives. In: Accepted: Proceedings of the IEEE international conference on robotics and automation (ICRA).
Zurück zum Zitat Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pastor, P., & Schaal, S. (2013). Dynamical movement primitives: Learning attractor models for motor behaviors. Neural Computation, 25(2), 328–373.MathSciNetCrossRefMATH Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pastor, P., & Schaal, S. (2013). Dynamical movement primitives: Learning attractor models for motor behaviors. Neural Computation, 25(2), 328–373.MathSciNetCrossRefMATH
Zurück zum Zitat Kalakrishnan, M., Chitta, S., Theodorou, E., Pastor, P., & Schaal, S. (2011). STOMP: Stochastic trajectory optimization for motion planning. In: Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 4569–4574). Kalakrishnan, M., Chitta, S., Theodorou, E., Pastor, P., & Schaal, S. (2011). STOMP: Stochastic trajectory optimization for motion planning. In: Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 4569–4574).
Zurück zum Zitat Kim, S., Gribovskaya, E., & Billard, A. (2010). Learning motion dynamics to catch a moving object. In: Proceedings of the IEEE-RAS international conference on humanoid robots (HUMANOIDS) (pp. 106–111). Kim, S., Gribovskaya, E., & Billard, A. (2010). Learning motion dynamics to catch a moving object. In: Proceedings of the IEEE-RAS international conference on humanoid robots (HUMANOIDS) (pp. 106–111).
Zurück zum Zitat Koppula, H.S., & Saxena, A., (2013). Anticipating human activities using object affordances for reactive robotic response. In: Robotics: Science and systems. Koppula, H.S., & Saxena, A., (2013). Anticipating human activities using object affordances for reactive robotic response. In: Robotics: Science and systems.
Zurück zum Zitat Kulvicius, T., Biehl, M., Aein, M. J., Tamosiunaite, M., & Wörgötter, F. (2013). Interaction learning for dynamic movement primitives used in cooperative robotic tasks. Robotics and Autonomous Systems, 61(12), 1450–1459.CrossRef Kulvicius, T., Biehl, M., Aein, M. J., Tamosiunaite, M., & Wörgötter, F. (2013). Interaction learning for dynamic movement primitives used in cooperative robotic tasks. Robotics and Autonomous Systems, 61(12), 1450–1459.CrossRef
Zurück zum Zitat Kupcsik, A., Hsu, D., & Lee, S. (2015). Learning dynamic robot-to-human object handover from human feedback. In: International symposium on robotics research (ISRR). Kupcsik, A., Hsu, D., & Lee, S. (2015). Learning dynamic robot-to-human object handover from human feedback. In: International symposium on robotics research (ISRR).
Zurück zum Zitat Lawitzky, M., Medina, J., Lee, D., & Hirche, S. (2012, Oct). Feedback motion planning and learning from demonstration in physical robotic assistance: differences and synergies. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 3646–3652). Lawitzky, M., Medina, J., Lee, D., & Hirche, S. (2012, Oct). Feedback motion planning and learning from demonstration in physical robotic assistance: differences and synergies. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 3646–3652).
Zurück zum Zitat Lee, D., Ott, C., & Nakamura, Y. (2010). Mimetic communication model with compliant physical contact in human–humanoid interaction. The International Journal of Robotics Research, 29(13), 1684–1704.CrossRef Lee, D., Ott, C., & Nakamura, Y. (2010). Mimetic communication model with compliant physical contact in human–humanoid interaction. The International Journal of Robotics Research, 29(13), 1684–1704.CrossRef
Zurück zum Zitat Maeda, G., Ewerton, M., Lioutikov, R., Ben Amor, H., Peters, J., & Neumann, G. (2014). Learning interaction for collaborative tasks with probabilistic movement primitives. In: Proceedings of the international conference on humanoid robots (HU- MANOIDS) (pp. 527–534). Maeda, G., Ewerton, M., Lioutikov, R., Ben Amor, H., Peters, J., & Neumann, G. (2014). Learning interaction for collaborative tasks with probabilistic movement primitives. In: Proceedings of the international conference on humanoid robots (HU- MANOIDS) (pp. 527–534).
Zurück zum Zitat Maeda, G., Neumann, G., Ewerton, L. R., M., & Peters, J. (2015). A probabilistic framework for semiautonomous robots based on interaction primitives with phase estimation. In: Proceedings of the international symposium of robotics research (ISRR). Maeda, G., Neumann, G., Ewerton, L. R., M., & Peters, J. (2015). A probabilistic framework for semiautonomous robots based on interaction primitives with phase estimation. In: Proceedings of the international symposium of robotics research (ISRR).
Zurück zum Zitat Mainprice, J., & Berenson, D. (2013). Human–robot collaborative manipulation planning using early prediction of human motion. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 299–306). Mainprice, J., & Berenson, D. (2013). Human–robot collaborative manipulation planning using early prediction of human motion. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 299–306).
Zurück zum Zitat Oliver, N., Rosario, B., & Pentland, A. (2000). A Bayesian computer vision system for modeling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8), 831–843. doi:10.1109/34.868684.CrossRef Oliver, N., Rosario, B., & Pentland, A. (2000). A Bayesian computer vision system for modeling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8), 831–843. doi:10.​1109/​34.​868684.CrossRef
Zurück zum Zitat Paraschos, A., Daniel, C., Peters, J., & Neumann, G. (2013). Probabilistic movement primitives. In: Advances in neural information processing systems (NIPS) (pp. 2616–2624). Paraschos, A., Daniel, C., Peters, J., & Neumann, G. (2013). Probabilistic movement primitives. In: Advances in neural information processing systems (NIPS) (pp. 2616–2624).
Zurück zum Zitat Ratliff, N., Zucker, M., Bagnell, J. A., & Srinivasa, S. (2009). Chomp: Gradient optimization techniques for efficient motion planning. In: Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 489–494). Ratliff, N., Zucker, M., Bagnell, J. A., & Srinivasa, S. (2009). Chomp: Gradient optimization techniques for efficient motion planning. In: Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 489–494).
Zurück zum Zitat Rohmer, E., Freese, M., Singh, S. P. (2013). V-rep: A versatile and scalable robot simulation framework. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS). Rohmer, E., Freese, M., Singh, S. P. (2013). V-rep: A versatile and scalable robot simulation framework. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS).
Zurück zum Zitat Rozo, L., Calinon, S., Caldwell, D. G., Jimenez, P., & Torras, C. (2013). Learning collaborative impedance-based robot behaviors. In: AAAI conference on artificial intelligence. Bellevue, Washington, USA Rozo, L., Calinon, S., Caldwell, D. G., Jimenez, P., & Torras, C. (2013). Learning collaborative impedance-based robot behaviors. In: AAAI conference on artificial intelligence. Bellevue, Washington, USA
Zurück zum Zitat Sakoe, H., & Chiba, S. (1978). Dynamic programming algorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech and Signal Processing, 26(1), 43–49.CrossRefMATH Sakoe, H., & Chiba, S. (1978). Dynamic programming algorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech and Signal Processing, 26(1), 43–49.CrossRefMATH
Zurück zum Zitat Schaal, S. (1999). Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences, 3(6), 233–242.CrossRef Schaal, S. (1999). Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences, 3(6), 233–242.CrossRef
Zurück zum Zitat Sisbot, E. A., & Alami, R. (2012). A human-aware manipulation planner. IEEE Transactions on Robotics, 28(5), 1045–1057.CrossRef Sisbot, E. A., & Alami, R. (2012). A human-aware manipulation planner. IEEE Transactions on Robotics, 28(5), 1045–1057.CrossRef
Zurück zum Zitat Strabala, K. W., Lee, M. K., Dragan, A. D., Forlizzi, J. L., Srinivasa, S., Cakmak, M., et al. (2013). Towards seamless human–robot handovers. Journal of Human–Robot Interaction, 2(1), 112–132. Strabala, K. W., Lee, M. K., Dragan, A. D., Forlizzi, J. L., Srinivasa, S., Cakmak, M., et al. (2013). Towards seamless human–robot handovers. Journal of Human–Robot Interaction, 2(1), 112–132.
Zurück zum Zitat Tanaka, Y., Kinugawa, J., Sugahara, Y., & Kosuge, K. (2012). Motion planning with worker’s trajectory prediction for assembly task partner robot. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 1525–1532). Tanaka, Y., Kinugawa, J., Sugahara, Y., & Kosuge, K. (2012). Motion planning with worker’s trajectory prediction for assembly task partner robot. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 1525–1532).
Zurück zum Zitat Theodorou, E., Buchli, J., & Schaal, S. (2010). Reinforcement learning of motor skills in high dimensions: A path integral approach. In: Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 2397–2403). Theodorou, E., Buchli, J., & Schaal, S. (2010). Reinforcement learning of motor skills in high dimensions: A path integral approach. In: Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 2397–2403).
Zurück zum Zitat Wang, Z., Muelling, K., Deisenroth, M. P., Ben Amor, H., Vogt, D., Schoelkopf, B., et al. (2013). Probabilistic movement modeling for intention inference in human–robot interaction. The International Journal of Robotics Research, 7, 841–858.CrossRef Wang, Z., Muelling, K., Deisenroth, M. P., Ben Amor, H., Vogt, D., Schoelkopf, B., et al. (2013). Probabilistic movement modeling for intention inference in human–robot interaction. The International Journal of Robotics Research, 7, 841–858.CrossRef
Zurück zum Zitat Yamane, K., Revfi, M., & Asfour, T. (2013). Synthesizing object receiving motions of humanoid robots with human motion database. In: Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 1629–1636). Yamane, K., Revfi, M., & Asfour, T. (2013). Synthesizing object receiving motions of humanoid robots with human motion database. In: Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 1629–1636).
Zurück zum Zitat Yamane, K., Yamaguchi, Y., & Nakamura, Y. (2011). Human motion database with a binary tree and node transition graphs. Autonomous Robots, 30(1), 87–98.CrossRef Yamane, K., Yamaguchi, Y., & Nakamura, Y. (2011). Human motion database with a binary tree and node transition graphs. Autonomous Robots, 30(1), 87–98.CrossRef
Metadaten
Titel
Probabilistic movement primitives for coordination of multiple human–robot collaborative tasks
verfasst von
Guilherme J. Maeda
Gerhard Neumann
Marco Ewerton
Rudolf Lioutikov
Oliver Kroemer
Jan Peters
Publikationsdatum
10.03.2016
Verlag
Springer US
Erschienen in
Autonomous Robots / Ausgabe 3/2017
Print ISSN: 0929-5593
Elektronische ISSN: 1573-7527
DOI
https://doi.org/10.1007/s10514-016-9556-2

Weitere Artikel der Ausgabe 3/2017

Autonomous Robots 3/2017 Zur Ausgabe

Neuer Inhalt