Skip to main content
Top

2016 | OriginalPaper | Chapter

A Framework for Modelling Local Human-Robot Interactions Based on Unsupervised Learning

Authors : Rafael Ramón-Vigo, Noé Pérez-Higueras, Fernando Caballero, Luis Merino

Published in: Social Robotics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper addresses the problem of teaching a robot interaction behaviors using the imitation learning paradigm. Particularly, the approach makes use of Gaussian Mixture Models (GMMs) to model the physical interaction of the robot and the person when the robot is teleoperated or guided by an expert. The learned models are integrated into a sample-based planner, an RRT*, at two levels: as a cost function in order to plan trajectories considering behavior constraints, and as configuration space sampling bias to discard samples with low cost according to the behaviors. The algorithm is successfully tested in the laboratory using an actual robot and real trajectories examples provided by an expert.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abbeel, P., Ng, A.Y.: Apprenticeship learning via inverse reinforcement learning. In: Proceeding of the Twenty-First International Conference on Machine Learning, ICML 2004, pp. 1–6. ACM, New York (2004) Abbeel, P., Ng, A.Y.: Apprenticeship learning via inverse reinforcement learning. In: Proceeding of the Twenty-First International Conference on Machine Learning, ICML 2004, pp. 1–6. ACM, New York (2004)
2.
go back to reference Argali, B., Chernova, S., Veloso, M., Browning, B.: A survey of robot learning from demonstrations. Robot. Auton. Syst. 57, 469–483 (2009)CrossRef Argali, B., Chernova, S., Veloso, M., Browning, B.: A survey of robot learning from demonstrations. Robot. Auton. Syst. 57, 469–483 (2009)CrossRef
3.
go back to reference Calinon, S.: Robot Programming by Demonstration: A Probabilistic Approach. EPFL/CRC Press, Boca Raton (2009) Calinon, S.: Robot Programming by Demonstration: A Probabilistic Approach. EPFL/CRC Press, Boca Raton (2009)
4.
go back to reference Calinon, S., Billard, A.: A probabilistic programming by demonstration framework handling constraints in joint space and task space. In: Proceeding IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS (2008) Calinon, S., Billard, A.: A probabilistic programming by demonstration framework handling constraints in joint space and task space. In: Proceeding IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS (2008)
5.
go back to reference Claassens, J.: A RRT-based path planner for use in trajectory imitation. In: Proceeding of the International Conference on Robotics and Automation, ICRA, pp. 3090–3095. IEEE (2010) Claassens, J.: A RRT-based path planner for use in trajectory imitation. In: Proceeding of the International Conference on Robotics and Automation, ICRA, pp. 3090–3095. IEEE (2010)
6.
go back to reference Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc.: Ser. B 39(1), 1–38 (1977)MathSciNetMATH Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc.: Ser. B 39(1), 1–38 (1977)MathSciNetMATH
7.
go back to reference Ferrer, G., Garrell, A., Sanfeliu, A.: Robot companion: a social-force based approach with human awareness-navigation in crowded environments. In: Proceeding of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS. pp. 1688–1694 (2013) Ferrer, G., Garrell, A., Sanfeliu, A.: Robot companion: a social-force based approach with human awareness-navigation in crowded environments. In: Proceeding of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS. pp. 1688–1694 (2013)
8.
go back to reference Henry, P., Vollmer, C., Ferris, B., Fox, D.: Learning to navigate through crowded environments. In: Proceeding of the International Conference on Robotics and Automation, ICRA, pp. 981–986 (2010) Henry, P., Vollmer, C., Ferris, B., Fox, D.: Learning to navigate through crowded environments. In: Proceeding of the International Conference on Robotics and Automation, ICRA, pp. 981–986 (2010)
9.
go back to reference Islas Ramírez, O., Khambhaita, H., Chatila, R., Chetouani, M., Alami, R.: Robots learning how and where to approach people. In: RO-MAN 2016 25th, IEEE International Symposium on Robot and Human Interactive Communication (2016, to appear) Islas Ramírez, O., Khambhaita, H., Chatila, R., Chetouani, M., Alami, R.: Robots learning how and where to approach people. In: RO-MAN 2016 25th, IEEE International Symposium on Robot and Human Interactive Communication (2016, to appear)
10.
go back to reference Karaman, S., Frazzoli, E.: Sampling-based algorithms for optimal motion planning. Int. J. Robot. Res. 30(7), 846–894 (2011)CrossRefMATH Karaman, S., Frazzoli, E.: Sampling-based algorithms for optimal motion planning. Int. J. Robot. Res. 30(7), 846–894 (2011)CrossRefMATH
11.
go back to reference Luber, M., Spinello, L., Silva, J., Arras, K.: Socially-aware robot navigation: a learning approach. In: Proceeding of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, pp. 797–803. IEEE (2012) Luber, M., Spinello, L., Silva, J., Arras, K.: Socially-aware robot navigation: a learning approach. In: Proceeding of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, pp. 797–803. IEEE (2012)
12.
go back to reference Okal, B., Gilbert, H., Arras, K.O.: Efficient inverse reinforcement learning using adaptive state-graphs. In: Learning from Demonstration: Inverse Optimal Control, Reinforcement Learning and Lifelong Learning Workshop at Robotics: Science and Systems (RSS), Rome, Italy (2015) Okal, B., Gilbert, H., Arras, K.O.: Efficient inverse reinforcement learning using adaptive state-graphs. In: Learning from Demonstration: Inverse Optimal Control, Reinforcement Learning and Lifelong Learning Workshop at Robotics: Science and Systems (RSS), Rome, Italy (2015)
13.
go back to reference Perez-Higueras, N., Ramon-Vigo, R., Caballero, F., Merino, L.: Robot local navigation with learned social cost functions. In: Proceeding of the 11th International Conference on Informatics in Control, Automation and Robotics, ICINCO, vol. 02, pp. 618–625 (2014) Perez-Higueras, N., Ramon-Vigo, R., Caballero, F., Merino, L.: Robot local navigation with learned social cost functions. In: Proceeding of the 11th International Conference on Informatics in Control, Automation and Robotics, ICINCO, vol. 02, pp. 618–625 (2014)
14.
go back to reference Ramon-Vigo, R., Perez-Higueras, N., Caballero, F., Merino, L.: Analyzing the relevance of features for a social navigation task. Robot 2015: Second Iberian Robotics Conference. AISC, vol. 418, 10.1007/978-3-319-27149-119 edn, pp. 235–246. Springer, Heidelberg (2016)CrossRef Ramon-Vigo, R., Perez-Higueras, N., Caballero, F., Merino, L.: Analyzing the relevance of features for a social navigation task. Robot 2015: Second Iberian Robotics Conference. AISC, vol. 418, 10.1007/978-3-319-27149-119 edn, pp. 235–246. Springer, Heidelberg (2016)CrossRef
16.
go back to reference Trautman, P., Krause, A.: Unfreezing the robot: Navigation in dense, interacting crowds. In: Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, pp. 797–803. IEEE (2010) Trautman, P., Krause, A.: Unfreezing the robot: Navigation in dense, interacting crowds. In: Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, pp. 797–803. IEEE (2010)
Metadata
Title
A Framework for Modelling Local Human-Robot Interactions Based on Unsupervised Learning
Authors
Rafael Ramón-Vigo
Noé Pérez-Higueras
Fernando Caballero
Luis Merino
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-47437-3_4

Premium Partner