Skip to main content
Top

2016 | OriginalPaper | Chapter

Adaptation of Motor Primitives to the Environment Through Learning and Statistical Generalization

Authors : Miha Deniša, Aleš Ude, Andrej Gams

Published in: Advances in Robot Design and Intelligent Control

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper we propose a method of adapting motion to the environment based on force feedback. Our method combines two approaches of motor primitive adaptation. Starting from a single demonstration of motion, we use iterative learning control to adapt the motion to different conditions of the environment, for example, the height of the table. The adaptation is realized through coupling terms at the velocity level of a dynamic movement primitive, and acts as a feedforward component, predetermined for the given external condition. As adaptation to each condition takes several iterations, we combine this method with statistical generalization, employing Gaussian process regression. By generating a small database of coupling terms through iterative learning, we adapt to the environment by generalizing between the coupling terms in the database, thus either already achieving an appropriate coupling term for our demonstration trajectory or providing an initial estimate for the adaptation. Consequently, the learning doesn’t need to be executed for every condition of the environment, but only for a small set. In the paper we provide the details of the method and evaluate it in a simulated setting for the use case of placing a glass on a table.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Dillmann, R.: Teaching and learning of robot tasks via observation of human performance. Robot. Auton. Syst. 47(2–3), 109–116 (2004)CrossRef Dillmann, R.: Teaching and learning of robot tasks via observation of human performance. Robot. Auton. Syst. 47(2–3), 109–116 (2004)CrossRef
2.
go back to reference Kober, J., Bagnell, D., Peters, J.: Reinforcement learning in robotics: a survey. Int. J. Robot. Res. 32(11), 1238–1274 (2013)CrossRef Kober, J., Bagnell, D., Peters, J.: Reinforcement learning in robotics: a survey. Int. J. Robot. Res. 32(11), 1238–1274 (2013)CrossRef
3.
go back to reference Stulp, F., Sigaud, O.: Robot skill learning: from reinforcement learning to evolution strategies. Paladyn. J. Behav. Robot. 4(1), 49–61 (2013) Stulp, F., Sigaud, O.: Robot skill learning: from reinforcement learning to evolution strategies. Paladyn. J. Behav. Robot. 4(1), 49–61 (2013)
4.
go back to reference Ijspeert, A., Nakanishi, J., Pastor, P., Hoffmann, H., Schaal, S.: Dynamical movement primitives: learning attractor models for motor behaviors. Neural Comput. 25(2), 328–373 (2013)MathSciNetCrossRefMATH Ijspeert, A., Nakanishi, J., Pastor, P., Hoffmann, H., Schaal, S.: Dynamical movement primitives: learning attractor models for motor behaviors. Neural Comput. 25(2), 328–373 (2013)MathSciNetCrossRefMATH
5.
go back to reference Tamosiunaite, M., Nemec, B., Ude, A., Woergoetter, F.: Learning to pour with a robot arm combining goal and shape learning for dynamic movement primitives. Robot. Auton. Syst. 59(11), 910–922 (2011)CrossRef Tamosiunaite, M., Nemec, B., Ude, A., Woergoetter, F.: Learning to pour with a robot arm combining goal and shape learning for dynamic movement primitives. Robot. Auton. Syst. 59(11), 910–922 (2011)CrossRef
6.
go back to reference Bristow, D., Tharayil, M., Alleyne, A.: A survey of iterative learning control. IEEE Control Syst. Mag. 26(3), 96–114 (2006)CrossRef Bristow, D., Tharayil, M., Alleyne, A.: A survey of iterative learning control. IEEE Control Syst. Mag. 26(3), 96–114 (2006)CrossRef
7.
go back to reference Gams, A., Nemec, B., Ijspeert, A., Ude, A.: Coupling movement primitives: interaction with the environment and bimanual tasks. IEEE Trans. Rob. 30(4), 816–830 (2014)CrossRef Gams, A., Nemec, B., Ijspeert, A., Ude, A.: Coupling movement primitives: interaction with the environment and bimanual tasks. IEEE Trans. Rob. 30(4), 816–830 (2014)CrossRef
8.
go back to reference Ude, A., Gams, A., Asfour, T., Morimoto, J.: Task-specific generalization of discrete and periodic dynamic movement primitives. IEEE Trans. Rob. 26(5), 800–815 (2010)CrossRef Ude, A., Gams, A., Asfour, T., Morimoto, J.: Task-specific generalization of discrete and periodic dynamic movement primitives. IEEE Trans. Rob. 26(5), 800–815 (2010)CrossRef
9.
go back to reference Forte, D., Gams, A., Morimoto, J., Ude, A.: On-line motion synthesis and adaptation using a trajectory database. Robot. Auton. Syst. 60(10), 1327–1339 (2012)CrossRef Forte, D., Gams, A., Morimoto, J., Ude, A.: On-line motion synthesis and adaptation using a trajectory database. Robot. Auton. Syst. 60(10), 1327–1339 (2012)CrossRef
10.
go back to reference Deniša, M., Ude, A.: Discovering new motor primitives in transition graphs. In: Intelligent Autonomous Systems, vol. 12, pp. 219–230. Springer, Heidelberg (2013) Deniša, M., Ude, A.: Discovering new motor primitives in transition graphs. In: Intelligent Autonomous Systems, vol. 12, pp. 219–230. Springer, Heidelberg (2013)
11.
go back to reference Pastor, P., Righetti, L., Kalakrishnan, M., Schaal, S.: Online movement adaptation based on previous sensor experiences. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 365–371. IEEE Press, San Francisco (2011) Pastor, P., Righetti, L., Kalakrishnan, M., Schaal, S.: Online movement adaptation based on previous sensor experiences. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 365–371. IEEE Press, San Francisco (2011)
12.
go back to reference Rasmussen, C., Williams, C.: Gaussian processes for machine learning. MIT Press, Cambridge (2006)MATH Rasmussen, C., Williams, C.: Gaussian processes for machine learning. MIT Press, Cambridge (2006)MATH
Metadata
Title
Adaptation of Motor Primitives to the Environment Through Learning and Statistical Generalization
Authors
Miha Deniša
Aleš Ude
Andrej Gams
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-21290-6_45