Skip to main content

2016 | OriginalPaper | Buchkapitel

Adaptation of Motor Primitives to the Environment Through Learning and Statistical Generalization

verfasst von : Miha Deniša, Aleš Ude, Andrej Gams

Erschienen in: Advances in Robot Design and Intelligent Control

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper we propose a method of adapting motion to the environment based on force feedback. Our method combines two approaches of motor primitive adaptation. Starting from a single demonstration of motion, we use iterative learning control to adapt the motion to different conditions of the environment, for example, the height of the table. The adaptation is realized through coupling terms at the velocity level of a dynamic movement primitive, and acts as a feedforward component, predetermined for the given external condition. As adaptation to each condition takes several iterations, we combine this method with statistical generalization, employing Gaussian process regression. By generating a small database of coupling terms through iterative learning, we adapt to the environment by generalizing between the coupling terms in the database, thus either already achieving an appropriate coupling term for our demonstration trajectory or providing an initial estimate for the adaptation. Consequently, the learning doesn’t need to be executed for every condition of the environment, but only for a small set. In the paper we provide the details of the method and evaluate it in a simulated setting for the use case of placing a glass on a table.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Dillmann, R.: Teaching and learning of robot tasks via observation of human performance. Robot. Auton. Syst. 47(2–3), 109–116 (2004)CrossRef Dillmann, R.: Teaching and learning of robot tasks via observation of human performance. Robot. Auton. Syst. 47(2–3), 109–116 (2004)CrossRef
2.
Zurück zum Zitat Kober, J., Bagnell, D., Peters, J.: Reinforcement learning in robotics: a survey. Int. J. Robot. Res. 32(11), 1238–1274 (2013)CrossRef Kober, J., Bagnell, D., Peters, J.: Reinforcement learning in robotics: a survey. Int. J. Robot. Res. 32(11), 1238–1274 (2013)CrossRef
3.
Zurück zum Zitat Stulp, F., Sigaud, O.: Robot skill learning: from reinforcement learning to evolution strategies. Paladyn. J. Behav. Robot. 4(1), 49–61 (2013) Stulp, F., Sigaud, O.: Robot skill learning: from reinforcement learning to evolution strategies. Paladyn. J. Behav. Robot. 4(1), 49–61 (2013)
4.
Zurück zum Zitat Ijspeert, A., Nakanishi, J., Pastor, P., Hoffmann, H., Schaal, S.: Dynamical movement primitives: learning attractor models for motor behaviors. Neural Comput. 25(2), 328–373 (2013)MathSciNetCrossRefMATH Ijspeert, A., Nakanishi, J., Pastor, P., Hoffmann, H., Schaal, S.: Dynamical movement primitives: learning attractor models for motor behaviors. Neural Comput. 25(2), 328–373 (2013)MathSciNetCrossRefMATH
5.
Zurück zum Zitat Tamosiunaite, M., Nemec, B., Ude, A., Woergoetter, F.: Learning to pour with a robot arm combining goal and shape learning for dynamic movement primitives. Robot. Auton. Syst. 59(11), 910–922 (2011)CrossRef Tamosiunaite, M., Nemec, B., Ude, A., Woergoetter, F.: Learning to pour with a robot arm combining goal and shape learning for dynamic movement primitives. Robot. Auton. Syst. 59(11), 910–922 (2011)CrossRef
6.
Zurück zum Zitat Bristow, D., Tharayil, M., Alleyne, A.: A survey of iterative learning control. IEEE Control Syst. Mag. 26(3), 96–114 (2006)CrossRef Bristow, D., Tharayil, M., Alleyne, A.: A survey of iterative learning control. IEEE Control Syst. Mag. 26(3), 96–114 (2006)CrossRef
7.
Zurück zum Zitat Gams, A., Nemec, B., Ijspeert, A., Ude, A.: Coupling movement primitives: interaction with the environment and bimanual tasks. IEEE Trans. Rob. 30(4), 816–830 (2014)CrossRef Gams, A., Nemec, B., Ijspeert, A., Ude, A.: Coupling movement primitives: interaction with the environment and bimanual tasks. IEEE Trans. Rob. 30(4), 816–830 (2014)CrossRef
8.
Zurück zum Zitat Ude, A., Gams, A., Asfour, T., Morimoto, J.: Task-specific generalization of discrete and periodic dynamic movement primitives. IEEE Trans. Rob. 26(5), 800–815 (2010)CrossRef Ude, A., Gams, A., Asfour, T., Morimoto, J.: Task-specific generalization of discrete and periodic dynamic movement primitives. IEEE Trans. Rob. 26(5), 800–815 (2010)CrossRef
9.
Zurück zum Zitat Forte, D., Gams, A., Morimoto, J., Ude, A.: On-line motion synthesis and adaptation using a trajectory database. Robot. Auton. Syst. 60(10), 1327–1339 (2012)CrossRef Forte, D., Gams, A., Morimoto, J., Ude, A.: On-line motion synthesis and adaptation using a trajectory database. Robot. Auton. Syst. 60(10), 1327–1339 (2012)CrossRef
10.
Zurück zum Zitat Deniša, M., Ude, A.: Discovering new motor primitives in transition graphs. In: Intelligent Autonomous Systems, vol. 12, pp. 219–230. Springer, Heidelberg (2013) Deniša, M., Ude, A.: Discovering new motor primitives in transition graphs. In: Intelligent Autonomous Systems, vol. 12, pp. 219–230. Springer, Heidelberg (2013)
11.
Zurück zum Zitat Pastor, P., Righetti, L., Kalakrishnan, M., Schaal, S.: Online movement adaptation based on previous sensor experiences. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 365–371. IEEE Press, San Francisco (2011) Pastor, P., Righetti, L., Kalakrishnan, M., Schaal, S.: Online movement adaptation based on previous sensor experiences. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 365–371. IEEE Press, San Francisco (2011)
12.
Zurück zum Zitat Rasmussen, C., Williams, C.: Gaussian processes for machine learning. MIT Press, Cambridge (2006)MATH Rasmussen, C., Williams, C.: Gaussian processes for machine learning. MIT Press, Cambridge (2006)MATH
Metadaten
Titel
Adaptation of Motor Primitives to the Environment Through Learning and Statistical Generalization
verfasst von
Miha Deniša
Aleš Ude
Andrej Gams
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-21290-6_45