Skip to main content
Erschienen in: Autonomous Robots 2/2020

23.10.2019

Learning quasi-periodic robot motions from demonstration

verfasst von: Xiao Li, Hongtai Cheng, Heping Chen, Jiaming Chen

Erschienen in: Autonomous Robots | Ausgabe 2/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The goal of Learning from Demonstration is to automatically transfer the skill knowledge from human to robot. Current researches focus on the problem of modeling aperiodic/periodic robot motions and extracting dynamic task parameters from the recorded sensory information. However, it is still not adequate for describing complex behaviors in an unstructured environment, such as searching for an unknown fitting position or painting/polishing an irregular surface. The quasi-periodic and stochastic properties cause a high demand for generalization ability of the modeling techniques. This paper proposes a systematic framework for learning quasi-periodic robot motions, which contains three steps: decomposition, modeling, and synthesization. Firstly FFT transform is performed to identify all the frequencies in the quasi-periodic motion. Then the motion is decomposed into an offset component, a series of harmonic and corresponding envelop components based on the concept of equivalent transformation. The offset component is extracted by Empirical Mode Decomposition, harmonic is separated by notch filter, and envelope component is extracted by Hilbert Transform. These components are either periodic or aperiodic. The aperiodic motions can be modeled by conventional techniques such as Gaussian Mixture Model and recovered by Gaussian Mixture Regression. The periodic motions are modeled in closed-form expressions. Finally, they are synthesized together to regenerate the robot motion. This modeling process captures both the aperiodicity and periodicity of a quasi-periodic motion. Simulation and experiment show that the proposed methods are feasible, effective and can predict robot motions beyond demonstrations. With this generalization ability, it is able to reduce the programming difficulty and demonstration complexity.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009). A survey of robot learning from demonstration. Robotics & Autonomous Systems, 57(5), 469.CrossRef Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009). A survey of robot learning from demonstration. Robotics & Autonomous Systems, 57(5), 469.CrossRef
Zurück zum Zitat Asakawa, N., & Takeuchi, Y. (1997). In Proceedings of international conference on robotics and automation (vol. 3, pp. 1875–1879). Asakawa, N., & Takeuchi, Y. (1997). In Proceedings of international conference on robotics and automation (vol. 3, pp. 1875–1879).
Zurück zum Zitat Billard, A., Epars, Y., Calinon, S., Schaal, S., & Cheng, G. (2004). Discovering optimal imitation strategies. Robotics and Autonomous Systems, 47(2), 69. Robot Learning from Demonstration.CrossRef Billard, A., Epars, Y., Calinon, S., Schaal, S., & Cheng, G. (2004). Discovering optimal imitation strategies. Robotics and Autonomous Systems, 47(2), 69. Robot Learning from Demonstration.CrossRef
Zurück zum Zitat Billard, A., & Hayes, G. M. (1999). Drama, a connectionist architecture for control and learning in autonomous robots. Adaptive Behavior, 7(1), 35.CrossRef Billard, A., & Hayes, G. M. (1999). Drama, a connectionist architecture for control and learning in autonomous robots. Adaptive Behavior, 7(1), 35.CrossRef
Zurück zum Zitat Böckmann, A. (2017). T. Laue. In S. Behnke, R. Sheh, S. Sarıel, & D. D. Lee (Eds.), RoboCup 2016: robot world cup XX (pp. 33–44). Cham: Springer International Publishing.CrossRef Böckmann, A. (2017). T. Laue. In S. Behnke, R. Sheh, S. Sarıel, & D. D. Lee (Eds.), RoboCup 2016: robot world cup XX (pp. 33–44). Cham: Springer International Publishing.CrossRef
Zurück zum Zitat Calinon, S. (2016). A tutorial on task-parameterized movement learning and retrieval. Intelligent Service Robotics, 9(1), 1.CrossRef Calinon, S. (2016). A tutorial on task-parameterized movement learning and retrieval. Intelligent Service Robotics, 9(1), 1.CrossRef
Zurück zum Zitat Calinon, S., Guenter, F., & Billard, A. (2007). On learning, representing, and generalizing a task in a humanoid robot. Piscataway: IEEE Press.CrossRef Calinon, S., Guenter, F., & Billard, A. (2007). On learning, representing, and generalizing a task in a humanoid robot. Piscataway: IEEE Press.CrossRef
Zurück zum Zitat Chen, H., Cheng, H., Liu, J., Zhang, B., Zhang, G., & Fuhlbrigge, T. (2013). In: 2013 IEEE international conference on automation science and engineering (CASE), (pp. 540–545). 10.1109/CoASE.2013.6653989 Chen, H., Cheng, H., Liu, J., Zhang, B., Zhang, G., & Fuhlbrigge, T. (2013). In: 2013 IEEE international conference on automation science and engineering (CASE), (pp. 540–545). 10.1109/CoASE.2013.6653989
Zurück zum Zitat Chen, H., Wang, J., Zhang, G., & Fuhlbrigge, T., & Kock, S. (2008). In 2008 IEEE conference on robotics, automation and mechatronics (pp. 24–29). Chen, H., Wang, J., Zhang, G., & Fuhlbrigge, T., & Kock, S. (2008). In 2008 IEEE conference on robotics, automation and mechatronics (pp. 24–29).
Zurück zum Zitat Chen, H., & Xi, N. (2012). Automated robot tool trajectory connection for spray forming process. Journal of Manufacturing Science & Engineering, 134(2), 021017.CrossRef Chen, H., & Xi, N. (2012). Automated robot tool trajectory connection for spray forming process. Journal of Manufacturing Science & Engineering, 134(2), 021017.CrossRef
Zurück zum Zitat Chen, H., Xi, N., Sheng, W., & Chen, Y. (2005). General framework of optimal tool trajectory planning for free-form surfaces in surface manufacturing. Journal of Manufacturing Science & Engineering, 127(1), 49.CrossRef Chen, H., Xi, N., Sheng, W., & Chen, Y. (2005). General framework of optimal tool trajectory planning for free-form surfaces in surface manufacturing. Journal of Manufacturing Science & Engineering, 127(1), 49.CrossRef
Zurück zum Zitat Daji, H., Jinping, Z., & Jilan, S. (2003). Practical implementation of the hilbert–huang transform algorithm. Acta Oceanologica Sinica, 25(1), 1–11. Daji, H., Jinping, Z., & Jilan, S. (2003). Practical implementation of the hilbert–huang transform algorithm. Acta Oceanologica Sinica, 25(1), 1–11.
Zurück zum Zitat Feldman, M. (2011). Hilbert transform applications in mechanical vibration. Hoboken: Wiley.CrossRef Feldman, M. (2011). Hilbert transform applications in mechanical vibration. Hoboken: Wiley.CrossRef
Zurück zum Zitat Graeve, K., Stueckler, J., & Behnke, S. (2011). Robotics, 1–8. Graeve, K., Stueckler, J., & Behnke, S. (2011). Robotics, 1–8.
Zurück zum Zitat Gu, Y., Sheng, W., Crick, C., & Ou, Y. (2018). Automated assembly skill acquisition and implementation through human demonstration. Robotics and Autonomous Systems, 99, 1.CrossRef Gu, Y., Sheng, W., Crick, C., & Ou, Y. (2018). Automated assembly skill acquisition and implementation through human demonstration. Robotics and Autonomous Systems, 99, 1.CrossRef
Zurück zum Zitat Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., et al. (1998). The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings Mathematical Physical & Engineering Sciences, 454(1971), 903.MathSciNetMATHCrossRef Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., et al. (1998). The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings Mathematical Physical & Engineering Sciences, 454(1971), 903.MathSciNetMATHCrossRef
Zurück zum Zitat Ijspeert, A. (2003). Learning attractor landscapes for learning motor primitives. Neural Information Processing Systems, 15, 1523. Ijspeert, A. (2003). Learning attractor landscapes for learning motor primitives. Neural Information Processing Systems, 15, 1523.
Zurück zum Zitat Kharidege, A., Du, T. T., & Zhang, Y. (2017). A practical approach for automated polishing system of freeform surface path generation based on industrial arm robot. International Journal of Advanced Manufacturing Technology, 1, 1. Kharidege, A., Du, T. T., & Zhang, Y. (2017). A practical approach for automated polishing system of freeform surface path generation based on industrial arm robot. International Journal of Advanced Manufacturing Technology, 1, 1.
Zurück zum Zitat Lee, S. H., Suh, I. H., Calinon, S., & Johansson, R. (2015). Autonomous framework for segmenting robot trajectories of manipulation task. Autonomous Robots, 38(2), 107.CrossRef Lee, S. H., Suh, I. H., Calinon, S., & Johansson, R. (2015). Autonomous framework for segmenting robot trajectories of manipulation task. Autonomous Robots, 38(2), 107.CrossRef
Zurück zum Zitat Levitan, B. M., & Zhikov, V. V. (1982). Almost periodic functions and differential equations. Cambridge: Cambridge University Press.MATH Levitan, B. M., & Zhikov, V. V. (1982). Almost periodic functions and differential equations. Cambridge: Cambridge University Press.MATH
Zurück zum Zitat Marvel, J. A., Newman, W. S., Gravel, D. P. Zhang, G., Wang, J., & Fuhlbrigge, T. (2009). In: IEEE international conference on robotics & biomimetics. Marvel, J. A., Newman, W. S., Gravel, D. P. Zhang, G., Wang, J., & Fuhlbrigge, T. (2009). In: IEEE international conference on robotics & biomimetics.
Zurück zum Zitat Meng, F. (2008). Trajectory and spray control planning on unknown 3d surfaces for industrial spray painting robot, Dissertations & Theses Gradworks. Meng, F. (2008). Trajectory and spray control planning on unknown 3d surfaces for industrial spray painting robot, Dissertations & Theses Gradworks.
Zurück zum Zitat Moghtaderi, A., Flandrin, P., & Borgnat, P. (2013). Trend filtering via empirical mode decompositions. Computational Statistics & Data Analysis, 58(1), 114.MathSciNetMATHCrossRef Moghtaderi, A., Flandrin, P., & Borgnat, P. (2013). Trend filtering via empirical mode decompositions. Computational Statistics & Data Analysis, 58(1), 114.MathSciNetMATHCrossRef
Zurück zum Zitat Nagata, F., Watanabe, K., & Izumi, K. (2001). In: 2001 Proceedings on IEEE international conference on robotics and automation, (vol. 1, pp. 319–324). Nagata, F., Watanabe, K., & Izumi, K. (2001). In: 2001 Proceedings on IEEE international conference on robotics and automation, (vol. 1, pp. 319–324).
Zurück zum Zitat Nehorai, A. (1985). A minimal parameter adaptive notch filter with constrained poles and zeros. IEEE Transactions on Acoustics, Speech, and Signal Processing, 33(4), 983.CrossRef Nehorai, A. (1985). A minimal parameter adaptive notch filter with constrained poles and zeros. IEEE Transactions on Acoustics, Speech, and Signal Processing, 33(4), 983.CrossRef
Zurück zum Zitat Patterson, A. L. (1934). A fourier series method for the determination of the components of interatomic distances in crystals. Physical Review, 46, 372.MATHCrossRef Patterson, A. L. (1934). A fourier series method for the determination of the components of interatomic distances in crystals. Physical Review, 46, 372.MATHCrossRef
Zurück zum Zitat Potkonjak, V., Đorđević, G. S., Kostić, D., & Rašić, M. (2000). Dynamics of anthropomorphic painting robot Quality analysis and cost reduction. Robotics and Autonomous Systems, 32(1), 17.CrossRef Potkonjak, V., Đorđević, G. S., Kostić, D., & Rašić, M. (2000). Dynamics of anthropomorphic painting robot Quality analysis and cost reduction. Robotics and Autonomous Systems, 32(1), 17.CrossRef
Zurück zum Zitat Regalia, P. A. (1991). An improved lattice-based adaptive iir notch filter. IEEE Transactions on Signal Processing, 39(9), 2124.CrossRef Regalia, P. A. (1991). An improved lattice-based adaptive iir notch filter. IEEE Transactions on Signal Processing, 39(9), 2124.CrossRef
Zurück zum Zitat Reiley, C. E., Plaku, E., & Hager, G. D. (2010). In: International conference of the ieee engineering in medicine and biology, (pp. 967–970). Reiley, C. E., Plaku, E., & Hager, G. D. (2010). In: International conference of the ieee engineering in medicine and biology, (pp. 967–970).
Zurück zum Zitat Schaal, S. (2006). Dynamic movement primitives a framework for motor control in humans and humanoid robotics. Tokyo: Springer.CrossRef Schaal, S. (2006). Dynamic movement primitives a framework for motor control in humans and humanoid robotics. Tokyo: Springer.CrossRef
Zurück zum Zitat Schneider, M., & Ertel, W. (2010). Ieee/rsj international conference on intelligent robots and systems, (pp. 255–260). Schneider, M., & Ertel, W. (2010). Ieee/rsj international conference on intelligent robots and systems, (pp. 255–260).
Zurück zum Zitat Suh, S. H., Woo, I. K., & Noh, S. K. (1991). Automatic trajectory planning system (atps) for spray painting robots. Journal of Manufacturing Systems, 10(5), 396.CrossRef Suh, S. H., Woo, I. K., & Noh, S. K. (1991). Automatic trajectory planning system (atps) for spray painting robots. Journal of Manufacturing Systems, 10(5), 396.CrossRef
Zurück zum Zitat Tam, H. Y., Lui, C. H., & Mok, A. C. K. (1999). Robotic polishing of freeform surfaces using scanning paths. Journal of Materials Processing Technology, 95(1), 191.CrossRef Tam, H. Y., Lui, C. H., & Mok, A. C. K. (1999). Robotic polishing of freeform surfaces using scanning paths. Journal of Materials Processing Technology, 95(1), 191.CrossRef
Zurück zum Zitat Tow, A. W., Sünderhauf, N., Shirazi, S., Milford, M., & Leitner, J. (2017). What would you do? acting by learning to predict, CoRR arXiv:1703.02658 Tow, A. W., Sünderhauf, N., Shirazi, S., Milford, M., & Leitner, J. (2017). What would you do? acting by learning to predict, CoRR arXiv:​1703.​02658
Zurück zum Zitat Vuković, N., Mitić, M., & Miljković, Z. (2015). Trajectory learning and reproduction for differential drive mobile robots based on gmm/hmm and dynamic time warping using learning from demonstration framework. Engineering Applications of Artificial Intelligence, 45, 388.CrossRef Vuković, N., Mitić, M., & Miljković, Z. (2015). Trajectory learning and reproduction for differential drive mobile robots based on gmm/hmm and dynamic time warping using learning from demonstration framework. Engineering Applications of Artificial Intelligence, 45, 388.CrossRef
Zurück zum Zitat Webb, W. T. (1994). Modern quadrature amplitude modulation: Principles and applications for fixed and wireless channels. Piscataway: IEEE Press. Webb, W. T. (1994). Modern quadrature amplitude modulation: Principles and applications for fixed and wireless channels. Piscataway: IEEE Press.
Zurück zum Zitat Wu, Z., & Huang, N. E. (2004). A study of the characteristics of white noise using the empirical mode decomposition method. Proceedings of the Royal Society of London A: Mathematical, Physical and Engineering Sciences, 460(2046), 1597.MATHCrossRef Wu, Z., & Huang, N. E. (2004). A study of the characteristics of white noise using the empirical mode decomposition method. Proceedings of the Royal Society of London A: Mathematical, Physical and Engineering Sciences, 460(2046), 1597.MATHCrossRef
Zurück zum Zitat Wulfmeier, M., Rao, D., Wang, D. Z., Ondruska, P., & Posner, I. (2017). Large-scale cost function learning for path planning using deep inverse reinforcement learning. The International Journal of Robotics Research, 36(10), 1073.CrossRef Wulfmeier, M., Rao, D., Wang, D. Z., Ondruska, P., & Posner, I. (2017). Large-scale cost function learning for path planning using deep inverse reinforcement learning. The International Journal of Robotics Research, 36(10), 1073.CrossRef
Zurück zum Zitat Zeng, Y., Gong, J., & Ning, H. (2011). in International conference on electric information and control engineering (pp. 5570–5573). Zeng, Y., Gong, J., & Ning, H. (2011). in International conference on electric information and control engineering (pp. 5570–5573).
Zurück zum Zitat Zhang, B., Gravel, D., Zhang, B., Wang, J., & Bell, A. (2011). In IEEE international conference on robotics and automation, ICRA 2011, Shanghai, China, 9–13 May (pp. 464–469). Zhang, B., Gravel, D., Zhang, B., Wang, J., & Bell, A. (2011). In IEEE international conference on robotics and automation, ICRA 2011, Shanghai, China, 9–13 May (pp. 464–469).
Metadaten
Titel
Learning quasi-periodic robot motions from demonstration
verfasst von
Xiao Li
Hongtai Cheng
Heping Chen
Jiaming Chen
Publikationsdatum
23.10.2019
Verlag
Springer US
Erschienen in
Autonomous Robots / Ausgabe 2/2020
Print ISSN: 0929-5593
Elektronische ISSN: 1573-7527
DOI
https://doi.org/10.1007/s10514-019-09891-y

Weitere Artikel der Ausgabe 2/2020

Autonomous Robots 2/2020 Zur Ausgabe

Neuer Inhalt