Skip to main content
Top
Published in: International Journal of Social Robotics 5/2017

07-08-2017

Robust Regression-Based Motion Perception for Online Imitation on Humanoid Robot

Authors: Tehao Zhu, Qunfei Zhao, Weibing Wan, Zeyang Xia

Published in: International Journal of Social Robotics | Issue 5/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Kinect is frequently used as a capture device for perceiving human motion in human–robot interaction. However, the Kinect’s principle of capture makes it possible for outliers to be present in the raw 3D joint position data, yielding an unsatisfying motion imitation by a humanoid robot. To eliminate these outliers and improve the precision of motion perception, we are inspired from the principle of signal restoration and propose a robust regression-based refining algorithm. We made contributions mainly in designing an Arc Tangent Square function to estimate the tendency of motion trajectories, and constructing a stepwise robust regression strategy to successively refine the outliers hidden in the motion capture data. The motion trajectories refined by the proposed algorithm are 40, 10, and 30% better than the raw motion capture data on spatial similarity, temporal similarity, and smoothness, respectively. In the online implementation on a humanoid robot NAO, the imitated motions of the human’s upper limbs are synchronous and accurate. The proposed robust regression-based refining algorithm realizes high-performance motion perception for online imitation of the humanoid robot.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
4.
go back to reference Almetwally I, Mallem M (2013) Real-time tele-operation and tele-walking of humanoid robot nao using Kinect depth camera. In: 2013 10th IEEE international conference on networking, sensing and control (ICNSC). IEEE, Evry, pp 463–466 Almetwally I, Mallem M (2013) Real-time tele-operation and tele-walking of humanoid robot nao using Kinect depth camera. In: 2013 10th IEEE international conference on networking, sensing and control (ICNSC). IEEE, Evry, pp 463–466
6.
go back to reference Brown S (2013) Understanding machinima: essays on filmmaking in virtual worlds. Bloomsbury Academic, London Brown S (2013) Understanding machinima: essays on filmmaking in virtual worlds. Bloomsbury Academic, London
7.
go back to reference Do M, Azad P, Asfour T, Dillmann R (2008) Imitation of human motion on a humanoid robot using non-linear optimization. In: 2008 8th IEEE-RAS international conference on humanoid robots. IEEE, Daejeon, pp 545–552 Do M, Azad P, Asfour T, Dillmann R (2008) Imitation of human motion on a humanoid robot using non-linear optimization. In: 2008 8th IEEE-RAS international conference on humanoid robots. IEEE, Daejeon, pp 545–552
8.
go back to reference Edgeworth FY (1887) On observations relating to several quantities. Hermathena 6(13):279–285 Edgeworth FY (1887) On observations relating to several quantities. Hermathena 6(13):279–285
9.
go back to reference Fujimoto I, Matsumoto T, De Silva PRS, Kobayashi M, Higashi M (2011) Mimicking and evaluating human motion to improve the imitation skill of children with autism through a robot. Int J Soc Robot 3(4):349–357CrossRef Fujimoto I, Matsumoto T, De Silva PRS, Kobayashi M, Higashi M (2011) Mimicking and evaluating human motion to improve the imitation skill of children with autism through a robot. Int J Soc Robot 3(4):349–357CrossRef
10.
go back to reference Gall J, Rosenhahn B, Brox T, Seidel HP (2010) Optimization and filtering for human motion capture. Int J Comput Vis 87(1–2):75–92CrossRef Gall J, Rosenhahn B, Brox T, Seidel HP (2010) Optimization and filtering for human motion capture. Int J Comput Vis 87(1–2):75–92CrossRef
11.
go back to reference Gross AM (1977) Confidence intervals for bisquare regression estimates. J Am Stat Assoc 72(358):341–354CrossRefMATH Gross AM (1977) Confidence intervals for bisquare regression estimates. J Am Stat Assoc 72(358):341–354CrossRefMATH
12.
go back to reference Holland PW, Welsch RE (1977) Robust regression using iteratively reweighted least-squares. Commun Stat Theory Methods 6(9):813–827CrossRefMATH Holland PW, Welsch RE (1977) Robust regression using iteratively reweighted least-squares. Commun Stat Theory Methods 6(9):813–827CrossRefMATH
14.
go back to reference López-Méndez A, Alcoverro M, Pardàs M, Casas JR (2011) Real-time upper body tracking with online initialization using a range sensor. In: 2011 IEEE international conference on computer vision workshops (ICCV workshops). IEEE, pp 391–398 López-Méndez A, Alcoverro M, Pardàs M, Casas JR (2011) Real-time upper body tracking with online initialization using a range sensor. In: 2011 IEEE international conference on computer vision workshops (ICCV workshops). IEEE, pp 391–398
16.
go back to reference Luo RC, Shih BH, Lin TW (2013) Real time human motion imitation of anthropomorphic dual arm robot based on Cartesian impedance control. In: 2013 IEEE international symposium on robotic and sensors environments (ROSE). IEEE, Washington, DC, pp 25–30 Luo RC, Shih BH, Lin TW (2013) Real time human motion imitation of anthropomorphic dual arm robot based on Cartesian impedance control. In: 2013 IEEE international symposium on robotic and sensors environments (ROSE). IEEE, Washington, DC, pp 25–30
19.
go back to reference Muis A, Indrajit W (2012) Realistic motion preservation-imitation development through Kinect and humanoid robot. TELKOMNIKA 10(4):599–608CrossRef Muis A, Indrajit W (2012) Realistic motion preservation-imitation development through Kinect and humanoid robot. TELKOMNIKA 10(4):599–608CrossRef
20.
go back to reference Nguyen VV, Lee JH (2012) Full-body imitation of human motions with kinect and heterogeneous kinematic structure of humanoid robot. In: 2012 IEEE/SICE international symposium on system integration (SII 2012), Fukuoka, pp 93–98 Nguyen VV, Lee JH (2012) Full-body imitation of human motions with kinect and heterogeneous kinematic structure of humanoid robot. In: 2012 IEEE/SICE international symposium on system integration (SII 2012), Fukuoka, pp 93–98
21.
go back to reference Ou Y, Hu J, Wang Z, Fu Y, Wu X, Li X (2015) A real-time human imitation system using Kinect. Int J Soc Robot 7(5):587–600CrossRef Ou Y, Hu J, Wang Z, Fu Y, Wu X, Li X (2015) A real-time human imitation system using Kinect. Int J Soc Robot 7(5):587–600CrossRef
23.
go back to reference Roosink M, Robitaille N, McFadyen BJ, Hbert LJ, Jackson PL, Bouyer LJ, Mercier C (2015) Real-time modulation of visual feedback on human full-body movements in a virtual mirror: development and proof-of-concept. J Neuroeng Rehabil. doi:10.1186/1743-0003-12-2 Roosink M, Robitaille N, McFadyen BJ, Hbert LJ, Jackson PL, Bouyer LJ, Mercier C (2015) Real-time modulation of visual feedback on human full-body movements in a virtual mirror: development and proof-of-concept. J Neuroeng Rehabil. doi:10.​1186/​1743-0003-12-2
24.
go back to reference Rosado J, Silva F, Santos V (2014) A Kinect-based motion capture system for robotic gesture imitation. In: ROBOT2013: first Iberian robotics conference. Springer, Switzerland, pp 585–595 Rosado J, Silva F, Santos V (2014) A Kinect-based motion capture system for robotic gesture imitation. In: ROBOT2013: first Iberian robotics conference. Springer, Switzerland, pp 585–595
25.
go back to reference Stearns KM, Pollard CD (2013) Abnormal frontal plane knee mechanics during sidestep cutting in female soccer athletes after anterior cruciate ligament reconstruction and return to sport. Am J Sports Med. doi:10.1177/0363546513476853 Stearns KM, Pollard CD (2013) Abnormal frontal plane knee mechanics during sidestep cutting in female soccer athletes after anterior cruciate ligament reconstruction and return to sport. Am J Sports Med. doi:10.​1177/​0363546513476853​
26.
go back to reference Tan H, Kawamura K (2011) A computational framework for integrating robotic exploration and human demonstration in imitation learning. In: 2011 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, Anchorage, pp 2501–2506 Tan H, Kawamura K (2011) A computational framework for integrating robotic exploration and human demonstration in imitation learning. In: 2011 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, Anchorage, pp 2501–2506
27.
go back to reference Thobbi A, Sheng W (2010) Imitation learning of arm gestures in presence of missing data for humanoid robots. In: 2010 10th IEEE-RAS international conference on humanoid robots. IEEE, Nashville, pp 92–97 Thobbi A, Sheng W (2010) Imitation learning of arm gestures in presence of missing data for humanoid robots. In: 2010 10th IEEE-RAS international conference on humanoid robots. IEEE, Nashville, pp 92–97
28.
go back to reference Vakanski A, Mantegh I, Irish A, Janabi-Sharifi F (2012) Trajectory learning for robot programming by demonstration using hidden Markov model and dynamic time warping. IEEE Trans Syst Man Cybern B Cybern 42(4):1039–1052CrossRef Vakanski A, Mantegh I, Irish A, Janabi-Sharifi F (2012) Trajectory learning for robot programming by demonstration using hidden Markov model and dynamic time warping. IEEE Trans Syst Man Cybern B Cybern 42(4):1039–1052CrossRef
29.
go back to reference Xiao Y, Zhang Z, Beck A, Yuan J, Thalmann D (2014) Human–robot interaction by understanding upper body gestures. Presence Teleoper Virtual Environ 23(2):133–154CrossRef Xiao Y, Zhang Z, Beck A, Yuan J, Thalmann D (2014) Human–robot interaction by understanding upper body gestures. Presence Teleoper Virtual Environ 23(2):133–154CrossRef
30.
go back to reference Zhang L, Huang Q, Yang J, Shi Y, Wang Z (2007) Design of humanoid complicated dynamic motion with similarity considered. Acta Autom Sin 33(5):522–528MATH Zhang L, Huang Q, Yang J, Shi Y, Wang Z (2007) Design of humanoid complicated dynamic motion with similarity considered. Acta Autom Sin 33(5):522–528MATH
31.
go back to reference Zhang Z (1997) Parameter estimation techniques: a tutorial with application to conic fitting. Image Vis Comput 15(1):59–76CrossRef Zhang Z (1997) Parameter estimation techniques: a tutorial with application to conic fitting. Image Vis Comput 15(1):59–76CrossRef
33.
go back to reference Zhu T, Zhao Q, Xia Z (2014) A visual perception algorithm for human motion by a Kinect. Robot 36(6):647–653 Zhu T, Zhao Q, Xia Z (2014) A visual perception algorithm for human motion by a Kinect. Robot 36(6):647–653
Metadata
Title
Robust Regression-Based Motion Perception for Online Imitation on Humanoid Robot
Authors
Tehao Zhu
Qunfei Zhao
Weibing Wan
Zeyang Xia
Publication date
07-08-2017
Publisher
Springer Netherlands
Published in
International Journal of Social Robotics / Issue 5/2017
Print ISSN: 1875-4791
Electronic ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-017-0416-9

Other articles of this Issue 5/2017

International Journal of Social Robotics 5/2017 Go to the issue

Premium Partners