Skip to main content
Erschienen in: KI - Künstliche Intelligenz 2/2020

27.05.2020 | Technical Contribution

ITP: Inverse Trajectory Planning for Human Pose Prediction

verfasst von: Pedro A. Peña, Ubbo Visser

Erschienen in: KI - Künstliche Intelligenz | Ausgabe 2/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Tracking and predicting humans in three dimensional space in order to know the location and heading of the human in the environment is a difficult task. Though if solved it will allow a robotic agent to know where it can safely be and navigate the environment without imposing any danger to the human that it is interacting with. We propose a novel probabilistic framework for robotic systems in which multiple models can be fused into a circular probabilitymap to forecast human poses. We developed and implemented the framework and tested it on Toyota’s HSR robot and Waymo Open Dataset. Our experiments show promising results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

KI - Künstliche Intelligenz

The Scientific journal "KI – Künstliche Intelligenz" is the official journal of the division for artificial intelligence within the "Gesellschaft für Informatik e.V." (GI) – the German Informatics Society - with constributions from troughout the field of artificial intelligence.

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Busch B, Grizou J, Lopes M, Stulp F (2017) Learning legible motion from human–robot interactions. Int J Social Robot 9(5):765–779CrossRef Busch B, Grizou J, Lopes M, Stulp F (2017) Learning legible motion from human–robot interactions. Int J Social Robot 9(5):765–779CrossRef
3.
Zurück zum Zitat Cao Z, Hidalgo G, Simon T, Wei SE, Sheikh Y (2018) OpenPose: realtime multi-person 2D pose estimation using part affinity fields. arXiv:1812.08008(arXiv preprint) Cao Z, Hidalgo G, Simon T, Wei SE, Sheikh Y (2018) OpenPose: realtime multi-person 2D pose estimation using part affinity fields. arXiv:​1812.​08008(arXiv preprint)
4.
Zurück zum Zitat Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2D pose estimation using part affinity fields. In: CVPR Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2D pose estimation using part affinity fields. In: CVPR
6.
Zurück zum Zitat Dermy O, Charpillet F, Ivaldi S (2019) Multi-modal intention prediction with probabilistic movement primitives. In: Ficuciello F, Ruggiero F, Finzi A (eds) Human friendly robotics. Springer, Cham, pp 181–196CrossRef Dermy O, Charpillet F, Ivaldi S (2019) Multi-modal intention prediction with probabilistic movement primitives. In: Ficuciello F, Ruggiero F, Finzi A (eds) Human friendly robotics. Springer, Cham, pp 181–196CrossRef
7.
Zurück zum Zitat Dermy O, Chaveroche M, Colas F, Charpillet F, Ivaldi S (2018) Prediction of human whole-body movements with AE-ProMPs. In: 2018 IEEE-RAS 18th international conference on humanoid robots (humanoids), pp 572–579. IEEE Dermy O, Chaveroche M, Colas F, Charpillet F, Ivaldi S (2018) Prediction of human whole-body movements with AE-ProMPs. In: 2018 IEEE-RAS 18th international conference on humanoid robots (humanoids), pp 572–579. IEEE
9.
Zurück zum Zitat Dragan AD, Lee KCT, Srinivasa SS (2013) Legibility and predictability of robot motion. In: 2013 8th ACM/IEEE international conference on human–robot interaction (HRI), pp 301–308 Dragan AD, Lee KCT, Srinivasa SS (2013) Legibility and predictability of robot motion. In: 2013 8th ACM/IEEE international conference on human–robot interaction (HRI), pp 301–308
10.
Zurück zum Zitat Edsinger A, Kemp CC (2007) Human–robot interaction for cooperative manipulation: handing objects to one another. In: RO-MAN 2007—the 16th ieee international symposium on robot and human interactive communication, pp 1167–1172 Edsinger A, Kemp CC (2007) Human–robot interaction for cooperative manipulation: handing objects to one another. In: RO-MAN 2007—the 16th ieee international symposium on robot and human interactive communication, pp 1167–1172
12.
Zurück zum Zitat Ferrer G, Garrell A, Sanfeliu A (2013) Robot companion: a social-force based approach with human awareness-navigation in crowded environments. In: 2013 IEEE/RSJ international conference on intelligent robots and systems, pp 1688–1694 Ferrer G, Garrell A, Sanfeliu A (2013) Robot companion: a social-force based approach with human awareness-navigation in crowded environments. In: 2013 IEEE/RSJ international conference on intelligent robots and systems, pp 1688–1694
14.
Zurück zum Zitat Fisac JF, Bajcsy A, Herbert SL, Fridovich-Keil D, Wang S, Tomlin CJ, Dragan AD (2018) Probabilistically safe robot planning with confidence-based human predictions Fisac JF, Bajcsy A, Herbert SL, Fridovich-Keil D, Wang S, Tomlin CJ, Dragan AD (2018) Probabilistically safe robot planning with confidence-based human predictions
15.
Zurück zum Zitat Fridovich-Keil D, Bajcsy A, Fisac JF, Herbert SL, Wang S, Dragan AD, Tomlin CJ (2019) Confidence-aware motion prediction for real-time collision avoidance. Int J Robot Res 20:0278364919859436 Fridovich-Keil D, Bajcsy A, Fisac JF, Herbert SL, Wang S, Dragan AD, Tomlin CJ (2019) Confidence-aware motion prediction for real-time collision avoidance. Int J Robot Res 20:0278364919859436
16.
Zurück zum Zitat Gopalakrishnan A, Mali A, Kifer D, Giles L, Ororbia AG (2019) A neural temporal model for human motion prediction. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp 12108–12117 Gopalakrishnan A, Mali A, Kifer D, Giles L, Ororbia AG (2019) A neural temporal model for human motion prediction. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp 12108–12117
19.
Zurück zum Zitat Henry P, Vollmer C, Ferris B, Fox D (2010) Learning to navigate through crowded environments. In: 2010 IEEE international conference on robotics and automation. IEEE, pp 981–986 Henry P, Vollmer C, Ferris B, Fox D (2010) Learning to navigate through crowded environments. In: 2010 IEEE international conference on robotics and automation. IEEE, pp 981–986
21.
Zurück zum Zitat Kitani KM, Ziebart BD, Bagnell JA, Hebert M (2012) Activity forecasting. In: Fitzgibbon A, Lazebnik S, Perona P, Sato Y, Schmid C (eds) Computer vision—ECCV 2012. Springer, Berlin, pp 201–214CrossRef Kitani KM, Ziebart BD, Bagnell JA, Hebert M (2012) Activity forecasting. In: Fitzgibbon A, Lazebnik S, Perona P, Sato Y, Schmid C (eds) Computer vision—ECCV 2012. Springer, Berlin, pp 201–214CrossRef
23.
Zurück zum Zitat Mainprice J, Berenson D (2013) Human–robot collaborative manipulation planning using early prediction of human motion. In: 2013 IEEE/RSJ international conference on intelligent robots and systems, pp 299–306 Mainprice J, Berenson D (2013) Human–robot collaborative manipulation planning using early prediction of human motion. In: 2013 IEEE/RSJ international conference on intelligent robots and systems, pp 299–306
24.
Zurück zum Zitat Mindermann S, Armstrong S (2018) Occam’s razor is insufficient to infer the preferences of irrational agents. In: Proceedings of the 32nd international conference on neural information processing systems, NIPS’18. Curran Associates Inc., Red Hook, NY, USA, pp 5603–5614 Mindermann S, Armstrong S (2018) Occam’s razor is insufficient to infer the preferences of irrational agents. In: Proceedings of the 32nd international conference on neural information processing systems, NIPS’18. Curran Associates Inc., Red Hook, NY, USA, pp 5603–5614
25.
Zurück zum Zitat Park JS, Park C, Manocha D (2019) I-Planner: intention-aware motion planning using learning-based human motion prediction. Int J Robot Res 38(1):23–39CrossRef Park JS, Park C, Manocha D (2019) I-Planner: intention-aware motion planning using learning-based human motion prediction. Int J Robot Res 38(1):23–39CrossRef
26.
Zurück zum Zitat Peña P (2019) An omni-directional kick engine for NAO humanoid robots. Master’s thesis, University of Miami, 1365 Memorial Drive Coral Gables, FL. 33146 Peña P (2019) An omni-directional kick engine for NAO humanoid robots. Master’s thesis, University of Miami, 1365 Memorial Drive Coral Gables, FL. 33146
27.
Zurück zum Zitat Peña P, Masterjohn J, Visser U (2018) An omni-directional kick engine for humanoid robots with parameter optimization. In: Akiyama H, Obst O, Sammut C, Tonidandel F (eds) RoboCup 2017: Robot World Cup XXI, vol 11175. Lecture notes in artificial intelligence. Springer, Cham, pp 385–397. https://doi.org/10.1007/978-3-030-00308-1 CrossRef Peña P, Masterjohn J, Visser U (2018) An omni-directional kick engine for humanoid robots with parameter optimization. In: Akiyama H, Obst O, Sammut C, Tonidandel F (eds) RoboCup 2017: Robot World Cup XXI, vol 11175. Lecture notes in artificial intelligence. Springer, Cham, pp 385–397. https://​doi.​org/​10.​1007/​978-3-030-00308-1 CrossRef
29.
Zurück zum Zitat Quigley M, Conley K, Gerkey B, Faust J, Foote T, Leibs J, Wheeler R, Ng AY (2009) ROS: an open-source robot operating system. In: ICRA workshop on open source software, vol 3, p 5. Kobe, Japan (2009) Quigley M, Conley K, Gerkey B, Faust J, Foote T, Leibs J, Wheeler R, Ng AY (2009) ROS: an open-source robot operating system. In: ICRA workshop on open source software, vol 3, p 5. Kobe, Japan (2009)
30.
Zurück zum Zitat Randhavane T, Bera A, Kubin E, Wang A, Gray K, Manocha D (2018) Pedestrian dominance modeling for socially-aware robot navigation Randhavane T, Bera A, Kubin E, Wang A, Gray K, Manocha D (2018) Pedestrian dominance modeling for socially-aware robot navigation
32.
Zurück zum Zitat Rehder E, Wirth F, Lauer M, Stiller C (2018) Pedestrian prediction by planning using deep neural networks. In: 2018 IEEE international conference on robotics and automation (ICRA), pp 5903–5908 Rehder E, Wirth F, Lauer M, Stiller C (2018) Pedestrian prediction by planning using deep neural networks. In: 2018 IEEE international conference on robotics and automation (ICRA), pp 5903–5908
33.
Zurück zum Zitat Rhinehart N, Kitani KM (2020) First-person activity forecasting from video with online inverse reinforcement learning. IEEE Trans Pattern Anal Mach Intell 42(2):304–317CrossRef Rhinehart N, Kitani KM (2020) First-person activity forecasting from video with online inverse reinforcement learning. IEEE Trans Pattern Anal Mach Intell 42(2):304–317CrossRef
34.
Zurück zum Zitat Shah R, Gundotra N, Abbeel P, Dragan A (2019) On the feasibility of learning, rather than assuming, human biases for reward inference. In: Chaudhuri K, Salakhutdinov R (eds) Proceedings of the 36th international conference on machine learning, proceedings of machine learning research, vol 97, pp 5670–5679. PMLR, Long Beach, California, USA. http://proceedings.mlr.press/v97/shah19a.html Shah R, Gundotra N, Abbeel P, Dragan A (2019) On the feasibility of learning, rather than assuming, human biases for reward inference. In: Chaudhuri K, Salakhutdinov R (eds) Proceedings of the 36th international conference on machine learning, proceedings of machine learning research, vol 97, pp 5670–5679. PMLR, Long Beach, California, USA. http://​proceedings.​mlr.​press/​v97/​shah19a.​html
35.
Zurück zum Zitat Simon T, Joo H, Matthews I, Sheikh Y (2017) Hand keypoint detection in single images using multiview bootstrapping. In: CVPR Simon T, Joo H, Matthews I, Sheikh Y (2017) Hand keypoint detection in single images using multiview bootstrapping. In: CVPR
36.
Zurück zum Zitat Sun P, Kretzschmar H, Dotiwalla X, Chouard A, Patnaik V, Tsui P, Guo J, Zhou Y, Chai Y, Caine B, Vasudevan, V, Han W, Ngiam J, Zhao H, Timofeev A, Ettinger S, Krivokon M, Gao A, Joshi A, Zhao S, Cheng S, Zhang Y, Shlens J, Chen Z, Anguelov D (2019) Scalability in perception for autonomous driving: Waymo Open Dataset Sun P, Kretzschmar H, Dotiwalla X, Chouard A, Patnaik V, Tsui P, Guo J, Zhou Y, Chai Y, Caine B, Vasudevan, V, Han W, Ngiam J, Zhao H, Timofeev A, Ettinger S, Krivokon M, Gao A, Joshi A, Zhao S, Cheng S, Zhang Y, Shlens J, Chen Z, Anguelov D (2019) Scalability in perception for autonomous driving: Waymo Open Dataset
37.
Zurück zum Zitat Truong XT, Ngo TD (2019) Social interactive intention prediction and categorization. In: ICRA 2019 workshop on MoRobAE—mobile robot assistants for the elderly, Montreal Canada, May 20–24 Truong XT, Ngo TD (2019) Social interactive intention prediction and categorization. In: ICRA 2019 workshop on MoRobAE—mobile robot assistants for the elderly, Montreal Canada, May 20–24
38.
Zurück zum Zitat Wang W, Li R, Chen Y, Jia Y (2018) Human intention prediction in human–robot collaborative tasks. In: Companion of the 2018 ACM/IEEE international conference on human–robot interaction, HRI ’18, pp 279–280. ACM, New York, NY, USA. https://doi.org/10.1145/3173386.3177025 Wang W, Li R, Chen Y, Jia Y (2018) Human intention prediction in human–robot collaborative tasks. In: Companion of the 2018 ACM/IEEE international conference on human–robot interaction, HRI ’18, pp 279–280. ACM, New York, NY, USA. https://​doi.​org/​10.​1145/​3173386.​3177025
39.
Zurück zum Zitat Wei S, Ramakrishna V, Kanade T, Sheikh Y (2016) Convolutional pose machines. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 4724–4732 Wei S, Ramakrishna V, Kanade T, Sheikh Y (2016) Convolutional pose machines. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 4724–4732
41.
Zurück zum Zitat Ziebart BD, Maas A, Bagnell JA, Dey AK (2008) Maximum entropy inverse reinforcement learning. In: Proceedings of the 23rd national conference on artificial intelligence—volume 3, AAAI’08. AAAI Press, pp 1433–1438 Ziebart BD, Maas A, Bagnell JA, Dey AK (2008) Maximum entropy inverse reinforcement learning. In: Proceedings of the 23rd national conference on artificial intelligence—volume 3, AAAI’08. AAAI Press, pp 1433–1438
Metadaten
Titel
ITP: Inverse Trajectory Planning for Human Pose Prediction
verfasst von
Pedro A. Peña
Ubbo Visser
Publikationsdatum
27.05.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
KI - Künstliche Intelligenz / Ausgabe 2/2020
Print ISSN: 0933-1875
Elektronische ISSN: 1610-1987
DOI
https://doi.org/10.1007/s13218-020-00658-7

Weitere Artikel der Ausgabe 2/2020

KI - Künstliche Intelligenz 2/2020 Zur Ausgabe