Skip to main content
Erschienen in: KI - Künstliche Intelligenz 4/2019

16.09.2019 | Technical Contribution

SocRob@Home

Integrating AI Components in a Domestic Robot System

verfasst von: Pedro U. Lima, Carlos Azevedo, Emilia Brzozowska, João Cartucho, Tiago J. Dias, João Gonçalves, Mithun Kinarullathil, Guilherme Lawless, Oscar Lima, Rute Luz, Pedro Miraldo, Enrico Piazza, Miguel Silva, Tiago Veiga, Rodrigo Ventura

Erschienen in: KI - Künstliche Intelligenz | Ausgabe 4/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper describes the SocRob@Home robot system, consisting of a mobile robot (MBOT) equipped with several sensors and actuators, including a manipulator arm, and several software modules that provide the skills and capability to perform domestic tasks while interacting with humans in a domestic environment. We describe the whole system holistically, explaining how it integrates the contributing modules, and then we focus on the most relevant sub-systems, pointing out the original contributions of our research and development on the system in the last 5 years. The robot system includes metric and semantic mapping, several navigation modes (way-point navigation, person following and multi-sensor obstacle detection and avoidance), vision-based object detection, recognition, servoing and grasping, speech understanding, task planning and task execution. The robot system is mostly activated by speech commands from a human, and these commands, after being interpreted, are executed by the robot sub-systems, coordinated by a task executor. Lessons learned during the development and use of this system, which are useful as guidelines for the development of similar robot systems, are provided. MBOT’s performance is assessed using the task benchmarks scoring system of the European Robotics League competitions on Consumer Service robots.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

KI - Künstliche Intelligenz

The Scientific journal "KI – Künstliche Intelligenz" is the official journal of the division for artificial intelligence within the "Gesellschaft für Informatik e.V." (GI) – the German Informatics Society - with constributions from troughout the field of artificial intelligence.

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
2.
Zurück zum Zitat Bellotto N, Hu H (2010) Computationally efficient solutions for tracking people with a mobile robot: an experimental evaluation of Bayesian filters. Auton Robots 28(4):425–438CrossRef Bellotto N, Hu H (2010) Computationally efficient solutions for tracking people with a mobile robot: an experimental evaluation of Bayesian filters. Auton Robots 28(4):425–438CrossRef
3.
Zurück zum Zitat Brock O, Khatib O (1999) High-speed navigation using the global dynamic window approach. Proc IEEE Int Conf Robotics Autom 1:341–346 (IEEE)CrossRef Brock O, Khatib O (1999) High-speed navigation using the global dynamic window approach. Proc IEEE Int Conf Robotics Autom 1:341–346 (IEEE)CrossRef
4.
Zurück zum Zitat Brzozowska E, Lima O, Ventura R (2019) A generic optimization based cartesian controller for robotic mobile manipulation. In: Proceedings of the IEEE international conference on robotics and automation (ICRA-19). (accepted) Brzozowska E, Lima O, Ventura R (2019) A generic optimization based cartesian controller for robotic mobile manipulation. In: Proceedings of the IEEE international conference on robotics and automation (ICRA-19). (accepted)
5.
Zurück zum Zitat Cartucho J, Ventura R, Veloso M (2018) Robust object recognition through symbiotic deep learning in mobile robots. In: 2018 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 2336–2341 (IEEE) Cartucho J, Ventura R, Veloso M (2018) Robust object recognition through symbiotic deep learning in mobile robots. In: 2018 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 2336–2341 (IEEE)
6.
Zurück zum Zitat Cashmore M, Fox M, Long D, Magazzeni D, Ridder B, Carrera A, Palomeras N, Hurtos N, Carreras M (2015) Rosplan: planning in the robot operating system. In: ICAPS, pp 333–341 Cashmore M, Fox M, Long D, Magazzeni D, Ridder B, Carrera A, Palomeras N, Hurtos N, Carreras M (2015) Rosplan: planning in the robot operating system. In: ICAPS, pp 333–341
8.
Zurück zum Zitat Chaumette F, Hutchinson S (2006) Visual servo control. I. Basic approaches. IEEE Robot Autom Mag 13(4):82–90CrossRef Chaumette F, Hutchinson S (2006) Visual servo control. I. Basic approaches. IEEE Robot Autom Mag 13(4):82–90CrossRef
9.
Zurück zum Zitat Chitta S, Sucan I, Cousins S (2012) Moveit![ROS topics]. IEEE Robot Autom Mag 19(1):18–19CrossRef Chitta S, Sucan I, Cousins S (2012) Moveit![ROS topics]. IEEE Robot Autom Mag 19(1):18–19CrossRef
11.
Zurück zum Zitat Forlizzi J, DiSalvo C (2006) Service robots in the domestic environment: a study of the roomba vacuum in the home. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human–robot interaction, pp 258–265. ACM Forlizzi J, DiSalvo C (2006) Service robots in the domestic environment: a study of the roomba vacuum in the home. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human–robot interaction, pp 258–265. ACM
12.
Zurück zum Zitat Fox D, Burgard W, Thrun S (1997) The dynamic window approach to collision avoidance. IEEE Robot Autom Mag 4(1):23–33CrossRef Fox D, Burgard W, Thrun S (1997) The dynamic window approach to collision avoidance. IEEE Robot Autom Mag 4(1):23–33CrossRef
13.
Zurück zum Zitat Girshick R (2015) Fast R-CNN. In: IEEE Int’l Conf. computer vision (ICCV), pp 1440–1448 Girshick R (2015) Fast R-CNN. In: IEEE Int’l Conf. computer vision (ICCV), pp 1440–1448
14.
Zurück zum Zitat Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: IEEE Conf. computer vision and pattern recognition (CVPR), pp 580–587 Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: IEEE Conf. computer vision and pattern recognition (CVPR), pp 580–587
15.
Zurück zum Zitat Gonçalves J, Lima PU (2019) Grasp planning with incomplete knowledge about the object to be grasped. In: Proc. of 19th IEEE Int. Conf. on autonomous robot systems and competitions (ICARSC). IEEE Gonçalves J, Lima PU (2019) Grasp planning with incomplete knowledge about the object to be grasped. In: Proc. of 19th IEEE Int. Conf. on autonomous robot systems and competitions (ICARSC). IEEE
16.
Zurück zum Zitat Han J, Jo M, Park S, Kim S (2005) The educational use of home robots for children. In: Robot and human interactive communication, 2005. ROMAN 2005. IEEE International Workshop on, pp 378–383. IEEE Han J, Jo M, Park S, Kim S (2005) The educational use of home robots for children. In: Robot and human interactive communication, 2005. ROMAN 2005. IEEE International Workshop on, pp 378–383. IEEE
17.
Zurück zum Zitat Hess W, Kohler D, Rapp H, Andor D (2016) Real-time loop closure in 2D lidar slam. In: 2016 IEEE international conference on robotics and automation (ICRA), pp 1271–1278 Hess W, Kohler D, Rapp H, Andor D (2016) Real-time loop closure in 2D lidar slam. In: 2016 IEEE international conference on robotics and automation (ICRA), pp 1271–1278
18.
Zurück zum Zitat Hirai K, Hirose M, Haikawa Y, Takenaka T (1998) The development of Honda humanoid robot. Robot Autom 2018, Proc 1998 IEEE Int Conf 2:1321–1326 (IEEE) Hirai K, Hirose M, Haikawa Y, Takenaka T (1998) The development of Honda humanoid robot. Robot Autom 2018, Proc 1998 IEEE Int Conf 2:1321–1326 (IEEE)
19.
Zurück zum Zitat Katz M, Hoffmann J (2014) Mercury planner: pushing the limits of partial delete relaxation. In: Proceedings of the 8th international planning competition (IPC-2014) Katz M, Hoffmann J (2014) Mercury planner: pushing the limits of partial delete relaxation. In: Proceedings of the 8th international planning competition (IPC-2014)
20.
Zurück zum Zitat Kinarullathil1 M, Martins PH, Azevedo C, Lima O, Lawless G, Lima PU, Custódio L, Ventura R (2018) From user spoken commands to robot task plans: a case study in RoboCup@Home. In: Proc. of language and robotics workshop of IROS2018. IEEE Kinarullathil1 M, Martins PH, Azevedo C, Lima O, Lawless G, Lima PU, Custódio L, Ventura R (2018) From user spoken commands to robot task plans: a case study in RoboCup@Home. In: Proc. of language and robotics workshop of IROS2018. IEEE
22.
Zurück zum Zitat Lima O, Ventura R, Awaad I (2018) Integrating classical planning and real robots in industrial and service robotics domains. PlanRob, ICAPS Workshop Lima O, Ventura R, Awaad I (2018) Integrating classical planning and real robots in industrial and service robotics domains. PlanRob, ICAPS Workshop
23.
Zurück zum Zitat Lima PU (2018) A probabilistic approach to benchmarking and performance evaluation of robot systems. In: 2018 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 7231–7236. IEEE Lima PU (2018) A probabilistic approach to benchmarking and performance evaluation of robot systems. In: 2018 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 7231–7236. IEEE
24.
Zurück zum Zitat Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick CL (2014) Microsoft COCO: common objects in context. In: European conference on computer vision, pp 740–755. Springer Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick CL (2014) Microsoft COCO: common objects in context. In: European conference on computer vision, pp 740–755. Springer
25.
Zurück zum Zitat Martins PH, Custódio L, Ventura R (2018) A deep learning approach for understanding natural language commands for mobile service robots. CoRR abs/1807.03053. arXiv:1807.03053 Martins PH, Custódio L, Ventura R (2018) A deep learning approach for understanding natural language commands for mobile service robots. CoRR abs/1807.03053. arXiv:​1807.​03053
26.
Zurück zum Zitat Matamoros M, Seib V, Memmesheimer R, Paulus D (2018) Robocup@Home: summarizing achievements in over 11 years of competition. In: Proceedings of 2018 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC 2018), pp 186–191, April, Torres Vedras, Portugal Matamoros M, Seib V, Memmesheimer R, Paulus D (2018) Robocup@Home: summarizing achievements in over 11 years of competition. In: Proceedings of 2018 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC 2018), pp 186–191, April, Torres Vedras, Portugal
27.
Zurück zum Zitat McDermott DM (2000) The 1998 AI planning systems competition. AI Mag 21(2):35 McDermott DM (2000) The 1998 AI planning systems competition. AI Mag 21(2):35
28.
Zurück zum Zitat Melo FS, Sardinha A, Belo D, Couto M, Faria M, Farias A, Gambôa H, Jesus C, Kinarullathil M, Lima P, Luz L, Mateus A, Melo I, Moreno P, Osório D, Paiva A, Pimentel J, Rodrigues J, Sequeira P, Solera-Ureña R, Vasco M, Veloso M, Ventura R (2018) Project INSIDE: towards autonomous semi-unstructured human–robot social interaction in autism therapy. Artif Intell Med 96:198–216CrossRef Melo FS, Sardinha A, Belo D, Couto M, Faria M, Farias A, Gambôa H, Jesus C, Kinarullathil M, Lima P, Luz L, Mateus A, Melo I, Moreno P, Osório D, Paiva A, Pimentel J, Rodrigues J, Sequeira P, Solera-Ureña R, Vasco M, Veloso M, Ventura R (2018) Project INSIDE: towards autonomous semi-unstructured human–robot social interaction in autism therapy. Artif Intell Med 96:198–216CrossRef
29.
Zurück zum Zitat Messias J, Ventura R, Lima P, Sequeira J, Alvito P, Marques C, Carriço P (2014) A robotic platform for edutainment activities in a pediatric hospital. In: Proceedings of the IEEE international conference on autonomous robot systems and competitions (ICARSC), pp 193–198 Messias J, Ventura R, Lima P, Sequeira J, Alvito P, Marques C, Carriço P (2014) A robotic platform for edutainment activities in a pediatric hospital. In: Proceedings of the IEEE international conference on autonomous robot systems and competitions (ICARSC), pp 193–198
30.
Zurück zum Zitat Montemerlo M, Thrun S (2007) Fastslam 2.0. FastSLAM: s scalable method for the simultaneous localization and mapping problem in robotics. Springer, New York, pp 63–90MATH Montemerlo M, Thrun S (2007) Fastslam 2.0. FastSLAM: s scalable method for the simultaneous localization and mapping problem in robotics. Springer, New York, pp 63–90MATH
31.
Zurück zum Zitat Pangercic D, Pitzer B, Tenorth M, Beetz M (2012) Semantic object maps for robotic housework-representation, acquisition and use. In: Intelligent robots and systems (IROS), 2012 IEEE/RSJ international conference on, pp 4644–4651. IEEE Pangercic D, Pitzer B, Tenorth M, Beetz M (2012) Semantic object maps for robotic housework-representation, acquisition and use. In: Intelligent robots and systems (IROS), 2012 IEEE/RSJ international conference on, pp 4644–4651. IEEE
34.
Zurück zum Zitat Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In: Proceedings of Neural Information Processing Systems (NIPS 2015), pp 91–99, Montreal, Canada, December Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In: Proceedings of Neural Information Processing Systems (NIPS 2015), pp 91–99, Montreal, Canada, December
35.
Zurück zum Zitat Rusu RB, Blodow N, Marton ZC, Beetz M (2009) Close-range scene segmentation and reconstruction of 3D point cloud maps for mobile manipulation in domestic environments. In: Intelligent robots and systems, 2009. IROS 2009. IEEE/RSJ international conference on, pp 1–6. IEEE Rusu RB, Blodow N, Marton ZC, Beetz M (2009) Close-range scene segmentation and reconstruction of 3D point cloud maps for mobile manipulation in domestic environments. In: Intelligent robots and systems, 2009. IROS 2009. IEEE/RSJ international conference on, pp 1–6. IEEE
38.
Zurück zum Zitat Stückler J, Holz D, Behnke S (2012) Demonstrating everyday manipulation skills in robocup@home. Robot Autom Mag 19(2):34–42CrossRef Stückler J, Holz D, Behnke S (2012) Demonstrating everyday manipulation skills in robocup@home. Robot Autom Mag 19(2):34–42CrossRef
39.
Zurück zum Zitat Talebpour Z, Geetha Viswanathan D, Ventura R, Englebienne G, Martinoli A (2016) Incorporating perception uncertainty in human-aware navigation: a comparative study. In: IEEE international symposium on robot and human interactive communication (RO-MAN) Talebpour Z, Geetha Viswanathan D, Ventura R, Englebienne G, Martinoli A (2016) Incorporating perception uncertainty in human-aware navigation: a comparative study. In: IEEE international symposium on robot and human interactive communication (RO-MAN)
40.
Zurück zum Zitat Veiga TS, Silva M, Ventura R, Lima PU (2019) An hierarchical approach to active semantic mapping using probabilistic logic and information reward POMDP. In: Proc. of 29th international conference on automated planning and scheduling (ICAPS) Veiga TS, Silva M, Ventura R, Lima PU (2019) An hierarchical approach to active semantic mapping using probabilistic logic and information reward POMDP. In: Proc. of 29th international conference on automated planning and scheduling (ICAPS)
42.
Zurück zum Zitat Wasik A, Pereira JN, Ventura R, Lima PU, Martinoli A (2016) Graph-based distributed control for adaptive multi-robot patrolling using local formation reconfiguration. In: IEEE/RSJ international conference on intelligent robots and systems (IROS) Wasik A, Pereira JN, Ventura R, Lima PU, Martinoli A (2016) Graph-based distributed control for adaptive multi-robot patrolling using local formation reconfiguration. In: IEEE/RSJ international conference on intelligent robots and systems (IROS)
Metadaten
Titel
SocRob@Home
Integrating AI Components in a Domestic Robot System
verfasst von
Pedro U. Lima
Carlos Azevedo
Emilia Brzozowska
João Cartucho
Tiago J. Dias
João Gonçalves
Mithun Kinarullathil
Guilherme Lawless
Oscar Lima
Rute Luz
Pedro Miraldo
Enrico Piazza
Miguel Silva
Tiago Veiga
Rodrigo Ventura
Publikationsdatum
16.09.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
KI - Künstliche Intelligenz / Ausgabe 4/2019
Print ISSN: 0933-1875
Elektronische ISSN: 1610-1987
DOI
https://doi.org/10.1007/s13218-019-00618-w

Weitere Artikel der Ausgabe 4/2019

KI - Künstliche Intelligenz 4/2019 Zur Ausgabe