Skip to main content
Top

2016 | OriginalPaper | Chapter

Human-Robot Collaborative Remote Object Search

Authors : Jun Miura, Shin Kadekawa, Kota Chikaarashi, Junichi Sugiyama

Published in: Intelligent Autonomous Systems 13

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Object search is one of the typical tasks for remotely controlled service robots. Although object recognition technologies have been well developed, an efficient search strategy (or viewpoint planning method) is still an issue. This paper describes a new approach to human-robot collaborative remote object search. An analogy for our approach is ride on shoulders; a user controls a fish-eye camera on a remote robot to change views and search for a target object, independently of the robot. Combined with a certain level of automatic search capability of the robot, this collaboration can realize an efficient target object search. We developed an experimental system to show the feasibility of the approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Note that the operator was able to see which table the robot is looking at through a fish-eye camera.
 
Literature
1.
go back to reference A.A. Makarenko, S.B. Williams, F. Bourgault, and H.F. Durrant-Whyte. An Experiment in Integrated Exploration. In Proceedings of 2002 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 534–539, 2002. A.A. Makarenko, S.B. Williams, F. Bourgault, and H.F. Durrant-Whyte. An Experiment in Integrated Exploration. In Proceedings of 2002 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 534–539, 2002.
2.
go back to reference R. Martinez-Cantin, N. de Freitas, R. Brochu, J. Castellanos, and A. Doucet. A Bayesian Exploration-Exploitation Approach for Optimal Online Sensing and Planning with a Visually Guided Mobile Robot. Autonomous Robots, Vol. 27, pp. 93–103, 2009.CrossRef R. Martinez-Cantin, N. de Freitas, R. Brochu, J. Castellanos, and A. Doucet. A Bayesian Exploration-Exploitation Approach for Optimal Online Sensing and Planning with a Visually Guided Mobile Robot. Autonomous Robots, Vol. 27, pp. 93–103, 2009.CrossRef
3.
go back to reference Y. Ye and J.K. Tsotsos. Sensor Planning for 3D Object Search. Computer Vision and Image Understanding, Vol. 73, No. 2, pp. 145–168, 1999.CrossRef Y. Ye and J.K. Tsotsos. Sensor Planning for 3D Object Search. Computer Vision and Image Understanding, Vol. 73, No. 2, pp. 145–168, 1999.CrossRef
4.
go back to reference K. Shubina and J.K. Tsotsos. Visual Search for an Object in a 3D Environment Uing a Mobile Robot. Computer Vision and Image Understanding, Vol. 114, pp. 535–547, 2010.CrossRef K. Shubina and J.K. Tsotsos. Visual Search for an Object in a 3D Environment Uing a Mobile Robot. Computer Vision and Image Understanding, Vol. 114, pp. 535–547, 2010.CrossRef
5.
go back to reference F. Saidi, O. Stasse, K. Yokoi, and F. Kanehiro. Online Object Search with a Humanoid Robot. In Proceedings of 2007 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 1677–1682, 2007. F. Saidi, O. Stasse, K. Yokoi, and F. Kanehiro. Online Object Search with a Humanoid Robot. In Proceedings of 2007 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 1677–1682, 2007.
6.
go back to reference A. Aydemir, K. Sjöö, J. Folkesson, A. Pronobis, and P. Jensfelt. Search in the Real World: Active Visual Object Search Based on Spatial Relations. In Proceedings of 2011 IEEE Int. Conf. on Robotics and Automation, pp. 2818–2824, 2011. A. Aydemir, K. Sjöö, J. Folkesson, A. Pronobis, and P. Jensfelt. Search in the Real World: Active Visual Object Search Based on Spatial Relations. In Proceedings of 2011 IEEE Int. Conf. on Robotics and Automation, pp. 2818–2824, 2011.
7.
go back to reference H. Masuzawa and J. Miura. Observation Planning for Efficient Environment Information Summarization. In Proceedings of 2009 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 5794–5780, 2009. H. Masuzawa and J. Miura. Observation Planning for Efficient Environment Information Summarization. In Proceedings of 2009 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 5794–5780, 2009.
8.
go back to reference H. Masuzawa and J. Miura. Observation Planning for Environment Information Summarization with Deadlines. In Proceedings of 2010 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 30–36, 2010. H. Masuzawa and J. Miura. Observation Planning for Environment Information Summarization with Deadlines. In Proceedings of 2010 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 30–36, 2010.
9.
go back to reference M. Boussard and J. Miura. Observation planning for object search by a mobile robot with uncertain recognition. In Proceedings of the 12th Int. Conf. on Intelligent Autonomous Systems, 2012. F3B.5 (CD-ROM). M. Boussard and J. Miura. Observation planning for object search by a mobile robot with uncertain recognition. In Proceedings of the 12th Int. Conf. on Intelligent Autonomous Systems, 2012. F3B.5 (CD-ROM).
10.
go back to reference B. Bonet and H. Geffner. Labeled RTDP: Improving the Convergence of Real-Time Dynamic Programming. In Enrico Giunchiglia, Nicola Muscettola, and Dana S. Nau, editors, Proceedings 13th Int. Conf. on Automated Planning and Scheduling (ICAPS-2003), pp. 12–31. AAAI, 2003. B. Bonet and H. Geffner. Labeled RTDP: Improving the Convergence of Real-Time Dynamic Programming. In Enrico Giunchiglia, Nicola Muscettola, and Dana S. Nau, editors, Proceedings 13th Int. Conf. on Automated Planning and Scheduling (ICAPS-2003), pp. 12–31. AAAI, 2003.
11.
go back to reference T. Fong, C. Thorpe, and C. Baur. Advanced Interfaces for Vehicle Teleoperation: Collaborative Control, Sensor Fusion Displays, and Remote Driving Tools. Autonomous Robots, Vol. 11, pp. 77–85, 2001.CrossRefMATH T. Fong, C. Thorpe, and C. Baur. Advanced Interfaces for Vehicle Teleoperation: Collaborative Control, Sensor Fusion Displays, and Remote Driving Tools. Autonomous Robots, Vol. 11, pp. 77–85, 2001.CrossRefMATH
12.
go back to reference S. Suzuki. A Vision System for Remote Control of Mobile Robot to Enlarge Field of View in Horizontal and Vertical. In Proceedings of 2011 IEEE Int. Conf. on Robotics and Biomimetics, pp. 8–13, 2011. S. Suzuki. A Vision System for Remote Control of Mobile Robot to Enlarge Field of View in Horizontal and Vertical. In Proceedings of 2011 IEEE Int. Conf. on Robotics and Biomimetics, pp. 8–13, 2011.
13.
go back to reference K. Saitoh, T. Machida, K. Kiyokawa, and H. Takemura. A 2D-3D Integrated Interface for Mobile Robot Control using Omnidirectional Images and 3D Geometric Models. In Proceedings of 2006 IEEE/ACM Int. Symp. on Mixed and Augmented Reality, pp. 173–176, 2006. K. Saitoh, T. Machida, K. Kiyokawa, and H. Takemura. A 2D-3D Integrated Interface for Mobile Robot Control using Omnidirectional Images and 3D Geometric Models. In Proceedings of 2006 IEEE/ACM Int. Symp. on Mixed and Augmented Reality, pp. 173–176, 2006.
14.
go back to reference N. Shiroma, N. Sato, Y. Chiu, and F. Matsuno. Study on Effective Camera Images for Mobile Robot Teleoperation. In Proceedings of 13th IEEE Int. Workshop on Robot and Human Interactive Communication, pp. 107–112, 2004. N. Shiroma, N. Sato, Y. Chiu, and F. Matsuno. Study on Effective Camera Images for Mobile Robot Teleoperation. In Proceedings of 13th IEEE Int. Workshop on Robot and Human Interactive Communication, pp. 107–112, 2004.
15.
go back to reference T. Fong, C. Thorpe, and C. Baur. A Safeguarded Teleoperation Controller. In Proceedings of 2001 IEEE Int. Conf. on Advanced Robotics, 2001. T. Fong, C. Thorpe, and C. Baur. A Safeguarded Teleoperation Controller. In Proceedings of 2001 IEEE Int. Conf. on Advanced Robotics, 2001.
16.
go back to reference T. Sawaragi, T. Shiose, and G. Akashi. Foundations for Designing an Ecological Interface for Mobile Robot Teleoperation. Robotics and Autonomous Systems, Vol. 31, pp. 193–207, 2000.CrossRef T. Sawaragi, T. Shiose, and G. Akashi. Foundations for Designing an Ecological Interface for Mobile Robot Teleoperation. Robotics and Autonomous Systems, Vol. 31, pp. 193–207, 2000.CrossRef
17.
go back to reference N. Ando, T. Suehiro, and T. Kotoku. A Software Platform for Component Based RT System Development: OpenRTM-aist. In Proceedings of the 1st Int. Conf. on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR ’08), pp. 87–98, 2008. N. Ando, T. Suehiro, and T. Kotoku. A Software Platform for Component Based RT System Development: OpenRTM-aist. In Proceedings of the 1st Int. Conf. on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR ’08), pp. 87–98, 2008.
19.
go back to reference D.G. Lowe. Distinctive Image Features from Scale-Invariant Keypoints. Int. J. of Computer Vision, Vol. 60, No. 2, pp. 91–110, 2004.CrossRef D.G. Lowe. Distinctive Image Features from Scale-Invariant Keypoints. Int. J. of Computer Vision, Vol. 60, No. 2, pp. 91–110, 2004.CrossRef
22.
go back to reference Y. Ueno, T. Ohno, K. Terashima, H. Kitagawa, K. Funato, and K. Kakihara. Novel Differential Drive Steering System with Energy Saving and Normal Tire using Spur Gear for Omni-directional Mobile Robot. In Proceedings of the 2010 IEEE Int. Conf. on Robotics and Automation, pp. 3763–3768, 2010. Y. Ueno, T. Ohno, K. Terashima, H. Kitagawa, K. Funato, and K. Kakihara. Novel Differential Drive Steering System with Energy Saving and Normal Tire using Spur Gear for Omni-directional Mobile Robot. In Proceedings of the 2010 IEEE Int. Conf. on Robotics and Automation, pp. 3763–3768, 2010.
Metadata
Title
Human-Robot Collaborative Remote Object Search
Authors
Jun Miura
Shin Kadekawa
Kota Chikaarashi
Junichi Sugiyama
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-08338-4_71

Premium Partner