Skip to main content

2015 | OriginalPaper | Buchkapitel

Shared Autonomy Perception and Manipulation of Physical Device Controls

verfasst von : Matthew Rueben, William D. Smart

Erschienen in: Advances in Visual Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

As robots begin to enter our homes and workplaces, they will have to deal with the devices and appliances that are already there. These devices are invariably designed with human perception and manipulation abilities in mind. Unfortunately, this often makes them hard for robots to interact with autonomously. Control elements, such as buttons, switches, and knobs, are often hard to identify with current sensors. Even when they are found, it is often not clear how they should be manipulated to achieve a specific goal without extensive background knowledge of the specific device and task.
In this paper, we describe a shared-autonomy approach to the identification and operation of these device controls. A human operator provides assistance with perception and high-level planning, while the robot takes care of the low-level actions that depend on closed-loop sensor feedback. We demonstrate our approach by controlling a consumer electronics device, despite not being able to autonomously sense some of its control elements, and give the results of some initial evaluations suggesting that the shared autonomy interface is both easier to use and more efficient than a direct teleoperation interface.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ciocarlie, M., Hsiao, K., Leeper, A., Gossow, D.: Mobile manipulation through an assistive home robot. In: Proceedings of the IEEE/RSJ International Conference on Robots and Systems (IROS), Vilamoura, Portugal, pp. 5313–5320 (2012) Ciocarlie, M., Hsiao, K., Leeper, A., Gossow, D.: Mobile manipulation through an assistive home robot. In: Proceedings of the IEEE/RSJ International Conference on Robots and Systems (IROS), Vilamoura, Portugal, pp. 5313–5320 (2012)
2.
Zurück zum Zitat Sankaran, B., Pitzer, B., Osentoski, S.: Failure recovery with shared autonomy. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 349–355. IEEE (2012) Sankaran, B., Pitzer, B., Osentoski, S.: Failure recovery with shared autonomy. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 349–355. IEEE (2012)
3.
Zurück zum Zitat Goodfellow, I.J., Koenig, N., Muja, M., Pantofaru, C., Sorokin, A., Takayama, L.: Help me help you: interfaces for personal robots. In: Proceedings of the 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Osaka, Japan, pp. 187–188 (2010) Goodfellow, I.J., Koenig, N., Muja, M., Pantofaru, C., Sorokin, A., Takayama, L.: Help me help you: interfaces for personal robots. In: Proceedings of the 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Osaka, Japan, pp. 187–188 (2010)
4.
Zurück zum Zitat Fong, T., Thorpe, C., Baur, C.: Robot, asker of questions. Robot. Auton. Syst. 42, 235–243 (2003)MATHCrossRef Fong, T., Thorpe, C., Baur, C.: Robot, asker of questions. Robot. Auton. Syst. 42, 235–243 (2003)MATHCrossRef
5.
Zurück zum Zitat Atherton, A.J., Goodrich, M.A.: Perception by proxy: humans helping robots to see in a manipulation task. In: Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Lausanne, Switzerland, pp. 109–110 (2011) Atherton, A.J., Goodrich, M.A.: Perception by proxy: humans helping robots to see in a manipulation task. In: Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Lausanne, Switzerland, pp. 109–110 (2011)
6.
Zurück zum Zitat Pitzer, B., Styer, M., Bersch, C., DuHadway, C., Becker, J.: Towards perceptual shared autonomy for robotic mobile manipulation. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, pp. 6245–6251 (2011) Pitzer, B., Styer, M., Bersch, C., DuHadway, C., Becker, J.: Towards perceptual shared autonomy for robotic mobile manipulation. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, pp. 6245–6251 (2011)
7.
Zurück zum Zitat Nguyen, H., Ciocarlie, M., Hsiao, K., Kemp, C.C.: ROS commander (ROSCo): behavior creation for home robots. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany (2013) Nguyen, H., Ciocarlie, M., Hsiao, K., Kemp, C.C.: ROS commander (ROSCo): behavior creation for home robots. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany (2013)
8.
Zurück zum Zitat Srinivasa, S.S., Ferguson, D., Helfrich, C.J., Berenson, D., Collet, A., Diankov, R., Gallagher, G., Hollinger, G., Kuffner, J., Weghe, M.V.: HERB: a home exploring robotic butler. Auton. Robots 28, 520 (2010)CrossRef Srinivasa, S.S., Ferguson, D., Helfrich, C.J., Berenson, D., Collet, A., Diankov, R., Gallagher, G., Hollinger, G., Kuffner, J., Weghe, M.V.: HERB: a home exploring robotic butler. Auton. Robots 28, 520 (2010)CrossRef
9.
Zurück zum Zitat Beetz, M., Klank, U., Kresse, I., Maldonado, A., Mosenlechner, L., Pangercic, D., Ruhr, T., Tenorth, M.: Robotic roommates making pancakes. In: 2011 11th IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 529–536 (2011) Beetz, M., Klank, U., Kresse, I., Maldonado, A., Mosenlechner, L., Pangercic, D., Ruhr, T., Tenorth, M.: Robotic roommates making pancakes. In: 2011 11th IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 529–536 (2011)
10.
Zurück zum Zitat Eruhimov, V., Meeussen, W.: Outlet detection and pose estimation for robot continuous operation. In: Proceedings of the IEEE/RSJ International Conference on Robots and Systems (IROS), San Francisco, CA, pp. 2941–2946 (2011) Eruhimov, V., Meeussen, W.: Outlet detection and pose estimation for robot continuous operation. In: Proceedings of the IEEE/RSJ International Conference on Robots and Systems (IROS), San Francisco, CA, pp. 2941–2946 (2011)
11.
Zurück zum Zitat Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Berger, E., Wheeler, R., Ng, A.: ROS: An open-source robot operating system. In: Proceedings of the ICRA 2009 Workshop on Open-Source Robotics (2009) Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Berger, E., Wheeler, R., Ng, A.: ROS: An open-source robot operating system. In: Proceedings of the ICRA 2009 Workshop on Open-Source Robotics (2009)
12.
Zurück zum Zitat Rusu, R.B., Cousins, S.: 3D is here: point cloud library (PCL). In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, pp. 1–4 (2011) Rusu, R.B., Cousins, S.: 3D is here: point cloud library (PCL). In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, pp. 1–4 (2011)
13.
Zurück zum Zitat Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools 25, 120–126 (2000) Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools 25, 120–126 (2000)
14.
Zurück zum Zitat Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)CrossRefMathSciNet Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)CrossRefMathSciNet
Metadaten
Titel
Shared Autonomy Perception and Manipulation of Physical Device Controls
verfasst von
Matthew Rueben
William D. Smart
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-27863-6_78

Premium Partner