Skip to main content

2016 | OriginalPaper | Buchkapitel

Immersive Virtual Reality-Based Simulation to Support the Design of Natural Human-Robot Interfaces for Service Robotic Applications

verfasst von : Federica Bazzano, Federico Gentilini, Fabrizio Lamberti, Andrea Sanna, Gianluca Paravati, Valentina Gatteschi, Marco Gaspardone

Erschienen in: Augmented Reality, Virtual Reality, and Computer Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The increasing popularity of robotics and related applications in modern society makes interacting and communicating with robots of crucial importance. In service robotics, where robots operate to assist human beings in their daily life, natural interaction paradigms capable to foster an ever more intuitive and effective collaboration between involved actors are needed. The aim of this paper is to discuss activities that have been carried out to create a 3D immersive simulation environment able to ease the design and evaluation of natural human-robot interfaces in generic usage contexts. The proposed framework has been exploited to tackle a specific use case represented by a robotics-enabled office scenario and to develop two user interfaces based on augmented reality, speech recognition as well as gaze and body tracking technologies. Then, a user study has been performed to study user experience in the execution of semi-autonomous tasks in the considered scenario though both objective and subjective observations. Besides confirming the validity of the devised approach, the study provided precious indications regarding possible evolutions of both the simulation environment and the service robotic scenario considered.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Acquisti, A., Feltovich, P., Hoffman, R., Jeffers, R., Prescott, D., Suri, N., Uszok, A., Van Hoof, R., Bradshaw, J.M., Sierhuis, M.: Adjustable autonomy and human-agent teamwork in practice: an interim report on space applications. In: Hexmoor, H., Castelfranchi, C., Falcone, R. (eds.) Agent Autonomy. Multiagent Systems, Artificial Societies, and Simulated Organizations, vol. 7, pp. 243–280. Springer, New York (2003)CrossRef Acquisti, A., Feltovich, P., Hoffman, R., Jeffers, R., Prescott, D., Suri, N., Uszok, A., Van Hoof, R., Bradshaw, J.M., Sierhuis, M.: Adjustable autonomy and human-agent teamwork in practice: an interim report on space applications. In: Hexmoor, H., Castelfranchi, C., Falcone, R. (eds.) Agent Autonomy. Multiagent Systems, Artificial Societies, and Simulated Organizations, vol. 7, pp. 243–280. Springer, New York (2003)CrossRef
3.
Zurück zum Zitat LaViola, J.J., Jenkins, O.C.: Natural user interfaces for adjustable autonomy in robot control. IEEE Comput. Graph. Appl. 35(3), 20–21 (2015)CrossRef LaViola, J.J., Jenkins, O.C.: Natural user interfaces for adjustable autonomy in robot control. IEEE Comput. Graph. Appl. 35(3), 20–21 (2015)CrossRef
4.
Zurück zum Zitat Goodrich, M.A., Schultz, A.C.: Human-robot interaction: a survey. Found. Trends Hum. Comput. Interact. 1(3), 203–275 (2007)CrossRefMATH Goodrich, M.A., Schultz, A.C.: Human-robot interaction: a survey. Found. Trends Hum. Comput. Interact. 1(3), 203–275 (2007)CrossRefMATH
5.
Zurück zum Zitat Stiefelhagen, R., Ekenel, H.K., Fügen, C., Gieselmann, P., Holzapfel, H., Kraft, F., Nickel, K., Voit, M., Waibel, A.: Enabling multimodal human-robot interaction for the karlsruhe humanoid robot. IEEE Trans. Robot. 23(5), 840–851 (2007)CrossRef Stiefelhagen, R., Ekenel, H.K., Fügen, C., Gieselmann, P., Holzapfel, H., Kraft, F., Nickel, K., Voit, M., Waibel, A.: Enabling multimodal human-robot interaction for the karlsruhe humanoid robot. IEEE Trans. Robot. 23(5), 840–851 (2007)CrossRef
6.
Zurück zum Zitat Adkar, P.: Unimodal and multimodal human computer interaction: a modern overview. Int. J. Comput. Sci. Inf. Eng. Technol. 2(3), 1–8 (2013) Adkar, P.: Unimodal and multimodal human computer interaction: a modern overview. Int. J. Comput. Sci. Inf. Eng. Technol. 2(3), 1–8 (2013)
7.
Zurück zum Zitat Oviatt, S.: Multimodal interfaces. Hum. Comput. Interact. Handb. Fundam. Evolving Technol. Emerg. Appl. 14, 286–304 (2003) Oviatt, S.: Multimodal interfaces. Hum. Comput. Interact. Handb. Fundam. Evolving Technol. Emerg. Appl. 14, 286–304 (2003)
8.
Zurück zum Zitat Kollar, T., Vedantham, A., Sobel, C., Chang, C., Perera, V., Veloso, M.: A multi-modal approach for natural human-robot interaction. In: Ge, S.S., Khatib, O., Cabibihan, J.-J., Simmons, R., Williams, M.-A. (eds.) ICSR 2012. LNCS, vol. 7621, pp. 458–467. Springer, Heidelberg (2012)CrossRef Kollar, T., Vedantham, A., Sobel, C., Chang, C., Perera, V., Veloso, M.: A multi-modal approach for natural human-robot interaction. In: Ge, S.S., Khatib, O., Cabibihan, J.-J., Simmons, R., Williams, M.-A. (eds.) ICSR 2012. LNCS, vol. 7621, pp. 458–467. Springer, Heidelberg (2012)CrossRef
9.
Zurück zum Zitat Crandall, J.W., Goodrich, M.A., Olsen Jr., D.R., Nielsen, C.W.: Validating human-robot interaction schemes in multitasking environments. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 35(4), 438–449 (2005) Crandall, J.W., Goodrich, M.A., Olsen Jr., D.R., Nielsen, C.W.: Validating human-robot interaction schemes in multitasking environments. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 35(4), 438–449 (2005)
10.
Zurück zum Zitat Sheridan, T.B.: Humans and Automation: System Design and Research Issues. John Wiley and Sons Inc., New York (2002) Sheridan, T.B.: Humans and Automation: System Design and Research Issues. John Wiley and Sons Inc., New York (2002)
11.
Zurück zum Zitat Endsley, M.R.: Designing for Situation Awareness: An Approach to User-Centered Design. CRC Press, Boca Raton (2011)CrossRef Endsley, M.R.: Designing for Situation Awareness: An Approach to User-Centered Design. CRC Press, Boca Raton (2011)CrossRef
12.
Zurück zum Zitat Johnston, J.H., Fiore, S.M., Paris, C., Smith, C.A.: Application of Cognitive Load Theory to Developing a Measure of Team Decision Efficiency. Technical report, DTIC Document (2002) Johnston, J.H., Fiore, S.M., Paris, C., Smith, C.A.: Application of Cognitive Load Theory to Developing a Measure of Team Decision Efficiency. Technical report, DTIC Document (2002)
13.
Zurück zum Zitat Klein, G., Feltovich, P.J., Bradshaw, J.M., Woods, D.D.: Common ground and coordination in joint activity. Organ. Simul. 53, 139–184 (2005)CrossRef Klein, G., Feltovich, P.J., Bradshaw, J.M., Woods, D.D.: Common ground and coordination in joint activity. Organ. Simul. 53, 139–184 (2005)CrossRef
14.
Zurück zum Zitat Nechvatal, J.: Immersive Ideals/Critical Distances, pp. 48–60. LAP Lambert Academic Publishing, Saarbrücken (2009) Nechvatal, J.: Immersive Ideals/Critical Distances, pp. 48–60. LAP Lambert Academic Publishing, Saarbrücken (2009)
15.
Zurück zum Zitat Bolt, R.A.: “Put-that-there": Voice and Gesture at the Graphics Interface, vol. 14(3), pp. 262–270. ACM (1980) Bolt, R.A.: “Put-that-there": Voice and Gesture at the Graphics Interface, vol. 14(3), pp. 262–270. ACM (1980)
16.
Zurück zum Zitat Skubic, M., Perzanowski, D., Blisard, S., Schultz, A., Adams, W., Bugajska, M., Brock, D.: Spatial language for human-robot dialogs. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 34(2), 154–167 (2004)CrossRef Skubic, M., Perzanowski, D., Blisard, S., Schultz, A., Adams, W., Bugajska, M., Brock, D.: Spatial language for human-robot dialogs. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 34(2), 154–167 (2004)CrossRef
17.
Zurück zum Zitat Fong, T., Thorpe, C., Baur, C.: Multi-robot remote driving with collaborative control. IEEE Trans. Ind. Electron. 50(4), 699–704 (2003)CrossRef Fong, T., Thorpe, C., Baur, C.: Multi-robot remote driving with collaborative control. IEEE Trans. Ind. Electron. 50(4), 699–704 (2003)CrossRef
18.
Zurück zum Zitat Green, S.A., Chen, X., Billinghurst, M., Chase, J.G.: Collaborating with a mobile robot: an augmented reality multimodal interface. In: 17th World Congress of the International Federation of Automatic Control, pp. 15595–15600 (2008) Green, S.A., Chen, X., Billinghurst, M., Chase, J.G.: Collaborating with a mobile robot: an augmented reality multimodal interface. In: 17th World Congress of the International Federation of Automatic Control, pp. 15595–15600 (2008)
19.
Zurück zum Zitat Maida, J.C., Bowen, C.K., Pace, J.W.: Enhanced Lighting Techniques and Augmented Reality to Improve Human Task Performance. Technical report, NASA (2005) Maida, J.C., Bowen, C.K., Pace, J.W.: Enhanced Lighting Techniques and Augmented Reality to Improve Human Task Performance. Technical report, NASA (2005)
20.
Zurück zum Zitat Gerkey, B., Vaughan, R.T., Howard, A.: The player/stage project: tools for multi-robot and distributed sensor systems. In: 11th International Conference on Advanced Robotics, pp. 317–323 (2003) Gerkey, B., Vaughan, R.T., Howard, A.: The player/stage project: tools for multi-robot and distributed sensor systems. In: 11th International Conference on Advanced Robotics, pp. 317–323 (2003)
21.
Zurück zum Zitat Severinson-Eklundh, K., Green, A., Hüttenrauch, H.: Social and collaborative aspects of interaction with a service robot. Robot. Auton. Syst. 42(3), 223–234 (2003)CrossRefMATH Severinson-Eklundh, K., Green, A., Hüttenrauch, H.: Social and collaborative aspects of interaction with a service robot. Robot. Auton. Syst. 42(3), 223–234 (2003)CrossRefMATH
22.
Zurück zum Zitat Savage-Carmona, J., Billinghurst, M., Holden, A.: The virbot: a virtual reality robot driven with multimodal commands. Expert Syst. Appl. 15(3), 413–419 (1998)CrossRef Savage-Carmona, J., Billinghurst, M., Holden, A.: The virbot: a virtual reality robot driven with multimodal commands. Expert Syst. Appl. 15(3), 413–419 (1998)CrossRef
23.
Zurück zum Zitat Echeverria, G., Lemaignan, S., Degroote, A., Lacroix, S., Karg, M., Koch, P., Lesire, C., Stinckwich, S.: Simulating complex robotic scenarios with MORSE. In: Noda, I., Ando, N., Brugali, D., Kuffner, J.J. (eds.) SIMPAR 2012. LNCS, vol. 7628, pp. 197–208. Springer, Heidelberg (2012)CrossRef Echeverria, G., Lemaignan, S., Degroote, A., Lacroix, S., Karg, M., Koch, P., Lesire, C., Stinckwich, S.: Simulating complex robotic scenarios with MORSE. In: Noda, I., Ando, N., Brugali, D., Kuffner, J.J. (eds.) SIMPAR 2012. LNCS, vol. 7628, pp. 197–208. Springer, Heidelberg (2012)CrossRef
24.
Zurück zum Zitat Giuliano, L., Ng, K., Efrain, M., Lupetti, M.L., Germak, C.: Virgil, robot for museum experience: study on the opportunity given by robot capability to integrate the actual museum visit. In: 7th International Conference on Intelligent Technologies for Interactive Entertainment, pp. 222–223 (2015) Giuliano, L., Ng, K., Efrain, M., Lupetti, M.L., Germak, C.: Virgil, robot for museum experience: study on the opportunity given by robot capability to integrate the actual museum visit. In: 7th International Conference on Intelligent Technologies for Interactive Entertainment, pp. 222–223 (2015)
25.
Zurück zum Zitat Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum. Comput. Interact. 7(1), 57–78 (1995)CrossRef Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum. Comput. Interact. 7(1), 57–78 (1995)CrossRef
26.
Zurück zum Zitat Hone, K.S., Graham, R.: Towards a tool for the subjective assessment of speech system interfaces. Nat. Lang. Eng. 6(3–4), 287–303 (2000)CrossRef Hone, K.S., Graham, R.: Towards a tool for the subjective assessment of speech system interfaces. Nat. Lang. Eng. 6(3–4), 287–303 (2000)CrossRef
Metadaten
Titel
Immersive Virtual Reality-Based Simulation to Support the Design of Natural Human-Robot Interfaces for Service Robotic Applications
verfasst von
Federica Bazzano
Federico Gentilini
Fabrizio Lamberti
Andrea Sanna
Gianluca Paravati
Valentina Gatteschi
Marco Gaspardone
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-40621-3_3

Premium Partner