Skip to main content

2016 | OriginalPaper | Buchkapitel

Current Challenges for UX Evaluation of Human-Robot Interaction

verfasst von : Jessica Lindblom, Rebecca Andreasson

Erschienen in: Advances in Ergonomics of Manufacturing: Managing the Enterprise of the Future

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The development of socially interactive robots is expected to have an increasing importance in everyday life for a growing number of people. For social robots to provide long-term added value to people’s lives, it is of major importance to stress the need for developing a positive user experience (UX). The human-centered view emphasizes various aspects including acceptance, usability, and credibility, as they emerge in the interaction between humans and robots. In current human-robot interaction (HRI) research, UX is reckoned to be important, but is often taken for granted. However, a positive user experience does not appear by itself but has to be systematically designed and evaluated. In this paper, we focus on the role and relevance of UX in HRI and present three challenges related to the evaluation of UX in interaction with robots, addressing the need for interdisciplinary research in order to achieve long-term success of socially interactive robots.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Briefly stated, formative evaluation is typically performed during the early development of a system, while summative evaluation is performed at the end of a design process.
 
Literatur
1.
Zurück zum Zitat Dautenhahn, K.: Socially intelligent robots: dimensions of human-robot interaction. Phil. Trans. R. Soc. B 362(1480), 679–704 (2007)CrossRef Dautenhahn, K.: Socially intelligent robots: dimensions of human-robot interaction. Phil. Trans. R. Soc. B 362(1480), 679–704 (2007)CrossRef
2.
Zurück zum Zitat Weiss, A., Bernhaupt, R., Tscheligi, M.: The USUS evaluation framework for user-centered HRI. In: Dautenhahn, K., Saunders, J. (eds.) New Frontiers in Human–Robot Interaction, pp. 89–110). John Benjamins Publishing Co, Amsterdam (2011) Weiss, A., Bernhaupt, R., Tscheligi, M.: The USUS evaluation framework for user-centered HRI. In: Dautenhahn, K., Saunders, J. (eds.) New Frontiers in Human–Robot Interaction, pp. 89–110). John Benjamins Publishing Co, Amsterdam (2011)
3.
Zurück zum Zitat Thrun, S.: Toward a framework for human-robot interaction. Hum. Comput. Interact. 19(1–2), 9–24 (2004)CrossRef Thrun, S.: Toward a framework for human-robot interaction. Hum. Comput. Interact. 19(1–2), 9–24 (2004)CrossRef
4.
Zurück zum Zitat Bartneck, C., Kulić, D., Croft, E., Zoghbi, S.: Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int. J. Soc. Robot. 1(1), 71–81 (2009)CrossRef Bartneck, C., Kulić, D., Croft, E., Zoghbi, S.: Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int. J. Soc. Robot. 1(1), 71–81 (2009)CrossRef
5.
Zurück zum Zitat Dautenhahn, K., Saunders, J. (eds.): New Frontiers in Human-Robot Interaction. Advances in Interaction Studies. J. Benjamins Pub, Amsterdam (2011) Dautenhahn, K., Saunders, J. (eds.): New Frontiers in Human-Robot Interaction. Advances in Interaction Studies. J. Benjamins Pub, Amsterdam (2011)
6.
Zurück zum Zitat Dautenhahn, K.: Methodology and themes of human-robot interaction: a growing research field. Int. J. Adv. Robot. Syst. 4(1), 103–108 (2007) Dautenhahn, K.: Methodology and themes of human-robot interaction: a growing research field. Int. J. Adv. Robot. Syst. 4(1), 103–108 (2007)
8.
Zurück zum Zitat Brady, K., Tarn, T., Xi, N., Love, L., Lloyd, P., Davis, H., Burks, B.: Remote systems for waste retrieval from the Oak Ridge national laboratory gunite tanks. Int. J. Robot. Res. 17, 450–460 (1998)CrossRef Brady, K., Tarn, T., Xi, N., Love, L., Lloyd, P., Davis, H., Burks, B.: Remote systems for waste retrieval from the Oak Ridge national laboratory gunite tanks. Int. J. Robot. Res. 17, 450–460 (1998)CrossRef
9.
Zurück zum Zitat Thrun, S., Hähnel, D., Ferguson, D., Montemerlo, M., Triebel, R., Burgard, W., Bakery, C., Omohundroy, Z., Thayery, S., Whittakery, W.: A system for volumetric robotic mapping of abandoned mines. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). IEEE, Piscataway, NJ (2003) Thrun, S., Hähnel, D., Ferguson, D., Montemerlo, M., Triebel, R., Burgard, W., Bakery, C., Omohundroy, Z., Thayery, S., Whittakery, W.: A system for volumetric robotic mapping of abandoned mines. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). IEEE, Piscataway, NJ (2003)
10.
Zurück zum Zitat Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robot. Auton. Syst. 42(3–4), 143–166 (2003)CrossRefMATH Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robot. Auton. Syst. 42(3–4), 143–166 (2003)CrossRefMATH
11.
Zurück zum Zitat Hartson, H.R., Pyla, P.S.: The UX Book: process and guidelines for ensuring a quality user experience. Elsevier, Amsterdam (2012) Hartson, H.R., Pyla, P.S.: The UX Book: process and guidelines for ensuring a quality user experience. Elsevier, Amsterdam (2012)
13.
Zurück zum Zitat Hassenzahl, M., Tractinsky, N.: User experience—a research agenda. Behav. Inform. Technol. 25(2), 91–97 (2006)CrossRef Hassenzahl, M., Tractinsky, N.: User experience—a research agenda. Behav. Inform. Technol. 25(2), 91–97 (2006)CrossRef
14.
Zurück zum Zitat ISO 9241-210: Human-Centred Design for Interactive Systems, International Organization for Standardization, Geneva, Switzerland (2010) ISO 9241-210: Human-Centred Design for Interactive Systems, International Organization for Standardization, Geneva, Switzerland (2010)
15.
Zurück zum Zitat ISO 9241-11: Guidance on Usability, International Organization for Standardization, Geneva, Switzerland (1998) ISO 9241-11: Guidance on Usability, International Organization for Standardization, Geneva, Switzerland (1998)
16.
Zurück zum Zitat Hassenzahl, M., Roto, V.: Being and doing: a perspective on user experience and its measurement. Interfaces 72, 10–12 (2007) Hassenzahl, M., Roto, V.: Being and doing: a perspective on user experience and its measurement. Interfaces 72, 10–12 (2007)
17.
Zurück zum Zitat Anderson, J., McRee, J., Wilson, R., the Effective UI Team: Effective UI. O’Reilly, Sebastopol, CA (2010) Anderson, J., McRee, J., Wilson, R., the Effective UI Team: Effective UI. O’Reilly, Sebastopol, CA (2010)
18.
Zurück zum Zitat de Graaf, M.M.A., Allouch, S.B.: Exploring influencing variables for the acceptance of social robots. Robot. Auton. Syst. 6(12), 1476–1486 (2013)CrossRef de Graaf, M.M.A., Allouch, S.B.: Exploring influencing variables for the acceptance of social robots. Robot. Auton. Syst. 6(12), 1476–1486 (2013)CrossRef
19.
Zurück zum Zitat Alenljung, B., Lindblom, J.: User experience of socially interactive robots: its role and relevance. In: Vallverdú, J. (ed.) Handbook of Research on Synthesizing Human Emotion in Intelligent Systems and Robotics, pp. 352–364. IGI Global, Hershey (2015) Alenljung, B., Lindblom, J.: User experience of socially interactive robots: its role and relevance. In: Vallverdú, J. (ed.) Handbook of Research on Synthesizing Human Emotion in Intelligent Systems and Robotics, pp. 352–364. IGI Global, Hershey (2015)
20.
Zurück zum Zitat Kim, Y., Mutlu, B.: How social distance shapes human–robot interaction. Int. J. Hum. Comput. Stud. 72, 783–795 (2014)CrossRef Kim, Y., Mutlu, B.: How social distance shapes human–robot interaction. Int. J. Hum. Comput. Stud. 72, 783–795 (2014)CrossRef
21.
Zurück zum Zitat Jokinen, K., Wilcock, G.: Modelling user experience in human-robot interactions. In: Böck, R., Bonin, F., Campbell, N. Poppe, R. (eds.) Second International Workshop, MA3HMI 2014, pp. 45–56 (2015) Jokinen, K., Wilcock, G.: Modelling user experience in human-robot interactions. In: Böck, R., Bonin, F., Campbell, N. Poppe, R. (eds.) Second International Workshop, MA3HMI 2014, pp. 45–56 (2015)
22.
Zurück zum Zitat Moon, A.J., Zheng, M., Troniak, D.M., Blumer, B., Gleeson, B., MacLean, K., Pan, M.K.X.J., Croft, E.A.: Meet me where I’m gazing: how shared attention gaze affects human-robot handover timing. Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction, pp. 334–341. ACM, Bielefeld (2014)CrossRef Moon, A.J., Zheng, M., Troniak, D.M., Blumer, B., Gleeson, B., MacLean, K., Pan, M.K.X.J., Croft, E.A.: Meet me where I’m gazing: how shared attention gaze affects human-robot handover timing. Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction, pp. 334–341. ACM, Bielefeld (2014)CrossRef
23.
Zurück zum Zitat Juarez, A., Bartneck, C., Feijs, L.: Using semantic technologies to describe robotic embodiments. In: Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 425–432. Lausanne, Switzerland (2011) Juarez, A., Bartneck, C., Feijs, L.: Using semantic technologies to describe robotic embodiments. In: Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 425–432. Lausanne, Switzerland (2011)
24.
Zurück zum Zitat Callejas, Z., Griol, D., López-Cózar, R.: A framework for the assessment of synthetic personalities according to user perception. Int. J. Hum. Comput. Stud. 72(7), 567–583 (2014)CrossRef Callejas, Z., Griol, D., López-Cózar, R.: A framework for the assessment of synthetic personalities according to user perception. Int. J. Hum. Comput. Stud. 72(7), 567–583 (2014)CrossRef
25.
Zurück zum Zitat Karreman, D., Ludden, G., Evers, V.: Visiting cultural heritage with a tour guide robot: a user evaluation study in-the-wild. In: Tapus, A., André, E., Martin, J.C., Ferland, F., Ammi, M. (eds.) Social Robotics. LNCS, vol. 9388, pp. 317–326. Springer International Publishing, Switzerland (2015) Karreman, D., Ludden, G., Evers, V.: Visiting cultural heritage with a tour guide robot: a user evaluation study in-the-wild. In: Tapus, A., André, E., Martin, J.C., Ferland, F., Ammi, M. (eds.) Social Robotics. LNCS, vol. 9388, pp. 317–326. Springer International Publishing, Switzerland (2015)
26.
Zurück zum Zitat dos Santos, T.F., de Castro, D.G., Masiero, A.A., Aquino Junior, P.T.: Behavioral persona for human-robot interaction: a study based on pet robot. Proceedings of the 16th International Conference. HCI International, pp. 687–696. Heraklion, Crete (2014) dos Santos, T.F., de Castro, D.G., Masiero, A.A., Aquino Junior, P.T.: Behavioral persona for human-robot interaction: a study based on pet robot. Proceedings of the 16th International Conference. HCI International, pp. 687–696. Heraklion, Crete (2014)
27.
Zurück zum Zitat Xu, Q., Ng, J., Cheong, Y.L., Tan, O., Wong, J.B., Tay, T.C., Park, T. (2012). The role of social context in human-robot interaction. Southeast Asian Network of Ergonomics Societies Conference (SEANES). Langkawi, Kedah Xu, Q., Ng, J., Cheong, Y.L., Tan, O., Wong, J.B., Tay, T.C., Park, T. (2012). The role of social context in human-robot interaction. Southeast Asian Network of Ergonomics Societies Conference (SEANES). Langkawi, Kedah
28.
Zurück zum Zitat Beňuš, Š.: Social aspects of entrainment in spoken interaction. Cog. Comp. 6(4), 802–813 (2014)CrossRef Beňuš, Š.: Social aspects of entrainment in spoken interaction. Cog. Comp. 6(4), 802–813 (2014)CrossRef
29.
Zurück zum Zitat Cohen, I., Looije, R., Neerincx, M.A.: Child’s perception of robot’s emotions: effects of platform, context and experience. Int. J. Soc. Robot. 6, 507–518 (2014)CrossRef Cohen, I., Looije, R., Neerincx, M.A.: Child’s perception of robot’s emotions: effects of platform, context and experience. Int. J. Soc. Robot. 6, 507–518 (2014)CrossRef
30.
Zurück zum Zitat Holthaus, P., Wachsmuth, S.: The receptionist robot. In: Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction. ACM, pp. 329. Bielefeld, Germany (2014) Holthaus, P., Wachsmuth, S.: The receptionist robot. In: Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction. ACM, pp. 329. Bielefeld, Germany (2014)
31.
Zurück zum Zitat Anzalone, S.M., Boucenna, S., Ivaldi, S., Chetouani, M.: Evaluating the engagement with social robots. Int. J. Soc. Robot. 7(4), 465–478 (2015)CrossRef Anzalone, S.M., Boucenna, S., Ivaldi, S., Chetouani, M.: Evaluating the engagement with social robots. Int. J. Soc. Robot. 7(4), 465–478 (2015)CrossRef
32.
Zurück zum Zitat Bevilacqua, R., Felici, E., Marcellini, F., Glende, S., Klemcke, S., Conrad, I., Esposito, R., Cavallo, F., Dario, P.: Robot-era project: preliminary results on the system usability. In: Marcus, A. (ed.) Design, User Experience, and Usability: Interactive Experience Design: 4th International Conference, DUXU 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, Proceedings, Part III, pp. 553-561, Springer International Publishing, Cham, 2–7 Aug 2015 Bevilacqua, R., Felici, E., Marcellini, F., Glende, S., Klemcke, S., Conrad, I., Esposito, R., Cavallo, F., Dario, P.: Robot-era project: preliminary results on the system usability. In: Marcus, A. (ed.) Design, User Experience, and Usability: Interactive Experience Design: 4th International Conference, DUXU 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, Proceedings, Part III, pp. 553-561, Springer International Publishing, Cham, 2–7 Aug 2015
33.
Zurück zum Zitat Cesta, A., Cortellessa, G., Orlandini, A., Tiberio, L.: Long-term evaluation of a telepresence robot for the elderly: methodology and ecological case study. Int. J. Soc. Robot. 1–20 (2016) Cesta, A., Cortellessa, G., Orlandini, A., Tiberio, L.: Long-term evaluation of a telepresence robot for the elderly: methodology and ecological case study. Int. J. Soc. Robot. 1–20 (2016)
34.
Zurück zum Zitat Johnson, D.O., Cuijpers, R.H., Juola, J.F., Torta, E., Simonov, M., Frisiello, A., Bazzani, M., Yan, W., Weber, C., Wermter, S., Meins, N., Oberzaucher, J., Panek, P., Edelmayer, G., Mayer, P., Beck, C.: Socially assistive robots: a comprehensive approach to extending independent living. Int. J. Soc. Robot. 6, 195–211 (2014)CrossRef Johnson, D.O., Cuijpers, R.H., Juola, J.F., Torta, E., Simonov, M., Frisiello, A., Bazzani, M., Yan, W., Weber, C., Wermter, S., Meins, N., Oberzaucher, J., Panek, P., Edelmayer, G., Mayer, P., Beck, C.: Socially assistive robots: a comprehensive approach to extending independent living. Int. J. Soc. Robot. 6, 195–211 (2014)CrossRef
35.
Zurück zum Zitat Lohse, M., Siepmann, F., Wachsmuth, S.: A modeling framework for user-driven iterative design of autonomous systems. Int. J. Soc. Robot. 6, 121–139 (2014)CrossRef Lohse, M., Siepmann, F., Wachsmuth, S.: A modeling framework for user-driven iterative design of autonomous systems. Int. J. Soc. Robot. 6, 121–139 (2014)CrossRef
36.
Zurück zum Zitat Goodman, E., Kuniavsky, M., Moed, A.: Observing the user experience: a practitioner’s guide to user research. Morgan Kaufmann Publishers, San Francisco (2013) Goodman, E., Kuniavsky, M., Moed, A.: Observing the user experience: a practitioner’s guide to user research. Morgan Kaufmann Publishers, San Francisco (2013)
37.
Zurück zum Zitat Young, J.E., Sung, J., Voida, A., Sharlin, E., Igarashi, T., Christensen, H.I., Grinter, R.E.: Evaluating human-robot interaction—focusing on the holistic interaction experience. Int. J. Soc. Robot. 3(1), 53–67 (2011)CrossRef Young, J.E., Sung, J., Voida, A., Sharlin, E., Igarashi, T., Christensen, H.I., Grinter, R.E.: Evaluating human-robot interaction—focusing on the holistic interaction experience. Int. J. Soc. Robot. 3(1), 53–67 (2011)CrossRef
Metadaten
Titel
Current Challenges for UX Evaluation of Human-Robot Interaction
verfasst von
Jessica Lindblom
Rebecca Andreasson
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-41697-7_24