Skip to main content
Top

2016 | OriginalPaper | Chapter

Current Challenges for UX Evaluation of Human-Robot Interaction

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The development of socially interactive robots is expected to have an increasing importance in everyday life for a growing number of people. For social robots to provide long-term added value to people’s lives, it is of major importance to stress the need for developing a positive user experience (UX). The human-centered view emphasizes various aspects including acceptance, usability, and credibility, as they emerge in the interaction between humans and robots. In current human-robot interaction (HRI) research, UX is reckoned to be important, but is often taken for granted. However, a positive user experience does not appear by itself but has to be systematically designed and evaluated. In this paper, we focus on the role and relevance of UX in HRI and present three challenges related to the evaluation of UX in interaction with robots, addressing the need for interdisciplinary research in order to achieve long-term success of socially interactive robots.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Briefly stated, formative evaluation is typically performed during the early development of a system, while summative evaluation is performed at the end of a design process.
 
Literature
1.
go back to reference Dautenhahn, K.: Socially intelligent robots: dimensions of human-robot interaction. Phil. Trans. R. Soc. B 362(1480), 679–704 (2007)CrossRef Dautenhahn, K.: Socially intelligent robots: dimensions of human-robot interaction. Phil. Trans. R. Soc. B 362(1480), 679–704 (2007)CrossRef
2.
go back to reference Weiss, A., Bernhaupt, R., Tscheligi, M.: The USUS evaluation framework for user-centered HRI. In: Dautenhahn, K., Saunders, J. (eds.) New Frontiers in Human–Robot Interaction, pp. 89–110). John Benjamins Publishing Co, Amsterdam (2011) Weiss, A., Bernhaupt, R., Tscheligi, M.: The USUS evaluation framework for user-centered HRI. In: Dautenhahn, K., Saunders, J. (eds.) New Frontiers in Human–Robot Interaction, pp. 89–110). John Benjamins Publishing Co, Amsterdam (2011)
3.
go back to reference Thrun, S.: Toward a framework for human-robot interaction. Hum. Comput. Interact. 19(1–2), 9–24 (2004)CrossRef Thrun, S.: Toward a framework for human-robot interaction. Hum. Comput. Interact. 19(1–2), 9–24 (2004)CrossRef
4.
go back to reference Bartneck, C., Kulić, D., Croft, E., Zoghbi, S.: Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int. J. Soc. Robot. 1(1), 71–81 (2009)CrossRef Bartneck, C., Kulić, D., Croft, E., Zoghbi, S.: Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int. J. Soc. Robot. 1(1), 71–81 (2009)CrossRef
5.
go back to reference Dautenhahn, K., Saunders, J. (eds.): New Frontiers in Human-Robot Interaction. Advances in Interaction Studies. J. Benjamins Pub, Amsterdam (2011) Dautenhahn, K., Saunders, J. (eds.): New Frontiers in Human-Robot Interaction. Advances in Interaction Studies. J. Benjamins Pub, Amsterdam (2011)
6.
go back to reference Dautenhahn, K.: Methodology and themes of human-robot interaction: a growing research field. Int. J. Adv. Robot. Syst. 4(1), 103–108 (2007) Dautenhahn, K.: Methodology and themes of human-robot interaction: a growing research field. Int. J. Adv. Robot. Syst. 4(1), 103–108 (2007)
8.
go back to reference Brady, K., Tarn, T., Xi, N., Love, L., Lloyd, P., Davis, H., Burks, B.: Remote systems for waste retrieval from the Oak Ridge national laboratory gunite tanks. Int. J. Robot. Res. 17, 450–460 (1998)CrossRef Brady, K., Tarn, T., Xi, N., Love, L., Lloyd, P., Davis, H., Burks, B.: Remote systems for waste retrieval from the Oak Ridge national laboratory gunite tanks. Int. J. Robot. Res. 17, 450–460 (1998)CrossRef
9.
go back to reference Thrun, S., Hähnel, D., Ferguson, D., Montemerlo, M., Triebel, R., Burgard, W., Bakery, C., Omohundroy, Z., Thayery, S., Whittakery, W.: A system for volumetric robotic mapping of abandoned mines. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). IEEE, Piscataway, NJ (2003) Thrun, S., Hähnel, D., Ferguson, D., Montemerlo, M., Triebel, R., Burgard, W., Bakery, C., Omohundroy, Z., Thayery, S., Whittakery, W.: A system for volumetric robotic mapping of abandoned mines. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). IEEE, Piscataway, NJ (2003)
10.
go back to reference Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robot. Auton. Syst. 42(3–4), 143–166 (2003)CrossRefMATH Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robot. Auton. Syst. 42(3–4), 143–166 (2003)CrossRefMATH
11.
go back to reference Hartson, H.R., Pyla, P.S.: The UX Book: process and guidelines for ensuring a quality user experience. Elsevier, Amsterdam (2012) Hartson, H.R., Pyla, P.S.: The UX Book: process and guidelines for ensuring a quality user experience. Elsevier, Amsterdam (2012)
13.
go back to reference Hassenzahl, M., Tractinsky, N.: User experience—a research agenda. Behav. Inform. Technol. 25(2), 91–97 (2006)CrossRef Hassenzahl, M., Tractinsky, N.: User experience—a research agenda. Behav. Inform. Technol. 25(2), 91–97 (2006)CrossRef
14.
go back to reference ISO 9241-210: Human-Centred Design for Interactive Systems, International Organization for Standardization, Geneva, Switzerland (2010) ISO 9241-210: Human-Centred Design for Interactive Systems, International Organization for Standardization, Geneva, Switzerland (2010)
15.
go back to reference ISO 9241-11: Guidance on Usability, International Organization for Standardization, Geneva, Switzerland (1998) ISO 9241-11: Guidance on Usability, International Organization for Standardization, Geneva, Switzerland (1998)
16.
go back to reference Hassenzahl, M., Roto, V.: Being and doing: a perspective on user experience and its measurement. Interfaces 72, 10–12 (2007) Hassenzahl, M., Roto, V.: Being and doing: a perspective on user experience and its measurement. Interfaces 72, 10–12 (2007)
17.
go back to reference Anderson, J., McRee, J., Wilson, R., the Effective UI Team: Effective UI. O’Reilly, Sebastopol, CA (2010) Anderson, J., McRee, J., Wilson, R., the Effective UI Team: Effective UI. O’Reilly, Sebastopol, CA (2010)
18.
go back to reference de Graaf, M.M.A., Allouch, S.B.: Exploring influencing variables for the acceptance of social robots. Robot. Auton. Syst. 6(12), 1476–1486 (2013)CrossRef de Graaf, M.M.A., Allouch, S.B.: Exploring influencing variables for the acceptance of social robots. Robot. Auton. Syst. 6(12), 1476–1486 (2013)CrossRef
19.
go back to reference Alenljung, B., Lindblom, J.: User experience of socially interactive robots: its role and relevance. In: Vallverdú, J. (ed.) Handbook of Research on Synthesizing Human Emotion in Intelligent Systems and Robotics, pp. 352–364. IGI Global, Hershey (2015) Alenljung, B., Lindblom, J.: User experience of socially interactive robots: its role and relevance. In: Vallverdú, J. (ed.) Handbook of Research on Synthesizing Human Emotion in Intelligent Systems and Robotics, pp. 352–364. IGI Global, Hershey (2015)
20.
go back to reference Kim, Y., Mutlu, B.: How social distance shapes human–robot interaction. Int. J. Hum. Comput. Stud. 72, 783–795 (2014)CrossRef Kim, Y., Mutlu, B.: How social distance shapes human–robot interaction. Int. J. Hum. Comput. Stud. 72, 783–795 (2014)CrossRef
21.
go back to reference Jokinen, K., Wilcock, G.: Modelling user experience in human-robot interactions. In: Böck, R., Bonin, F., Campbell, N. Poppe, R. (eds.) Second International Workshop, MA3HMI 2014, pp. 45–56 (2015) Jokinen, K., Wilcock, G.: Modelling user experience in human-robot interactions. In: Böck, R., Bonin, F., Campbell, N. Poppe, R. (eds.) Second International Workshop, MA3HMI 2014, pp. 45–56 (2015)
22.
go back to reference Moon, A.J., Zheng, M., Troniak, D.M., Blumer, B., Gleeson, B., MacLean, K., Pan, M.K.X.J., Croft, E.A.: Meet me where I’m gazing: how shared attention gaze affects human-robot handover timing. Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction, pp. 334–341. ACM, Bielefeld (2014)CrossRef Moon, A.J., Zheng, M., Troniak, D.M., Blumer, B., Gleeson, B., MacLean, K., Pan, M.K.X.J., Croft, E.A.: Meet me where I’m gazing: how shared attention gaze affects human-robot handover timing. Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction, pp. 334–341. ACM, Bielefeld (2014)CrossRef
23.
go back to reference Juarez, A., Bartneck, C., Feijs, L.: Using semantic technologies to describe robotic embodiments. In: Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 425–432. Lausanne, Switzerland (2011) Juarez, A., Bartneck, C., Feijs, L.: Using semantic technologies to describe robotic embodiments. In: Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 425–432. Lausanne, Switzerland (2011)
24.
go back to reference Callejas, Z., Griol, D., López-Cózar, R.: A framework for the assessment of synthetic personalities according to user perception. Int. J. Hum. Comput. Stud. 72(7), 567–583 (2014)CrossRef Callejas, Z., Griol, D., López-Cózar, R.: A framework for the assessment of synthetic personalities according to user perception. Int. J. Hum. Comput. Stud. 72(7), 567–583 (2014)CrossRef
25.
go back to reference Karreman, D., Ludden, G., Evers, V.: Visiting cultural heritage with a tour guide robot: a user evaluation study in-the-wild. In: Tapus, A., André, E., Martin, J.C., Ferland, F., Ammi, M. (eds.) Social Robotics. LNCS, vol. 9388, pp. 317–326. Springer International Publishing, Switzerland (2015) Karreman, D., Ludden, G., Evers, V.: Visiting cultural heritage with a tour guide robot: a user evaluation study in-the-wild. In: Tapus, A., André, E., Martin, J.C., Ferland, F., Ammi, M. (eds.) Social Robotics. LNCS, vol. 9388, pp. 317–326. Springer International Publishing, Switzerland (2015)
26.
go back to reference dos Santos, T.F., de Castro, D.G., Masiero, A.A., Aquino Junior, P.T.: Behavioral persona for human-robot interaction: a study based on pet robot. Proceedings of the 16th International Conference. HCI International, pp. 687–696. Heraklion, Crete (2014) dos Santos, T.F., de Castro, D.G., Masiero, A.A., Aquino Junior, P.T.: Behavioral persona for human-robot interaction: a study based on pet robot. Proceedings of the 16th International Conference. HCI International, pp. 687–696. Heraklion, Crete (2014)
27.
go back to reference Xu, Q., Ng, J., Cheong, Y.L., Tan, O., Wong, J.B., Tay, T.C., Park, T. (2012). The role of social context in human-robot interaction. Southeast Asian Network of Ergonomics Societies Conference (SEANES). Langkawi, Kedah Xu, Q., Ng, J., Cheong, Y.L., Tan, O., Wong, J.B., Tay, T.C., Park, T. (2012). The role of social context in human-robot interaction. Southeast Asian Network of Ergonomics Societies Conference (SEANES). Langkawi, Kedah
28.
go back to reference Beňuš, Š.: Social aspects of entrainment in spoken interaction. Cog. Comp. 6(4), 802–813 (2014)CrossRef Beňuš, Š.: Social aspects of entrainment in spoken interaction. Cog. Comp. 6(4), 802–813 (2014)CrossRef
29.
go back to reference Cohen, I., Looije, R., Neerincx, M.A.: Child’s perception of robot’s emotions: effects of platform, context and experience. Int. J. Soc. Robot. 6, 507–518 (2014)CrossRef Cohen, I., Looije, R., Neerincx, M.A.: Child’s perception of robot’s emotions: effects of platform, context and experience. Int. J. Soc. Robot. 6, 507–518 (2014)CrossRef
30.
go back to reference Holthaus, P., Wachsmuth, S.: The receptionist robot. In: Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction. ACM, pp. 329. Bielefeld, Germany (2014) Holthaus, P., Wachsmuth, S.: The receptionist robot. In: Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction. ACM, pp. 329. Bielefeld, Germany (2014)
31.
go back to reference Anzalone, S.M., Boucenna, S., Ivaldi, S., Chetouani, M.: Evaluating the engagement with social robots. Int. J. Soc. Robot. 7(4), 465–478 (2015)CrossRef Anzalone, S.M., Boucenna, S., Ivaldi, S., Chetouani, M.: Evaluating the engagement with social robots. Int. J. Soc. Robot. 7(4), 465–478 (2015)CrossRef
32.
go back to reference Bevilacqua, R., Felici, E., Marcellini, F., Glende, S., Klemcke, S., Conrad, I., Esposito, R., Cavallo, F., Dario, P.: Robot-era project: preliminary results on the system usability. In: Marcus, A. (ed.) Design, User Experience, and Usability: Interactive Experience Design: 4th International Conference, DUXU 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, Proceedings, Part III, pp. 553-561, Springer International Publishing, Cham, 2–7 Aug 2015 Bevilacqua, R., Felici, E., Marcellini, F., Glende, S., Klemcke, S., Conrad, I., Esposito, R., Cavallo, F., Dario, P.: Robot-era project: preliminary results on the system usability. In: Marcus, A. (ed.) Design, User Experience, and Usability: Interactive Experience Design: 4th International Conference, DUXU 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, Proceedings, Part III, pp. 553-561, Springer International Publishing, Cham, 2–7 Aug 2015
33.
go back to reference Cesta, A., Cortellessa, G., Orlandini, A., Tiberio, L.: Long-term evaluation of a telepresence robot for the elderly: methodology and ecological case study. Int. J. Soc. Robot. 1–20 (2016) Cesta, A., Cortellessa, G., Orlandini, A., Tiberio, L.: Long-term evaluation of a telepresence robot for the elderly: methodology and ecological case study. Int. J. Soc. Robot. 1–20 (2016)
34.
go back to reference Johnson, D.O., Cuijpers, R.H., Juola, J.F., Torta, E., Simonov, M., Frisiello, A., Bazzani, M., Yan, W., Weber, C., Wermter, S., Meins, N., Oberzaucher, J., Panek, P., Edelmayer, G., Mayer, P., Beck, C.: Socially assistive robots: a comprehensive approach to extending independent living. Int. J. Soc. Robot. 6, 195–211 (2014)CrossRef Johnson, D.O., Cuijpers, R.H., Juola, J.F., Torta, E., Simonov, M., Frisiello, A., Bazzani, M., Yan, W., Weber, C., Wermter, S., Meins, N., Oberzaucher, J., Panek, P., Edelmayer, G., Mayer, P., Beck, C.: Socially assistive robots: a comprehensive approach to extending independent living. Int. J. Soc. Robot. 6, 195–211 (2014)CrossRef
35.
go back to reference Lohse, M., Siepmann, F., Wachsmuth, S.: A modeling framework for user-driven iterative design of autonomous systems. Int. J. Soc. Robot. 6, 121–139 (2014)CrossRef Lohse, M., Siepmann, F., Wachsmuth, S.: A modeling framework for user-driven iterative design of autonomous systems. Int. J. Soc. Robot. 6, 121–139 (2014)CrossRef
36.
go back to reference Goodman, E., Kuniavsky, M., Moed, A.: Observing the user experience: a practitioner’s guide to user research. Morgan Kaufmann Publishers, San Francisco (2013) Goodman, E., Kuniavsky, M., Moed, A.: Observing the user experience: a practitioner’s guide to user research. Morgan Kaufmann Publishers, San Francisco (2013)
37.
go back to reference Young, J.E., Sung, J., Voida, A., Sharlin, E., Igarashi, T., Christensen, H.I., Grinter, R.E.: Evaluating human-robot interaction—focusing on the holistic interaction experience. Int. J. Soc. Robot. 3(1), 53–67 (2011)CrossRef Young, J.E., Sung, J., Voida, A., Sharlin, E., Igarashi, T., Christensen, H.I., Grinter, R.E.: Evaluating human-robot interaction—focusing on the holistic interaction experience. Int. J. Soc. Robot. 3(1), 53–67 (2011)CrossRef
Metadata
Title
Current Challenges for UX Evaluation of Human-Robot Interaction
Authors
Jessica Lindblom
Rebecca Andreasson
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-41697-7_24

Premium Partner