Skip to main content
Top

2019 | OriginalPaper | Chapter

Do Smart Speakers Respond to Their Errors Properly? A Study on Human-Computer Dialogue Strategy

Authors : Xiang Ge, Dan Li, Daisong Guan, Shihui Xu, Yanyan Sun, Moli Zhou

Published in: Design, User Experience, and Usability. User Experience in Advanced Technological Environments

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

As smart speakers with voice interaction capability permeate continuously in the world, more and more people will gradually get used to the new interaction medium–voice. Although speech recognition, natural language processing (NLP) have been greatly improved over the past few years, users still may encounter errors from time to time like “cannot understand”, “no requested audio resource (such as music)”, which can frustrate users. Therefore, when an error message is reported, it is vital that the smart speaker gives an effective and proper response. However, currently the response strategies adopted by leading smart speaker brands in China differed mainly on two dimensions: “apology or not” and “humor or neutral”. We explored user’s preference of response strategies under two error scenarios——“cannot understand” and “no requested audio resource”. A 2 (apology: yes vs. no) × 2 (error message expression tone: humor vs. neutral) within-subjects experiment was conducted. Two dependent variables (satisfaction and perceived sincerity of response) were measured. The results showed that participants were more satisfied and perceived higher sincerity when smart speaker apologized in both error scenarios. In the “no requested audio resource” scenario, humor had no significant impact on the perception of satisfaction and sincerity. But in the “cannot understand” scenario, humorous expression decreased perceived sincerity.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Pyae, A., Joelsson, T.N.: Investigating the usability and user experiences of voice user interface: a case of Google home smart speaker. In: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI 2018), pp. 127–131. ACM, New York (2016) Pyae, A., Joelsson, T.N.: Investigating the usability and user experiences of voice user interface: a case of Google home smart speaker. In: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI 2018), pp. 127–131. ACM, New York (2016)
3.
go back to reference Gao, Y., Pan, Z., Wang, H., Chen, G.: Alexa, My love: analyzing reviews of Amazon echo. In: 2018 IEEE Smart World, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation, pp. 372–380. IEEE Press, New York (2018) Gao, Y., Pan, Z., Wang, H., Chen, G.: Alexa, My love: analyzing reviews of Amazon echo. In: 2018 IEEE Smart World, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation, pp. 372–380. IEEE Press, New York (2018)
6.
go back to reference Bargas-Avila, J.A., Brenzikofer, O., Roth, S.P., Tuch, A.N., Orsini, S., Opwis, K.: Simple but crucial user interfaces in the world wide web: introducing 20 guidelines for usable web form design. In: Matrai, R. (ed.) User Interfaces. InTech (2010) Bargas-Avila, J.A., Brenzikofer, O., Roth, S.P., Tuch, A.N., Orsini, S., Opwis, K.: Simple but crucial user interfaces in the world wide web: introducing 20 guidelines for usable web form design. In: Matrai, R. (ed.) User Interfaces. InTech (2010)
7.
go back to reference Bargas-Avila, J.A., Oberholzer, G., Schmutz, P., de Vito, M., Opwis, K.: Usable error message presentation in the world wide web: do not show errors right away. Interact. Comput. 19(3), 330–341 (2007)CrossRef Bargas-Avila, J.A., Oberholzer, G., Schmutz, P., de Vito, M., Opwis, K.: Usable error message presentation in the world wide web: do not show errors right away. Interact. Comput. 19(3), 330–341 (2007)CrossRef
8.
go back to reference Klein, J., Moon, Y., Picard, R.W.: This computer responds to user frustration: theory, design, and results. Interact. Comput. 14(2), 119–140 (2002)CrossRef Klein, J., Moon, Y., Picard, R.W.: This computer responds to user frustration: theory, design, and results. Interact. Comput. 14(2), 119–140 (2002)CrossRef
9.
go back to reference Hone, K., Aktar, F., Saffu, M.: Affective agents to reduce user frustration: the role of agent embodiment. In: Proceedings of Human-Computer Interaction (HCI 2003), Bath, UK (2003) Hone, K., Aktar, F., Saffu, M.: Affective agents to reduce user frustration: the role of agent embodiment. In: Proceedings of Human-Computer Interaction (HCI 2003), Bath, UK (2003)
10.
go back to reference Hone, K.: Empathic agents to reduce user frustration: the effects of varying agent characteristics. Interact. Comput. 18(2), 227–245 (2006)CrossRef Hone, K.: Empathic agents to reduce user frustration: the effects of varying agent characteristics. Interact. Comput. 18(2), 227–245 (2006)CrossRef
11.
go back to reference Feigenblat, G., Konopnicki, D., Shmueli-Scheuer, M., Herzig, J., Shkedi, H.: I understand your frustration. In: Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion, pp. 25–28. ACM, New York (2016) Feigenblat, G., Konopnicki, D., Shmueli-Scheuer, M., Herzig, J., Shkedi, H.: I understand your frustration. In: Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion, pp. 25–28. ACM, New York (2016)
12.
go back to reference Rajendran, R., Iyer, S., Murthy, S.: Personalized affective feedback to address students’ frustration in ITS. IEEE Trans. Learn. Technol., 1 (2018) Rajendran, R., Iyer, S., Murthy, S.: Personalized affective feedback to address students’ frustration in ITS. IEEE Trans. Learn. Technol., 1 (2018)
13.
go back to reference Purington, A., Taft, J.G., Sannon, S., Bazarova, N.N., Taylor, S.H.: Alexa is my new BFF: social roles, user satisfaction, and personification of the amazon echo. In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2853–2859. ACM, New York (2017) Purington, A., Taft, J.G., Sannon, S., Bazarova, N.N., Taylor, S.H.: Alexa is my new BFF: social roles, user satisfaction, and personification of the amazon echo. In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2853–2859. ACM, New York (2017)
14.
go back to reference Lopatovska, I., Williams, H.: Personification of the Amazon Alexa: BFF or a mindless companion. In: Proceedings of the 2018 Conference on Human Information Interaction & Retrieval, pp. 265–268. ACM, New York (2018) Lopatovska, I., Williams, H.: Personification of the Amazon Alexa: BFF or a mindless companion. In: Proceedings of the 2018 Conference on Human Information Interaction & Retrieval, pp. 265–268. ACM, New York (2018)
15.
go back to reference Suo, Z.Y.: Pragmatics in Chinese: A Course Book. Beijing University Press, Beijing (2000) Suo, Z.Y.: Pragmatics in Chinese: A Course Book. Beijing University Press, Beijing (2000)
16.
go back to reference Luger, E., Sellen, A.: “Like Having a Really Bad PA”: the Gulf between user expectation and experience of conversational agents. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 5286–5297. ACM, New York (2016) Luger, E., Sellen, A.: “Like Having a Really Bad PA”: the Gulf between user expectation and experience of conversational agents. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 5286–5297. ACM, New York (2016)
17.
go back to reference Myers, C., Furqan, A., Nebolsky, J., Caro, K., Zhu, J.: Patterns for how users overcome obstacles in voice user interfaces. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, p. 6. ACM, New York (2018) Myers, C., Furqan, A., Nebolsky, J., Caro, K., Zhu, J.: Patterns for how users overcome obstacles in voice user interfaces. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, p. 6. ACM, New York (2018)
18.
go back to reference Prendinger, H., Ishizuka, M.: The empathic companion: a character-based interface that addresses users’ affective states. Appl. Artif. Intell. 19(3–4), 267–285 (2005)CrossRef Prendinger, H., Ishizuka, M.: The empathic companion: a character-based interface that addresses users’ affective states. Appl. Artif. Intell. 19(3–4), 267–285 (2005)CrossRef
19.
go back to reference Woolf, B., Burleson, W., Arroyo, I., Dragon, T., Cooper, D., Picard, R.: Affect-aware tutors: recognizing and responding to student affect. Int. J. Learn. Technol. 4(3–4), 129–164 (2009)CrossRef Woolf, B., Burleson, W., Arroyo, I., Dragon, T., Cooper, D., Picard, R.: Affect-aware tutors: recognizing and responding to student affect. Int. J. Learn. Technol. 4(3–4), 129–164 (2009)CrossRef
20.
go back to reference Park, E.K., Lee, K.M., Shin, D.H.: Social responses to conversational TV VUI: apology and voice. Int. J. Technol. Hum. Interact. 11(1), 17–32 (2015)CrossRef Park, E.K., Lee, K.M., Shin, D.H.: Social responses to conversational TV VUI: apology and voice. Int. J. Technol. Hum. Interact. 11(1), 17–32 (2015)CrossRef
21.
go back to reference Blum-Kulka, S., Olshtain, E.: Requests and apologies: a cross-cultural study of speech act realization patterns (CCSARP). Appl. Linguist. 5(3), 196–213 (1984)CrossRef Blum-Kulka, S., Olshtain, E.: Requests and apologies: a cross-cultural study of speech act realization patterns (CCSARP). Appl. Linguist. 5(3), 196–213 (1984)CrossRef
22.
go back to reference Akgun, M., Cagiltay, K., Zeyrek, D.: The effect of apologetic error messages and mood states on computer users’ self-appraisal of performance. J. Pragmat. 42(9), 2430–2448 (2010)CrossRef Akgun, M., Cagiltay, K., Zeyrek, D.: The effect of apologetic error messages and mood states on computer users’ self-appraisal of performance. J. Pragmat. 42(9), 2430–2448 (2010)CrossRef
23.
go back to reference Tzeng, J.Y.: Toward a more civilized design: studying the effects of computers that apologize. Int. J. Hum. Comput. Stud. 61(3), 319–345 (2004)CrossRef Tzeng, J.Y.: Toward a more civilized design: studying the effects of computers that apologize. Int. J. Hum. Comput. Stud. 61(3), 319–345 (2004)CrossRef
24.
go back to reference Park, S.J., MacDonald, C.M., Khoo, M.: Do you care if a computer says sorry? User experience design through affective messages. In: Proceedings of the Designing Interactive Systems Conference, pp. 731–740. ACM, New York (2012) Park, S.J., MacDonald, C.M., Khoo, M.: Do you care if a computer says sorry? User experience design through affective messages. In: Proceedings of the Designing Interactive Systems Conference, pp. 731–740. ACM, New York (2012)
25.
go back to reference Baylor, A.L., Warren, D., Park, C.H., Shen, E., Perez, R.: The impact of frustration-mitigating messages delivered by an interface agent. In: Artificial Intelligence in Education: Supporting Learning through Intelligent and Socially Informed Technology, vol. 125, pp. 73–79. IOS Press, Amsterdam (2005) Baylor, A.L., Warren, D., Park, C.H., Shen, E., Perez, R.: The impact of frustration-mitigating messages delivered by an interface agent. In: Artificial Intelligence in Education: Supporting Learning through Intelligent and Socially Informed Technology, vol. 125, pp. 73–79. IOS Press, Amsterdam (2005)
26.
go back to reference Jaksic, N., Branco, P., Stephenson, P., Encarnaçao, L.M.: The effectiveness of social agents in reducing user frustration. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 917–922. ACM, New York (2006) Jaksic, N., Branco, P., Stephenson, P., Encarnaçao, L.M.: The effectiveness of social agents in reducing user frustration. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 917–922. ACM, New York (2006)
27.
go back to reference de Visser, E.J., Monfort, S.S., McKendrick, R., Smith, M.A., McKnight, P.E., Krueger, F., Parasuraman, R.: Almost human: anthropomorphism increases trust resilience in cognitive agents. J. Exp. Psychol. Appl. 22(3), 331 (2016)CrossRef de Visser, E.J., Monfort, S.S., McKendrick, R., Smith, M.A., McKnight, P.E., Krueger, F., Parasuraman, R.: Almost human: anthropomorphism increases trust resilience in cognitive agents. J. Exp. Psychol. Appl. 22(3), 331 (2016)CrossRef
28.
go back to reference Nijholt, A.: From word play to world play: introducing humor in human-computer interaction. In: Proceedings of the 36th European Conference on Cognitive Ergonomics, p. 1. ACM, New York (2018) Nijholt, A.: From word play to world play: introducing humor in human-computer interaction. In: Proceedings of the 36th European Conference on Cognitive Ergonomics, p. 1. ACM, New York (2018)
29.
go back to reference Nijholt, A., Niculescu, A.I., Valitutti, A., Banchs, R.E.: Humor in human computer interaction. A short survey. In: Adjunct Proceedings of INTERACT 2017, pp. 192–214. IDC, Indian Institute of Technology, Bombay, India (2017) Nijholt, A., Niculescu, A.I., Valitutti, A., Banchs, R.E.: Humor in human computer interaction. A short survey. In: Adjunct Proceedings of INTERACT 2017, pp. 192–214. IDC, Indian Institute of Technology, Bombay, India (2017)
30.
go back to reference Morkes, J., Kernal, H.K., Nass, C.: Effects of humor in task-oriented human–computer interaction and computer-mediated communication: a direct test of SRCT theory. Hum. Comput. Interact. 14, 395–435 (1999)CrossRef Morkes, J., Kernal, H.K., Nass, C.: Effects of humor in task-oriented human–computer interaction and computer-mediated communication: a direct test of SRCT theory. Hum. Comput. Interact. 14, 395–435 (1999)CrossRef
31.
go back to reference Dolen, W.M., Ruyter, K., Streukens, S.: The effect of humor in electronic service encounters. J. Econ. Psychol. 29(2), 160–179 (2008)CrossRef Dolen, W.M., Ruyter, K., Streukens, S.: The effect of humor in electronic service encounters. J. Econ. Psychol. 29(2), 160–179 (2008)CrossRef
32.
go back to reference Tzeng, J.Y.: Matching users’ diverse social scripts with resonating humanized features to create a polite interface. Int. J. Hum. Comput. Stud. 64(12), 1230–1242 (2006)CrossRef Tzeng, J.Y.: Matching users’ diverse social scripts with resonating humanized features to create a polite interface. Int. J. Hum. Comput. Stud. 64(12), 1230–1242 (2006)CrossRef
33.
go back to reference Khooshabeh, P., McCall, C., Gandhe, S., Gratch, J., Blascovich, J.: Does it matter if a computer jokes. In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 77–86. ACM, New York (2011) Khooshabeh, P., McCall, C., Gandhe, S., Gratch, J., Blascovich, J.: Does it matter if a computer jokes. In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 77–86. ACM, New York (2011)
34.
go back to reference Niculescu, A.I., van Dijk, B., Nijholt, A., Li, H., See, S.L.: Making social robots more attractive the effects of voice pitch, humor and empathy. Int. J. Soc. Robot. 5(2), 171–191 (2013)CrossRef Niculescu, A.I., van Dijk, B., Nijholt, A., Li, H., See, S.L.: Making social robots more attractive the effects of voice pitch, humor and empathy. Int. J. Soc. Robot. 5(2), 171–191 (2013)CrossRef
35.
go back to reference Niculescu, A., Banchs, R.: Humor intelligence for virtual agents. In: Ninth International Workshop on Spoken Dialogue Systems Technology (IWSDS 2018), Singapore, vol. 1 (2018) Niculescu, A., Banchs, R.: Humor intelligence for virtual agents. In: Ninth International Workshop on Spoken Dialogue Systems Technology (IWSDS 2018), Singapore, vol. 1 (2018)
36.
go back to reference Dybala, P., Ptaszynski, M., Rzepka, R., Araki, K.: Humoroids: conversational agents that induce positive emotions with humor. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems, vol. 2, pp. 1171–1172. International Foundation for Autonomous Agents and Multiagent Systems (2009) Dybala, P., Ptaszynski, M., Rzepka, R., Araki, K.: Humoroids: conversational agents that induce positive emotions with humor. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems, vol. 2, pp. 1171–1172. International Foundation for Autonomous Agents and Multiagent Systems (2009)
37.
go back to reference Niculescu, A.I., Banchs, R.E.: Strategies to cope with errors in human-machine spoken interactions: using chatbots as back-off mechanism for task-oriented dialogues. In: Proceedings of ERRARE, Sinaia, Romania (2015) Niculescu, A.I., Banchs, R.E.: Strategies to cope with errors in human-machine spoken interactions: using chatbots as back-off mechanism for task-oriented dialogues. In: Proceedings of ERRARE, Sinaia, Romania (2015)
39.
go back to reference Zillmann, D., Williams, B.R., Bryant, J., Boynton, K.R., Wolf, M.A.: Acquisition of information from educational television programs as a function of differently paced humorous inserts. J. Educ. Psychol. 72(2), 170 (1980)CrossRef Zillmann, D., Williams, B.R., Bryant, J., Boynton, K.R., Wolf, M.A.: Acquisition of information from educational television programs as a function of differently paced humorous inserts. J. Educ. Psychol. 72(2), 170 (1980)CrossRef
Metadata
Title
Do Smart Speakers Respond to Their Errors Properly? A Study on Human-Computer Dialogue Strategy
Authors
Xiang Ge
Dan Li
Daisong Guan
Shihui Xu
Yanyan Sun
Moli Zhou
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-23541-3_32