Skip to main content

2019 | OriginalPaper | Buchkapitel

Measuring User Experience in Chatbots: An Approach to Interpersonal Communication Competence

verfasst von : Marita Skjuve, Petter Bae Brandzaeg

Erschienen in: Internet Science

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The increasing usage of chatbots is fundamentally changing the way people interact with new technology. Instead of clicking buttons to functionally navigate on a web page, people can access content and services by the use of natural language in interaction with an artificial agent (e.g., chatbot). This change toward human–chatbot interaction is typically manifested through a social and natural conversational style. This shift of how to interact with data and services has major repercussions for how to explore and measure conversational user experience with chatbots. Hence, in this paper we suggest the importance of measuring the social aspects in human–chatbot interaction through a focus on interpersonal communicational competence (ICC). We build our suggested framework on previous knowledge about communicational competence in successful human–human interaction. Based on this we have developed factors that might be of importance for chatbots’ ICC and how these can be measured.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Brandtzaeg, P.B., Følstad, A.: Chatbots: changing user needs and motivations. Interactions 25(5), 38–43 (2018)CrossRef Brandtzaeg, P.B., Følstad, A.: Chatbots: changing user needs and motivations. Interactions 25(5), 38–43 (2018)CrossRef
6.
Zurück zum Zitat Bargas-Avila, J.A., Hornbæk, K.: Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada, pp. 2689–2698 (2011). https://doi.org/10.1145/1978942.1979336 Bargas-Avila, J.A., Hornbæk, K.: Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada, pp. 2689–2698 (2011). https://​doi.​org/​10.​1145/​1978942.​1979336
7.
Zurück zum Zitat Brooke, J.: SUS-A quick and dirty usability scale. In: Usability Evaluation in Industry, vol. 189, no. 194, pp. 4–7 (1996) Brooke, J.: SUS-A quick and dirty usability scale. In: Usability Evaluation in Industry, vol. 189, no. 194, pp. 4–7 (1996)
14.
Zurück zum Zitat De Graaf, M., Ben Allouch, S., Van Dijk, J.: Why do they refuse to use my robot?: Reasons for non-use derived from a long-term home study. In: Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, Vienna, Austria, pp. 224–233 (2017). https://doi.org/10.1145/2909824.3020236 De Graaf, M., Ben Allouch, S., Van Dijk, J.: Why do they refuse to use my robot?: Reasons for non-use derived from a long-term home study. In: Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, Vienna, Austria, pp. 224–233 (2017). https://​doi.​org/​10.​1145/​2909824.​3020236
15.
Zurück zum Zitat Medhi Thies, I., Menon, N., Magapu, S., Subramony, M., O’Neill, J.: How do you want your chatbot? An exploratory Wizard-of-Oz study with young, urban indians. In: Bernhaupt, R., Dalvi, G., Joshi, A., Balkrishan, D.K., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10513, pp. 441–459. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67744-6_28CrossRef Medhi Thies, I., Menon, N., Magapu, S., Subramony, M., O’Neill, J.: How do you want your chatbot? An exploratory Wizard-of-Oz study with young, urban indians. In: Bernhaupt, R., Dalvi, G., Joshi, A., Balkrishan, D.K., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10513, pp. 441–459. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-67744-6_​28CrossRef
16.
Zurück zum Zitat Fitzpatrick, K.K., Darcy, A., Vierhile, M.: Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Mental Health 4(2), e19 (2017). https://doi.org/10.2196/mental.7785CrossRef Fitzpatrick, K.K., Darcy, A., Vierhile, M.: Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Mental Health 4(2), e19 (2017). https://​doi.​org/​10.​2196/​mental.​7785CrossRef
17.
Zurück zum Zitat Kim, J., et al.: Can a machine tend to teenagers’ emotional needs?: A study with conversational agents. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal QC, Canada, pp. LBW018 (2018). https://doi.org/10.1145/3170427.3188548 Kim, J., et al.: Can a machine tend to teenagers’ emotional needs?: A study with conversational agents. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal QC, Canada, pp. LBW018 (2018). https://​doi.​org/​10.​1145/​3170427.​3188548
18.
Zurück zum Zitat Marrinan, F.: Qualitative investigations into a virtual CBT therapist: relational features, client experiences and implications for counselling psychology practice. Doctoral thesis, University of Surrey (2018) Marrinan, F.: Qualitative investigations into a virtual CBT therapist: relational features, client experiences and implications for counselling psychology practice. Doctoral thesis, University of Surrey (2018)
19.
Zurück zum Zitat Luger, E., Sellen, A.: Like having a really bad PA: the gulf between user expectation and experience of conversational agents. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, California, USA, pp. 5286–5297 (2016). https://doi.org/10.1145/2858036.2858288 Luger, E., Sellen, A.: Like having a really bad PA: the gulf between user expectation and experience of conversational agents. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, California, USA, pp. 5286–5297 (2016). https://​doi.​org/​10.​1145/​2858036.​2858288
20.
Zurück zum Zitat Curry, A.C., Rieser, V.: # MeToo Alexa: how conversational systems respond to sexual harassment. In: Proceedings of the Second ACL Workshop on Ethics in Natural Language Processing, New Orleans, Louisiana, pp. 7–14 (2018) Curry, A.C., Rieser, V.: # MeToo Alexa: how conversational systems respond to sexual harassment. In: Proceedings of the Second ACL Workshop on Ethics in Natural Language Processing, New Orleans, Louisiana, pp. 7–14 (2018)
21.
Zurück zum Zitat Di Gaetano, S., Diliberto, P.: Chatbots and conversational interfaces: three domains of use. In: Fifth International Workshop on Cultures of Participation in the Digital Age, Castiglione della Pescaia, Italy, vol. 2101, pp. 62–70 (2018) Di Gaetano, S., Diliberto, P.: Chatbots and conversational interfaces: three domains of use. In: Fifth International Workshop on Cultures of Participation in the Digital Age, Castiglione della Pescaia, Italy, vol. 2101, pp. 62–70 (2018)
Metadaten
Titel
Measuring User Experience in Chatbots: An Approach to Interpersonal Communication Competence
verfasst von
Marita Skjuve
Petter Bae Brandzaeg
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-17705-8_10

Premium Partner