Skip to main content
Top

2017 | OriginalPaper | Chapter

Assessing Spoken Dialog Services from the End-User Perspective: Usability and Experience

Authors : Otilia Kocsis, Basilis Kladis, Anastasios Tsopanoglou, Nikos Fakotakis

Published in: Speech and Computer

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Assessment of usability and user experience of spoken dialog services is a rather complex task, which remains difficult to achieve with real end-users. In this work a three-fold evaluation approach is introduced, which supports reliable assessment of usability and user experience. The approach combines interaction log data based assessment (at dialog, task and node level) with an optimized questionnaire-based end-users evaluation and a controlled stress test performed by an IVR system. The 3-fold evaluation approach was used for the assessment of usability and user experience of the pilot deployment of a voice banking systems. The proposed assessment approach provides sufficient evidence for the business informed decision-making with respect to perceived user quality of the interaction and offered services and allows for investigation of potential improvement areas.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Mporas, I., Kocsis, O., Ganchev, T., Fakotakis, N.: Robust speech interaction in motorcycle environment. Expert Syst. Appl. 37(3), 1827–1835 (2010)CrossRefMATH Mporas, I., Kocsis, O., Ganchev, T., Fakotakis, N.: Robust speech interaction in motorcycle environment. Expert Syst. Appl. 37(3), 1827–1835 (2010)CrossRefMATH
3.
go back to reference Diewald, S., Moller, A., Roalter, L., Kranz, M.: Mobile device integration and interaction in the automotive domain. In: Proceedings of AutomotiveUI 2011 (2012) Diewald, S., Moller, A., Roalter, L., Kranz, M.: Mobile device integration and interaction in the automotive domain. In: Proceedings of AutomotiveUI 2011 (2012)
4.
go back to reference Strauss, P.M., Minker, W.: Proactive Spoken Dialogue Interaction in Multi-Party Environments. Springer Science + Business Media, New York (2010)CrossRefMATH Strauss, P.M., Minker, W.: Proactive Spoken Dialogue Interaction in Multi-Party Environments. Springer Science + Business Media, New York (2010)CrossRefMATH
5.
go back to reference Kocsis, O., Kladis, B.: Entrance manager application: alternative ways for event handling at the front door of a smart house. In: Janse, M.D. (ed.) Amigo Project Workshop Proceedings, pp. 47–48 (2008) Kocsis, O., Kladis, B.: Entrance manager application: alternative ways for event handling at the front door of a smart house. In: Janse, M.D. (ed.) Amigo Project Workshop Proceedings, pp. 47–48 (2008)
6.
go back to reference Almeida, N., Silva, S., Teixeira, A.: Design and development of speech interaction: a methodology. In: Kurosu, M. (ed.) HCI 2014. LNCS, vol. 8511, pp. 370–381. Springer, Cham (2014). doi:10.1007/978-3-319-07230-2_36 Almeida, N., Silva, S., Teixeira, A.: Design and development of speech interaction: a methodology. In: Kurosu, M. (ed.) HCI 2014. LNCS, vol. 8511, pp. 370–381. Springer, Cham (2014). doi:10.​1007/​978-3-319-07230-2_​36
7.
go back to reference Moller, S.: Evaluating interaction with spoken dialogue telephone services. Chapter in Recent Trends in Discourse and Dialogue 39, 69–100 (2008)CrossRef Moller, S.: Evaluating interaction with spoken dialogue telephone services. Chapter in Recent Trends in Discourse and Dialogue 39, 69–100 (2008)CrossRef
9.
go back to reference Turunen, M., Hakulinen, J., Melto, A., Heimonen, T., Laivo, T., Hella, J.: SUXES – User experience evaluation method for spoken and multimodal interaction. In: Proceedings of INTERSPEECH 2009, pp. 2567–2570 (2009) Turunen, M., Hakulinen, J., Melto, A., Heimonen, T., Laivo, T., Hella, J.: SUXES – User experience evaluation method for spoken and multimodal interaction. In: Proceedings of INTERSPEECH 2009, pp. 2567–2570 (2009)
10.
go back to reference Jurcicek, F., Keizer, S., Gasic, M., Mairesse, F., Thomson, B., Yu, K., Young, S.: Real user evaluation of spoken dialogue systems using Amazon Mechanic Turk. In: Proceedings of INTERSPEECH 2011 (2011) Jurcicek, F., Keizer, S., Gasic, M., Mairesse, F., Thomson, B., Yu, K., Young, S.: Real user evaluation of spoken dialogue systems using Amazon Mechanic Turk. In: Proceedings of INTERSPEECH 2011 (2011)
11.
go back to reference Metze, F., Englert, R., Bub, U., Burkhardt, F., Stegmann, J.: Getting closer: tailored human-computer speech dialog. Univ. Access Inf. Soc. 8, 97–108 (2009), doi:10.1007/s10209-008-0133-0 Metze, F., Englert, R., Bub, U., Burkhardt, F., Stegmann, J.: Getting closer: tailored human-computer speech dialog. Univ. Access Inf. Soc. 8, 97–108 (2009), doi:10.​1007/​s10209-008-0133-0
Metadata
Title
Assessing Spoken Dialog Services from the End-User Perspective: Usability and Experience
Authors
Otilia Kocsis
Basilis Kladis
Anastasios Tsopanoglou
Nikos Fakotakis
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-66429-3_15

Premium Partner