Skip to main content
Top

2015 | OriginalPaper | Chapter

A Comparative Analysis of Usability Evaluation Methods on Their Versatility in the Face of Diversified User Input Methods

Authors : Daiju Ishikawa, Takashi Kato, Chigusa Kita

Published in: HCI International 2015 - Posters’ Extended Abstracts

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Every command consists of an action and an object, suggesting that a usability problem can occur whenever the user is unable to identify an appropriate action and/or the object associated with his/her current goal. The recent shift from mouse-based to touch-based interaction demands that any usability evaluation method be sensitive to not only object-related but also action-related usability problems. This study involved a total of 32 participants, four kinds of tasks differing in the difficulty of identifying objects and executing actions, and four qualitative methods of usability evaluation. Analyses of sets of observation data with concurrent and retrospective protocol by the same participant and interpretive protocol by a new participant indicate that while the oral instruction method seems least appropriate, the newly-devised narration method seems to have better prospects than the observation and the think aloud method for the usability evaluation of touch-based interaction.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Carroll, J.M., Mack, R.L.: Learning to use a word processor: by doing, by thinking, and by knowing. In: Thomas, J.C., Schneider, M.L. (eds.) Human Factors in Computer Systems, pp. 13–51. Ablex, Norwood (1984) Carroll, J.M., Mack, R.L.: Learning to use a word processor: by doing, by thinking, and by knowing. In: Thomas, J.C., Schneider, M.L. (eds.) Human Factors in Computer Systems, pp. 13–51. Ablex, Norwood (1984)
2.
go back to reference Elling, S., Lentz, L., de Jong, M.: Retrospective think-aloud method: using eye movements as an extra cue for participants’ verbalizations. In: CHI 2011 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1161–1170. ACM, New York (2011) Elling, S., Lentz, L., de Jong, M.: Retrospective think-aloud method: using eye movements as an extra cue for participants’ verbalizations. In: CHI 2011 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1161–1170. ACM, New York (2011)
3.
go back to reference Erlandsson, M., Jansson, A.: Verbal reports and domain-specific knowledge: a comparison between collegial and retrospective verbalisation. Cogn. Technol. Work 15, 239–254 (2013)CrossRef Erlandsson, M., Jansson, A.: Verbal reports and domain-specific knowledge: a comparison between collegial and retrospective verbalisation. Cogn. Technol. Work 15, 239–254 (2013)CrossRef
4.
go back to reference Hori, M., Kihara, Y., Kato, T.: Investigation of indirect oral operation method for think aloud usability testing. In: Kurosu, M. (ed.) HCD 2011. LNCS, vol. 6776, pp. 38–46. Springer, Heidelberg (2011)CrossRef Hori, M., Kihara, Y., Kato, T.: Investigation of indirect oral operation method for think aloud usability testing. In: Kurosu, M. (ed.) HCD 2011. LNCS, vol. 6776, pp. 38–46. Springer, Heidelberg (2011)CrossRef
5.
go back to reference Kato, T.: What “question-asking protocols” can say about the user interface. Int. J. Man Mach. Stud. 25, 659–673 (1986)CrossRef Kato, T.: What “question-asking protocols” can say about the user interface. Int. J. Man Mach. Stud. 25, 659–673 (1986)CrossRef
6.
go back to reference Mack, R.L., Robinson, J.B.: When novices elicit knowledge: question asking in designing, evaluating, and learning to use software. In: Hoffman, R.R. (ed.) The Psychology of Expertise: Cognitive Research and Empirical AI, pp. 245–268. Springer, New York (1992)CrossRef Mack, R.L., Robinson, J.B.: When novices elicit knowledge: question asking in designing, evaluating, and learning to use software. In: Hoffman, R.R. (ed.) The Psychology of Expertise: Cognitive Research and Empirical AI, pp. 245–268. Springer, New York (1992)CrossRef
7.
go back to reference Olmsted-Hawala, E.L., Murphy, E.D., Hawala, S., Ashenfelter, K.T.: Think-aloud protocols: a comparison of three think-aloud protocols for use in testing data-dissemination web sites for usability. In: CHI 2010 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2381–2390. ACM, New York (2010) Olmsted-Hawala, E.L., Murphy, E.D., Hawala, S., Ashenfelter, K.T.: Think-aloud protocols: a comparison of three think-aloud protocols for use in testing data-dissemination web sites for usability. In: CHI 2010 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2381–2390. ACM, New York (2010)
8.
go back to reference Van den Haak, M.J., de Jong, M.D.T., Schellens, P.J.: Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue. Behav. Inf. Technol. 22, 339–351 (2003)CrossRef Van den Haak, M.J., de Jong, M.D.T., Schellens, P.J.: Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue. Behav. Inf. Technol. 22, 339–351 (2003)CrossRef
Metadata
Title
A Comparative Analysis of Usability Evaluation Methods on Their Versatility in the Face of Diversified User Input Methods
Authors
Daiju Ishikawa
Takashi Kato
Chigusa Kita
Copyright Year
2015
Publisher
Springer International Publishing
DOI
https://doi.org/10.1007/978-3-319-21380-4_6