Skip to main content
Top

2016 | OriginalPaper | Chapter

Types of Problems Elicited by Verbal Protocols for Blind and Sighted Participants

Authors : Andreas Savva, Helen Petrie, Christopher Power

Published in: Computers Helping People with Special Needs

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Verbal protocols are often used in user-based studies of interactive technologies. This study investigated whether different types of problems are revealed by concurrent and retrospective verbal protocols (CVP and RVP) for blind and sighted participants. Eight blind and eight sighted participants undertook both CVP and RVP on four websites. Overall, interactivity problems were significantly more frequent in comparison to content or information architecture problems. In addition, RVP revealed significantly more interactivity problems than CVP for both user groups. Finally, blind participants encountered significantly more interactivity problems than sighted participants. The findings have implications for which protocol is appropriate, depending on the purpose of a particular study and the user groups involved.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Boren, T., Ramey, J.: Thinking aloud: reconciling theory and practice. IEEE Trans. Prof. Commun. 43(3), 261–278 (2000)CrossRef Boren, T., Ramey, J.: Thinking aloud: reconciling theory and practice. IEEE Trans. Prof. Commun. 43(3), 261–278 (2000)CrossRef
2.
go back to reference Bowers, V.A., Snyder, H.L.: Concurrent versus retrospective verbal protocol for comparing window usability. Hum. Factors Ergon. Soc. Annu. Meet. 34(17), 1270–1274 (1990)CrossRef Bowers, V.A., Snyder, H.L.: Concurrent versus retrospective verbal protocol for comparing window usability. Hum. Factors Ergon. Soc. Annu. Meet. 34(17), 1270–1274 (1990)CrossRef
3.
go back to reference Dumas, J.S., Redish, J.: A Practical Guide to Usability Testing. Intellect Books, London (1999) Dumas, J.S., Redish, J.: A Practical Guide to Usability Testing. Intellect Books, London (1999)
4.
go back to reference Ericsson, K.A., Simon, H.A.: Protocol Analysis. MIT Press, Cambridge (1993) Ericsson, K.A., Simon, H.A.: Protocol Analysis. MIT Press, Cambridge (1993)
5.
go back to reference Ericsson, K.A., Simon, H.A.: Verbal reports as data. Psychol. Rev. 87(3), 215–253 (1980)CrossRef Ericsson, K.A., Simon, H.A.: Verbal reports as data. Psychol. Rev. 87(3), 215–253 (1980)CrossRef
6.
go back to reference Hertzum, M., Jacobsen, N.E.: The evaluator effect: a chilling fact about usability evaluation methods. Int. J. Hum. Comput. Inter. 13(4), 421–443 (2001)CrossRef Hertzum, M., Jacobsen, N.E.: The evaluator effect: a chilling fact about usability evaluation methods. Int. J. Hum. Comput. Inter. 13(4), 421–443 (2001)CrossRef
7.
go back to reference Jørgensen, A.H.: Thinking-aloud in user interface design: a method promoting cognitive ergonomics. Ergonomics 33(4), 501–507 (1990)CrossRef Jørgensen, A.H.: Thinking-aloud in user interface design: a method promoting cognitive ergonomics. Ergonomics 33(4), 501–507 (1990)CrossRef
9.
go back to reference Lewis, C.: Using the “thinking-aloud” method in cognitive interface design. Research report RC9265, IBM TJ Watson Research Center, Yorktown Heights, NY (1982) Lewis, C.: Using the “thinking-aloud” method in cognitive interface design. Research report RC9265, IBM TJ Watson Research Center, Yorktown Heights, NY (1982)
10.
go back to reference Nielsen, J.: Usability Engineering. Elsevier, New York (1994)MATH Nielsen, J.: Usability Engineering. Elsevier, New York (1994)MATH
11.
go back to reference Nørgaard, M., Hornbæk, K.: What do usability evaluators do in practice?: an explorative study of think-aloud testing. In: 6th Conference on Designing Interactive Systems, pp. 209–218 (2006) Nørgaard, M., Hornbæk, K.: What do usability evaluators do in practice?: an explorative study of think-aloud testing. In: 6th Conference on Designing Interactive Systems, pp. 209–218 (2006)
12.
go back to reference Petrie, H., Power, C.: What do users really care about?: a comparison of usability problems found by users and experts on highly interactive websites. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 2107–2116 (2012) Petrie, H., Power, C.: What do users really care about?: a comparison of usability problems found by users and experts on highly interactive websites. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 2107–2116 (2012)
13.
go back to reference Preece, J., Sharp, H., Rogers, Y.: Interaction Design: Beyond Human-Computer Interaction. Wiley, Chichester (2015) Preece, J., Sharp, H., Rogers, Y.: Interaction Design: Beyond Human-Computer Interaction. Wiley, Chichester (2015)
14.
go back to reference Rubin, J.: Handbook of Usability Testing. Wiley, New York (1994) Rubin, J.: Handbook of Usability Testing. Wiley, New York (1994)
15.
go back to reference Savva, A., Petrie, H., Power, C.: Comparing concurrent and retrospective verbal protocols for blind and sighted users. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9296, pp. 55–71. Springer, Heidelberg (2015)CrossRef Savva, A., Petrie, H., Power, C.: Comparing concurrent and retrospective verbal protocols for blind and sighted users. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9296, pp. 55–71. Springer, Heidelberg (2015)CrossRef
16.
go back to reference van den Haak, M.J., De Jong, M.D.T., Schellens, P.J.: Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison. Interact. Comput. 16(6), 1153–1170 (2004)CrossRef van den Haak, M.J., De Jong, M.D.T., Schellens, P.J.: Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison. Interact. Comput. 16(6), 1153–1170 (2004)CrossRef
17.
go back to reference van den Haak, M.J., De Jong, M.D.T., Schellens, P.J.: Evaluation of an informational web site: three variants of the think-aloud method compared. Tech. Commun. 54(1), 58–71 (2007) van den Haak, M.J., De Jong, M.D.T., Schellens, P.J.: Evaluation of an informational web site: three variants of the think-aloud method compared. Tech. Commun. 54(1), 58–71 (2007)
18.
go back to reference van den Haak, M.J., De Jong, M.D.T., Schellens, P.J.: Evaluating municipal websites: a methodological comparison of three think-aloud variants. Gov. Inf. Q. 26(1), 193–202 (2009)CrossRef van den Haak, M.J., De Jong, M.D.T., Schellens, P.J.: Evaluating municipal websites: a methodological comparison of three think-aloud variants. Gov. Inf. Q. 26(1), 193–202 (2009)CrossRef
19.
go back to reference van den Haak, M.J., De Jong, M.D.T., Schellens, P.J.: Retrospective vs concurrent think-aloud protocols: testing the usability of an online library catalogue. Behav. Inf. Technol. 22(5), 339–351 (2003)CrossRef van den Haak, M.J., De Jong, M.D.T., Schellens, P.J.: Retrospective vs concurrent think-aloud protocols: testing the usability of an online library catalogue. Behav. Inf. Technol. 22(5), 339–351 (2003)CrossRef
20.
go back to reference Wright, P.C., Monk, A.F.: The use of think-aloud evaluation method in design. ACM SIGCHI Bull. 23(1), 55–57 (1991)CrossRef Wright, P.C., Monk, A.F.: The use of think-aloud evaluation method in design. ACM SIGCHI Bull. 23(1), 55–57 (1991)CrossRef
Metadata
Title
Types of Problems Elicited by Verbal Protocols for Blind and Sighted Participants
Authors
Andreas Savva
Helen Petrie
Christopher Power
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-41267-2_79