Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Design for UX in Flexible Offices – Bringing Research and Practice Together Read chapter Read first chapter

2022 | OriginalPaper | Chapter

Reliability of Heuristic Evaluation During Usability Analysis

Authors : Thomas J. Smith, Cindy Kheng

Published in: Proceedings of the 21st Congress of the International Ergonomics Association (IEA 2021)

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Scientific reliability—the degree to which a research method produces stable and consistent results—represents a major linchpin of tenable scientific research. A number of different studies support the conclusion that usability testing of software interfaces lacks scientific reliability (Jacobsen et al., 1998; Jordan, 2017). The present report augments this conclusion with findings that heuristic evaluation, the second major pillar of usability analysis, also lacks reliability. We conclude that a key priority of “usability science” should be to initiate a systematic program of inquiry to investigate the degree to which this term has meaning.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Explainable AI for Entertainment: Issues on Video on Demand Platforms
next chapter Clinical Usability Studies – Clash of Cultures? Study Design Proposal from Lessons Learned
Literature
1.
Bevan, N., Butler, S., Curson, I., Kindlund, E., Kirakowski, J, Miller, D., Molich, R.: Comparative evaluation of usability tests. In: Proceedings of the Usability Professionals Association 1998 Conference, pp. 1–12. Usability Professionals Association, Washington, D.C. (1998)
2.
Jacobsen, N.E., Hertzum, M., John, B.E.: The evaluator effect in usability studies: problem detection and severity judgments. In: Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, pp. 1336–1339. Human Factors and Ergonomics Society, Washington, D.C. (1998)
3.
4.
5.
6.
Gould, J.D.: How to design usable systems. In: Helander, M. (ed.) Handbook of Human-Computer Interaction, pp. 757–789. Elsevier, Amsterdam (1988)CrossRef
7.
Nielsen, J.: Heuristic evaluation. In: Mack, R.L., Nielsen, J. (eds.) Usability Inspection Methods, pp. 25–62. Wiley, New York (1994)
8.
Mandel, T.: Elements of User Interface Design. Wiley, New York (1997)
9.
Kortum, P.: Usability assessment: how to measure the usability of products, services, and systems. Human Factors and Ergonomics Society, Washington, D.C. (2016)
10.
Georgsson, M., Weir, C.R., Staggers, N.: Revisiting heuristic evaluation methods to improve the reliability of findings. In: Lovis, C., Séroussi, B., Hasman, A. Pape-Haugaard, L., Saka, O., Andersen, S.K. (eds.). E-health - for Continuity of Care. Proceedings of the 25th European Medical Informatics Conference – MIE 2014, pp. 930–934. IOS Press, Amsterdam (2014). https://​bth.​diva-portal.​org/​smash/​get/​diva2:​834138/​FULLTEXT01.​pdf. Accessed 11 Jan 2021
11.
12.
White, G.R., Mirza-Babaei, P., McAllister, G., Good, J.: Weak inter-rater reliability in heuristic evaluation of video games. In: Proceedings of the 29th Annual CHI Conference on Human Factors in Computing Systems. CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 1441–1446. Association of Computing Machinery, New York (2011)
13.
Smith, T.J.: Observer perceptions of overall system quality – the Lake Wobegon effect. In: Proceedings of the Human Factors and Ergonomics Society 59th Annual Meeting, pp. 1769–1773. Human Factors and Ergonomics Society, Washington D.C. (2015)
14.
Norman, D.A.: The Design of Everyday Things. Doubleday, New York (1988)
15.
Snedecor, G.W., Cochran, W.G.: Statistical Methods. 6th edn. The Iowa State University Press, Ames (1967)
16.
17.
Krippendorff, K.: Content Analysis: An Introduction to Its Methodology. Sage, Thousand Oaks (2004)
Metadata
Title
Reliability of Heuristic Evaluation During Usability Analysis
Authors
Thomas J. Smith
Cindy Kheng
Copyright Year
2022
Book
Proceedings of the 21st Congress of the International Ergonomics Association (IEA 2021)

Print ISBN: 978-3-030-74613-1

Electronic ISBN: 978-3-030-74614-8

Copyright Year: 2022

DOI
https://doi.org/10.1007/978-3-030-74614-8_88