Abstract
This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen’s heuristics to identify and classify usability problems and Nielsen’s severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, “consistency and standards” was violated most frequently. Moreover, mean severity of problems concerning “error prevention” and “help and documentation” heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.
Similar content being viewed by others
References
Kohn, L. T., Corrigan, J. M., and Donaldson, M. S., To err is human: building a safer health system. Institute of Medicine, Washington, 2000.
Kaushal, R., Shojania, K. G., and Bates, D. W., Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch. Intern. Med. 163(12):1409–1416, 2003.
Khajouei, R., and Jaspers, M. W., The impact of CPOE medication systems’ design aspects on usability, workflow and medication orders: a systematic review. Methods Inf. Med. 49(1):3–19, 2010.
Koppel, R., Metlay, J. P., Cohen, A., Abaluck, B., Localio, A. R., Kimmel, S. E., and Strom, B. L., Role of computerized physician order entry systems in facilitating medication errors. J. Am. Med. Assoc. 293(10):1197–1203, 2005.
Shu, K., Boyle, D., Spurr, C., Horsky, J., Heiman, H., O’Connor, P., Lepore, J., and Bates, D. W., Comparison of time spent writing orders on paper with computerized physician order entry. Stud. Health. Technol. Inform. 84(Pt 2):1207–1211, 2001.
Tierney, W. M., Miller, M. E., Overhage, J. M., and McDonald, C. J., Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. J. Am. Med. Assoc. 269(3):379–383, 1993.
Horsky J, Kaufman DR, Patel VL (2003) The cognitive complexity of a provider order entry interface. AMIA Annual Symposium proceedings/AMIA Symposium AMIA Symposium:294–298
Khajouei, R., Peek, N., Wierenga, P. C., Kersten, M. J., and Jaspers, M. W., Effect of predefined order sets and usability problems on efficiency of computerized medication ordering. Int. J. Med. Inform. 79(10):690–698, 2010.
Kushniruk, A. W., Triola, M. M., Borycki, E. M., Stein, B., and Kannry, J. L., Technology induced error and usability: the relationship between usability problems and prescription errors when using a handheld application. Int. J. Med. Inform. 74(7–8):519–526, 2005.
Thyvalikakath, T. P., Monaco, V., Thambuganipalle, H. B., and Schleyer, T., A usability evaluation of four commercial dental computer-based patient record systems. J. Am. Dent. Assoc. 139(12):1632–1642, 2008.
Part 11 : Guidance on usability (ISO 9242–11) (1998). In: Ergonomic requirements for office work with visual display terminals (VDTs).
Shah, S. G., and Robinson, I., Benefits of and barriers to involving users in medical device technology development and evaluation. Int. J. Technol. Assess. Health Care 23(1):131–137, 2007.
Jaspers, M. W., A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int. J. Med. Inform. 78(5):340–353, 2009.
Yui, B. H., Jim, W. T., Chen, M., Hsu, J. M., Liu, C. Y., and Lee, T. T., Evaluation of computerized physician order entry system-a satisfaction survey in Taiwan. J. Med. Syst. 36(6):3817–3824, 2012.
Karahoca, A., Bayraktar, E., Tatoglu, E., and Karahoca, D., Information system design for a hospital emergency department: a usability analysis of software prototypes. J. Biomed. Inform. 43(2):224–232, 2010.
Thyvalikakath, T. P., Schleyer, T. K., and Monaco, V., Heuristic evaluation of clinical functions in four practice management systems: a pilot study. J. Am. Dent. Assoc. 138(2):209–210, 2007. 212–208.
Joshi, A., Arora, M., Dai, L., Price, K., Vizer, L., and Sears, A., Usability of a patient education and motivation tool using heuristic evaluation. J. Med. Internet Res. 11(4):e47, 2009.
Peute, L. W., and Jaspers, M. M., Usability evaluation of a laboratory order entry system: cognitive walkthrough and think aloud combined. Stud. Health. Technol. Inform. 116:599–604, 2005.
Safdari, R., Dargahi, H., Shahmoradi, L., and Farzaneh Nejad, A., Comparing four softwares based on ISO 9241 part 10. J. Med. Syst. 36(5):2787–2793, 2012.
Nielsen, J., Usability inspection methods. Wiley, New York, 1994.
Nielsen, J., Usability engineering, 1st edition. Morgan Kaufmann, San Francisco, 1993.
Choi, J., and Bakken, S., Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing. Int. J. Med. Inform. 79(8):565–575, 2010.
Edwards, P. J., Moloney, K. P., Jacko, J. A., and Sainfort, F., Evaluating usability of a commercial electronic health record: A case study. Int. J. Hum. Comput. Stud. 66(10):718–728, 2008.
Pressler, T. R., Yen, P. Y., Ding, J., Liu, J., Embi, P. J., and Payne, P. R., Computational challenges and human factors influencing the design and use of clinical research participant eligibility pre-screening tools. BMC Med. Inform. Decis. Mak. 12:47, 2012.
Su, K. W., and Liu, C. L., A mobile Nursing Information System based on human-computer interaction design for improving quality of nursing. J. Med. Syst. 36(3):1139–1153, 2012.
Nielsen J, Landauer TK A mathematical model of the finding of usability problems. In: Proceedings ACM/IFIP INTERCHI’93 Conference, Amsterdam, The Netherlands, April 24–29 1993. pp 206–213.
Acknowledgments
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
The authors would like to thank Amirabbas Azizi for its assistance in the study.
Conflicts of interest
The authors declare that they have no competing interests
Author information
Authors and Affiliations
Corresponding author
Additional information
This article is part of the Topical Collection on Systems-Level Quality Improvement
Rights and permissions
About this article
Cite this article
Nabovati, E., Vakili-Arki, H., Eslami, S. et al. Usability Evaluation of Laboratory and Radiology Information Systems Integrated into a Hospital Information System. J Med Syst 38, 35 (2014). https://doi.org/10.1007/s10916-014-0035-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10916-014-0035-z