Skip to main content
Top

2015 | OriginalPaper | Chapter

What Learnability Issues Do Primary Care Physicians Experience When Using CPOE?

Authors : Martina A. Clarke, Jeffery L. Belden, Min S. Kim

Published in: Human-Computer Interaction: Users and Contexts

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Objective: To determine learnability gaps between expert and novice primary care physicians when using a computerized physician order entry (CPOE). Method: Two rounds of lab-based usability tests using video analyses with triangular method approach were conducted to analyze learnability gaps between ten novice and six expert physicians. Results: There was a 14 percent point increase in novice physicians’ task success rate (p = 0.29) and an 11 percent point increase in expert physicians’ task success rate between round one and round two (p = 0.64). There was an 8 % decrease in novice physicians’ time on task between round one and round two (p = 0.83) and a 12 % decrease in expert physicians’ time on task between round one and round two (p = 0.47). There was a 17 % decrease in novice physicians’ mouse clicks between round one and round two (p = 0.97) and a 20 % decrease in expert physicians’ mouse clicks between round one and round two (p = 0.80). There was a 5 % increase in novice physicians’ mouse movements between round one and round two (p = 0.67) and an 8 % decrease in expert physicians’ mouse movements between round one and round two (p = 0.99). Conclusion: Future directions include identifying usability issues faced by physicians when using the EHR through subtask analysis.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Committee on Identifying and Preventing Medication Errors. Preventing Medication Errors 2006, The National Academies Press, Washington, DC (2006) Committee on Identifying and Preventing Medication Errors. Preventing Medication Errors 2006, The National Academies Press, Washington, DC (2006)
2.
go back to reference Crossing the quality chasm: A new health system for the 21st century. National Academies Press, Washington, DC (2001) Crossing the quality chasm: A new health system for the 21st century. National Academies Press, Washington, DC (2001)
4.
go back to reference Brown, N.: Driving EMR adoption: making EMRs a sustainable, profitable investment. Health Manag. Technol. 26(5), 47–48 (2005) Brown, N.: Driving EMR adoption: making EMRs a sustainable, profitable investment. Health Manag. Technol. 26(5), 47–48 (2005)
5.
go back to reference Connolly, C.: Cedars-Sinai doctors cling to pen and paper. In: Washington Post (2005) Connolly, C.: Cedars-Sinai doctors cling to pen and paper. In: Washington Post (2005)
6.
go back to reference Scott, J.T., et al.: Kaiser Permanente’s experience of implementing an electronic medical record: a qualitative study. BMJ 331(7528), 1313–1316 (2005)CrossRef Scott, J.T., et al.: Kaiser Permanente’s experience of implementing an electronic medical record: a qualitative study. BMJ 331(7528), 1313–1316 (2005)CrossRef
7.
go back to reference Smelcer, J., Miller-Jacobs, H., Kantrovich, L.: Usability of electronic medical records. J. Usability Stud. 4(2), 70–84 (2009) Smelcer, J., Miller-Jacobs, H., Kantrovich, L.: Usability of electronic medical records. J. Usability Stud. 4(2), 70–84 (2009)
8.
go back to reference Berger, R.G., Kichak, J.P.: Computerized physician order entry: helpful or harmful? J. Am. Med. Inform. Assoc. 11(2), 100–103 (2004)CrossRef Berger, R.G., Kichak, J.P.: Computerized physician order entry: helpful or harmful? J. Am. Med. Inform. Assoc. 11(2), 100–103 (2004)CrossRef
9.
go back to reference Ash, J.S., Stavri, P.Z., Kuperman, G.J.: A consensus statement on considerations for a successful CPOE implementation. J. Am. Med. Inform. Assoc. 10(3), 229–234 (2003)CrossRef Ash, J.S., Stavri, P.Z., Kuperman, G.J.: A consensus statement on considerations for a successful CPOE implementation. J. Am. Med. Inform. Assoc. 10(3), 229–234 (2003)CrossRef
10.
go back to reference Khajouei, R., Jaspers, M.W.: The impact of CPOE medication systems’ design aspects on usability, workflow and medication orders: a systematic review. Methods Inf. Med. 49(1), 3–19 (2010) Khajouei, R., Jaspers, M.W.: The impact of CPOE medication systems’ design aspects on usability, workflow and medication orders: a systematic review. Methods Inf. Med. 49(1), 3–19 (2010)
11.
go back to reference Chan, J., et al.: Usability evaluation of order sets in a computerised provider order entry system. BMJ Qual. Saf. 20(11), 932–940 (2011)CrossRef Chan, J., et al.: Usability evaluation of order sets in a computerised provider order entry system. BMJ Qual. Saf. 20(11), 932–940 (2011)CrossRef
12.
go back to reference Kjeldskov, J., Skov, M.B., Stage, J.: A longitudinal study of usability in health care: does time heal? Int. J. Med. Inform. 79(6), e135–e143 (2010)CrossRef Kjeldskov, J., Skov, M.B., Stage, J.: A longitudinal study of usability in health care: does time heal? Int. J. Med. Inform. 79(6), e135–e143 (2010)CrossRef
13.
go back to reference Neinstein, A., Cucina, R.: An analysis of the usability of inpatient insulin ordering in three computerized provider order entry systems. J. Diab. Sci. Technol. 5(6), 1427–1436 (2011)CrossRef Neinstein, A., Cucina, R.: An analysis of the usability of inpatient insulin ordering in three computerized provider order entry systems. J. Diab. Sci. Technol. 5(6), 1427–1436 (2011)CrossRef
14.
go back to reference ISO 9241-11: Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs): Part 11: Guidance on Usability. 1 ed. International Organization for Standardization, p. 22 (1998) ISO 9241-11: Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs): Part 11: Guidance on Usability. 1 ed. International Organization for Standardization, p. 22 (1998)
15.
go back to reference Systems and Software Engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – System and software quality models. International Organization for Standardization, Geneva, p. 34 (2011) Systems and Software Engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – System and software quality models. International Organization for Standardization, Geneva, p. 34 (2011)
16.
go back to reference Elliott, G.J., Jones, E., Barker, P.: A grounded theory approach to modelling learnability of hypermedia authoring tools. Interact. Comput. 14(5), 547–574 (2002)CrossRef Elliott, G.J., Jones, E., Barker, P.: A grounded theory approach to modelling learnability of hypermedia authoring tools. Interact. Comput. 14(5), 547–574 (2002)CrossRef
17.
go back to reference Nielsen, J.: Usability Engineering, xiv edn, p. 358. Academic Press, Boston (1993)MATH Nielsen, J.: Usability Engineering, xiv edn, p. 358. Academic Press, Boston (1993)MATH
18.
go back to reference Whiteside, J., et al.: User performance with command, menu, and iconic interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 185–191. ACM, San Francisco, California, USA (1985) Whiteside, J., et al.: User performance with command, menu, and iconic interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 185–191. ACM, San Francisco, California, USA (1985)
19.
go back to reference Lin, H.X., Choong, Y.-Y., Salvendy, G.: A proposed index of usability: a method for comparing the relative usability of different software systems. Behav. Inf. Technol. 16(4–5), 267–277 (1997)CrossRef Lin, H.X., Choong, Y.-Y., Salvendy, G.: A proposed index of usability: a method for comparing the relative usability of different software systems. Behav. Inf. Technol. 16(4–5), 267–277 (1997)CrossRef
20.
go back to reference Tullis, T., Albert, W.: Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics, p. 336. Morgan Kaufmann Publishers Inc., San Francisco (2008) Tullis, T., Albert, W.: Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics, p. 336. Morgan Kaufmann Publishers Inc., San Francisco (2008)
21.
go back to reference Healthcare Reform: Impact on Physicians, in Health Capital Topics. Health Capital Consultants: HealthCapital.com, p. 3 (2011) Healthcare Reform: Impact on Physicians, in Health Capital Topics. Health Capital Consultants: HealthCapital.com, p. 3 (2011)
22.
go back to reference Brooke, J.: SUS-A quick and dirty usability scale. In: Jordan, P.W., et al. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor and Francis, London (1996) Brooke, J.: SUS-A quick and dirty usability scale. In: Jordan, P.W., et al. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor and Francis, London (1996)
26.
go back to reference Battaglia, M.: Convenience sampling. In: Lavrakas, P. (ed.) Encyclopedia of Survey Research Methods. Sage Publications Inc., Thousand Oaks (2008) Battaglia, M.: Convenience sampling. In: Lavrakas, P. (ed.) Encyclopedia of Survey Research Methods. Sage Publications Inc., Thousand Oaks (2008)
27.
go back to reference Barnum, C.: The magic number 5: is it enough for web testing? Inf. Des. J. 11, 160–170 (2003) Barnum, C.: The magic number 5: is it enough for web testing? Inf. Des. J. 11, 160–170 (2003)
28.
go back to reference Kim, M., et al.: A pilot study on usability analysis of emergency department information system by nurses. Appl. Clin. Inform. 3, 135–153 (2012)CrossRef Kim, M., et al.: A pilot study on usability analysis of emergency department information system by nurses. Appl. Clin. Inform. 3, 135–153 (2012)CrossRef
29.
go back to reference Lewis, J.R., Sauro, J.: The factor structure of the system usability scale. In: Kurosu, M. (ed.) HCD 2009. LNCS, vol. 5619, pp. 94–103. Springer, Heidelberg (2009)CrossRef Lewis, J.R., Sauro, J.: The factor structure of the system usability scale. In: Kurosu, M. (ed.) HCD 2009. LNCS, vol. 5619, pp. 94–103. Springer, Heidelberg (2009)CrossRef
30.
go back to reference Van Someren, M.W., Barnard, Y.F., Sandberg, J.A.: The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes. Academic Press, London (1994) Van Someren, M.W., Barnard, Y.F., Sandberg, J.A.: The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes. Academic Press, London (1994)
31.
go back to reference Cordes, R.E.: The effects of running fewer subjects on time-on-task measures. Int. J. Hum.-Comput. Interact. 5(4), 393–403 (1993)CrossRef Cordes, R.E.: The effects of running fewer subjects on time-on-task measures. Int. J. Hum.-Comput. Interact. 5(4), 393–403 (1993)CrossRef
32.
go back to reference Clarke, M.A., Belden, J.L., Kim, M.S.: Determining differences in user performance between expert and novice primary care doctors when using an electronic health record (EHR). J. Eval. Clin. Pract. 20(6), 1153–1161 (2015)CrossRef Clarke, M.A., Belden, J.L., Kim, M.S.: Determining differences in user performance between expert and novice primary care doctors when using an electronic health record (EHR). J. Eval. Clin. Pract. 20(6), 1153–1161 (2015)CrossRef
33.
go back to reference Clarke, M.A., Steege, L.M., Moore, J.L., Belden, J.L., Koopman, R.J., Kim, M.S.: Addressing human computer interaction issues of electronic health record in clinical encounters. In: Marcus, A. (ed.) DUXU 2013, Part II. LNCS, vol. 8013, pp. 381–390. Springer, Heidelberg (2013) Clarke, M.A., Steege, L.M., Moore, J.L., Belden, J.L., Koopman, R.J., Kim, M.S.: Addressing human computer interaction issues of electronic health record in clinical encounters. In: Marcus, A. (ed.) DUXU 2013, Part II. LNCS, vol. 8013, pp. 381–390. Springer, Heidelberg (2013)
34.
go back to reference Phansalkar, S., et al.: A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems. J. Am. Med. Inform. Assoc. 17(5), 493–501 (2010)CrossRef Phansalkar, S., et al.: A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems. J. Am. Med. Inform. Assoc. 17(5), 493–501 (2010)CrossRef
35.
go back to reference Maguire, M.: Methods to support human-centred design. Int. J. Hum. Comput. Stud. 55(4), 587–634 (2001)CrossRefMATH Maguire, M.: Methods to support human-centred design. Int. J. Hum. Comput. Stud. 55(4), 587–634 (2001)CrossRefMATH
36.
go back to reference Belden, J., Grayson, R., Barnes, J.: Defining and Testing EMR Usability: Principles and Proposed Methods of EMR Usability Evaluation and Rating. Healthcare Information and Management Systems, Chicago (IL) (2009) Belden, J., Grayson, R., Barnes, J.: Defining and Testing EMR Usability: Principles and Proposed Methods of EMR Usability Evaluation and Rating. Healthcare Information and Management Systems, Chicago (IL) (2009)
37.
go back to reference Clarke, M.A., et al.: Determining primary care physician information needs to inform ambulatory visit note display. Appl. Clin. Inform. 5(1), 169–190 (2014)CrossRef Clarke, M.A., et al.: Determining primary care physician information needs to inform ambulatory visit note display. Appl. Clin. Inform. 5(1), 169–190 (2014)CrossRef
38.
go back to reference Khajouei, R., Jaspers, M.W.: CPOE system design aspects and their qualitative effect on usability. Stud. Health Technol. Inform. 136, 309–314 (2008) Khajouei, R., Jaspers, M.W.: CPOE system design aspects and their qualitative effect on usability. Stud. Health Technol. Inform. 136, 309–314 (2008)
39.
go back to reference Clarke, M., et al.: Creating a more readable electronic health record (EHR) model: analysis of primary care physicians’ information needs. In: AMIA (2012) Clarke, M., et al.: Creating a more readable electronic health record (EHR) model: analysis of primary care physicians’ information needs. In: AMIA (2012)
40.
go back to reference Koopman, R.J., et al.: A diabetes dashboard and physician efficiency and accuracy in accessing data needed for high-quality diabetes care. Ann. Fam. Med. 9(5), 398–405 (2011)CrossRef Koopman, R.J., et al.: A diabetes dashboard and physician efficiency and accuracy in accessing data needed for high-quality diabetes care. Ann. Fam. Med. 9(5), 398–405 (2011)CrossRef
Metadata
Title
What Learnability Issues Do Primary Care Physicians Experience When Using CPOE?
Authors
Martina A. Clarke
Jeffery L. Belden
Min S. Kim
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-21006-3_36