Skip to main content

Metrics for the Measurement of Skill

  • Chapter
  • First Online:
Fundamentals of Surgical Simulation

Abstract

The ‘Bristol Case’ (Senate of Surgery 1998) and the “To Err is Human” (Kohn et al. 2000) report have revealed a major deficiency in the area of surgical education, training, and assessment. Analysis revealed that there is no uniform or consistent training in surgical skills, either at a local or national level.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • Adair JG. The Hawthorne effect: a reconsideration of the methodological artifact. J Appl Psychol. 1984;69(2):334-345.

    Article  Google Scholar 

  • Ahlberg G, Enochsson L, Gallagher AG, et al. Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg. 2007;193(6):797-804.

    Article  PubMed  Google Scholar 

  • Byrne D. Interpersonal attraction and attitude similarity. J Abnorm Soc Psychol. 1961;62(3):713-715.

    Article  PubMed  CAS  Google Scholar 

  • Catania A. Learning. Englewood Cliffs: Prentice-Hall; 1984.

    Google Scholar 

  • Coleman J, Nduka CC, Darzi A. Virtual reality and laparoscopic surgery. Br J Surg. 1994;81(12):1709-1711.

    Article  PubMed  CAS  Google Scholar 

  • Darzi A, Smith S, Taffinder N. Assessing operative skill. BMJ. 1999;318(7188):887.

    Article  PubMed  CAS  Google Scholar 

  • Francis NK, Hanna GB, Cuschieri A. Reliability of the Dundee Endoscopic Psychomotor Tester (DEPT) for dominant hand performance. Surg Endosc. 2001;15(7):673-676.

    Article  PubMed  CAS  Google Scholar 

  • Francis NK, Hanna GB, Cuschieri A. The performance of master surgeons on the Advanced Dundee Endoscopic Psychomotor Tester: contrast validity study. Arch Surg. 2002;137(7):841.

    Article  PubMed  Google Scholar 

  • Gallagher AG, Satava RM. Virtual reality as a metric for the assessment of laparoscopic psychomotor skills. Learning curves and reliability measures. Surg Endosc. 2002;16(12):1746-1752.

    Article  PubMed  CAS  Google Scholar 

  • Gallagher AG, McClure N, McGuigan J, Crothers I, Browning J. Virtual reality training in laparoscopic surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST VR). Endoscopy. 1999;31(4):310-313.

    Article  PubMed  CAS  Google Scholar 

  • Gallagher AG, Hughes C, Reinhardt-Rutland AH, McGuigan J, McClure N. A case-control comparison of traditional and virtual-reality training in laparoscopic psychomotor performance. Minim Invasive Ther Allied Technol. 2000;9(5):347-352.

    Article  Google Scholar 

  • Gallagher AG, Richie K, McClure N, McGuigan J. Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg. 2001;25(11):1478-1483.

    Article  PubMed  CAS  Google Scholar 

  • Gallagher AG, Smith CD, Bowers SP, et al. Psychomotor skills assessment in practicing surgeons experienced in performing advanced laparoscopic procedures. J Am Coll Surg. 2003;197(3):479-488.

    Article  PubMed  Google Scholar 

  • Gallagher AG, Lederman AB, McGlade K, Satava RM, Smith CD. Discriminative validity of the minimally invasive surgical trainer in virtual reality (MIST-VR) using criteria levels based on expert performance. Surg Endosc. 2004;18(4):660-665.

    Article  PubMed  CAS  Google Scholar 

  • Gallagher AG, Neary P, Gillen P, et al. Novel method for assessment and selection of trainees for higher surgical training in general surgery. Aust N Z J Surg. 2008;78(4):282-290.

    Article  Google Scholar 

  • Gallagher AG, Leonard G, Traynor OJ. Role and feasibility of psychomotor and dexterity testing in selection for surgical training. Aust N Z J Surg. 2009;79(3):108-113.

    Article  Google Scholar 

  • Ghazisaedy M, Adamczyk D, Sandin DJ, Kenyon RV, DeFanti TA. Ultrasonic calibration of a magnetic tracker in a virtual realityspace. Proceedings of the IEEE Virtual Reality Annual International Symposium (VRAIS 95), Research Triangle Park, NC, March 1995.

    Google Scholar 

  • Gordon R. Great Medical Disasters. London: House of Stratus Ltd.; 2001.

    Google Scholar 

  • Hance J, Aggarwal R, Stanbridge R, et al. Objective assessment of technical skills in cardiac surgery. Eur J Cardiothorac Surg. 2005;28(1):157-162.

    Article  PubMed  Google Scholar 

  • Hanna GB, Drew T, Clinch P, Hunter B, Cuschieri A. Computer-controlled endoscopic performance assessment system. Surg Endosc. 1998;12(7):997-1000.

    Article  PubMed  CAS  Google Scholar 

  • Jordan JA, Gallagher AG, McGuigan J, McClure N. Randomly alternating image presentation during laparoscopic training leads to faster automation to the “fulcrum effect”. Endoscopy. 2000;32(4):317-321.

    Article  PubMed  CAS  Google Scholar 

  • Jordan JA, Gallagher AG, McGuigan J, McClure N. Virtual reality training leads to faster adaptation to the novel psychomotor restrictions encountered by laparoscopic surgeons. Surg Endosc. 2001;15(10):1080-1084.

    Article  PubMed  CAS  Google Scholar 

  • Kazdin AE. Behavior Modification in Applied Settings. Pacific Grove: Brooks/Cole Publishing Co.; 1994.

    Google Scholar 

  • Kohn LT, Corrigan JM, Donaldson MS. To Err Is Human: Building a Safer Health System. Washington: National Academy Press; 2000:196-197.

    Google Scholar 

  • Landsberger HA. Hawthorne Revisited. New York: Cornell University Press; 1968.

    Google Scholar 

  • Larsen CR, Grantcharov T, Aggarwal R, et al. Objective assessment of gynecologic laparoscopic skills using the LapSimGyn virtual reality simulator. Surg Endosc. 2006;20(9):1460-1466.

    Article  PubMed  CAS  Google Scholar 

  • Luchins AS. Primacy-recency in impression formation. In: Hovland CI, ed. The Order of Presentation in Persuasion. New Haven: Yale University Press; 1957:33-61.

    Google Scholar 

  • Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84(2):273-278.

    Article  PubMed  CAS  Google Scholar 

  • Meyer K, Applewhite HL, Biocca FA. A survey of position trackers. Presence: Teleoperators and Virtual Environments. 1992;1(2):173-200.

    Google Scholar 

  • Nixon MA, McCallum BC, Fright WR, Price NB. The effects of metals and interfering fields on electromagnetic trackers. Presence. 1998;7(2):204-218.

    Article  Google Scholar 

  • Pearson AM, Gallagher AG, Rosser JC, Satava RM. Evaluation of structured and quantitative training methods for teaching intracorporeal knot tying. Surg Endosc. 2002;16(1):130-137.

    Article  PubMed  CAS  Google Scholar 

  • Perloff RM. The Dynamics of Persuasion. New York: Lawrence Erlbaum Associates; 2008.

    Google Scholar 

  • Raab FH, Blood EB, Steiner TO, Jones HR. Magnetic position and orientation tracking system. IEEE Trans Aerosp Electron Sys. 1979;AES-15(5):709-718.

    Article  Google Scholar 

  • Reber AS, Reber ES. The Penguin Dictionary of Psychology. London: Penguin Books; 1985.

    Google Scholar 

  • Regenbogen SE, Greenberg CC, Studdert DM, Lipsitz SR, Zinner MJ, Gawande AA. Patterns of technical error among surgical malpractice claims: an analysis of strategies to prevent injury to surgical patients. Ann Surg. 2007;246(5):705.

    Article  PubMed  Google Scholar 

  • Riva G. Applications of virtual environments in medicine. Methods Inf Med. 2003;42(5):524-534.

    PubMed  CAS  Google Scholar 

  • Satava RM. Virtual reality surgical simulator. The first steps. Surg Endosc. 1993;7(3):203-205.

    Article  PubMed  CAS  Google Scholar 

  • Senate of Surgery. Response to the General Medical Council Determination on the Bristol Case: Senate Paper 5. London: The Senate of Surgery of Great Britain and Ireland; 1998.

    Google Scholar 

  • Seymour NE, Gallagher AG, Roman SA, et al. Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg. 2002;236(4):458-463; discussion 463-454.

    Article  PubMed  Google Scholar 

  • Smith SG, Torkington J, Brown TJ, Taffinder NJ, Darzi A. Motion analysis: a tool for assessing laparoscopic dexterity in the performance of a laboratory-based laparoscopic cholecystectomy. Surg Endosc. 2002;16:640-645.

    Article  PubMed  CAS  Google Scholar 

  • Spencer F. Teaching and measuring surgical techniques: the technical evaluation of competence. Bull Am Coll Surg. 1978;63:9-12.

    Google Scholar 

  • Taffinder N, Sutton C, Fishwick R, McManus I, Darzi A. Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. Stud Health Technol Inform. 1998;50:124-130.

    PubMed  CAS  Google Scholar 

  • Van Sickle K, Ritter EM, Baghai M, et al. Prospective, randomized, double-blind trial of curriculum-based training for intracorporeal suturing and knot tying. J Am Coll Surg. 2008;207(4):560-568.

    Article  PubMed  Google Scholar 

  • Wilson MS, Middlebrook A, Sutton C, Stone R, McCloy RF. MIST VR: a virtual reality trainer for laparoscopic surgery assesses performance. Ann R Coll Surg Engl. 1997;79(6):403-404.

    PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this chapter

Cite this chapter

Gallagher, A.G., O’Sullivan, G.C., O’Sullivan, G.C. (2011). Metrics for the Measurement of Skill. In: Fundamentals of Surgical Simulation. Improving Medical Outcome - Zero Tolerance. Springer, London. https://doi.org/10.1007/978-0-85729-763-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-0-85729-763-1_5

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-0-85729-762-4

  • Online ISBN: 978-0-85729-763-1

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics