Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 9/2021

04-06-2021 | Original Article

Comprehensive metrics for evaluating surgical microscope use during tympanostomy tube placement

Authors: Brandon Wickens, Arefin Shamsil, Murad Husein, Lily H. P. Nguyen, Philip C. Doyle, Lorne S. Parnes, Sumit K. Agrawal, Hanif M. Ladak

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 9/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

Learning to use a surgical microscope is a fundamental step in otolaryngology training; however, there is currently no objective method to teach or assess this skill. Tympanostomy tube placement is a common otologic procedure that requires skilled use of a surgical microscope. This study was designed to (1) implement metrics capable of evaluating microscope use and (2) establish construct validity.

Study design

This was a prospective cohort study.

Methods

Eight otolaryngology trainees and three otolaryngology experts were asked to use a microscope to insert a tympanostomy tube into a cadaveric myringotomy in a standardized setting. Microscope movements were tracked in a three-dimensional space, and tracking metrics were applied to the data. The procedure was video-recorded and then analyzed by blinded experts using operational metrics. Results from both groups were compared, and discriminatory metrics were determined.

Results

The following tracking metrics were identified as discriminatory between the trainee and expert groups: total completion time, operation time, still time, and jitter (movement perturbation). Many operational metrics were found to be discriminatory between the two groups, including several positioning metrics, optical metrics, and procedural metrics.

Conclusions

Performance metrics were implemented, and construct validity was established for a subset of the proposed metrics by discriminating between expert and novice participants. These discriminatory metrics could form the basis of an automated system for providing feedback to residents during training while using a myringotomy surgical simulator. Additionally, these metrics may be useful in guiding a standardized teaching and evaluation methodology for training in the use of surgical microscopes.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kotsis SV, Chung KC (2013) Application of the ‘see one, do one, teach one’ concept in surgical training. Plast Reconstr Surg 131(5):1194–1201CrossRef Kotsis SV, Chung KC (2013) Application of the ‘see one, do one, teach one’ concept in surgical training. Plast Reconstr Surg 131(5):1194–1201CrossRef
2.
go back to reference Halsted WS (1904) The training of the surgeon. Bull Johns Hopkins Hosp 15:267–275 Halsted WS (1904) The training of the surgeon. Bull Johns Hopkins Hosp 15:267–275
3.
go back to reference Montague ML, Lee MSW, Hussain SSM (2004) Human error identification: an analysis of myringotomy and ventilation tube insertion. Arch Otolaryngol Head Neck Surg 130(10):1153–1157CrossRef Montague ML, Lee MSW, Hussain SSM (2004) Human error identification: an analysis of myringotomy and ventilation tube insertion. Arch Otolaryngol Head Neck Surg 130(10):1153–1157CrossRef
4.
go back to reference Ho AK, Alsaffar H, Doyle PC, Ladak HM, Agrawal SK (2012) Virtual reality myringotomy simulation with real-time deformation: Development and validity testing. Laryngoscope 122(8):1844–1851CrossRef Ho AK, Alsaffar H, Doyle PC, Ladak HM, Agrawal SK (2012) Virtual reality myringotomy simulation with real-time deformation: Development and validity testing. Laryngoscope 122(8):1844–1851CrossRef
5.
go back to reference Sowerby LJ, Rehal G, Husein M, Doyle PC, Agrawal SK, Ladak HM (2010) Development and face validity testing of a three-dimensional myringotomy simulator with haptic feedback. J Otolaryngol Head Neck Surg 39(2):122–129PubMed Sowerby LJ, Rehal G, Husein M, Doyle PC, Agrawal SK, Ladak HM (2010) Development and face validity testing of a three-dimensional myringotomy simulator with haptic feedback. J Otolaryngol Head Neck Surg 39(2):122–129PubMed
6.
go back to reference Wheeler B, Doyle PC, Chandarana S, Agrawal S, Husein M, Ladak H (2010) Interactive computer-based simulator for training in blade navigation and targeting in myringotomy. Comput Methods Programs Biomed 98(2):130–139CrossRef Wheeler B, Doyle PC, Chandarana S, Agrawal S, Husein M, Ladak H (2010) Interactive computer-based simulator for training in blade navigation and targeting in myringotomy. Comput Methods Programs Biomed 98(2):130–139CrossRef
7.
go back to reference Huang C, Cheng H, Bureau Y, Agrawal SK, Ladak HM (2015) Face and content validity of a virtual-reality simulator for myringotomy with tube placement. J Otolaryngol Head Neck Surg 44:40CrossRef Huang C, Cheng H, Bureau Y, Agrawal SK, Ladak HM (2015) Face and content validity of a virtual-reality simulator for myringotomy with tube placement. J Otolaryngol Head Neck Surg 44:40CrossRef
8.
go back to reference Huang C, Cheng H, Bureau Y, Ladak HM, Agrawal S (2018) Automated metrics in a virtual-reality myringotomy simulator: Development and construct validity. Otol Neurotol 39(7):e601–e608CrossRef Huang C, Cheng H, Bureau Y, Ladak HM, Agrawal S (2018) Automated metrics in a virtual-reality myringotomy simulator: Development and construct validity. Otol Neurotol 39(7):e601–e608CrossRef
9.
go back to reference Zhao YC, Kennedy G, Yukawa K, Pyman B, O’Leary S (2011) Improving temporal bone dissection using self-directed virtual reality simulation: Results of a randomized blinded control trial. Otolaryngol Head Neck Surg 144(3):357–364CrossRef Zhao YC, Kennedy G, Yukawa K, Pyman B, O’Leary S (2011) Improving temporal bone dissection using self-directed virtual reality simulation: Results of a randomized blinded control trial. Otolaryngol Head Neck Surg 144(3):357–364CrossRef
10.
go back to reference Francis HW, Malik MU, Diaz Voss Varela DA, Barffour MA, Chien WW, Carey JP, Niparko JK, Bhatti NI (2012) Technical skills improve after practice on virtual-reality temporal bone simulator. Laryngoscope 122(6):1385–1391CrossRef Francis HW, Malik MU, Diaz Voss Varela DA, Barffour MA, Chien WW, Carey JP, Niparko JK, Bhatti NI (2012) Technical skills improve after practice on virtual-reality temporal bone simulator. Laryngoscope 122(6):1385–1391CrossRef
11.
go back to reference Zirkle M, Roberson DW, Leuwer R, Dubrowski A (2007) Using a virtual reality temporal bone simulator to assess otolaryngology trainees. Laryngoscope 117(2):258–263CrossRef Zirkle M, Roberson DW, Leuwer R, Dubrowski A (2007) Using a virtual reality temporal bone simulator to assess otolaryngology trainees. Laryngoscope 117(2):258–263CrossRef
12.
go back to reference Agus M, Giacheti A, Gobbetti E, Zanetti G, Zorcolo A, John NW, Stone RJ (2002) Mastoidectomy simulation with combined visual and haptic feedback. Stud Health Technol Inform 85:17–23PubMed Agus M, Giacheti A, Gobbetti E, Zanetti G, Zorcolo A, John NW, Stone RJ (2002) Mastoidectomy simulation with combined visual and haptic feedback. Stud Health Technol Inform 85:17–23PubMed
13.
go back to reference Sewell C, Morris D, Blevins NH, Agrawal S, Dutta S, Barbagli F, Salisbury K (2007) Validating metrics for a mastoidectomy simulator. Stud Health Technol Inform 125:421–426PubMed Sewell C, Morris D, Blevins NH, Agrawal S, Dutta S, Barbagli F, Salisbury K (2007) Validating metrics for a mastoidectomy simulator. Stud Health Technol Inform 125:421–426PubMed
14.
go back to reference Schwartz J, Costescu A, Mascarella MA, Young ME, Husein M, Agrawal S, Roth K, Doyle PC, Nguyen LH (2016) Objective assessment of myringotomy and tympanostomy tube insertion: A prospective single-blinded validation study. Laryngoscope 126(9):2140–2146CrossRef Schwartz J, Costescu A, Mascarella MA, Young ME, Husein M, Agrawal S, Roth K, Doyle PC, Nguyen LH (2016) Objective assessment of myringotomy and tympanostomy tube insertion: A prospective single-blinded validation study. Laryngoscope 126(9):2140–2146CrossRef
15.
go back to reference Lapeer R, Chen MS, Gonzalez G, Linney A, Alusi G (2008) Image-enhanced surgical navigation for endoscopic sinus surgery: evaluating calibration, registration and tracking. Int J Med Robot Comput Assist Surg 4(1):32–45CrossRef Lapeer R, Chen MS, Gonzalez G, Linney A, Alusi G (2008) Image-enhanced surgical navigation for endoscopic sinus surgery: evaluating calibration, registration and tracking. Int J Med Robot Comput Assist Surg 4(1):32–45CrossRef
16.
go back to reference Yamaguchi S, Yoshida D, Kenmotsu H, Yasunaga T, Konishi K, Ieiri S, Nakashima H, Tanoue K, Hashizume M (2011) Objective assessment of laparoscopic suturing skills using a motion-tracking system. Surg Endosc 25(3):771–775CrossRef Yamaguchi S, Yoshida D, Kenmotsu H, Yasunaga T, Konishi K, Ieiri S, Nakashima H, Tanoue K, Hashizume M (2011) Objective assessment of laparoscopic suturing skills using a motion-tracking system. Surg Endosc 25(3):771–775CrossRef
17.
go back to reference García J, Thoranaghatte R, Marti G, Zheng G, Caversaccio M, González Ballester MA (2008) Calibration of a surgical microscope with automated zoom lenses using an active optical tracker. Int J Med Robot Comput Assist Surg 4(1):87–93CrossRef García J, Thoranaghatte R, Marti G, Zheng G, Caversaccio M, González Ballester MA (2008) Calibration of a surgical microscope with automated zoom lenses using an active optical tracker. Int J Med Robot Comput Assist Surg 4(1):87–93CrossRef
18.
go back to reference Howells NR, Brinsden MD, Gill RS, Carr AJ, Rees JL (2008) Motion Analysis: A Validated Method for Showing Skill Levels in Arthroscopy. Arthrosc-J Arthrosc Relat Surg 24(3):335–342CrossRef Howells NR, Brinsden MD, Gill RS, Carr AJ, Rees JL (2008) Motion Analysis: A Validated Method for Showing Skill Levels in Arthroscopy. Arthrosc-J Arthrosc Relat Surg 24(3):335–342CrossRef
19.
go back to reference Horeman T, Dankelman J, Jansen FW, Van Den Dobbelsteen JJ (2014) Assessment of laparoscopic skills based on force and motion parameters. IEEE Trans Biomed Eng 61(3):805–813CrossRef Horeman T, Dankelman J, Jansen FW, Van Den Dobbelsteen JJ (2014) Assessment of laparoscopic skills based on force and motion parameters. IEEE Trans Biomed Eng 61(3):805–813CrossRef
20.
go back to reference Estrada S, O’Malley MK, Duran C, Schulz D, Bismuth J (2014) On the development of objective metrics for surgical skills evaluation based on tool motion. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, pp 3144–3149 Estrada S, O’Malley MK, Duran C, Schulz D, Bismuth J (2014) On the development of objective metrics for surgical skills evaluation based on tool motion. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, pp 3144–3149
21.
go back to reference Mason JD, Ansell J, Warren N, Torkington J (2013) Is motion analysis a valid tool for assessing laparoscopic skill? Surg Endosc 27(5):1468–1477CrossRef Mason JD, Ansell J, Warren N, Torkington J (2013) Is motion analysis a valid tool for assessing laparoscopic skill? Surg Endosc 27(5):1468–1477CrossRef
22.
go back to reference Contreras-Vidal JL, Buch ER (2003) Effects of Parkinson’s disease on visuomotor adaptation. Exp Brain Res 50(1):25–32CrossRef Contreras-Vidal JL, Buch ER (2003) Effects of Parkinson’s disease on visuomotor adaptation. Exp Brain Res 50(1):25–32CrossRef
23.
go back to reference Goldvasser D, McGibbon CA, Krebs DE (2001) High curvature and jerk analyses of arm ataxia. Biol Cybern 84(2):85–90CrossRef Goldvasser D, McGibbon CA, Krebs DE (2001) High curvature and jerk analyses of arm ataxia. Biol Cybern 84(2):85–90CrossRef
Metadata
Title
Comprehensive metrics for evaluating surgical microscope use during tympanostomy tube placement
Authors
Brandon Wickens
Arefin Shamsil
Murad Husein
Lily H. P. Nguyen
Philip C. Doyle
Lorne S. Parnes
Sumit K. Agrawal
Hanif M. Ladak
Publication date
04-06-2021
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 9/2021
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-021-02428-8

Other articles of this Issue 9/2021

International Journal of Computer Assisted Radiology and Surgery 9/2021 Go to the issue

Premium Partner