Skip to main content
SpringerLink
Log in

An evaluation of the endoscopic surgical skills assessment using a video analysis software program

  • Published:
Surgical Endoscopy Aims and scope Submit manuscript

Abstract

Backgrounds

Recently, the endoscopic surgical skills of surgeons have become a focus of many investigators and society as a whole. Hence, the importance of the training and education programs used to ensure safer endoscopic surgery has been gradually increasing. We developed our own motion analysis system called the HUESAD, and already demonstrated its construct validity. In this study, we verified that another motion analysis system (which uses the Dartfish Software program) could assess surgeons’ endoscopic surgical skills.

Methods

Experts (who had performed more than 100 laparoscopic surgeries) and novices (who had no experience performing laparoscopic surgery) were recruited for this study. The task was suturing in a dry box trainer. The time and the locus tracing of both sides’ needle holders were analyzed using the new video analysis system (Dartfish Software).

Results

There were statistically significant differences between the experts and novices in all three variables assessed (task time: p = 0.0011, the locus tracing of the left sides’ needle holders: p = 0.0011, the locus tracing of the right sides’ needle holders: p = 0.0011).

Conclusions

The results of this study demonstrated that the results of the motion analysis by the Dartfish Software were well correlated with the surgeon’s skill level.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Litynski GS (1999) Profiles in laparoscopy: Mouret, Dubois, and Perissat: the laparoscopic breakthrough in Europe (1987–1988). JSLS 3(2):163–167

    CAS  PubMed Central  PubMed  Google Scholar 

  2. Botden SM, Buzink SN, Schijven MP, Jakimowicz JJ (2007) Augmented versus virtual reality laparoscopic simulation: what is the difference? A comparison of the ProMIS augmented reality laparoscopic simulator versus LapSim virtual reality laparoscopic simulator. World J Surg 31(4):764–772. doi:10.1007/s00268-006-0724-y

    Article  PubMed Central  PubMed  Google Scholar 

  3. Guidelines for granting of privileges for laparoscopic and/or thoracoscopic general surgery. Society of American Gastrointestinal Endoscopic Surgeons (SAGES) (1998). Surg Endosc 12(4):379–380

  4. Training and assessment of competence (1994). Surg Endosc 8(6):721–722

  5. Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84(2):273–278

    Article  CAS  PubMed  Google Scholar 

  6. Anastakis DJ, Regehr G, Reznick RK, Cusimano M, Murnaghan J, Brown M, Hutchison C (1999) Assessment of technical skills transfer from the bench training model to the human model. Am J Surg 177(2):167–170

    Article  CAS  PubMed  Google Scholar 

  7. Gallagher AG, Lederman AB, McGlade K, Satava RM, Smith CD (2004) Discriminative validity of the Minimally Invasive Surgical Trainer in Virtual Reality (MIST-VR) using criteria levels based on expert performance. Surg Endosc 18(4):660–665. doi:10.1007/s00464-003-8176-z

    Article  CAS  PubMed  Google Scholar 

  8. Maithel S, Sierra R, Korndorffer J, Neumann P, Dawson S, Callery M, Jones D, Scott D (2006) Construct and face validity of MIST-VR, Endotower, and CELTS: are we ready for skills assessment using simulators? Surg Endosc 20(1):104–112. doi:10.1007/s00464-005-0054-4

    Article  CAS  PubMed  Google Scholar 

  9. Zhang A, Hunerbein M, Dai Y, Schlag PM, Beller S (2008) Construct validity testing of a laparoscopic surgery simulator (Lap Mentor): evaluation of surgical skill with a virtual laparoscopic training simulator. Surg Endosc 22(6):1440–1444. doi:10.1007/s00464-007-9625-x

    Article  PubMed  Google Scholar 

  10. Yamaguchi S, Konishi K, Yasunaga T, Yoshida D, Kinjo N, Kobayashi K, Ieiri S, Okazaki K, Nakashima H, Tanoue K, Maehara Y, Hashizume M (2007) Construct validity for eye-hand coordination skill on a virtual reality laparoscopic surgical simulator. Surg Endosc 21(12):2253–2257. doi:10.1007/s00464-007-9362-1

    Article  PubMed  Google Scholar 

  11. Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P, Fowler DL (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19(3):401–405. doi:10.1007/s00464-004-8202-9

    Article  CAS  PubMed  Google Scholar 

  12. Woodrum DT, Andreatta PB, Yellamanchilli RK, Feryus L, Gauger PG, Minter RM (2006) Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg 191(1):28–32. doi:10.1016/j.amjsurg.2005.10.018

    Article  PubMed  Google Scholar 

  13. Pellen MG, Horgan LF, Barton JR, Attwood SE (2009) Construct validity of the ProMIS laparoscopic simulator. Surg Endosc 23(1):130–139. doi:10.1007/s00464-008-0066-y

    Article  PubMed  Google Scholar 

  14. Datta V, Mandalia M, Mackay S, Chang A, Cheshire N, Darzi A (2002) Relationship between skill and outcome in the laboratory-based model. Surgery 131(3):318–323

    Article  PubMed  Google Scholar 

  15. Bann SD, Khan MS, Darzi AW (2003) Measurement of surgical dexterity using motion analysis of simple bench tasks. World J Surg 27(4):390–394. doi:10.1007/s00268-002-6769-7

    Article  PubMed  Google Scholar 

  16. Moorthy K, Munz Y, Dosis A, Bello F, Chang A, Darzi A (2004) Bimodal assessment of laparoscopic suturing skills: construct and concurrent validity. Surg Endosc 18(11):1608–1612. doi:10.1007/s00464-003-9312-5

    CAS  PubMed  Google Scholar 

  17. Francis NK, Hanna GB, Cuschieri A (2002) The performance of master surgeons on the Advanced Dundee Endoscopic Psychomotor Tester: contrast validity study. Arch Surg 137(7):841–844

    Article  PubMed  Google Scholar 

  18. Macmillan AI, Cuschieri A (1999) Assessment of innate ability and skills for endoscopic manipulations by the Advanced Dundee Endoscopic Psychomotor Tester: predictive and concurrent validity. Am J Surg 177(3):274–277

    Article  CAS  PubMed  Google Scholar 

  19. Egi H, Okajima M, Yoshimitsu M, Ikeda S, Miyata Y, Masugami H, Kawahara T, Kurita Y, Kaneko M, Asahara T (2008) Objective assessment of endoscopic surgical skills by analyzing direction-dependent dexterity using the Hiroshima University Endoscopic Surgical Assessment Device (HUESAD). Surg Today 38(8):705–710. doi:10.1007/s00595-007-3696-0

    Article  PubMed  Google Scholar 

  20. Egi H, Tokunaga M, Hattori M, Ohdan H (2012) Evaluating the correlation between the HUESAD and OSATS scores: concurrent validity study. Minim Invasive Ther Allied Technol. doi:10.3109/13645706.2012.742113

    Google Scholar 

  21. Egi H, Okajima M, Kawahara T, Yoshimitsu M, Sumitani D, Tokunaga M, Takeda H, Itamoto T, Ohdan H (2010) Scientific assessment of endoscopic surgical skills. Minim Invasive Ther Allied Technol 19(1):30–34. doi:10.3109/13645700903493017

    Article  PubMed  Google Scholar 

  22. Tokunaga M, Egi H, Hattori M, Yoshimitsu M, Sumitani D, Kawahara T, Okajima M, Ohdan H (2012) Approaching time is important for assessment of endoscopic surgical skills. Minim Invasive Ther Allied Technol. doi:10.3109/13645706.2011.596547

    Google Scholar 

  23. Rucci JA, Tomporowski PD (2010) Three types of kinematic feedback and the execution of the hang power clean. J Strength Cond Res 24(3):771–778. doi:10.1519/JSC.0b013e3181cbab96

    Article  PubMed  Google Scholar 

  24. Xafis V, Babidge W, Field J, Altree M, Marlow N, Maddern G (2013) The efficacy of laparoscopic skills training in a mobile simulation unit compared with a fixed site: a comparative study. Surg Endosc. doi:10.1007/s00464-013-2798-6

    PubMed  Google Scholar 

  25. Padulo J, Annino G, Migliaccio GM, D’Ottavio S, Tihanyi J (2012) Kinematics of running at different slopes and speeds. J Strength Cond Res 26(5):1331–1339. doi:10.1519/JSC.0b013e318231aafa

    Article  PubMed  Google Scholar 

  26. Mason JD, Ansell J, Warren N, Torkington J (2013) Is motion analysis a valid tool for assessing laparoscopic skill? Surg Endosc 27(5):1468–1477. doi:10.1007/s00464-012-2631-7

    Article  PubMed  Google Scholar 

  27. Tokunaga M, Okajima M, Egi H, Yoshimitsu M, Sumitani D, Kawahara T, Hattori M, Ohdan H (2010) The importance of stressing the use of laparoscopic instruments in the initial training for laparoscopic surgery using box trainers: a Randomized Control Study. J Surg Res. doi:10.1016/j.jss.2010.11.906

    Google Scholar 

  28. Panait L, Akkary E, Bell RL, Roberts KE, Dudrick SJ, Duffy AJ (2009) The role of haptic feedback in laparoscopic simulation training. J Surg Res 156(2):312–316. doi:10.1016/j.jss.2009.04.018

    Article  PubMed  Google Scholar 

Download references

Disclosures

Drs. Takashi Suzuki, Hiroyuki Egi, Minoru Hattori, Masakazu Tokunaga, Hiroyuki Sawada and Hideki Ohdan have no competing interests or financial ties to disclose.

Author information

Authors and Affiliations

  1. Department of Gastroenterological and Transplant Surgery, Applied Life Sciences, Institute of Biomedical & Health Sciences, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan

    Takahisa Suzuki, Hiroyuki Egi, Masakazu Tokunaga, Hiroyuki Sawada & Hideki Ohdan

  2. Advanced Medical Skills Training Center, Institute of Biomedical & Health Sciences, Hiroshima University, Hiroshima, Japan

    Hiroyuki Egi & Minoru Hattori

Authors
  1. Takahisa Suzuki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hiroyuki Egi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Minoru Hattori
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Masakazu Tokunaga
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hiroyuki Sawada
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hideki Ohdan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hiroyuki Egi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Suzuki, T., Egi, H., Hattori, M. et al. An evaluation of the endoscopic surgical skills assessment using a video analysis software program. Surg Endosc 29, 1804–1808 (2015). https://doi.org/10.1007/s00464-014-3863-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00464-014-3863-5

Keywords

Search

Navigation