Skip to main content

2017 | OriginalPaper | Buchkapitel

Robust Laparoscopic Instruments Tracking Using Colored Strips

verfasst von : Virginia Mamone, Rosanna Maria Viglialoro, Fabrizio Cutolo, Filippo Cavallo, Simone Guadagni, Vincenzo Ferrari

Erschienen in: Augmented Reality, Virtual Reality, and Computer Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

To assist surgeons in the acquisition of the required skills for the proper execution of the laparoscopic procedure, surgical simulators are used. During training with simulators it is useful to provide a surgical performance quantitative evaluation. Recent research works showed that such evaluation can be obtained by tracking the laparoscopic instruments, using only the images provided by the laparoscope and without hindering the surgical scene. In this work the state of the art method is improved so that a robust tracking can run even with the noisy background provided by realistic simulators. The method was validated by comparison with the tracking of a “chess-board” pattern and following tests were performed to check the robustness of the developed algorithm. Despite the noisy environment, the implemented method was found to be able to track the tip of the surgical instrument with a good accuracy compared to the other studies in the literature.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Freschi, C., et al.: Technical review of the da Vinci surgical telemanipulator. Int. J. Med. Robot. Comput. Assist. Surg. 9(4), 396–406 (2013)CrossRef Freschi, C., et al.: Technical review of the da Vinci surgical telemanipulator. Int. J. Med. Robot. Comput. Assist. Surg. 9(4), 396–406 (2013)CrossRef
2.
Zurück zum Zitat Champion, H.R., Gallagher, A.G.: Surgical simulation—a ‘good idea whose time has come’. Br. J. Surg. 90(7), 767–768 (2003)CrossRef Champion, H.R., Gallagher, A.G.: Surgical simulation—a ‘good idea whose time has come’. Br. J. Surg. 90(7), 767–768 (2003)CrossRef
3.
Zurück zum Zitat Kneebone, R.: Simulation in surgical training: educational issues and practical implications. Med. Educ. 37(3), 267–277 (2003)CrossRef Kneebone, R.: Simulation in surgical training: educational issues and practical implications. Med. Educ. 37(3), 267–277 (2003)CrossRef
4.
Zurück zum Zitat Cavallo, F., et al.: Biomechanics-machine learning system for surgical gesture analysis and development of technologies for minimal access surgery. Surg. Innov. 21(5), 504–512 (2014)CrossRef Cavallo, F., et al.: Biomechanics-machine learning system for surgical gesture analysis and development of technologies for minimal access surgery. Surg. Innov. 21(5), 504–512 (2014)CrossRef
5.
Zurück zum Zitat Lahanas, V., Georgiou, E., Loukas, C.: Surgical simulation training systems: box trainers, virtual reality and augmented reality simulators. Int. J. Adv. Robot. Automn. 1, 1–9 (2016) Lahanas, V., Georgiou, E., Loukas, C.: Surgical simulation training systems: box trainers, virtual reality and augmented reality simulators. Int. J. Adv. Robot. Automn. 1, 1–9 (2016)
6.
Zurück zum Zitat Moglia, A., et al.: Patient specific surgical simulator for the evaluation of the movability of bimanual robotic arms. Stud. Health Technol. Inform. 163, 379–385 (2011) Moglia, A., et al.: Patient specific surgical simulator for the evaluation of the movability of bimanual robotic arms. Stud. Health Technol. Inform. 163, 379–385 (2011)
7.
Zurück zum Zitat Turini, G., et al.: Patient-specific surgical simulator for the pre-operative planning of single-incision laparoscopic surgery with bimanual robots. Comput. Aided Surg. 17(3), 103–112 (2012)CrossRef Turini, G., et al.: Patient-specific surgical simulator for the pre-operative planning of single-incision laparoscopic surgery with bimanual robots. Comput. Aided Surg. 17(3), 103–112 (2012)CrossRef
8.
Zurück zum Zitat Ferrari, V., et al.: Augmented reality visualization of deformable tubular structures for surgical simulation. Int. J. Med. Robot. Comput. Assist. Surg. 12, 231–240 (2015)CrossRef Ferrari, V., et al.: Augmented reality visualization of deformable tubular structures for surgical simulation. Int. J. Med. Robot. Comput. Assist. Surg. 12, 231–240 (2015)CrossRef
9.
Zurück zum Zitat Allan, M., Chang, P.-L., Ourselin, S., Hawkes, D.J., Sridhar, A., Kelly, J., Stoyanov, D.: Image based surgical instrument pose estimation with multi-class labelling and optical flow. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9349, pp. 331–338. Springer, Cham (2015). doi:10.1007/978-3-319-24553-9_41 CrossRef Allan, M., Chang, P.-L., Ourselin, S., Hawkes, D.J., Sridhar, A., Kelly, J., Stoyanov, D.: Image based surgical instrument pose estimation with multi-class labelling and optical flow. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9349, pp. 331–338. Springer, Cham (2015). doi:10.​1007/​978-3-319-24553-9_​41 CrossRef
10.
Zurück zum Zitat Loukas, C., Lahanas, V., Georgiou, E.: An integrated approach to endoscopic instrument tracking for augmented reality applications in surgical simulation training. Int. J. Med. Robot. 9(4), e34–e51 (2013)CrossRef Loukas, C., Lahanas, V., Georgiou, E.: An integrated approach to endoscopic instrument tracking for augmented reality applications in surgical simulation training. Int. J. Med. Robot. 9(4), e34–e51 (2013)CrossRef
11.
Zurück zum Zitat Viglialoro, R.M., Condino, S., Gesi, M., Ferrari, M., Ferrari, V.: Augmented reality simulator for laparoscopic cholecystectomy training. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2014. LNCS, vol. 8853, pp. 428–433. Springer, Cham (2014). doi:10.1007/978-3-319-13969-2_33 Viglialoro, R.M., Condino, S., Gesi, M., Ferrari, M., Ferrari, V.: Augmented reality simulator for laparoscopic cholecystectomy training. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2014. LNCS, vol. 8853, pp. 428–433. Springer, Cham (2014). doi:10.​1007/​978-3-319-13969-2_​33
12.
Zurück zum Zitat Viglialoro, R.M., et al.: AR visualization of “Synthetic Calot’s Triangle” for training in cholecystectomy. In: 12th IASTED International Conference on Biomedical Engineering. BioMed, Austria (2016) Viglialoro, R.M., et al.: AR visualization of “Synthetic Calot’s Triangle” for training in cholecystectomy. In: 12th IASTED International Conference on Biomedical Engineering. BioMed, Austria (2016)
13.
Zurück zum Zitat Viglialoro, R.M., et al.: A physical patient specific simulator for cholecystectomy training. In: Computer Assisted Radiology and Surgery (CARS) (2012) Viglialoro, R.M., et al.: A physical patient specific simulator for cholecystectomy training. In: Computer Assisted Radiology and Surgery (CARS) (2012)
14.
Zurück zum Zitat Condino, S., Viglialoro, R.M., Fani, S., Bianchi, M., Morelli, L., Ferrari, M., Bicchi, A., Ferrari, V.: Tactile augmented reality for arteries palpation in open surgery training. In: Zheng, G., Liao, H., Jannin, P., Cattin, P., Lee, S.-L. (eds.) MIAR 2016. LNCS, vol. 9805, pp. 186–197. Springer, Cham (2016). doi:10.1007/978-3-319-43775-0_17 CrossRef Condino, S., Viglialoro, R.M., Fani, S., Bianchi, M., Morelli, L., Ferrari, M., Bicchi, A., Ferrari, V.: Tactile augmented reality for arteries palpation in open surgery training. In: Zheng, G., Liao, H., Jannin, P., Cattin, P., Lee, S.-L. (eds.) MIAR 2016. LNCS, vol. 9805, pp. 186–197. Springer, Cham (2016). doi:10.​1007/​978-3-319-43775-0_​17 CrossRef
15.
Zurück zum Zitat Condino, S., et al.: How to build patient-specific synthetic abdominal anatomies. An innovative approach from physical toward hybrid surgical simulators. Int. J. Med. Robot. 7(2), 202–213 (2011)CrossRef Condino, S., et al.: How to build patient-specific synthetic abdominal anatomies. An innovative approach from physical toward hybrid surgical simulators. Int. J. Med. Robot. 7(2), 202–213 (2011)CrossRef
16.
Zurück zum Zitat Kyriakoulis, N., Gasteratos, A.: Light-invariant 3D object’s pose estimation using color distance transform. In: IEEE International Conference Imaging Systems and Techniques (IST) (2010) Kyriakoulis, N., Gasteratos, A.: Light-invariant 3D object’s pose estimation using color distance transform. In: IEEE International Conference Imaging Systems and Techniques (IST) (2010)
17.
Zurück zum Zitat Diotte, B., et al.: Multi-modal intra-operative navigation during distal locking of intramedullary nails. IEEE Trans. Med. Imaging 34(2), 487–495 (2015)CrossRef Diotte, B., et al.: Multi-modal intra-operative navigation during distal locking of intramedullary nails. IEEE Trans. Med. Imaging 34(2), 487–495 (2015)CrossRef
18.
Zurück zum Zitat Cutolo, F., et al.: Robust and accurate algorithm for wearable stereoscopic augmented reality with three indistinguishable markers. Electronics 5(3) (2016). Article number 59 Cutolo, F., et al.: Robust and accurate algorithm for wearable stereoscopic augmented reality with three indistinguishable markers. Electronics 5(3) (2016). Article number 59
19.
Zurück zum Zitat Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRef Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRef
20.
Zurück zum Zitat Chmarra, M.K., et al.: Retracting and seeking movements during laparoscopic goal-oriented movements. Is the shortest path length optimal? Surg. Endosc. 22(4), 943–949 (2008)CrossRef Chmarra, M.K., et al.: Retracting and seeking movements during laparoscopic goal-oriented movements. Is the shortest path length optimal? Surg. Endosc. 22(4), 943–949 (2008)CrossRef
Metadaten
Titel
Robust Laparoscopic Instruments Tracking Using Colored Strips
verfasst von
Virginia Mamone
Rosanna Maria Viglialoro
Fabrizio Cutolo
Filippo Cavallo
Simone Guadagni
Vincenzo Ferrari
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-60928-7_11

Premium Partner