Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 10/2016

01.10.2016 | Original Article

Virtually transparent surgical instruments in endoscopic surgery with augmentation of obscured regions

verfasst von: Yuta Koreeda, Yo Kobayashi, Satoshi Ieiri, Yuya Nishio, Kazuya Kawamura, Satoshi Obata, Ryota Souzaki, Makoto Hashizume, Masakatsu G. Fujie

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 10/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

We developed and evaluated a visual compensation system that allows surgeons to visualize obscured regions in real time, such that the surgical instrument appears virtually transparent.

Methods

The system consists of two endoscopes: a main endoscope to observe the surgical environment, and a supporting endoscope to render the region hidden from view by surgical instruments. The view captured by the supporting endoscope is transformed to simulate the view from the main endoscope, segmented to the shape of the hidden regions, and superimposed to the main endoscope image so that the surgical instruments look transparent. A prototype device was benchmarked for processing time and superimposition rendering error. Then, it was evaluated in a training environment with 22 participants performing a backhand needle driving task with needle exit point error as the criterion. Lastly, we conducted an in vivo study.

Results

In the benchmark, the mean processing time was 62.4 ms, which was lower than the processing time accepted in remote surgeries. The mean superimposition error of the superimposed image was 1.4 mm. In the training environment, needle exit point error with the system decreased significantly for experts compared with the condition without the system. This change was not significant for novices. In the in vivo study, our prototype enabled visualization of needle exit points during anastomosis.

Conclusion

The benchmark suggests that the implemented system had an acceptable performance, and evaluation in the training environment demonstrated improved surgical task outcomes in expert surgeons. We will conduct a more comprehensive in vivo study in the future.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Bradski G, Kaehler A (2008) Learning OpenCV: computer vision with the OpenCV Library. O’Reilly Media Bradski G, Kaehler A (2008) Learning OpenCV: computer vision with the OpenCV Library. O’Reilly Media
3.
Zurück zum Zitat Doignon C, Nageotte F, de Mathelin M (2006) Segmentation and guidance of multiple rigid objects for intra-operative endoscopic vision. In: WDV’05/WDV’06/ICCV’05/ECCV’06 proceedings of the 2005/2006 international conference on dynamical vision. Springer, pp 314–327 Doignon C, Nageotte F, de Mathelin M (2006) Segmentation and guidance of multiple rigid objects for intra-operative endoscopic vision. In: WDV’05/WDV’06/ICCV’05/ECCV’06 proceedings of the 2005/2006 international conference on dynamical vision. Springer, pp 314–327
5.
Zurück zum Zitat Heikkilä J, Silvén O (1997) A four-step camera calibration procedure with implicit image correction. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, IEEE Comput. Soc, San Juan, pp 1106–1112. doi:10.1109/CVPR.1997.609468 Heikkilä J, Silvén O (1997) A four-step camera calibration procedure with implicit image correction. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, IEEE Comput. Soc, San Juan, pp 1106–1112. doi:10.​1109/​CVPR.​1997.​609468
6.
Zurück zum Zitat Lee ACH, Haddad MJ, Hanna GB (2007) Influence of instrument size on endoscopic task performance in pediatric intracorporeal knot tying: smaller instruments are better in infants. Surg Endosc 21(11):2086–2090. doi:10.1007/s00464-007-9311-z CrossRefPubMed Lee ACH, Haddad MJ, Hanna GB (2007) Influence of instrument size on endoscopic task performance in pediatric intracorporeal knot tying: smaller instruments are better in infants. Surg Endosc 21(11):2086–2090. doi:10.​1007/​s00464-007-9311-z CrossRefPubMed
7.
Zurück zum Zitat Liao H, Inomata T, Sakuma I, Dohi T (2010) 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Bio-med Eng 57(6):1476–1486. doi:10.1109/TBME.2010.2040278 CrossRef Liao H, Inomata T, Sakuma I, Dohi T (2010) 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Bio-med Eng 57(6):1476–1486. doi:10.​1109/​TBME.​2010.​2040278 CrossRef
8.
Zurück zum Zitat Maier-Hein L, Mountney P, Bartoli A, Elhawary H, Elson D, Groch A, Kolb A, Rodrigues M, Sorger J, Speidel S, Stoyanov D (2013) Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery. Med Image Anal 17(8):974–996. doi:10.1016/j.media.2013.04.003 CrossRefPubMed Maier-Hein L, Mountney P, Bartoli A, Elhawary H, Elson D, Groch A, Kolb A, Rodrigues M, Sorger J, Speidel S, Stoyanov D (2013) Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery. Med Image Anal 17(8):974–996. doi:10.​1016/​j.​media.​2013.​04.​003 CrossRefPubMed
9.
Zurück zum Zitat Marescaux J, Leroy J, Rubino F, Smith M, Vix M, Simone M, Mutter D (2002) Transcontinental robot-assisted remote telesurgery: feasibility and potential applications. Ann Surg 235(4):487–492CrossRefPubMedPubMedCentral Marescaux J, Leroy J, Rubino F, Smith M, Vix M, Simone M, Mutter D (2002) Transcontinental robot-assisted remote telesurgery: feasibility and potential applications. Ann Surg 235(4):487–492CrossRefPubMedPubMedCentral
10.
Zurück zum Zitat Nageotte F, Zanne P, Doignon C, Mathelin M (2006) Visual servoing-based endoscopic path following for robot-assisted laparoscopic surgery. In: 2006 IEEE/RSJ international conference on intelligent robots and systems, IEEE, pp 2364–2369. doi:10.1109/IROS.2006.282647 Nageotte F, Zanne P, Doignon C, Mathelin M (2006) Visual servoing-based endoscopic path following for robot-assisted laparoscopic surgery. In: 2006 IEEE/RSJ international conference on intelligent robots and systems, IEEE, pp 2364–2369. doi:10.​1109/​IROS.​2006.​282647
11.
Zurück zum Zitat Navab N, Feuerstein M, Bichlmeier C (2007) Laparoscopic virtual mirror new interaction paradigm for monitor based augmented reality. In: 2007 IEEE virtual reality conference, IEEE, pp 43–50. doi:10.1109/VR.2007.352462 Navab N, Feuerstein M, Bichlmeier C (2007) Laparoscopic virtual mirror new interaction paradigm for monitor based augmented reality. In: 2007 IEEE virtual reality conference, IEEE, pp 43–50. doi:10.​1109/​VR.​2007.​352462
12.
Zurück zum Zitat Okubo T, Nakaguchi T, Hayashi H (2011) Abdominal view expansion by retractable camera. J Signal Process 15(4):311–314 Okubo T, Nakaguchi T, Hayashi H (2011) Abdominal view expansion by retractable camera. J Signal Process 15(4):311–314
13.
Zurück zum Zitat Perez M, Quiaios F, Andrivon P, Husson D, Dufaut M, Felblinger J, Hubert J (2007) Paradigms and experimental set-up for the determination of the acceptable delay in telesurgery. Conference proceedings: annual international conference of the IEEE engineering in medicine and biology society IEEE engineering in medicine and biology society conference 2007, pp 453–456. doi:10.1109/IEMBS.2007.4352321 Perez M, Quiaios F, Andrivon P, Husson D, Dufaut M, Felblinger J, Hubert J (2007) Paradigms and experimental set-up for the determination of the acceptable delay in telesurgery. Conference proceedings: annual international conference of the IEEE engineering in medicine and biology society IEEE engineering in medicine and biology society conference 2007, pp 453–456. doi:10.​1109/​IEMBS.​2007.​4352321
14.
Zurück zum Zitat Rayman R, Croome K, Galbraith N, McClure R, Morady R, Peterson S, Smith S, Subotic V, Van Wynsberghe A, Primak S (2006) Long-distance robotic telesurgery: a feasibility study for care in remote environments. Int J Med Robot Comput Assist Surg 2(3):216–224. doi:10.1002/rcs.99 CrossRef Rayman R, Croome K, Galbraith N, McClure R, Morady R, Peterson S, Smith S, Subotic V, Van Wynsberghe A, Primak S (2006) Long-distance robotic telesurgery: a feasibility study for care in remote environments. Int J Med Robot Comput Assist Surg 2(3):216–224. doi:10.​1002/​rcs.​99 CrossRef
17.
Zurück zum Zitat Tomikawa M, Kenmotsu H, Uemura M, Konishi K, Ohuchida K, Okazaki K, Ieiri S, Tanoue K, Hashizume M (2014) Analysis of surgeons who attended laparoscopic surgical skills training programs at Kyushu University. International journal of computer assisted radiology and surgery: 18th Annual Conference of the International Society for. Computer Aided Surgery 9(1 Suppl), pp 130–131 Tomikawa M, Kenmotsu H, Uemura M, Konishi K, Ohuchida K, Okazaki K, Ieiri S, Tanoue K, Hashizume M (2014) Analysis of surgeons who attended laparoscopic surgical skills training programs at Kyushu University. International journal of computer assisted radiology and surgery: 18th Annual Conference of the International Society for. Computer Aided Surgery 9(1 Suppl), pp 130–131
18.
Zurück zum Zitat Xia T, Baird C, Jallo G, Hayes K, Nakajima N, Hata N, Kazanzides P (2008) An integrated system for planning, navigation and robotic assistance for skull base surgery. Int J Med Robot Comput Assis Surg 4(4):321–330. doi:10.1002/rcs.213 CrossRef Xia T, Baird C, Jallo G, Hayes K, Nakajima N, Hata N, Kazanzides P (2008) An integrated system for planning, navigation and robotic assistance for skull base surgery. Int J Med Robot Comput Assis Surg 4(4):321–330. doi:10.​1002/​rcs.​213 CrossRef
19.
Zurück zum Zitat Xu S, Perez M, Yang K, Perrenot C, Felblinger J, Hubert J (2014) Determination of the latency effects on surgical performance and the acceptable latency levels in telesurgery using the dV-Trainer() simulator. Surg Endosc. doi:10.1007/s00464-014-3504-z Xu S, Perez M, Yang K, Perrenot C, Felblinger J, Hubert J (2014) Determination of the latency effects on surgical performance and the acceptable latency levels in telesurgery using the dV-Trainer() simulator. Surg Endosc. doi:10.​1007/​s00464-014-3504-z
20.
Zurück zum Zitat Yamaguchi T, Nakamoto M, Sato Y, Konishi K, Hashizume M, Sugano N, Yoshikawa H, Tamura S (2004) Development of a camera model and calibration procedure for oblique-viewing endoscopes. Comput Aided Surg 9(5):203–214. doi:10.3109/10929080500163505 PubMed Yamaguchi T, Nakamoto M, Sato Y, Konishi K, Hashizume M, Sugano N, Yoshikawa H, Tamura S (2004) Development of a camera model and calibration procedure for oblique-viewing endoscopes. Comput Aided Surg 9(5):203–214. doi:10.​3109/​1092908050016350​5 PubMed
Metadaten
Titel
Virtually transparent surgical instruments in endoscopic surgery with augmentation of obscured regions
verfasst von
Yuta Koreeda
Yo Kobayashi
Satoshi Ieiri
Yuya Nishio
Kazuya Kawamura
Satoshi Obata
Ryota Souzaki
Makoto Hashizume
Masakatsu G. Fujie
Publikationsdatum
01.10.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 10/2016
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-016-1384-5

Weitere Artikel der Ausgabe 10/2016

International Journal of Computer Assisted Radiology and Surgery 10/2016 Zur Ausgabe

Premium Partner