Skip to main content

2017 | Supplement | Buchkapitel

Concurrent Segmentation and Localization for Tracking of Surgical Instruments

verfasst von : Iro Laina, Nicola Rieke, Christian Rupprecht, Josué Page Vizcaíno, Abouzar Eslami, Federico Tombari, Nassir Navab

Erschienen in: Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Real-time instrument tracking is a crucial requirement for various computer-assisted interventions. To overcome problems such as specular reflection and motion blur, we propose a novel method that takes advantage of the interdependency between localization and segmentation of the surgical tool. In particular, we reformulate the 2D pose estimation as a heatmap regression and thereby enable a robust, concurrent regression of both tasks via deep learning. Throughout experimental results, we demonstrate that this modeling leads to a significantly better performance than directly regressing the tool position and that our method outperforms the state-of-the-art on a Retinal Microsurgery benchmark and the MICCAI EndoVis Challenge 2015.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
MICCAI 2015 Endoscopic Vision Challenge Instrument Segmentation and Tracking Sub-challenge http://​endovissub-instrument.​grand-challenge.​org.
 
2
The challenge administrators believe that the ground truth regarding tracking for sequence 5 and 6 is not as accurate as for the rest of the sequences.
 
Literatur
1.
Zurück zum Zitat Bouget, D., Allan, M., Stoyanov, D., Jannin, P.: Vision-based and marker-less surgical tool detection and tracking: a review of the literature. Med. Image Anal. 35, 633–654 (2017)CrossRef Bouget, D., Allan, M., Stoyanov, D., Jannin, P.: Vision-based and marker-less surgical tool detection and tracking: a review of the literature. Med. Image Anal. 35, 633–654 (2017)CrossRef
2.
Zurück zum Zitat Sznitman, R., Richa, R., Taylor, R.H., Jedynak, B., Hager, G.D.: Unified detection and tracking of instruments during retinal microsurgery. IEEE Trans. Pattern Anal. Mach. Intell. 35(5), 1263–1273 (2013)CrossRef Sznitman, R., Richa, R., Taylor, R.H., Jedynak, B., Hager, G.D.: Unified detection and tracking of instruments during retinal microsurgery. IEEE Trans. Pattern Anal. Mach. Intell. 35(5), 1263–1273 (2013)CrossRef
3.
Zurück zum Zitat Rieke, N., Tan, D.J., Amat di San Filippo, C., Tombari, F., Alsheakhali, M., Belagiannis, V., Eslami, A., Navab, N.: Real-time localization of articulated surgical instruments in retinal microsurgery. Med. Image Anal. 34, 82–100 (2016)CrossRef Rieke, N., Tan, D.J., Amat di San Filippo, C., Tombari, F., Alsheakhali, M., Belagiannis, V., Eslami, A., Navab, N.: Real-time localization of articulated surgical instruments in retinal microsurgery. Med. Image Anal. 34, 82–100 (2016)CrossRef
4.
Zurück zum Zitat Bouget, D., Benenson, R., Omran, M., Riffaud, L., Schiele, B., Jannin, P.: Detecting surgical tools by modelling local appearance and global shape. Trans. Med. Imaging 34(12), 2603–2617 (2015)CrossRef Bouget, D., Benenson, R., Omran, M., Riffaud, L., Schiele, B., Jannin, P.: Detecting surgical tools by modelling local appearance and global shape. Trans. Med. Imaging 34(12), 2603–2617 (2015)CrossRef
5.
Zurück zum Zitat Zhou, J., Payandeh, S.: Visual tracking of laparoscopic instruments. J. Autom. Cont. Eng. 2(3), 234–241 (2014)CrossRef Zhou, J., Payandeh, S.: Visual tracking of laparoscopic instruments. J. Autom. Cont. Eng. 2(3), 234–241 (2014)CrossRef
6.
Zurück zum Zitat Rieke, N., Tan, D.J., Tombari, F., Vizcaíno, J.P., Amat di San Filippo, C., Eslami, A., Navab, N.: Real-time online adaption for robust instrument tracking and pose estimation. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9900, pp. 422–430. Springer, Cham (2016). doi:10.1007/978-3-319-46720-7_49CrossRef Rieke, N., Tan, D.J., Tombari, F., Vizcaíno, J.P., Amat di San Filippo, C., Eslami, A., Navab, N.: Real-time online adaption for robust instrument tracking and pose estimation. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9900, pp. 422–430. Springer, Cham (2016). doi:10.​1007/​978-3-319-46720-7_​49CrossRef
7.
Zurück zum Zitat Sarikaya, D., Corso, J., Guru, K.: Detection and localization of robotic tools in robot-assisted surgery videos using deep neural networks for region proposal and detection. IEEE Trans. Med. Imaging 36(7), 1542–1549 (2017). doi:10.1109/TMI.2017.2665671CrossRef Sarikaya, D., Corso, J., Guru, K.: Detection and localization of robotic tools in robot-assisted surgery videos using deep neural networks for region proposal and detection. IEEE Trans. Med. Imaging 36(7), 1542–1549 (2017). doi:10.​1109/​TMI.​2017.​2665671CrossRef
8.
Zurück zum Zitat Allan, M., Ourselin, S., Thompson, S., Hawkes, D.J., Kelly, J., Stoyanov, D.: Toward detection and localization of instruments in minimally invasive surgery. IEEE Trans. Biomed. Eng. 60, 1050–1058 (2013)CrossRef Allan, M., Ourselin, S., Thompson, S., Hawkes, D.J., Kelly, J., Stoyanov, D.: Toward detection and localization of instruments in minimally invasive surgery. IEEE Trans. Biomed. Eng. 60, 1050–1058 (2013)CrossRef
9.
Zurück zum Zitat Reiter, A., Allen, P.K., Zhao, T.: Marker-less articulated surgical tool detection. In: Proceedings of Computer Assisted Radiology and Surgery, vol. 7, pp. 175–176 (2012) Reiter, A., Allen, P.K., Zhao, T.: Marker-less articulated surgical tool detection. In: Proceedings of Computer Assisted Radiology and Surgery, vol. 7, pp. 175–176 (2012)
10.
Zurück zum Zitat García-Peraza-Herrera, L.C., et al.: Real-time segmentation of non-rigid surgical tools based on deep learning and tracking. In: Peters, T., Yang, G.-Z., Navab, N., Mori, K., Luo, X., Reichl, T., McLeod, J. (eds.) CARE 2016. LNCS, vol. 10170, pp. 84–95. Springer, Cham (2017). doi:10.1007/978-3-319-54057-3_8CrossRef García-Peraza-Herrera, L.C., et al.: Real-time segmentation of non-rigid surgical tools based on deep learning and tracking. In: Peters, T., Yang, G.-Z., Navab, N., Mori, K., Luo, X., Reichl, T., McLeod, J. (eds.) CARE 2016. LNCS, vol. 10170, pp. 84–95. Springer, Cham (2017). doi:10.​1007/​978-3-319-54057-3_​8CrossRef
11.
Zurück zum Zitat Laina, I., Rupprecht, C., Belagiannis, V., Tombari, F., Navab, N.: Deeper depth prediction with fully convolutional residual networks. In: International Conference on 3D Vision (3DV), pp. 239–248. IEEE (2016) Laina, I., Rupprecht, C., Belagiannis, V., Tombari, F., Navab, N.: Deeper depth prediction with fully convolutional residual networks. In: International Conference on 3D Vision (3DV), pp. 239–248. IEEE (2016)
12.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
13.
Zurück zum Zitat Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). doi:10.1007/978-3-319-24574-4_28CrossRef Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). doi:10.​1007/​978-3-319-24574-4_​28CrossRef
14.
Zurück zum Zitat Sznitman, R., Becker, C., Fua, P.: Fast part-based classification for instrument detection in minimally invasive surgery. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8674, pp. 692–699. Springer, Cham (2014). doi:10.1007/978-3-319-10470-6_86CrossRef Sznitman, R., Becker, C., Fua, P.: Fast part-based classification for instrument detection in minimally invasive surgery. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8674, pp. 692–699. Springer, Cham (2014). doi:10.​1007/​978-3-319-10470-6_​86CrossRef
Metadaten
Titel
Concurrent Segmentation and Localization for Tracking of Surgical Instruments
verfasst von
Iro Laina
Nicola Rieke
Christian Rupprecht
Josué Page Vizcaíno
Abouzar Eslami
Federico Tombari
Nassir Navab
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-66185-8_75

Premium Partner