Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 12/2015

01.12.2015 | Original Article

An endoscopic structured light system using multispectral detection

verfasst von: Jianyu Lin, Neil T. Clancy, Daniel S. Elson

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 12/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

In clinical examinations, the tissue surface topology is an important feature for detecting the tissue pathology and implementing augmented reality. We have previously presented a miniaturised structured light (SL) system for recovery of tissue surface shape in minimally invasive surgery (MIS), based on a flexible multispectral structured illumination probe (1.9 mm diameter) (Clancy et al. in Biomed Opt Express 2(11):3119–3128, 2011. doi:10.​1364/​BOE.​2.​003119). This paper reports further hardware and analytical developments to improve the light pattern decoding result and increase the reconstruction accuracy.

Methods

The feasibility of using an 8-band multispectral camera with higher pattern-colour discrimination ability than normal RGB camera in this system was studied. Additionally, the “normalised cut” algorithm was investigated to improve pattern segmentation.

Results

The whole SL system was evaluated by phantom and in vivo experiments. Higher pattern identification performance than that of an RGB camera was recorded by using the multispectral camera (average precision >97 %, average sensitivity >62 %). An average of \(0.88\,\pm \,0.67\,\hbox {mm}\) reconstruction error was achieved using the proposed pattern decoding method on a heart phantom at a working distance of approximately 10 cm.

Conclusions

The experiment showed the superiority of the multispectral camera over the RGB camera in the spot identification step. The proposed pattern decoding algorithm underwent evaluations using different experiments, showing that it provided promising reconstruction results. The potential of using this system in MIS environments has been demonstrated.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Maier-Hein L, Mountney P, Bartoli A, Elhawary H, Elson D, Groch A, Kolb A, Rodrigues M, Sorger J, Speidel S, Stoyanov D (2013) Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery. Med Image Anal 17(8):974–996. doi:10.1016/j.media.2013.04.003 CrossRefPubMed Maier-Hein L, Mountney P, Bartoli A, Elhawary H, Elson D, Groch A, Kolb A, Rodrigues M, Sorger J, Speidel S, Stoyanov D (2013) Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery. Med Image Anal 17(8):974–996. doi:10.​1016/​j.​media.​2013.​04.​003 CrossRefPubMed
4.
Zurück zum Zitat King AP, Edwards PJ, Maurer CR, Cunha DAd, Gaston RP, Clarkson M, Hill DLG, Hawkes DJ, Fenlon MR, Strong AJ, Cox TCS, Gleeson MJ (2000) Stereo augmented reality in the surgical microscope. Presence Teleoper Virtual Environ 9(4):360–368. doi:10.1162/105474600566862 CrossRef King AP, Edwards PJ, Maurer CR, Cunha DAd, Gaston RP, Clarkson M, Hill DLG, Hawkes DJ, Fenlon MR, Strong AJ, Cox TCS, Gleeson MJ (2000) Stereo augmented reality in the surgical microscope. Presence Teleoper Virtual Environ 9(4):360–368. doi:10.​1162/​105474600566862 CrossRef
6.
Zurück zum Zitat Ackerman JD, Keller K, Fuchs H (2002) Surface reconstruction of abdominal organs using laparoscopic structured light for augmented reality. Society of photo-optical instrumentation engineers, vol 4661. INTERNATIONAL, Bellingham Ackerman JD, Keller K, Fuchs H (2002) Surface reconstruction of abdominal organs using laparoscopic structured light for augmented reality. Society of photo-optical instrumentation engineers, vol 4661. INTERNATIONAL, Bellingham
9.
Zurück zum Zitat Maurice X, Albitar C, Doignon C, de Mathelin M (2012) A structured light-based laparoscope with real-time organs’ surface reconstruction for minimally invasive surgery. In:Annual international conference of the IEEE engineering in medicine and biology society (EMBC), Aug. 28 2012-Sept. 1. pp 5769–5772. doi:10.1109/EMBC.2012.6347305 Maurice X, Albitar C, Doignon C, de Mathelin M (2012) A structured light-based laparoscope with real-time organs’ surface reconstruction for minimally invasive surgery. In:Annual international conference of the IEEE engineering in medicine and biology society (EMBC), Aug. 28 2012-Sept. 1. pp 5769–5772. doi:10.​1109/​EMBC.​2012.​6347305
11.
Zurück zum Zitat Sorg BS, Moeller BJ, Donovan O, Cao Y, Dewhirst MW (2005) Hyperspectral imaging of hemoglobin saturation in tumor microvasculature and tumor hypoxia development. BIOMEDO 10(4):044004-044004-044011. doi:10.1117/1.2003369 Sorg BS, Moeller BJ, Donovan O, Cao Y, Dewhirst MW (2005) Hyperspectral imaging of hemoglobin saturation in tumor microvasculature and tumor hypoxia development. BIOMEDO 10(4):044004-044004-044011. doi:10.​1117/​1.​2003369
12.
Zurück zum Zitat Tracy CR, Terrell JD, Francis RP, Wehner EF, Smith J, Litorja M, Hawkins DL, Pearle MS, Cadeddu JA, Zuzak KJ (2010) Characterization of renal ischemia using DLP hyperspectral imaging: a pilot study comparing artery-only occlusion versus artery and vein occlusion. J Endourol 24(3):321–325. doi:10.1089/end.2009.0184 CrossRefPubMed Tracy CR, Terrell JD, Francis RP, Wehner EF, Smith J, Litorja M, Hawkins DL, Pearle MS, Cadeddu JA, Zuzak KJ (2010) Characterization of renal ischemia using DLP hyperspectral imaging: a pilot study comparing artery-only occlusion versus artery and vein occlusion. J Endourol 24(3):321–325. doi:10.​1089/​end.​2009.​0184 CrossRefPubMed
13.
Zurück zum Zitat Yang VXD, Muller PJ, Herman P, Wilson BC (2003) A multispectral fluorescence imaging system: design and initial clinical tests in intra-operative Photofrin-photodynamic therapy of brain tumors. Lasers Surg Med 32(3):224–232. doi:10.1002/lsm.10131 CrossRefPubMed Yang VXD, Muller PJ, Herman P, Wilson BC (2003) A multispectral fluorescence imaging system: design and initial clinical tests in intra-operative Photofrin-photodynamic therapy of brain tumors. Lasers Surg Med 32(3):224–232. doi:10.​1002/​lsm.​10131 CrossRefPubMed
14.
Zurück zum Zitat Xu H, Rice BW (2009) In-vivo fluorescence imaging with a multivariate curve resolution spectral unmixing technique. BIOMEDO 14(6):064011-064011-064019. doi:10.1117/1.3258838 Xu H, Rice BW (2009) In-vivo fluorescence imaging with a multivariate curve resolution spectral unmixing technique. BIOMEDO 14(6):064011-064011-064019. doi:10.​1117/​1.​3258838
15.
Zurück zum Zitat Soille P (2003) Morphological image analysis: principles and applications. Springer, New York Soille P (2003) Morphological image analysis: principles and applications. Springer, New York
17.
Zurück zum Zitat Heikkila J, Silven O (1997) A four-step camera calibration procedure with implicit image correction. In:Proceedings of IEEE computer society conference on computer vision and pattern recognition, 17–19 Jun 1997. pp 1106–1112. doi:10.1109/CVPR.1997.609468 Heikkila J, Silven O (1997) A four-step camera calibration procedure with implicit image correction. In:Proceedings of IEEE computer society conference on computer vision and pattern recognition, 17–19 Jun 1997. pp 1106–1112. doi:10.​1109/​CVPR.​1997.​609468
19.
Zurück zum Zitat Li Q, Dai C, Liu H, Liu J (2009) In:Leukemic cells segmentation algorithm based on molecular spectral imaging technology. pp 73830V-73830V-73837 Li Q, Dai C, Liu H, Liu J (2009) In:Leukemic cells segmentation algorithm based on molecular spectral imaging technology. pp 73830V-73830V-73837
20.
Zurück zum Zitat Szeliski R (2010) Computer vision: algorithms and applications. Springer, New York Szeliski R (2010) Computer vision: algorithms and applications. Springer, New York
21.
Zurück zum Zitat Ng A, Jordan M, Weiss Y (2001) On spectral clustering: analysis and an algorithm. Citeulike-article-id: 1158897 Ng A, Jordan M, Weiss Y (2001) On spectral clustering: analysis and an algorithm. Citeulike-article-id: 1158897
Metadaten
Titel
An endoscopic structured light system using multispectral detection
verfasst von
Jianyu Lin
Neil T. Clancy
Daniel S. Elson
Publikationsdatum
01.12.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 12/2015
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1264-4

Weitere Artikel der Ausgabe 12/2015

International Journal of Computer Assisted Radiology and Surgery 12/2015 Zur Ausgabe

Premium Partner