Skip to main content
Top

2016 | OriginalPaper | Chapter

Inference of Tissue Haemoglobin Concentration from Stereo RGB

Authors : Geoffrey Jones, Neil T. Clancy, Simon Arridge, Daniel S. Elson, Danail Stoyanov

Published in: Medical Imaging and Augmented Reality

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multispectral imaging (MSI) can provide information about tissue oxygenation, perfusion and potentially function during surgery. In this paper we present a novel, near real-time technique for intrinsic measurements of total haemoglobin (THb) and blood oxygenation (SO\(_2\)) in tissue using only RGB images from a stereo laparoscope. The high degree of spectral overlap between channels makes inference of haemoglobin concentration challenging, non-linear and under constrained. We decompose the problem into two constrained linear sub-problems and show that with Tikhonov regularisation the estimation significantly improves, giving robust estimation of the THb. We demonstrate by using the co-registered stereo image data from two cameras it is possible to get robust SO\(_2\) estimation as well. Our method is closed from, providing computational efficiency even with multiple cameras. The method we present requires only spectral response calibration of each camera, without modification of existing laparoscopic imaging hardware. We validate our technique on synthetic data from Monte Carlo simulation and further, in vivo, on a multispectral porcine data set.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Bashkatov, A.N., Genina, E.A., Kochubey, V.I., Rubtsov, V.S., Kolesnikova, E.A., Tuchin, V.V.: Optical properties of human colon tissues in the 350–2500 nm spectral range. Quant. Electron. 44(8), 779–784 (2014)CrossRef Bashkatov, A.N., Genina, E.A., Kochubey, V.I., Rubtsov, V.S., Kolesnikova, E.A., Tuchin, V.V.: Optical properties of human colon tissues in the 350–2500 nm spectral range. Quant. Electron. 44(8), 779–784 (2014)CrossRef
4.
go back to reference Bro, R., Jong, S.D.: A fast non-negativity-constrained least squares algorithm. J. Chemometr. 11(5), 393–401 (1997)CrossRef Bro, R., Jong, S.D.: A fast non-negativity-constrained least squares algorithm. J. Chemometr. 11(5), 393–401 (1997)CrossRef
5.
go back to reference Clancy, N.T., Arya, S., Stoyanov, D., Singh, M., Hanna, G.B., Elson, D.S.: Intraoperative measurement of bowel oxygen saturation using a multispectral imaging laparoscope. Biomed. Opt. Express 6(10), 4179 (2015)CrossRef Clancy, N.T., Arya, S., Stoyanov, D., Singh, M., Hanna, G.B., Elson, D.S.: Intraoperative measurement of bowel oxygen saturation using a multispectral imaging laparoscope. Biomed. Opt. Express 6(10), 4179 (2015)CrossRef
6.
go back to reference Clancy, N.T., Saso, S., Stoyanov, D., Sauvage, V., Corless, D.J., Boyd, M., Noakes, D.E., Thum, M.Y., Ghaem-Maghami, S., Smith, J.R., Elson, D.S.: Multispectral imaging of organ viability during uterine transplantation surgery. In: Advanced Biomedical and Clinical Diagnostic Systems XII. SPIE-The International Society for Optical Engineering, February 2014. http://dx.doi.org/10.1117/12.2040518 Clancy, N.T., Saso, S., Stoyanov, D., Sauvage, V., Corless, D.J., Boyd, M., Noakes, D.E., Thum, M.Y., Ghaem-Maghami, S., Smith, J.R., Elson, D.S.: Multispectral imaging of organ viability during uterine transplantation surgery. In: Advanced Biomedical and Clinical Diagnostic Systems XII. SPIE-The International Society for Optical Engineering, February 2014. http://​dx.​doi.​org/​10.​1117/​12.​2040518
8.
go back to reference Claridge, E., Hidović-Rowe, D., Taniere, P., Ismail, T.: Quantifying mucosal blood volume fraction from multispectral images of the colon. In: Medical Imaging, p. 65110C. International Society for Optics and Photonics (2007) Claridge, E., Hidović-Rowe, D., Taniere, P., Ismail, T.: Quantifying mucosal blood volume fraction from multispectral images of the colon. In: Medical Imaging, p. 65110C. International Society for Optics and Photonics (2007)
9.
go back to reference Darzi, A., Mackay, S.: Recent advances in minimal access surgery. Br. Med. J. 324(7328), 31 (2002)CrossRef Darzi, A., Mackay, S.: Recent advances in minimal access surgery. Br. Med. J. 324(7328), 31 (2002)CrossRef
10.
go back to reference Du, X., Allan, M., Dore, A., Ourselin, S., Hawkes, D.J., Kelly, D.S.: Combined 2D and 3D tracking of surgical instruments for minimally invasive and robotic-assisted surgery. Int. J. Comput. Assist. Radiol. Surg. 11(6), 1109–1119 (2015)CrossRef Du, X., Allan, M., Dore, A., Ourselin, S., Hawkes, D.J., Kelly, D.S.: Combined 2D and 3D tracking of surgical instruments for minimally invasive and robotic-assisted surgery. Int. J. Comput. Assist. Radiol. Surg. 11(6), 1109–1119 (2015)CrossRef
12.
go back to reference Fang, Q.: Mesh-based Monte Carlo method using fast ray-tracing in plücker coordinates. Biomed. Opt. Express 1(1), 165 (2010)MathSciNetCrossRef Fang, Q.: Mesh-based Monte Carlo method using fast ray-tracing in plücker coordinates. Biomed. Opt. Express 1(1), 165 (2010)MathSciNetCrossRef
13.
go back to reference Fawzy, Y., Lam, S., Zeng, H.: Rapid multispectral endoscopic imaging system for near real-time mapping of the mucosa blood supply in the lung. Biomed. Opt. Express 6(8), 2980 (2015)CrossRef Fawzy, Y., Lam, S., Zeng, H.: Rapid multispectral endoscopic imaging system for near real-time mapping of the mucosa blood supply in the lung. Biomed. Opt. Express 6(8), 2980 (2015)CrossRef
14.
go back to reference Guazzi, A.R., Villarroel, M., Jorge, J., Daly, J., Frise, M.C., Robbins, P.A., Tarassenko, L.: Non-contact measurement of oxygen saturation with an RGB camera. Biomed. Opt. Express 6(9), 3320 (2015)CrossRef Guazzi, A.R., Villarroel, M., Jorge, J., Daly, J., Frise, M.C., Robbins, P.A., Tarassenko, L.: Non-contact measurement of oxygen saturation with an RGB camera. Biomed. Opt. Express 6(9), 3320 (2015)CrossRef
15.
go back to reference Hardeberg, J.Y., Brettel, H., Schmitt, F.J.M.: Spectral characterization of electronic cameras. In: Bares, J. (ed.) Electronic Imaging: Processing, Printing, and Publishing in Color. SPIE-The International Society for Optical Engineering, September 1998. http://dx.doi.org/10.1117/12.324101 Hardeberg, J.Y., Brettel, H., Schmitt, F.J.M.: Spectral characterization of electronic cameras. In: Bares, J. (ed.) Electronic Imaging: Processing, Printing, and Publishing in Color. SPIE-The International Society for Optical Engineering, September 1998. http://​dx.​doi.​org/​10.​1117/​12.​324101
16.
go back to reference Nighswander-Rempel, S.P., Shaw, R.A., Mansfield, J.R., Hewko, M., Kupriyanov, V.V., Mantsch, H.H.: Regional variations in myocardial tissue oxygenation mapped by near-infrared spectroscopic imaging. J. Mol. Cell. Cardiol. 34(9), 1195–1203 (2002)CrossRef Nighswander-Rempel, S.P., Shaw, R.A., Mansfield, J.R., Hewko, M., Kupriyanov, V.V., Mantsch, H.H.: Regional variations in myocardial tissue oxygenation mapped by near-infrared spectroscopic imaging. J. Mol. Cell. Cardiol. 34(9), 1195–1203 (2002)CrossRef
17.
go back to reference Nishidate, I., Maeda, T., Niizeki, K., Aizu, Y.: Estimation of melanin and hemoglobin using spectral reflectance images reconstructed from a digital RGB image by the Wiener estimation method. Sensors 13(6), 7902–7915 (2013)CrossRef Nishidate, I., Maeda, T., Niizeki, K., Aizu, Y.: Estimation of melanin and hemoglobin using spectral reflectance images reconstructed from a digital RGB image by the Wiener estimation method. Sensors 13(6), 7902–7915 (2013)CrossRef
18.
go back to reference Sorg, B.S., Moeller, B.J., Donovan, O., Cao, Y., Dewhirst, M.W.: Hyperspectral imaging of hemoglobin saturation in tumor microvasculature and tumor hypoxia development. J. Biomed. Opt. 10(4), 044004 (2005)CrossRef Sorg, B.S., Moeller, B.J., Donovan, O., Cao, Y., Dewhirst, M.W.: Hyperspectral imaging of hemoglobin saturation in tumor microvasculature and tumor hypoxia development. J. Biomed. Opt. 10(4), 044004 (2005)CrossRef
19.
go back to reference Wirkert, S.J., Clancy, N.T., Stoyanov, D., Arya, S., Hanna, G.B., Schlemmer, H.-P., Sauer, P., Elson, D.S., Maier-Hein, L.: Endoscopic sheffield index for unsupervised in vivo spectral band selection. In: Luo, X., Reich, T., Mirota, D., Soper, T. (eds.) CARE 2014. LNCS, vol. 8899, pp. 110–120. Springer, Heidelberg (2014) Wirkert, S.J., Clancy, N.T., Stoyanov, D., Arya, S., Hanna, G.B., Schlemmer, H.-P., Sauer, P., Elson, D.S., Maier-Hein, L.: Endoscopic sheffield index for unsupervised in vivo spectral band selection. In: Luo, X., Reich, T., Mirota, D., Soper, T. (eds.) CARE 2014. LNCS, vol. 8899, pp. 110–120. Springer, Heidelberg (2014)
Metadata
Title
Inference of Tissue Haemoglobin Concentration from Stereo RGB
Authors
Geoffrey Jones
Neil T. Clancy
Simon Arridge
Daniel S. Elson
Danail Stoyanov
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-43775-0_5

Premium Partner