Skip to main content
Top

2017 | OriginalPaper | Chapter

Capturing a Surgical Area Using Multiple Depth Cameras Mounted on a Robotic Mechanical System

Authors : Masahiro Nonaka, Kaoru Watanabe, Hiroshi Noborio, Masatoshi Kayaki, Kiminori Mizushino

Published in: Design, User Experience, and Usability: Designing Pleasurable Experiences

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In our surgical navigation study, we construct a mechanical system for steadily capturing several surgical scenes by using two parallel robotic sliders and multiple vision cameras. In this paper, we first determine how to select an adequate time interval during which each camera projects a pattern to calculate depth against an organ. If multiple cameras project and receive patterns simultaneously, pattern interferences occur around the organ and, consequently, the cameras cannot capture depth images. Second, we investigate whether few or no occlusions occur in several surgical scenarios for an organ operation. Finally, we check experimentally whether distance precision in depth images is exactly maintained when a surgeon raises the camera to insert a microscope during a microsurgery. If the above functions are performed correctly, our proposed transcription algorithms for position, orientation, and shape from a real organ to its virtual polyhedron’s organ with STL-format play an active part during an actual surgery.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Logan, W.C., Prashanth, D., William, C.C., Benoit, M.D., Robert, L.G., Michael, I.M.: Organ surface deformation measurement and analysis in open hepatic surgery: Method and preliminary results from 12 clinical cases. IEEE Trans. Biomed. Eng. 58(8), 2280–2289 (2011). doi:10.1109/TBME.2011.2146782 CrossRef Logan, W.C., Prashanth, D., William, C.C., Benoit, M.D., Robert, L.G., Michael, I.M.: Organ surface deformation measurement and analysis in open hepatic surgery: Method and preliminary results from 12 clinical cases. IEEE Trans. Biomed. Eng. 58(8), 2280–2289 (2011). doi:10.​1109/​TBME.​2011.​2146782 CrossRef
2.
go back to reference Xu, A., Zhu, J.F., Zhang, D.: Development of a measurement system for laparoendoscopic single-site surgery: Reliability and repeatability of digital image correlation for measurement of surface deformations in SILS port. JSLS 18(3) (2014). doi:10.4293/JSLS.2014.00267, PMCID: PMC4154418 Xu, A., Zhu, J.F., Zhang, D.: Development of a measurement system for laparoendoscopic single-site surgery: Reliability and repeatability of digital image correlation for measurement of surface deformations in SILS port. JSLS 18(3) (2014). doi:10.​4293/​JSLS.​2014.​00267, PMCID: PMC4154418
4.
go back to reference Watanabe, K., Kayaki, M., Mizushino, K., Nonaka, M., Noborio, H.: A mechanical system directly attaching beside a surgical bed for measuring surgical area precisely by depth camera. In: Proceedings of the 10th MedViz Conference and the 6th Eurographics Workshop on Visual Computing for Biology and Medicine (EG VCBM), Bergen, Norway, pp. 105–108, 7–9 September (2016). ISBN:978-82-998920-7-0 (Printed), ISBN:978-82-998920-8-7 (Electronic) Watanabe, K., Kayaki, M., Mizushino, K., Nonaka, M., Noborio, H.: A mechanical system directly attaching beside a surgical bed for measuring surgical area precisely by depth camera. In: Proceedings of the 10th MedViz Conference and the 6th Eurographics Workshop on Visual Computing for Biology and Medicine (EG VCBM), Bergen, Norway, pp. 105–108, 7–9 September (2016). ISBN:978-82-998920-7-0 (Printed), ISBN:978-82-998920-8-7 (Electronic)
5.
go back to reference Watanabe, K., Kayaki, M., Mizushino, K., Nonaka, M., Noborio, H.: Brain shift simulation controlled by directly captured surface points. In: Proceedings of the 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2016), Category: Late Breaking Research Posters, Theme: BioMedical Imaging and Image Processing, Sessions: Ignite_Theme 2_Fr2, Poster Session III, Orlando Florida USA, 16–20 August (2016) Watanabe, K., Kayaki, M., Mizushino, K., Nonaka, M., Noborio, H.: Brain shift simulation controlled by directly captured surface points. In: Proceedings of the 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2016), Category: Late Breaking Research Posters, Theme: BioMedical Imaging and Image Processing, Sessions: Ignite_Theme 2_Fr2, Poster Session III, Orlando Florida USA, 16–20 August (2016)
6.
go back to reference Watanabe, K., Kayaki, M., Mizushino, K., Nonaka, M., Noborio, H.: Capturing a brain shift directly by the depth camera kinect v2. In: Proceedings of the 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2016), Category: Late Breaking Research Posters, Theme: Computational Systems & Synthetic Biology; Multiscale Modeling, Sessions: Ignite_Theme 4_Fr1, Poster Session II, Orlando Florida USA, August 16–20 (2016) Watanabe, K., Kayaki, M., Mizushino, K., Nonaka, M., Noborio, H.: Capturing a brain shift directly by the depth camera kinect v2. In: Proceedings of the 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2016), Category: Late Breaking Research Posters, Theme: Computational Systems & Synthetic Biology; Multiscale Modeling, Sessions: Ignite_Theme 4_Fr1, Poster Session II, Orlando Florida USA, August 16–20 (2016)
7.
go back to reference Noborio, H., et al.: Tracking a real liver using a virtual liver and an experimental evaluation with kinect v2. In: Ortuño, F., Rojas, I. (eds.) IWBBIO 2016. LNCS, vol. 9656, pp. 149–162. Springer, Cham (2016). doi:10.1007/978-3-319-31744-1_14 CrossRef Noborio, H., et al.: Tracking a real liver using a virtual liver and an experimental evaluation with kinect v2. In: Ortuño, F., Rojas, I. (eds.) IWBBIO 2016. LNCS, vol. 9656, pp. 149–162. Springer, Cham (2016). doi:10.​1007/​978-3-319-31744-1_​14 CrossRef
8.
go back to reference Noborio, H., et al.: Depth image matching algorithm for deforming and cutting a virtual liver via its real liver image captured using kinect v2. In: Ortuño, F., Rojas, I. (eds.) IWBBIO 2016. LNCS, vol. 9656, pp. 196–205. Springer, Cham (2016). doi:10.1007/978-3-319-31744-1_18 CrossRef Noborio, H., et al.: Depth image matching algorithm for deforming and cutting a virtual liver via its real liver image captured using kinect v2. In: Ortuño, F., Rojas, I. (eds.) IWBBIO 2016. LNCS, vol. 9656, pp. 196–205. Springer, Cham (2016). doi:10.​1007/​978-3-319-31744-1_​18 CrossRef
9.
go back to reference Noborio, H., Watanabe, K., Yagi, M., Ida, Y., Nankaku, S., Onishi, K., Koeda, M., Kon, M., Matsui, K., Kaibori, M.: Experimental results of 2D depth-depth matching algorithm based on depth camera kinect v1. J. Bioinform. Neurosci. 1(1), 38–44 (2015) Noborio, H., Watanabe, K., Yagi, M., Ida, Y., Nankaku, S., Onishi, K., Koeda, M., Kon, M., Matsui, K., Kaibori, M.: Experimental results of 2D depth-depth matching algorithm based on depth camera kinect v1. J. Bioinform. Neurosci. 1(1), 38–44 (2015)
10.
go back to reference Noborio, H., Watanabe, K., Yagi, M., Ida, Y., Onishi, K., Koeda, M., Nankaku, S., Matsui, K., Kon, M., Kaibori, M.: Image-based initial position/orientation adjustment system between real and virtual livers. Jurnal Teknologi, Med. Eng. 77(6), 41–45 (2015). doi:10.11113/jt.v77.6225, Penerbit UTM Press, E-ISSN: 2180-3722 Noborio, H., Watanabe, K., Yagi, M., Ida, Y., Onishi, K., Koeda, M., Nankaku, S., Matsui, K., Kon, M., Kaibori, M.: Image-based initial position/orientation adjustment system between real and virtual livers. Jurnal Teknologi, Med. Eng. 77(6), 41–45 (2015). doi:10.​11113/​jt.​v77.​6225, Penerbit UTM Press, E-ISSN: 2180-3722
11.
go back to reference Intel® RealSense™ SDK 2016 R2 Reference Manual: Object Tracking, API Version 10.0 (2016) Intel® RealSense™ SDK 2016 R2 Reference Manual: Object Tracking, API Version 10.0 (2016)
Metadata
Title
Capturing a Surgical Area Using Multiple Depth Cameras Mounted on a Robotic Mechanical System
Authors
Masahiro Nonaka
Kaoru Watanabe
Hiroshi Noborio
Masatoshi Kayaki
Kiminori Mizushino
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-58637-3_42