Skip to main content

2016 | OriginalPaper | Buchkapitel

Tracking a Real Liver Using a Virtual Liver and an Experimental Evaluation with Kinect v2

verfasst von : Hiroshi Noborio, Kaoru Watanabe, Masahiro Yagi, Yasuhiro Ida, Shigeki Nankaku, Katsuhiko Onishi, Masanao Koeda, Masanori Kon, Kosuke Matsui, Masaki Kaibori

Erschienen in: Bioinformatics and Biomedical Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this study, we propose a smart transcription algorithm for translation and/or rotation motions. This algorithm has two phases: calculating the differences between real and virtual 2D depth images, and searching the motion space defined by three translation and three rotation degrees of freedom based on the depth differences. One depth image is captured for a real liver using a Kinect v2 depth camera and another depth image is obtained for a virtual liver (a polyhedron in stereo-lithography (STL) format by z-buffering with a graphics processing unit). The STL data are converted from Digital Imaging and Communication in Medicine (DICOM) data, where the DICOM data are captured from a patient’s liver using magnetic resonance imaging and/or a computed tomography scanner. In this study, we evaluated the motion precision of our proposed algorithm based on several experiments based using a Kinect v2 depth camera.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Besl, P.J., McKay, N.D.: A method for registration of 3-D Shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)CrossRef Besl, P.J., McKay, N.D.: A method for registration of 3-D Shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)CrossRef
2.
Zurück zum Zitat Zhang, Z.: Iterative point matching for registration of free-form surfaces. J. Comput. Vis. 13(2), 119–152 (1994)CrossRef Zhang, Z.: Iterative point matching for registration of free-form surfaces. J. Comput. Vis. 13(2), 119–152 (1994)CrossRef
3.
Zurück zum Zitat Granger, S., Pennec, X.: Multi-scale EM-ICP: a fast and robust approach for surface registration. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part IV. LNCS, vol. 2353, pp. 418–432. Springer, Heidelberg (2002)CrossRef Granger, S., Pennec, X.: Multi-scale EM-ICP: a fast and robust approach for surface registration. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part IV. LNCS, vol. 2353, pp. 418–432. Springer, Heidelberg (2002)CrossRef
4.
Zurück zum Zitat Liu, Y.: Automatic registration of overlapping 3D point clouds using closest points. J. Image Vis. Comput. 24(7), 762–781 (2006)CrossRef Liu, Y.: Automatic registration of overlapping 3D point clouds using closest points. J. Image Vis. Comput. 24(7), 762–781 (2006)CrossRef
5.
Zurück zum Zitat Salvi, J., Matabosch, C., Fofi, D., Forest, J.: A review of recent range image registration methods with accuracy evaluation. J. Image Vis. Comput. 25, 578–596 (2007)CrossRef Salvi, J., Matabosch, C., Fofi, D., Forest, J.: A review of recent range image registration methods with accuracy evaluation. J. Image Vis. Comput. 25, 578–596 (2007)CrossRef
6.
Zurück zum Zitat Rusu, R.B., Cousins, S.: 3D is here: Point Cloud Library (PCL): In: IEEE International Conference on Robotics and Automation, pp. 1–4 (2011) Rusu, R.B., Cousins, S.: 3D is here: Point Cloud Library (PCL): In: IEEE International Conference on Robotics and Automation, pp. 1–4 (2011)
7.
Zurück zum Zitat Wu, Y.F., Wang, W., Lu, K.Q., Wei, Y.D., Chen, Z.C.: A new method for registration of 3D point sets with low overlapping ratios. In: 13th CIRP Conference on Computer Aided Tolerancing, pp. 202–206 (2015) Wu, Y.F., Wang, W., Lu, K.Q., Wei, Y.D., Chen, Z.C.: A new method for registration of 3D point sets with low overlapping ratios. In: 13th CIRP Conference on Computer Aided Tolerancing, pp. 202–206 (2015)
8.
Zurück zum Zitat Noborio, H., Watanabe, K., Yagi, M., Ida, Y., Onishi, K., Koeda, M., Nankaku, S., Matsui, K., Kon, M., Kaibori, M.: Image-based initial position/orientation adjustment system between real and virtual livers. Jurnal Teknologi, Med. Eng. 77(6), 41–45 (2015). Penerbit UTM Press Noborio, H., Watanabe, K., Yagi, M., Ida, Y., Onishi, K., Koeda, M., Nankaku, S., Matsui, K., Kon, M., Kaibori, M.: Image-based initial position/orientation adjustment system between real and virtual livers. Jurnal Teknologi, Med. Eng. 77(6), 41–45 (2015). Penerbit UTM Press
9.
Zurück zum Zitat Noborio, H., Onishi, K., Koeda, M., Mizushino, K., Yagi, M., Kaibori, M., Kwon, M.: Motion transcription algorithm by matching corresponding depth image and Z-buffer. In: 10th Anniversary Asian Conference on Computer Aided Surgery, pp. 60–61. Kyusyu University, Japan, June 2014 Noborio, H., Onishi, K., Koeda, M., Mizushino, K., Yagi, M., Kaibori, M., Kwon, M.: Motion transcription algorithm by matching corresponding depth image and Z-buffer. In: 10th Anniversary Asian Conference on Computer Aided Surgery, pp. 60–61. Kyusyu University, Japan, June 2014
10.
Zurück zum Zitat Watanabe, K., Yagi, M., Ota, K., Onishi, K., Koeda, M., Nankaku, S., Noborio, H., Kon, M., Matsui, K., Kaibori, M.: Parameter identification of depth-depth-matching algorithm for liver following. Jurnal Teknologi, Med. Eng. 77(6), 35–39 (2015). Penerbit UTM Press Watanabe, K., Yagi, M., Ota, K., Onishi, K., Koeda, M., Nankaku, S., Noborio, H., Kon, M., Matsui, K., Kaibori, M.: Parameter identification of depth-depth-matching algorithm for liver following. Jurnal Teknologi, Med. Eng. 77(6), 35–39 (2015). Penerbit UTM Press
11.
Zurück zum Zitat Watanabe, K., Yagi, M., Shintani, A., Nankaku, S., Onishi, K., Koeda, M., Noborio, H., Kon, M., Matsui, K., Kaibori, M.: A new 2D depth-depth matching algorithm whose translation and rotation freedoms are separated. In: International Conference on Intelligent Informatics and Biomedical Sciences, Okinawa Japan, pp. 271–278, November 2015 Watanabe, K., Yagi, M., Shintani, A., Nankaku, S., Onishi, K., Koeda, M., Noborio, H., Kon, M., Matsui, K., Kaibori, M.: A new 2D depth-depth matching algorithm whose translation and rotation freedoms are separated. In: International Conference on Intelligent Informatics and Biomedical Sciences, Okinawa Japan, pp. 271–278, November 2015
12.
Zurück zum Zitat Noborio, H., Watanabe, K., Yagi, M., Ida, Y., Nankaku, S., Onishi, K., Koeda, H., Kon, M., Matsui, K., Kaibori, M.: Experimental results of 2D depth–depth matching algorithm based on depth camera Kinect v1. J. Bioinform. Neurosci. 1(1), 38–44 (2015). ISSN: 2188-8116 Noborio, H., Watanabe, K., Yagi, M., Ida, Y., Nankaku, S., Onishi, K., Koeda, H., Kon, M., Matsui, K., Kaibori, M.: Experimental results of 2D depth–depth matching algorithm based on depth camera Kinect v1. J. Bioinform. Neurosci. 1(1), 38–44 (2015). ISSN: 2188-8116
13.
Zurück zum Zitat Koeda, M., Tsukushi, A., Noborio, H., Onishi, K., Mizushino, K., Kunii, T., Watanabe, K., Kaibori, M., Matsui, K., Kwon, M.: Depth camera calibration and knife tip position estimation for liver surgery support system. In: 17th International Conference on Human-Computer Interaction, Los Angeles, CA, USA, pp. 496–502 August 2015 Koeda, M., Tsukushi, A., Noborio, H., Onishi, K., Mizushino, K., Kunii, T., Watanabe, K., Kaibori, M., Matsui, K., Kwon, M.: Depth camera calibration and knife tip position estimation for liver surgery support system. In: 17th International Conference on Human-Computer Interaction, Los Angeles, CA, USA, pp. 496–502 August 2015
14.
Zurück zum Zitat Doi, M., Yano, D., Koeda, M., Noborio, H., Onishi, K., Kayaki, M., Mizushino, K., Matsui, K., Kaibori, M.: Knife tip position estimation using multiple markers for liver surgery support. In: 6th International Conference on Advanced Mechatronics (ICAM 2015), pp. 74–75. Nishiwaseda Campus of Waseda University, Tokyo Japan, 1A2-08, 5–8 December 2015 Doi, M., Yano, D., Koeda, M., Noborio, H., Onishi, K., Kayaki, M., Mizushino, K., Matsui, K., Kaibori, M.: Knife tip position estimation using multiple markers for liver surgery support. In: 6th International Conference on Advanced Mechatronics (ICAM 2015), pp. 74–75. Nishiwaseda Campus of Waseda University, Tokyo Japan, 1A2-08, 5–8 December 2015
15.
Zurück zum Zitat Noborio, H., Kunii, T., Mizushino, K.: GPU-based shortest distance algorithm for liver surgery navigation. In: 10th Anniversary Asian Conference on Computer Aided Surgery, pp. 42–43. Kyusyu University, Japan, June 2014 Noborio, H., Kunii, T., Mizushino, K.: GPU-based shortest distance algorithm for liver surgery navigation. In: 10th Anniversary Asian Conference on Computer Aided Surgery, pp. 42–43. Kyusyu University, Japan, June 2014
16.
Zurück zum Zitat Noborio, H., Kunii, T., Mizushino, K.: Comparison of GPU-based and CPU-based algorithms for determining the minimum distance between a CUSA scalpel and blood vessels. In: The 7th International Conference on Bioinformatics Models, Methods and Algorithms, Roma, Italy (to appear) Noborio, H., Kunii, T., Mizushino, K.: Comparison of GPU-based and CPU-based algorithms for determining the minimum distance between a CUSA scalpel and blood vessels. In: The 7th International Conference on Bioinformatics Models, Methods and Algorithms, Roma, Italy (to appear)
17.
Zurück zum Zitat Onishi, K., Noborio, H., Koeda, M., Watanabe, K., Mizushino, K., Kunii, T., Kaibori, M., Matsui, K., Kwon, M.: Virtual liver surgical simulator by using Z-buffer for object deformation. In: 17th International Conference on Human-Computer Interaction (HCII 2015), Los Angeles, CA, USA, pp. 345–351 August 2015 Onishi, K., Noborio, H., Koeda, M., Watanabe, K., Mizushino, K., Kunii, T., Kaibori, M., Matsui, K., Kwon, M.: Virtual liver surgical simulator by using Z-buffer for object deformation. In: 17th International Conference on Human-Computer Interaction (HCII 2015), Los Angeles, CA, USA, pp. 345–351 August 2015
18.
Zurück zum Zitat Noborio, H., Onishi, K., Koeda, M., Mizushino, K., Kunii, T., Kaibori, M., Kon, M., Chen, Y.-W.: Fast surgical algorithm for cutting with liver standard triangulation language format using Z-Buffers in graphics processing unit. In: Fujie, M. (ed.) Computer Aided Surgery, pp. 127–140. Springer, Japan (2016). doi:10.1007/978-4-431-55810-1_11 CrossRef Noborio, H., Onishi, K., Koeda, M., Mizushino, K., Kunii, T., Kaibori, M., Kon, M., Chen, Y.-W.: Fast surgical algorithm for cutting with liver standard triangulation language format using Z-Buffers in graphics processing unit. In: Fujie, M. (ed.) Computer Aided Surgery, pp. 127–140. Springer, Japan (2016). doi:10.​1007/​978-4-431-55810-1_​11 CrossRef
Metadaten
Titel
Tracking a Real Liver Using a Virtual Liver and an Experimental Evaluation with Kinect v2
verfasst von
Hiroshi Noborio
Kaoru Watanabe
Masahiro Yagi
Yasuhiro Ida
Shigeki Nankaku
Katsuhiko Onishi
Masanao Koeda
Masanori Kon
Kosuke Matsui
Masaki Kaibori
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-31744-1_14