Skip to main content
Top

2021 | OriginalPaper | Chapter

VR-Based Surgery Navigation System with 3D User Interface for Robot-Assisted Laparoscopic Partial Nephrectomy

Authors : Masanao Koeda, Akihiro Hamada, Atsuro Sawada, Katsuhiko Onishi, Hiroshi Noborio, Osamu Ogawa

Published in: Human-Computer Interaction. Interaction Techniques and Novel Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We have been developing a surgical support system for Robot-Assisted Laparoscopic Partial Nephrectomy (RAPN) using augmented reality (AR) technology since April 2014. In our system, three-dimensional computer graphics (3DCG) models including kidneys, arteries, veins, tumors, and urinary tracts are generated from tomographic images (DICOM) preoperatively. The 3DCG models are superimposed on the endoscopic images and projected onto the operator’s console and the operating room monitor. The position and orientation of the 3DCG models are automatically controlled in real-time according to the movement of the endoscope camera image, and the display position and transparency of the 3DCG models can be changed manually by the assistant if necessary. Now, we are developing a VR system that can manually control the 3DCG intuitively. In this paper, we describe the details of this system.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Sengiku, A., et al.: Augmented Reality Navigation System for Robot-Assisted Laparoscopic Partial Nephrectomy. Springer International Publishing, Design, User Experience, and Usability: Designing Pleasurable Experiences, Part II. Lecture Notes in Computer Science, vol. 10289, pp. 575–584, 2017. https://doi.org/10.1007/978-3-319-58637-3_45 Sengiku, A., et al.: Augmented Reality Navigation System for Robot-Assisted Laparoscopic Partial Nephrectomy. Springer International Publishing, Design, User Experience, and Usability: Designing Pleasurable Experiences, Part II. Lecture Notes in Computer Science, vol. 10289, pp. 575–584, 2017. https://​doi.​org/​10.​1007/​978-3-319-58637-3_​45
3.
go back to reference Sawada, A., Hamada, A., Sengiku, A., Koeda, M., Onishi, K., Ogawa, O.: The development of a 3D navigation system for robot-assisted partial nephrectomy using augmented reality technology. In: Proceedings of The 2019 Annual EAU Congress, vol. 18(1) (2019) Sawada, A., Hamada, A., Sengiku, A., Koeda, M., Onishi, K., Ogawa, O.: The development of a 3D navigation system for robot-assisted partial nephrectomy using augmented reality technology. In: Proceedings of The 2019 Annual EAU Congress, vol. 18(1) (2019)
4.
go back to reference Hamada, A., et al.: The Current Status and Challenges in Augmented Reality Navigation System for Robot-Assisted Laparoscopic Partial Nephrectomy. Springer, Cham, Human-Computer Interaction. Design and User Experience. HCII2020. Lecture Notes in Computer Science, vol. 12182, pp. 620–629 (2020). https://doi.org/10.1007/978-3-319-58637-3_45 Hamada, A., et al.: The Current Status and Challenges in Augmented Reality Navigation System for Robot-Assisted Laparoscopic Partial Nephrectomy. Springer, Cham, Human-Computer Interaction. Design and User Experience. HCII2020. Lecture Notes in Computer Science, vol. 12182, pp. 620–629 (2020). https://​doi.​org/​10.​1007/​978-3-319-58637-3_​45
Metadata
Title
VR-Based Surgery Navigation System with 3D User Interface for Robot-Assisted Laparoscopic Partial Nephrectomy
Authors
Masanao Koeda
Akihiro Hamada
Atsuro Sawada
Katsuhiko Onishi
Hiroshi Noborio
Osamu Ogawa
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-78465-2_39