Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 3/2020

05.12.2019 | Original Article

Knee arthroscopic navigation using virtual-vision rendering and self-positioning technology

verfasst von: Cong Ma, Xiwen Cui, Fang Chen, Longfei Ma, Shenghai Xin, Hongen Liao

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 3/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Knee arthroscopy suffers from a lack of depth information and easy occlusion of the visual field. To solve these limitations, we propose an arthroscopic navigation system based on self-positioning technology, with the guidance of virtual-vision views. This system can work without any external tracking devices or added markers, thus increasing the working range and improving the robustness of the rotating operation.

Methods

The fly-through view and global positioning view for surgical guidance are rendered through virtual-vision rendering in real time. The fly-through view provides surgeons with navigating the arthroscope in the internal anatomical structures using a virtual camera perspective. The global positioning view shows the posture of the arthroscope relative to the preoperative model in a transparent manner. The posture of the arthroscope is estimated from the fusion of visual and inertial data based on the visual–inertial stereo slam. A flexible calibration method that transforms the posture of the arthroscope in the physical world into the virtual-vision rendering framework is proposed for the arthroscopic navigation system with self-positioning information.

Results

Quantitative experiments for evaluating self-positioning accuracy were performed. For translation, the acquired mean error was 0.41 ± 0.28 mm; for rotation, it was 0.11° ± 0.07°. The tracking range of the proposed system was approximately 1.4 times that of the traditional external optical tracking system for the rotating operation. Simulated surgical operations were performed on the phantom. The fly-through and global positing views were paired with original arthroscopic images for intuitive surgical guidance.

Conclusion

The proposed system provides surgeons with both fly-through and global positioning views without a dependence on the traditional external tracking systems for surgical guidance. The feasibility and robustness of the system are evaluated, and it shows promise for medical applications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kim S, Bosque J, Meehan JP, Jamali A, Marder R (2011) Increase in outpatient knee arthroscopy in the United States: a comparison of National Surveys of Ambulatory Surgery, 1996 and 2006. JBJS 93(11):994–1000CrossRef Kim S, Bosque J, Meehan JP, Jamali A, Marder R (2011) Increase in outpatient knee arthroscopy in the United States: a comparison of National Surveys of Ambulatory Surgery, 1996 and 2006. JBJS 93(11):994–1000CrossRef
2.
Zurück zum Zitat Picard F, DiGioia AM, Moody J, Martinek V, Fu FH, Rytel M, Nikou C, LaBarca RS, Jaramaz B (2001) Accuracy in tunnel placement for ACL reconstruction. Comparison of traditional arthroscopic and computer-assisted navigation techniques. Comput Aided Surg Off J Int Soc Comput Aided Surg 6(5):279–289CrossRef Picard F, DiGioia AM, Moody J, Martinek V, Fu FH, Rytel M, Nikou C, LaBarca RS, Jaramaz B (2001) Accuracy in tunnel placement for ACL reconstruction. Comparison of traditional arthroscopic and computer-assisted navigation techniques. Comput Aided Surg Off J Int Soc Comput Aided Surg 6(5):279–289CrossRef
3.
Zurück zum Zitat Liao H, Tsuzuki M, Mochizuki T, Kobayashi E, Chiba T, Sakuma I (2009) Fast image mapping of endoscopic image mosaics with three-dimensional ultrasound image for intrauterine fetal surgery. Minim Invasive Ther Allied Technol 18(6):332–340CrossRef Liao H, Tsuzuki M, Mochizuki T, Kobayashi E, Chiba T, Sakuma I (2009) Fast image mapping of endoscopic image mosaics with three-dimensional ultrasound image for intrauterine fetal surgery. Minim Invasive Ther Allied Technol 18(6):332–340CrossRef
4.
Zurück zum Zitat Zhang X, Chen G, Liao H (2016) High-quality see-through surgical guidance system using enhanced 3-D autostereoscopic augmented reality. IEEE Trans Biomed Eng 64(8):1815–1825CrossRef Zhang X, Chen G, Liao H (2016) High-quality see-through surgical guidance system using enhanced 3-D autostereoscopic augmented reality. IEEE Trans Biomed Eng 64(8):1815–1825CrossRef
5.
Zurück zum Zitat Liao H, Inomata T, Sakuma I, Dohi T (2010) 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Biomed Eng 57(6):1476–1486CrossRef Liao H, Inomata T, Sakuma I, Dohi T (2010) 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Biomed Eng 57(6):1476–1486CrossRef
6.
Zurück zum Zitat Kingham TP, Scherer MA, Neese BW, Clements LW, Stefansic JD, Jarnagin WR (2012) Image-guided liver surgery: intraoperative projection of computed tomography images utilizing tracked ultrasound. HPB 14(9):594–603CrossRef Kingham TP, Scherer MA, Neese BW, Clements LW, Stefansic JD, Jarnagin WR (2012) Image-guided liver surgery: intraoperative projection of computed tomography images utilizing tracked ultrasound. HPB 14(9):594–603CrossRef
7.
Zurück zum Zitat Wang J, Suenaga H, Hoshi K, Yang L, Kobayashi E, Sakuma I, Liao H (2014) Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng 61(4):1295–1304CrossRef Wang J, Suenaga H, Hoshi K, Yang L, Kobayashi E, Sakuma I, Liao H (2014) Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng 61(4):1295–1304CrossRef
8.
Zurück zum Zitat Tang R, Ma L, Li A, Yu L, Rong Z, Zhang X, Dong J (2018) Choledochoscopic examination of a 3-dimensional printing model using augmented reality techniques: a preliminary proof of concept study. Surg Innov 25:492–498CrossRef Tang R, Ma L, Li A, Yu L, Rong Z, Zhang X, Dong J (2018) Choledochoscopic examination of a 3-dimensional printing model using augmented reality techniques: a preliminary proof of concept study. Surg Innov 25:492–498CrossRef
9.
Zurück zum Zitat Wang J, Ohya T, Liao H, Sakuma I, Wang T, Tohnai I, Iwai T (2011) Intravascular catheter navigation using path planning and virtual visual feedback for oral cancer treatment. Int J Med Robot Comput Assist Surg 7(2):214–224CrossRef Wang J, Ohya T, Liao H, Sakuma I, Wang T, Tohnai I, Iwai T (2011) Intravascular catheter navigation using path planning and virtual visual feedback for oral cancer treatment. Int J Med Robot Comput Assist Surg 7(2):214–224CrossRef
10.
Zurück zum Zitat Kumar A, Wang YY, Liu KC, Huang SW, Lie WN, Huang CC (2015) Stereoscopic augmented reality for single camera endoscope using optical tracker: a study on phantom. In: IEEE third international conference on robot, vision and signal processing (RVSP), pp 55–58 Kumar A, Wang YY, Liu KC, Huang SW, Lie WN, Huang CC (2015) Stereoscopic augmented reality for single camera endoscope using optical tracker: a study on phantom. In: IEEE third international conference on robot, vision and signal processing (RVSP), pp 55–58
11.
Zurück zum Zitat Fried MP, Kleefield J, Gopal H, Reardon E, Ho BT, Kuhn FA (2015) Image-guided endoscopic surgery: results of accuracy and performance in a multicenter clinical study using an electromagnetic tracking system. Laryngoscope 125(4):774–781CrossRef Fried MP, Kleefield J, Gopal H, Reardon E, Ho BT, Kuhn FA (2015) Image-guided endoscopic surgery: results of accuracy and performance in a multicenter clinical study using an electromagnetic tracking system. Laryngoscope 125(4):774–781CrossRef
12.
Zurück zum Zitat Ma L, Zhao Z, Zhang B, Jiang W, Fu L, Zhang X, Liao H (2018) Three-dimensional augmented reality surgical navigation with hybrid optical and electromagnetic tracking for distal intramedullary nail interlocking. Int J Med Robot Comput Assist Surg 14(4):e1909CrossRef Ma L, Zhao Z, Zhang B, Jiang W, Fu L, Zhang X, Liao H (2018) Three-dimensional augmented reality surgical navigation with hybrid optical and electromagnetic tracking for distal intramedullary nail interlocking. Int J Med Robot Comput Assist Surg 14(4):e1909CrossRef
13.
Zurück zum Zitat Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:119–142CrossRef Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:119–142CrossRef
14.
Zurück zum Zitat Ren H, Rank D, Merdes M, Stallkamp J, Kazanzides P (2012) Multisensor data fusion in an integrated tracking system for endoscopic surgery. IEEE Trans Inf Technol Biomed 16(1):106–111CrossRef Ren H, Rank D, Merdes M, Stallkamp J, Kazanzides P (2012) Multisensor data fusion in an integrated tracking system for endoscopic surgery. IEEE Trans Inf Technol Biomed 16(1):106–111CrossRef
15.
Zurück zum Zitat Mahmoud N, Cirauqui I, Hostettler A, Doignon C, Soler L, Marescaux J, Montiel JMM (2016) ORBSLAM-based endoscope tracking and 3D reconstruction. In: International workshop on computer-assisted and robotic endoscopy, pp 72–83CrossRef Mahmoud N, Cirauqui I, Hostettler A, Doignon C, Soler L, Marescaux J, Montiel JMM (2016) ORBSLAM-based endoscope tracking and 3D reconstruction. In: International workshop on computer-assisted and robotic endoscopy, pp 72–83CrossRef
16.
Zurück zum Zitat Usenko V, Engel J, Stückler J, Cremers D (2016) Direct visual-inertial odometry with stereo cameras. In: IEEE international conference on robotics and automation (ICRA), pp 1885–1892 Usenko V, Engel J, Stückler J, Cremers D (2016) Direct visual-inertial odometry with stereo cameras. In: IEEE international conference on robotics and automation (ICRA), pp 1885–1892
17.
Zurück zum Zitat Qin T, Li P, Shen S (2018) Vins-mono: a robust and versatile monocular visual-inertial state estimator. IEEE Trans Robot 34(4):1004–1020CrossRef Qin T, Li P, Shen S (2018) Vins-mono: a robust and versatile monocular visual-inertial state estimator. IEEE Trans Robot 34(4):1004–1020CrossRef
18.
Zurück zum Zitat Engel J, Stückler J, Cremers D (2015) Large-scale direct SLAM with stereo cameras. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 1935–1942 Engel J, Stückler J, Cremers D (2015) Large-scale direct SLAM with stereo cameras. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 1935–1942
19.
Zurück zum Zitat Malti A, Barreto JP (2010) Robust hand-eye calibration for computer aided medical endoscopy. In: IEEE international conference on robotics and automation (ICRA), pp 5543–5549 Malti A, Barreto JP (2010) Robust hand-eye calibration for computer aided medical endoscopy. In: IEEE international conference on robotics and automation (ICRA), pp 5543–5549
20.
Zurück zum Zitat Tsai RY, Lenz RK (1989) A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Trans Robot Autom 5(3):345–358CrossRef Tsai RY, Lenz RK (1989) A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Trans Robot Autom 5(3):345–358CrossRef
21.
Zurück zum Zitat Yaniv Z (2015) Which pivot calibration? In: SPIE medical imaging, vol 9415. International society for optics and photonics. International Society for Optics and Photonics Yaniv Z (2015) Which pivot calibration? In: SPIE medical imaging, vol 9415. International society for optics and photonics. International Society for Optics and Photonics
22.
Zurück zum Zitat Wangsiripitak S, Murray DW (2009) Avoiding moving outliers in visual SLAM by tracking moving objects. In: 2009 IEEE international conference on robotics and automation. IEEE, pp 375–380 Wangsiripitak S, Murray DW (2009) Avoiding moving outliers in visual SLAM by tracking moving objects. In: 2009 IEEE international conference on robotics and automation. IEEE, pp 375–380
23.
Zurück zum Zitat Fuentes-Pacheco J, Ruiz-Ascencio J, Rendón-Mancha JM (2015) Visual simultaneous localization and mapping: a survey. Artif Intell Rev 43(1):55–81CrossRef Fuentes-Pacheco J, Ruiz-Ascencio J, Rendón-Mancha JM (2015) Visual simultaneous localization and mapping: a survey. Artif Intell Rev 43(1):55–81CrossRef
24.
Zurück zum Zitat Mountney P, Stoyanov D, Yang GZ (2010) Three-dimensional tissue deformation recovery and tracking. IEEE Signal Process Mag 27(4):14–24CrossRef Mountney P, Stoyanov D, Yang GZ (2010) Three-dimensional tissue deformation recovery and tracking. IEEE Signal Process Mag 27(4):14–24CrossRef
25.
Zurück zum Zitat Kenngott HG, Wagner M, Gondan M et al (2014) Real-time image guidance in laparoscopic liver surgery: first clinical experience with a guidance system based on intraoperative CT imaging. Surg Endosc 28(3):933–940CrossRef Kenngott HG, Wagner M, Gondan M et al (2014) Real-time image guidance in laparoscopic liver surgery: first clinical experience with a guidance system based on intraoperative CT imaging. Surg Endosc 28(3):933–940CrossRef
Metadaten
Titel
Knee arthroscopic navigation using virtual-vision rendering and self-positioning technology
verfasst von
Cong Ma
Xiwen Cui
Fang Chen
Longfei Ma
Shenghai Xin
Hongen Liao
Publikationsdatum
05.12.2019
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 3/2020
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-019-02099-6

Weitere Artikel der Ausgabe 3/2020

International Journal of Computer Assisted Radiology and Surgery 3/2020 Zur Ausgabe

Premium Partner