Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 11/2018

20.08.2018 | Original Article

Real-time microrobot posture recognition via biplane X-ray imaging system for external electromagnetic actuation

verfasst von: Phu Bao Nguyen, Byungjeon Kang, D. M. Bappy, Eunpyo Choi, Sukho Park, Seong Young Ko, Jong-Oh Park, Chang-Sei Kim

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 11/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

As a promising intravascular therapeutic approach for autonomous catheterization, especially for thrombosis treatment, a microrobot or robotic catheter driven by an external electromagnetic actuation system has been recently investigated. However, the three-dimensional (3D) real-time position and orientation tracking of the microrobot remains a challenge for precise feedback control in clinical applications owing to the micro-size of the microrobot geometry in vessels, along with bifurcation and vulnerability. Therefore, in this paper, we propose a 3D posture recognition method for the unmanned microrobotic surgery driven by an external electromagnetic actuator system.

Methods

We propose a real-time position and spatial orientation tracking method for a millimeter-sized intravascular object or microrobot using a principal component analysis algorithm and an X-ray reconstruction. The suggested algorithm was implemented to an actual controllable wireless microrobot system composed of a bullet-shaped object, a biplane X-ray imaging device, and an electromagnetic actuation system. Numerical computations and experiments were conducted for the performance verification.

Results

The experimental results showed a good performance of the implemented system with tracking errors less than 0.4 mm in position and 2° in orientation. The proposed tracking technique accomplished a fast processing time, ~ 0.125 ms/frame, and high-precision recognition of the micro-sized object.

Conclusions

Since the suggested method does not require pre-information of the object geometry in the human body for its 3D shape and position recognition, it could be applied to various elliptical shapes of the microrobot system with computation time efficacy and recognition accuracy. Hence, the method can be used for therapeutic millimeter- or micron-sized manipulator recognition in vascular, as well as implanted objects in the human body.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat World Health Organization (2015) Noncommunicable diseases progress monitor 2015 World Health Organization (2015) Noncommunicable diseases progress monitor 2015
2.
Zurück zum Zitat Dharmarajah B (2015) European Congress of Radiology, p 1 Dharmarajah B (2015) European Congress of Radiology, p 1
4.
Zurück zum Zitat Bowdle A (2014) Vascular complications of central venous catheter placement: evidence-based methods for prevention and treatment. J Cardiothorac Vasc Anesth 28:358–368CrossRefPubMed Bowdle A (2014) Vascular complications of central venous catheter placement: evidence-based methods for prevention and treatment. J Cardiothorac Vasc Anesth 28:358–368CrossRefPubMed
6.
Zurück zum Zitat Belharet K, Folio D, Ferreira A (2010) 3D MRI-based predictive control of a ferromagnetic microrobot navigating in blood vessels. In: 2010 3rd IEEE RAS and EMBS international conference on biomedical robotics and biomechatronics, BioRob 2010, pp 808–813 Belharet K, Folio D, Ferreira A (2010) 3D MRI-based predictive control of a ferromagnetic microrobot navigating in blood vessels. In: 2010 3rd IEEE RAS and EMBS international conference on biomedical robotics and biomechatronics, BioRob 2010, pp 808–813
8.
Zurück zum Zitat Lugez E, Sadjadi H, Joshi CP, Akl SG, Fichtinger G (2017) Improved electromagnetic tracking for catheter path reconstruction with application in high-dose-rate brachytherapy. Int J Comput Assist Radiol Surg 12:681–689CrossRefPubMed Lugez E, Sadjadi H, Joshi CP, Akl SG, Fichtinger G (2017) Improved electromagnetic tracking for catheter path reconstruction with application in high-dose-rate brachytherapy. Int J Comput Assist Radiol Surg 12:681–689CrossRefPubMed
9.
Zurück zum Zitat Oh J, Park JO, Park S, Ko SY (2015) Image-based guidance system for intravascular microrobot: Fiducial marker-based registration using biplanar fluoroscopic images and CTA images. In: 2015 15th international conference on control, automation and systems (ICCAS), pp 919–922 Oh J, Park JO, Park S, Ko SY (2015) Image-based guidance system for intravascular microrobot: Fiducial marker-based registration using biplanar fluoroscopic images and CTA images. In: 2015 15th international conference on control, automation and systems (ICCAS), pp 919–922
10.
Zurück zum Zitat Brattain LJ, Loschak PM, Tschabrunn CM, Anter E, Howe RD (2014) Instrument tracking and visualization for ultrasound catheter guided procedures. In: Augmented environments for computer-assisted interventions, pp 41–50 Brattain LJ, Loschak PM, Tschabrunn CM, Anter E, Howe RD (2014) Instrument tracking and visualization for ultrasound catheter guided procedures. In: Augmented environments for computer-assisted interventions, pp 41–50
11.
Zurück zum Zitat Saxena A, Driemeyer J, Ng AY (2009) Learning 3-d object orientation from images. In Robotics and Automation. In: ICRA’09. 2009 IEEE international conference on robotics and automation, pp 794–800 Saxena A, Driemeyer J, Ng AY (2009) Learning 3-d object orientation from images. In Robotics and Automation. In: ICRA’09. 2009 IEEE international conference on robotics and automation, pp 794–800
12.
Zurück zum Zitat Nakabo Y, Ishi I, Ishikawa M (2002) 3D tracking using two high-speed vision systems. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, pp 360–365 Nakabo Y, Ishi I, Ishikawa M (2002) 3D tracking using two high-speed vision systems. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, pp 360–365
16.
Zurück zum Zitat Benjamin JR, Jayasree T (2018) Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms. Int J Comput Assist Radiol Surg 13:229–240CrossRef Benjamin JR, Jayasree T (2018) Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms. Int J Comput Assist Radiol Surg 13:229–240CrossRef
17.
Zurück zum Zitat Wijewickrema SNR, Paplinski AP (2005) Principal component analysis for the approximation of a fruit as an ellipse. In: Proceedings of 13th international conference central Europe on computer graphics, visualization and computer vision, pp 1–6 Wijewickrema SNR, Paplinski AP (2005) Principal component analysis for the approximation of a fruit as an ellipse. In: Proceedings of 13th international conference central Europe on computer graphics, visualization and computer vision, pp 1–6
18.
Zurück zum Zitat Baur C, Milletari F, Belagiannis V, Navab N, Fallavollita P (2016) Automatic 3D reconstruction of electrophysiology catheters from two-view monoplane C-arm image sequences. Int J Comput Assist Radiol Surg 11:1319–1328CrossRefPubMed Baur C, Milletari F, Belagiannis V, Navab N, Fallavollita P (2016) Automatic 3D reconstruction of electrophysiology catheters from two-view monoplane C-arm image sequences. Int J Comput Assist Radiol Surg 11:1319–1328CrossRefPubMed
19.
Zurück zum Zitat Nguyen PB, Park JO, Park S, Ko SY (2016) Medical micro-robot navigation using image processing-blood vessel extraction and X-ray calibration. In Proceedings of the IEEE RAS and EMBS international conference on biomedical robotics and biomechatronics, vol 2016, pp 365–370 Nguyen PB, Park JO, Park S, Ko SY (2016) Medical micro-robot navigation using image processing-blood vessel extraction and X-ray calibration. In Proceedings of the IEEE RAS and EMBS international conference on biomedical robotics and biomechatronics, vol 2016, pp 365–370
20.
Zurück zum Zitat Richard Harltey AZ (2004) Multiple view geometry in computer vision. Cambridge University Press, Cambridge Richard Harltey AZ (2004) Multiple view geometry in computer vision. Cambridge University Press, Cambridge
21.
Zurück zum Zitat Jeong S, Choi H, Go G, Lee C, Lim KS, Sim DS, Jeong MH, Ko SY, Park JO, Park S (2016) Penetration of an artificial arterial thromboembolism in a live animal using an intravascular therapeutic microrobot system. Med Eng Phys 38:403–410CrossRefPubMed Jeong S, Choi H, Go G, Lee C, Lim KS, Sim DS, Jeong MH, Ko SY, Park JO, Park S (2016) Penetration of an artificial arterial thromboembolism in a live animal using an intravascular therapeutic microrobot system. Med Eng Phys 38:403–410CrossRefPubMed
22.
Zurück zum Zitat Mönnich H, Stein D, Raczkowsky J, Wörn H (2010) An automatic and complete self-calibration method for robotic guided laser ablation. In: Proceedings of IEEE international conference on robotics and automation, pp 1086–1087 Mönnich H, Stein D, Raczkowsky J, Wörn H (2010) An automatic and complete self-calibration method for robotic guided laser ablation. In: Proceedings of IEEE international conference on robotics and automation, pp 1086–1087
24.
Zurück zum Zitat Stein D, Moennich H, Raczkowsky J, Woern H (2009) IEEE automatic and hand guided self-registration between a robot and an optical tracking system. In: ICAR 2009 14th international conference on advanced robotics, vol 1–2, pp 13–17 Stein D, Moennich H, Raczkowsky J, Woern H (2009) IEEE automatic and hand guided self-registration between a robot and an optical tracking system. In: ICAR 2009 14th international conference on advanced robotics, vol 1–2, pp 13–17
Metadaten
Titel
Real-time microrobot posture recognition via biplane X-ray imaging system for external electromagnetic actuation
verfasst von
Phu Bao Nguyen
Byungjeon Kang
D. M. Bappy
Eunpyo Choi
Sukho Park
Seong Young Ko
Jong-Oh Park
Chang-Sei Kim
Publikationsdatum
20.08.2018
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 11/2018
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-018-1846-z

Weitere Artikel der Ausgabe 11/2018

International Journal of Computer Assisted Radiology and Surgery 11/2018 Zur Ausgabe