Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 2/2018

03.11.2017 | Original Article

An automatic markerless registration method for neurosurgical robotics based on an optical camera

verfasst von: Fanle Meng, Fangwen Zhai, Bowei Zeng, Hui Ding, Guangzhi Wang

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Current markerless registration methods for neurosurgical robotics use the facial surface to match the robot space with the image space, and acquisition of the facial surface usually requires manual interaction and constrains the patient to a supine position. To overcome these drawbacks, we propose a registration method that is automatic and does not constrain patient position.

Methods

An optical camera attached to the robot end effector captures images around the patient’s head from multiple views. Then, high coverage of the head surface is reconstructed from the images through multi-view stereo vision. Since the acquired head surface point cloud contains color information, a specific mark that is manually drawn on the patient’s head prior to the capture procedure can be extracted to automatically accomplish coarse registration rather than using facial anatomic landmarks. Then, fine registration is achieved by registering the high coverage of the head surface without relying solely on the facial region, thus eliminating patient position constraints.

Results

The head surface was acquired by the camera with a good repeatability accuracy. The average target registration error of 8 different patient positions measured with targets inside a head phantom was \(1.39\pm 0.33\,\hbox {mm}\), while the mean surface registration error was \(0.35\,\hbox {mm}\).

Conclusion

The method proposed in this paper achieves automatic markerless registration in multiple patient positions and guarantees registration accuracy inside the head. This method provides a new approach for establishing the spatial relationship between the image space and the robot space.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Taylor RH, Menciassi A, Fichtinger G, Dario P (2008) Medical robotics and computer-integrated surgery. In: Siciliano B, Khatib O (eds) Springer handbook of robotics. Springer, pp 1199–1222 Taylor RH, Menciassi A, Fichtinger G, Dario P (2008) Medical robotics and computer-integrated surgery. In: Siciliano B, Khatib O (eds) Springer handbook of robotics. Springer, pp 1199–1222
2.
Zurück zum Zitat Varma T, Eldridge P (2006) Use of the NeuroMate stereotactic robot in a frameless mode for functional neurosurgery. Int J Med Robot Comput Assist Surg 2(2):107–113CrossRef Varma T, Eldridge P (2006) Use of the NeuroMate stereotactic robot in a frameless mode for functional neurosurgery. Int J Med Robot Comput Assist Surg 2(2):107–113CrossRef
3.
Zurück zum Zitat Bekelis K, Radwan TA, Desai A, Roberts DW (2012) Frameless robotically targeted stereotactic brain biopsy: feasibility, diagnostic yield, and safety: clinical article. J Neurosurg 116(5):1002–1006CrossRefPubMed Bekelis K, Radwan TA, Desai A, Roberts DW (2012) Frameless robotically targeted stereotactic brain biopsy: feasibility, diagnostic yield, and safety: clinical article. J Neurosurg 116(5):1002–1006CrossRefPubMed
4.
Zurück zum Zitat Meng F, Ding H, Wang G (2014) A stereotaxic image-guided surgical robotic system for depth electrode insertion. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society. IEEE, pp 6167–6170 Meng F, Ding H, Wang G (2014) A stereotaxic image-guided surgical robotic system for depth electrode insertion. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society. IEEE, pp 6167–6170
5.
Zurück zum Zitat Horn BK (1987) Closed-form solution of absolute orientation using unit quaternions. JOSA A 4(4):629–642CrossRef Horn BK (1987) Closed-form solution of absolute orientation using unit quaternions. JOSA A 4(4):629–642CrossRef
6.
Zurück zum Zitat Joskowicz L, Shamir R, Freiman M, Shoham M, Zehavi E, Umansky F, Shoshan Y (2006) Image-guided system with miniature robot for precise positioning and targeting in keyhole neurosurgery. Comput Aided Surg 11(4):181–193CrossRefPubMed Joskowicz L, Shamir R, Freiman M, Shoham M, Zehavi E, Umansky F, Shoshan Y (2006) Image-guided system with miniature robot for precise positioning and targeting in keyhole neurosurgery. Comput Aided Surg 11(4):181–193CrossRefPubMed
7.
Zurück zum Zitat Lefranc M, Capel C, Pruvot-Occean A-S, Fichten A, Desenclos C, Toussaint P, Le Gars D, Peltier J (2015) Frameless robotic stereotactic biopsies: a consecutive series of 100 cases. J Neurosurg 122(2):342–352CrossRefPubMed Lefranc M, Capel C, Pruvot-Occean A-S, Fichten A, Desenclos C, Toussaint P, Le Gars D, Peltier J (2015) Frameless robotic stereotactic biopsies: a consecutive series of 100 cases. J Neurosurg 122(2):342–352CrossRefPubMed
8.
Zurück zum Zitat Shin S, Cho H, Yoon S, Park K, Kim Y, Park S, Kim L, Lee D (2015) Markerless surgical robotic system for intracerebral hemorrhage surgery. In: 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 5272–5275 Shin S, Cho H, Yoon S, Park K, Kim Y, Park S, Kim L, Lee D (2015) Markerless surgical robotic system for intracerebral hemorrhage surgery. In: 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 5272–5275
9.
Zurück zum Zitat Raabe A, Krishnan R, Wolff R, Hermann E, Zimmermann M, Seifert V (2002) Laser surface scanning for patient registration in intracranial image-guided surgery. Neurosurgery 50(4):797–803CrossRefPubMed Raabe A, Krishnan R, Wolff R, Hermann E, Zimmermann M, Seifert V (2002) Laser surface scanning for patient registration in intracranial image-guided surgery. Neurosurgery 50(4):797–803CrossRefPubMed
10.
Zurück zum Zitat Besl PJ, McKay ND (1992) A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 14(2):239–256 Besl PJ, McKay ND (1992) A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 14(2):239–256
11.
Zurück zum Zitat Medtech S (2010) Premarket notification 510 (K) submission rosa surgical device. Montpellier, France, pp 6–10 Medtech S (2010) Premarket notification 510 (K) submission rosa surgical device. Montpellier, France, pp 6–10
12.
Zurück zum Zitat Shamir RR, Freiman M, Joskowicz L, Spektor S, Shoshan Y (2009) Surface-based facial scan registration in neuronavigation procedures: a clinical study: clinical article. J Neurosurg 111(6):1201–1206CrossRefPubMed Shamir RR, Freiman M, Joskowicz L, Spektor S, Shoshan Y (2009) Surface-based facial scan registration in neuronavigation procedures: a clinical study: clinical article. J Neurosurg 111(6):1201–1206CrossRefPubMed
13.
Zurück zum Zitat Fan Y, Jiang D, Wang M, Song Z (2014) A new markerless patient-to-image registration method using a portable 3D scanner. Med Phys 41(10):101910-1–101910-13 Fan Y, Jiang D, Wang M, Song Z (2014) A new markerless patient-to-image registration method using a portable 3D scanner. Med Phys 41(10):101910-1–101910-13
14.
Zurück zum Zitat Horaud R, Dornaika F (1995) Hand-eye calibration. Int J Robot Res 14(3):195–210CrossRef Horaud R, Dornaika F (1995) Hand-eye calibration. Int J Robot Res 14(3):195–210CrossRef
15.
Zurück zum Zitat Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef
16.
Zurück zum Zitat Furukawa Y, Ponce J (2010) Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 32(8):1362–1376CrossRefPubMed Furukawa Y, Ponce J (2010) Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 32(8):1362–1376CrossRefPubMed
17.
Zurück zum Zitat Chen Y, Medioni G (1992) Object modelling by registration of multiple range images. Image Vis Comput 10(3):145–155CrossRef Chen Y, Medioni G (1992) Object modelling by registration of multiple range images. Image Vis Comput 10(3):145–155CrossRef
18.
Zurück zum Zitat Ledderose GJ, Hagedorn H, Spiegl K, Leunig A, Stelter K (2012) Image guided surgery of the lateral skull base: testing a new dental splint registration device. Comput Aided Surg 17(1):13–20CrossRefPubMed Ledderose GJ, Hagedorn H, Spiegl K, Leunig A, Stelter K (2012) Image guided surgery of the lateral skull base: testing a new dental splint registration device. Comput Aided Surg 17(1):13–20CrossRefPubMed
19.
Zurück zum Zitat Lefranc M, Capel C, Pruvot AS, Fichten A, Desenclos C, Toussaint P, Le Gars D, Peltier J (2014) The impact of the reference imaging modality, registration method and intraoperative flat-panel computed tomography on the accuracy of the ROSA® stereotactic robot. Stereotact Funct Neurosurg 92(4):242–250CrossRefPubMed Lefranc M, Capel C, Pruvot AS, Fichten A, Desenclos C, Toussaint P, Le Gars D, Peltier J (2014) The impact of the reference imaging modality, registration method and intraoperative flat-panel computed tomography on the accuracy of the ROSA® stereotactic robot. Stereotact Funct Neurosurg 92(4):242–250CrossRefPubMed
20.
Zurück zum Zitat Lee J-D, Huang C-H, Huang T-C, Hsieh H-Y, Lee S-T (2012) Medical augment reality using a markerless registration framework. Expert Syst Appl 39(5):5286–5294CrossRef Lee J-D, Huang C-H, Huang T-C, Hsieh H-Y, Lee S-T (2012) Medical augment reality using a markerless registration framework. Expert Syst Appl 39(5):5286–5294CrossRef
21.
Zurück zum Zitat Wang J, Suenaga H, Hoshi K, Yang L, Kobayashi E, Sakuma I, Liao H (2014) Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng 61(4):1295–1304CrossRefPubMed Wang J, Suenaga H, Hoshi K, Yang L, Kobayashi E, Sakuma I, Liao H (2014) Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng 61(4):1295–1304CrossRefPubMed
22.
Zurück zum Zitat Zeng B, Meng F, Ding H, Wang G (2017) A surgical robot with augmented reality visualization for stereoelectroencephalography electrode implantation. Int J Comput Assist Radiol Surg 12(8):1355–1368CrossRefPubMed Zeng B, Meng F, Ding H, Wang G (2017) A surgical robot with augmented reality visualization for stereoelectroencephalography electrode implantation. Int J Comput Assist Radiol Surg 12(8):1355–1368CrossRefPubMed
23.
Zurück zum Zitat Deacon G, Harwood A, Holdback J, Maiwand D, Pearce M, Reid I, Street M, Taylor J (2010) The Pathfinder image-guided surgical robot. Proc Inst Mech Eng H 224(5):691–713CrossRefPubMed Deacon G, Harwood A, Holdback J, Maiwand D, Pearce M, Reid I, Street M, Taylor J (2010) The Pathfinder image-guided surgical robot. Proc Inst Mech Eng H 224(5):691–713CrossRefPubMed
24.
Zurück zum Zitat Jerbic B, Nikolic G, Chudy D, Svaco M, Sekoranja B (2015) Robotic application in neurosurgery using intelligent visual and haptic interaction. Int J Simul Model 14(1):71–84 Jerbic B, Nikolic G, Chudy D, Svaco M, Sekoranja B (2015) Robotic application in neurosurgery using intelligent visual and haptic interaction. Int J Simul Model 14(1):71–84
25.
Zurück zum Zitat Wei J, Wang T, Liu D (2011) A vision guided hybrid robotic prototype system for stereotactic surgery. Int J Med Robot Comput Assisted Surg 7(4):475–481CrossRef Wei J, Wang T, Liu D (2011) A vision guided hybrid robotic prototype system for stereotactic surgery. Int J Med Robot Comput Assisted Surg 7(4):475–481CrossRef
26.
Zurück zum Zitat Meng C, Wang T, Chou W, Luan S, Zhang Y, Tian Z (2004) Remote surgery case: robot-assisted teleneurosurgery. In: 2004 IEEE international conference on robotics and automation, 2004. Proceedings. ICRA’04. IEEE, pp 819–823 Meng C, Wang T, Chou W, Luan S, Zhang Y, Tian Z (2004) Remote surgery case: robot-assisted teleneurosurgery. In: 2004 IEEE international conference on robotics and automation, 2004. Proceedings. ICRA’04. IEEE, pp 819–823
Metadaten
Titel
An automatic markerless registration method for neurosurgical robotics based on an optical camera
verfasst von
Fanle Meng
Fangwen Zhai
Bowei Zeng
Hui Ding
Guangzhi Wang
Publikationsdatum
03.11.2017
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 2/2018
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1675-5

Weitere Artikel der Ausgabe 2/2018

International Journal of Computer Assisted Radiology and Surgery 2/2018 Zur Ausgabe