Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 3/2017

29.09.2016 | Original Article

MITK-OpenIGTLink for combining open-source toolkits in real-time computer-assisted interventions

verfasst von: Martin Klemm, Thomas Kirchner, Janek Gröhl, Dominique Cheray, Marco Nolden, Alexander Seitel, Harald Hoppe, Lena Maier-Hein, Alfred M. Franz

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Due to rapid developments in the research areas of medical imaging, medical image processing and robotics, computer-assisted interventions (CAI) are becoming an integral part of modern patient care. From a software engineering point of view, these systems are highly complex and research can benefit greatly from reusing software components. This is supported by a number of open-source toolkits for medical imaging and CAI such as the medical imaging interaction toolkit (MITK), the public software library for ultrasound imaging research (PLUS) and 3D Slicer. An independent inter-toolkit communication such as the open image-guided therapy link (OpenIGTLink) can be used to combine the advantages of these toolkits and enable an easier realization of a clinical CAI workflow.

Methods

MITK-OpenIGTLink is presented as a network interface within MITK that allows easy to use, asynchronous two-way messaging between MITK and clinical devices or other toolkits. Performance and interoperability tests with MITK-OpenIGTLink were carried out considering the whole CAI workflow from data acquisition over processing to visualization.

Results

We present how MITK-OpenIGTLink can be applied in different usage scenarios. In performance tests, tracking data were transmitted with a frame rate of up to 1000 Hz and a latency of 2.81 ms. Transmission of images with typical ultrasound (US) and greyscale high-definition (HD) resolutions of \(640\times 480\) and \(1920\times 1080\) is possible at up to 512 and 128 Hz, respectively.

Conclusion

With the integration of OpenIGTLink into MITK, this protocol is now supported by all established open-source toolkits in the field. This eases interoperability between MITK and toolkits such as PLUS or 3D Slicer and facilitates cross-toolkit research collaborations. MITK and its submodule MITK-OpenIGTLink are provided open source under a BSD-style licence (http://​mitk.​org).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
7
CPU: Core i7-5960X 3.5 GHz 8 cores, RAM: 32 GB, Storage: SSD, GPU: Geforce GTX970 4 GB PCI-E x16, OS: Ubuntu 14.04.
 
Literatur
1.
Zurück zum Zitat Arata J, Kenmotsu H, Takagi M, Hori T, Miyagi T, Fujimoto H, Kajita Y, Hayashi Y, Chinzei K, Hashizume M (2013) Surgical bedside master console for neurosurgical robotic system. Int J Comput Assist Radiol Surg 8(1):75–86CrossRefPubMed Arata J, Kenmotsu H, Takagi M, Hori T, Miyagi T, Fujimoto H, Kajita Y, Hayashi Y, Chinzei K, Hashizume M (2013) Surgical bedside master console for neurosurgical robotic system. Int J Comput Assist Radiol Surg 8(1):75–86CrossRefPubMed
2.
Zurück zum Zitat Arata J, Kozuka H, Kim HW, Takesue N, Vladimirov B, Sakaguchi M, Tokuda J, Hata N, Chinzei K, Fujimoto H (2010) Open core control software for surgical robots. Int J Comput Assist Radiol Surg 5(3):211–220CrossRefPubMed Arata J, Kozuka H, Kim HW, Takesue N, Vladimirov B, Sakaguchi M, Tokuda J, Hata N, Chinzei K, Fujimoto H (2010) Open core control software for surgical robots. Int J Comput Assist Radiol Surg 5(3):211–220CrossRefPubMed
3.
Zurück zum Zitat Arata J, Tada Y, Kozuka H, Wada T, Saito Y, Ikedo N, Hayashi Y, Fujii M, Kajita Y, Mizuno M, Wakabayashi T, Yoshida J, Fujimoto H (2011) Neurosurgical robotic system for brain tumor removal. Int J Comput Assist Radiol Surg 6(3):375–385CrossRefPubMed Arata J, Tada Y, Kozuka H, Wada T, Saito Y, Ikedo N, Hayashi Y, Fujii M, Kajita Y, Mizuno M, Wakabayashi T, Yoshida J, Fujimoto H (2011) Neurosurgical robotic system for brain tumor removal. Int J Comput Assist Radiol Surg 6(3):375–385CrossRefPubMed
4.
Zurück zum Zitat Clarkson MJ, Zombori G, Thompson S, Totz J, Song Y, Espak M, Johnsen S, Hawkes D, Ourselin S (2014) The NifTK software platform for image-guided interventions: platform overview and NiftyLink messaging. Int J Comput Assist Radiol Surg 10(3):301–316CrossRefPubMedPubMedCentral Clarkson MJ, Zombori G, Thompson S, Totz J, Song Y, Espak M, Johnsen S, Hawkes D, Ourselin S (2014) The NifTK software platform for image-guided interventions: platform overview and NiftyLink messaging. Int J Comput Assist Radiol Surg 10(3):301–316CrossRefPubMedPubMedCentral
5.
Zurück zum Zitat Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12(1):119–142CrossRefPubMed Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12(1):119–142CrossRefPubMed
6.
Zurück zum Zitat Correll K, Barendt N, Branicky M (2005) Design considerations for software only implementations of the IEEE 1588 precision time protocol. In: Conference on IEEE, vol 1588, pp 10–12 Correll K, Barendt N, Branicky M (2005) Design considerations for software only implementations of the IEEE 1588 precision time protocol. In: Conference on IEEE, vol 1588, pp 10–12
7.
Zurück zum Zitat Egger J, Tokuda J, Chauvin L, Freisleben B, Nimsky C, Kapur T, Wells W (2012) Integration of the OpenIGTLink network protocol for image-guided therapy with the medical platform MeVisLab. Int J Med Robot Comput Assist Surg 8(3):282–290CrossRef Egger J, Tokuda J, Chauvin L, Freisleben B, Nimsky C, Kapur T, Wells W (2012) Integration of the OpenIGTLink network protocol for image-guided therapy with the medical platform MeVisLab. Int J Med Robot Comput Assist Surg 8(3):282–290CrossRef
8.
Zurück zum Zitat Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin JC, Pujol S, Bauer C, Jennings D, Fennessy F, Sonka M, Buatti J, Aylward S, Miller JV, Pieper S, Kikinis R (2012) 3D Slicer as an image computing platform for the quantitative imaging network. Magn Reson Imaging 30(9):1323–1341CrossRefPubMedPubMedCentral Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin JC, Pujol S, Bauer C, Jennings D, Fennessy F, Sonka M, Buatti J, Aylward S, Miller JV, Pieper S, Kikinis R (2012) 3D Slicer as an image computing platform for the quantitative imaging network. Magn Reson Imaging 30(9):1323–1341CrossRefPubMedPubMedCentral
9.
Zurück zum Zitat Franz AM, Seitel A, Servatius M, Zollner C, Gergel I, Wegner I, Neuhaus J, Zelzer S, Nolden M, Gaa J, Mercea P, Yung K, Sommer CM, Radeleff BA, Schlemmer HP, Kauczor HU, Meinzer HP, Maier-Hein L (2012) Simplified development of image-guided therapy software with MITK-IGT. In: Proceedings of SPIE, medical imaging 2012: image-guided procedures, robotic interventions, and modeling, vol 8316 Franz AM, Seitel A, Servatius M, Zollner C, Gergel I, Wegner I, Neuhaus J, Zelzer S, Nolden M, Gaa J, Mercea P, Yung K, Sommer CM, Radeleff BA, Schlemmer HP, Kauczor HU, Meinzer HP, Maier-Hein L (2012) Simplified development of image-guided therapy software with MITK-IGT. In: Proceedings of SPIE, medical imaging 2012: image-guided procedures, robotic interventions, and modeling, vol 8316
10.
Zurück zum Zitat Ibanez L, Schroeder W, Ng L, Cates J (2005) The ITK software guide. The ITK software guide 804 Ibanez L, Schroeder W, Ng L, Cates J (2005) The ITK software guide. The ITK software guide 804
11.
Zurück zum Zitat Ince DC, Hatton L, Graham-Cumming J (2012) The case for open computer programs. Nature 482:485–488CrossRefPubMed Ince DC, Hatton L, Graham-Cumming J (2012) The case for open computer programs. Nature 482:485–488CrossRefPubMed
12.
Zurück zum Zitat Kang HJ, Stolka PJ, Boctor E (2011) OpenIGTLinkMUSiiC : a standard communications protocol for advanced ultrasound research. MIDAS J 1–12 Kang HJ, Stolka PJ, Boctor E (2011) OpenIGTLinkMUSiiC : a standard communications protocol for advanced ultrasound research. MIDAS J 1–12
13.
Zurück zum Zitat Kilgus T, Heim E, Haase S, Prüfer S, Müller M, Seitel A, Fangerau M, Wiebe T, Iszatt J, Schlemmer HP, Hornegger J, Yen K, Maier-Hein L (2015) Mobile markerless augmented reality and its application in forensic medicine. Int J Comput Assist Radiol Surg 5(1):573–586CrossRef Kilgus T, Heim E, Haase S, Prüfer S, Müller M, Seitel A, Fangerau M, Wiebe T, Iszatt J, Schlemmer HP, Hornegger J, Yen K, Maier-Hein L (2015) Mobile markerless augmented reality and its application in forensic medicine. Int J Comput Assist Radiol Surg 5(1):573–586CrossRef
14.
Zurück zum Zitat Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) PLUS: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 61:1–11CrossRef Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) PLUS: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 61:1–11CrossRef
15.
Zurück zum Zitat Maier-Hein L, Tekbas A, Seitel A, Pianka F, Muller SA, Satzl S, Schawo S, Radeleff B, Tetzlaff R, Franz AM, Muller-Stich BP, Wolf I, Kauczor HU, Schmied BM, Meinzer HP (2008) In vivo accuracy assessment of a needle-based navigation system for CT-guided radiofrequency ablation of the liver. Med Phys 35(12):5385CrossRefPubMed Maier-Hein L, Tekbas A, Seitel A, Pianka F, Muller SA, Satzl S, Schawo S, Radeleff B, Tetzlaff R, Franz AM, Muller-Stich BP, Wolf I, Kauczor HU, Schmied BM, Meinzer HP (2008) In vivo accuracy assessment of a needle-based navigation system for CT-guided radiofrequency ablation of the liver. Med Phys 35(12):5385CrossRefPubMed
16.
Zurück zum Zitat März K, Franz AM, Seitel A, Winterstein A, Bendl R, Zelzer S, Nolden M, Meinzer HP, Maier-Hein L (2014) MITK-US: real-time ultrasound support within MITK. Int J Comput Assist Radiol Surg 9(3):411–420CrossRefPubMed März K, Franz AM, Seitel A, Winterstein A, Bendl R, Zelzer S, Nolden M, Meinzer HP, Maier-Hein L (2014) MITK-US: real-time ultrasound support within MITK. Int J Comput Assist Radiol Surg 9(3):411–420CrossRefPubMed
17.
Zurück zum Zitat März K, Franz AM, Seitel A, Winterstein A, Hafezi M, Saffari A, Bendl R, Stieltjes B, Meinzer HP, Mehrabi A, Maier-Hein L (2014) Interventional real-time ultrasound imaging with an integrated electromagnetic field generator. Int J Comput Assist Radiol Surg 9(5):759–768CrossRefPubMed März K, Franz AM, Seitel A, Winterstein A, Hafezi M, Saffari A, Bendl R, Stieltjes B, Meinzer HP, Mehrabi A, Maier-Hein L (2014) Interventional real-time ultrasound imaging with an integrated electromagnetic field generator. Int J Comput Assist Radiol Surg 9(5):759–768CrossRefPubMed
18.
Zurück zum Zitat McCormick M, Liu X, Jomier J, Marion C, Ibanez L (2014) ITK: enabling reproducible research and open science. Front Neuroinf 8(February):13 McCormick M, Liu X, Jomier J, Marion C, Ibanez L (2014) ITK: enabling reproducible research and open science. Front Neuroinf 8(February):13
19.
Zurück zum Zitat Müller M, Rassweiler MC, Klein J, Seitel A, Gondan M, Baumhauer M, Teber D, Rassweiler JJ, Meinzer HP, Maier-Hein L (2013) Mobile augmented reality for computer-assisted percutaneous nephrolithotomy. Int J Comput Assist Radiol Surg 8(4):663–675 Müller M, Rassweiler MC, Klein J, Seitel A, Gondan M, Baumhauer M, Teber D, Rassweiler JJ, Meinzer HP, Maier-Hein L (2013) Mobile augmented reality for computer-assisted percutaneous nephrolithotomy. Int J Comput Assist Radiol Surg 8(4):663–675
20.
Zurück zum Zitat Neuhaus J, Wegner I, Käst J, Baumhauer M, Seitel A, Gergel I, Nolden M, Maleike D, Wolf I, Meinzer H (2009) MITK-IGT: eine navigationskomponente für das medical imaging interaction toolkit. Bildverarb die Med 2009:454–458 Neuhaus J, Wegner I, Käst J, Baumhauer M, Seitel A, Gergel I, Nolden M, Maleike D, Wolf I, Meinzer H (2009) MITK-IGT: eine navigationskomponente für das medical imaging interaction toolkit. Bildverarb die Med 2009:454–458
21.
Zurück zum Zitat Nolden M, Zelzer S, Seitel A, Wald D, Müller M, Franz AM, Maleike D, Fangerau M, Baumhauer M, Maier-Hein L, Maier-Hein KH, Meinzer HP, Wolf I (2013) The medical imaging interaction toolkit: challenges and advances: 10 years of open-source development. Int J Comput Assist Radiol Surg 8(4):607–620CrossRefPubMed Nolden M, Zelzer S, Seitel A, Wald D, Müller M, Franz AM, Maleike D, Fangerau M, Baumhauer M, Maier-Hein L, Maier-Hein KH, Meinzer HP, Wolf I (2013) The medical imaging interaction toolkit: challenges and advances: 10 years of open-source development. Int J Comput Assist Radiol Surg 8(4):607–620CrossRefPubMed
22.
Zurück zum Zitat Ordas S, Yaniv Z, Cheng P, Tokuda J, Liu H, Hata N, Cleary K (2009) Interfacing proprietary hardware with the image-guided surgery toolkit (IGSTK): a case for the OpenIGTLink protocol. In: proceedings of SPIE, vol 7264, pp 72640F–72640F–7 Ordas S, Yaniv Z, Cheng P, Tokuda J, Liu H, Hata N, Cleary K (2009) Interfacing proprietary hardware with the image-guided surgery toolkit (IGSTK): a case for the OpenIGTLink protocol. In: proceedings of SPIE, vol 7264, pp 72640F–72640F–7
23.
Zurück zum Zitat Pieper S, Halle M, Kikinis R (2004) 3D Slicer. In: 2004 2nd IEEE international symposium on biomedical imaging: nano to macro (IEEE Cat No. 04EX821) Pieper S, Halle M, Kikinis R (2004) 3D Slicer. In: 2004 2nd IEEE international symposium on biomedical imaging: nano to macro (IEEE Cat No. 04EX821)
24.
Zurück zum Zitat Seitel A, Bellemann N, Hafezi M, Franz AM, Servatius M, Saffari A, Kilgus T, Schlemmer HP, Mehrabi A, Radeleff BA, Maier-Hein L (2015) Towards markerless navigation for percutaneous needle insertions. Int J Comput Assist Radiol Surg 11:107–117CrossRefPubMed Seitel A, Bellemann N, Hafezi M, Franz AM, Servatius M, Saffari A, Kilgus T, Schlemmer HP, Mehrabi A, Radeleff BA, Maier-Hein L (2015) Towards markerless navigation for percutaneous needle insertions. Int J Comput Assist Radiol Surg 11:107–117CrossRefPubMed
25.
Zurück zum Zitat Seitel A, Yung K, Mersmann S, Kilgus T, Groch A, Dos Santos TR, Franz AM, Nolden M, Meinzer HP, Maier-Hein L (2012) MITK-ToF-range data within MITK. Int J Comput Assist Radiol Surg 7(1):87–96CrossRefPubMed Seitel A, Yung K, Mersmann S, Kilgus T, Groch A, Dos Santos TR, Franz AM, Nolden M, Meinzer HP, Maier-Hein L (2012) MITK-ToF-range data within MITK. Int J Comput Assist Radiol Surg 7(1):87–96CrossRefPubMed
26.
Zurück zum Zitat Stolka PJ, Kang Hj, Boctor E (2010) The MUSiiC toolkit: modular real-time toolkit for advanced ultrasound research. MIDAS J Comput Assist Interv 1–11 Stolka PJ, Kang Hj, Boctor E (2010) The MUSiiC toolkit: modular real-time toolkit for advanced ultrasound research. MIDAS J Comput Assist Interv 1–11
27.
Zurück zum Zitat Su H, Shang W, Member S, Cole G, Li G, Member S, Harrington K, Camilo A, Tokuda J, Tempany CM, Hata N, Fischer GS (2014) Piezoelectrically actuated robotic system for MRI-guided prostate percutaneous therapy. IEEE/ASME Trans Mech 1:1–13 Su H, Shang W, Member S, Cole G, Li G, Member S, Harrington K, Camilo A, Tokuda J, Tempany CM, Hata N, Fischer GS (2014) Piezoelectrically actuated robotic system for MRI-guided prostate percutaneous therapy. IEEE/ASME Trans Mech 1:1–13
28.
Zurück zum Zitat Teather RJ, Pavlovych A, Stuerzlinger W, MacKenzie IS (2009) Effects of tracking technology, latency, and spatial jitter on object movement. In: Proceedings of 3DUI— IEEE symposium on 3D user interfaces 2009, pp 43–50 Teather RJ, Pavlovych A, Stuerzlinger W, MacKenzie IS (2009) Effects of tracking technology, latency, and spatial jitter on object movement. In: Proceedings of 3DUI— IEEE symposium on 3D user interfaces 2009, pp 43–50
29.
Zurück zum Zitat Tokuda J, Fischer GS, Papademetris X, Yaniv Z, Ibanez L, Cheng P, Liu H, Blevins J, Arata J, Golby AJ, Kapur T, Pieper S, Burdette EC, Fichtinger G, Tempany CM, Hata N, Alexandra J, Kapur T, Pieper S, Burdette EC, Fichtinger G, Clare M, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot Comput Assist Surg 5(4):423–434CrossRef Tokuda J, Fischer GS, Papademetris X, Yaniv Z, Ibanez L, Cheng P, Liu H, Blevins J, Arata J, Golby AJ, Kapur T, Pieper S, Burdette EC, Fichtinger G, Tempany CM, Hata N, Alexandra J, Kapur T, Pieper S, Burdette EC, Fichtinger G, Clare M, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot Comput Assist Surg 5(4):423–434CrossRef
30.
Zurück zum Zitat Wolf I, Vetter M, Wegner I, Nolden M, Bottger T, Hastenteufel M, Schobinger M, Kunert T, Meinzer HP (2004) The medical imaging interaction toolkit (MITK) a toolkit facilitating the creation of interactive software by extending VTK and ITK. Med Imaging 2004:16–27 Wolf I, Vetter M, Wegner I, Nolden M, Bottger T, Hastenteufel M, Schobinger M, Kunert T, Meinzer HP (2004) The medical imaging interaction toolkit (MITK) a toolkit facilitating the creation of interactive software by extending VTK and ITK. Med Imaging 2004:16–27
31.
Zurück zum Zitat Wu X, Taylor RH (2003) A framework for calibration of electromagnetic surgical navigation systems. In: Proceedings 2003 IEEE/RSJ international conference on intelligent robots and systems (IROS 2003), vol 1, pp 547–552 Wu X, Taylor RH (2003) A framework for calibration of electromagnetic surgical navigation systems. In: Proceedings 2003 IEEE/RSJ international conference on intelligent robots and systems (IROS 2003), vol 1, pp 547–552
Metadaten
Titel
MITK-OpenIGTLink for combining open-source toolkits in real-time computer-assisted interventions
verfasst von
Martin Klemm
Thomas Kirchner
Janek Gröhl
Dominique Cheray
Marco Nolden
Alexander Seitel
Harald Hoppe
Lena Maier-Hein
Alfred M. Franz
Publikationsdatum
29.09.2016
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 3/2017
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-016-1488-y

Weitere Artikel der Ausgabe 3/2017

International Journal of Computer Assisted Radiology and Surgery 3/2017 Zur Ausgabe

Premium Partner