Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 6/2017

22-03-2017 | Original Article

Robust motion tracking in liver from 2D ultrasound images using supporters

Authors: Ece Ozkan, Christine Tanner, Matej Kastelic, Oliver Mattausch, Maxim Makhinya, Orcun Goksel

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 6/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

Effectiveness of image-guided radiation therapy with precise dose delivery depends highly on accurate target localization, which may involve motion during treatment due to, e.g., breathing and drift. Therefore, it is important to track the motion and adjust the radiation delivery accordingly. Tracking generally requires reliable target appearance and image features, whereas in ultrasound imaging acoustic shadowing and other artifacts may degrade the visibility of a target, leading to substantial tracking errors. To minimize such errors, we propose a method based on so-called supporters, a computer vision tracking technique. This allows us to leverage information from surrounding motion for improving robustness of motion tracking on 2D ultrasound image sequences of the liver.

Methods

Image features, potentially useful for predicting the target positions, are individually tracked, and a supporter model capturing the coupling of motion between these features and the target is learned on-line. This model is then applied to predict the target position, when the target cannot be otherwise tracked reliably.

Results

The proposed method was evaluated using the Challenge on Liver Ultrasound Tracking (CLUST)-2015 dataset. Leave-one-out cross-validation was performed on the training set of 24 2D image sequences of each 1–5 min. The method was then applied on the test set (24 2D sequences), where the results were evaluated by the challenge organizers, yielding 1.04 mm mean and 2.26 mm 95%ile tracking error for all targets. We also devised a simulation framework to emulate acoustic shadowing artifacts from the ribs, which showed effective tracking despite the shadows.

Conclusions

Results support the feasibility and demonstrate the advantages of using supporters. The proposed method improves its baseline tracker, which uses optic flow and elliptic vessel models, and yields the state-of-the-art real-time tracking solution for the CLUST challenge.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Keall PJ, Mageras GS, Balter JM, Emery RS, Forster KM, Jiang SB, Kapatoes JM, Low DA, Murphy MJ, Murray BR et al (2006) The management of respiratory motion in radiation oncology report of AAPM Task Group 76a). Med Phys 33(10):3874–3900CrossRef Keall PJ, Mageras GS, Balter JM, Emery RS, Forster KM, Jiang SB, Kapatoes JM, Low DA, Murphy MJ, Murray BR et al (2006) The management of respiratory motion in radiation oncology report of AAPM Task Group 76a). Med Phys 33(10):3874–3900CrossRef
2.
go back to reference Magerasa GS, Yorkea E (2004) Deep inspiration breath hold and respiratory gating strategies for reducing organ motion in radiation treatment. Semin Radiat Oncol 14(1):65–75CrossRef Magerasa GS, Yorkea E (2004) Deep inspiration breath hold and respiratory gating strategies for reducing organ motion in radiation treatment. Semin Radiat Oncol 14(1):65–75CrossRef
3.
go back to reference De Luca V, Szkely G, Tanner C (2015) Estimation of large-scale organ motion in B-mode ultrasound image sequences: a survey. Ultrasound Med Biol 41(12):3044–3062CrossRefPubMed De Luca V, Szkely G, Tanner C (2015) Estimation of large-scale organ motion in B-mode ultrasound image sequences: a survey. Ultrasound Med Biol 41(12):3044–3062CrossRefPubMed
4.
go back to reference Vijayan S, Klein S, Hofstad EF, Lindseth F, Ystgaard B, Langø T (2013) Validation of a non-rigid registration method for motion compensation in 4D ultrasound of the liver. In: 2013 IEEE 10th international symposium on biomedical imaging, pp 792–795 Vijayan S, Klein S, Hofstad EF, Lindseth F, Ystgaard B, Langø T (2013) Validation of a non-rigid registration method for motion compensation in 4D ultrasound of the liver. In: 2013 IEEE 10th international symposium on biomedical imaging, pp 792–795
5.
go back to reference De Luca V, Tschannen M, Székely G, Tanner C (2013) A learning-based approach for fast and robust vessel tracking in long ultrasound sequences. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 518–525 De Luca V, Tschannen M, Székely G, Tanner C (2013) A learning-based approach for fast and robust vessel tracking in long ultrasound sequences. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 518–525
6.
go back to reference Makhinya M, Goksel O (2015) Motion tracking in 2D ultrasound using vessel models and robust optic-flow. In: MICCAI 2015 challenge on liver ultrasound tracking Makhinya M, Goksel O (2015) Motion tracking in 2D ultrasound using vessel models and robust optic-flow. In: MICCAI 2015 challenge on liver ultrasound tracking
7.
go back to reference Grabner H, Matas J, Van Gool L, Cattin P (2010) Tracking the invisible: learning where the object might be. In: International conference on computer vision and pattern recognition (CVPR), pp 1285–1292 Grabner H, Matas J, Van Gool L, Cattin P (2010) Tracking the invisible: learning where the object might be. In: International conference on computer vision and pattern recognition (CVPR), pp 1285–1292
8.
go back to reference Yanagawa Y, Echigo T, Vu H, Okazaki H, Fujiwara Y, Arakawa T, Yagi Y (2012) Tracking abnormalities in video capsule endoscopy using surrounding features with a triangular constraint. In: International symposium on biomedical imaging (ISBI) Yanagawa Y, Echigo T, Vu H, Okazaki H, Fujiwara Y, Arakawa T, Yagi Y (2012) Tracking abnormalities in video capsule endoscopy using surrounding features with a triangular constraint. In: International symposium on biomedical imaging (ISBI)
9.
go back to reference Chakraborty A, Roy-Chowdhury AK (2015) Context aware spatio-temporal cell tracking in densely packed multilayer tissues. Med Image Anal 19(1):149–163CrossRefPubMed Chakraborty A, Roy-Chowdhury AK (2015) Context aware spatio-temporal cell tracking in densely packed multilayer tissues. Med Image Anal 19(1):149–163CrossRefPubMed
10.
go back to reference Xia Y, Hussein S, Singh V, John M, Wu Y, Chen T (2016) Context region discovery for automatic motion compensation in fluoroscopy. Int J Comput Assist Radiol Surg 11(6):1–9CrossRef Xia Y, Hussein S, Singh V, John M, Wu Y, Chen T (2016) Context region discovery for automatic motion compensation in fluoroscopy. Int J Comput Assist Radiol Surg 11(6):1–9CrossRef
11.
go back to reference Sun Z, Yao H, Zhang S, Sun X (2011) Robust visual tracking via context objects computing. In: 18th IEEE international conference on image processing, pp 509–512 Sun Z, Yao H, Zhang S, Sun X (2011) Robust visual tracking via context objects computing. In: 18th IEEE international conference on image processing, pp 509–512
12.
go back to reference Xiong F, Camps OI, Sznaier M (2012) Dynamic context for tracking behind occlusions. In: European conference on computer vision (ECCV), pp 580–593 Xiong F, Camps OI, Sznaier M (2012) Dynamic context for tracking behind occlusions. In: European conference on computer vision (ECCV), pp 580–593
13.
go back to reference Meng L, Jia Q (2013) Multi-target tracking based on level set segmentation and contextual information. Int J Signal Process Image Process Pattern Recognit 6(4):287–296 Meng L, Jia Q (2013) Multi-target tracking based on level set segmentation and contextual information. Int J Signal Process Image Process Pattern Recognit 6(4):287–296
14.
go back to reference Zhang L, Van Der Maaten L (2014) Preserving structure in model-free tracking. IEEE Trans Pattern Anal Mach Intell 36(4):756–769CrossRefPubMed Zhang L, Van Der Maaten L (2014) Preserving structure in model-free tracking. IEEE Trans Pattern Anal Mach Intell 36(4):756–769CrossRefPubMed
15.
go back to reference Meshgi K, Maeda S-I, Oba S, Skibbe H, Li Y-Z, Ishii S (2016) An occlusion-aware particle filter tracker to handle complex and persistent occlusions. Comput Vis Image Underst 150:81–94CrossRef Meshgi K, Maeda S-I, Oba S, Skibbe H, Li Y-Z, Ishii S (2016) An occlusion-aware particle filter tracker to handle complex and persistent occlusions. Comput Vis Image Underst 150:81–94CrossRef
16.
go back to reference Samei G, Chlebus G, Sz ekely G, Tanner C (2013) Adaptive confidence regions of motion predictions from population exemplar models. In: MICCAI workshop on computational and clinical challenges in abdominal imaging, pp 231–240 Samei G, Chlebus G, Sz ekely G, Tanner C (2013) Adaptive confidence regions of motion predictions from population exemplar models. In: MICCAI workshop on computational and clinical challenges in abdominal imaging, pp 231–240
17.
go back to reference De Luca T, annd Benz V, Kondo S, Knig L, Lbke D, Rothlbbers S, Somphone O, Allaire S, Lediju Bell M, Chung D, Cifor A, Grozea C, Gnther M, Jenne J, Kipshagen T, Kowarschik M, Navab N, Rhaak J, Schwaab J, Tanner C (2015) The 2014 liver ultrasound tracking benchmark. Phys Med Biol 60(14):5571CrossRefPubMed De Luca T, annd Benz V, Kondo S, Knig L, Lbke D, Rothlbbers S, Somphone O, Allaire S, Lediju Bell M, Chung D, Cifor A, Grozea C, Gnther M, Jenne J, Kipshagen T, Kowarschik M, Navab N, Rhaak J, Schwaab J, Tanner C (2015) The 2014 liver ultrasound tracking benchmark. Phys Med Biol 60(14):5571CrossRefPubMed
18.
go back to reference Mohr M, Abrams E, Engel C, Long WB, Bottlang M (2007) Geometry of human ribs pertinent to orthopedic chest-wall reconstruction. J Biomech 40(6):1310–1317CrossRefPubMed Mohr M, Abrams E, Engel C, Long WB, Bottlang M (2007) Geometry of human ribs pertinent to orthopedic chest-wall reconstruction. J Biomech 40(6):1310–1317CrossRefPubMed
19.
go back to reference Mattausch O, Goksel O (2016) Monte-carlo ray-tracing for realistic interactive ultrasound simulation. In: Eurographics workshop on visual computing for biology and medicine Mattausch O, Goksel O (2016) Monte-carlo ray-tracing for realistic interactive ultrasound simulation. In: Eurographics workshop on visual computing for biology and medicine
20.
go back to reference Lucas B, Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: Proceedings of imaging understanding workshop, pp 121–130 Lucas B, Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: Proceedings of imaging understanding workshop, pp 121–130
21.
go back to reference Crimi A, Makhinya M, Baumann U, Thalhammer C, Szekely G, Goksel O (2016) Automatic measurement of venous pressure using B-mode ultrasound. IEEE Trans Biomed Eng 63(2):288–299CrossRefPubMed Crimi A, Makhinya M, Baumann U, Thalhammer C, Szekely G, Goksel O (2016) Automatic measurement of venous pressure using B-mode ultrasound. IEEE Trans Biomed Eng 63(2):288–299CrossRefPubMed
Metadata
Title
Robust motion tracking in liver from 2D ultrasound images using supporters
Authors
Ece Ozkan
Christine Tanner
Matej Kastelic
Oliver Mattausch
Maxim Makhinya
Orcun Goksel
Publication date
22-03-2017
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 6/2017
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1559-8

Other articles of this Issue 6/2017

International Journal of Computer Assisted Radiology and Surgery 6/2017 Go to the issue

Premium Partner