Skip to main content
Top

2017 | Supplement | Chapter

Globally-Optimal Anatomical Tree Extraction from 3D Medical Images Using Pictorial Structures and Minimal Paths

Authors : Zahra Mirikharaji, Mengliu Zhao, Ghassan Hamarneh

Published in: Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Extracting centerlines of anatomical trees (e.g., vasculature and airways) from 3D medical images is a crucial preliminary step for various medical applications. We propose an automatic tree extraction method that leverages prior knowledge of tree topology and geometry and ensures globally-optimal solutions. We define a pictorial structure with a corresponding cost function to detect tree bifurcations in anatomical trees with predefined topology. The tree bifurcations are encoded as nodes in the pictorial structure and are associated with an artificial neural network (ANN) based unary term. The geometrical (direction and length) statistics of tree branches are learned from a training set and encoded as geometrical priors for regularizing the pictorial structure edges. Finally, detected bifurcations as well as the ANN tubularity scores, are leveraged to trace globally optimal minimal paths along 3D tree centrelines. Our method outperforms competing state-of-the-art when evaluated on 3D synthesized vasculature and lung airways in CT and our results demonstrate the advantages of incorporating tree statistics and global optimization for this task.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Belagiannis, et al.: 3D pictorial structures for multiple human pose estimation. In: CVPR, pp. 1669–1676 (2014) Belagiannis, et al.: 3D pictorial structures for multiple human pose estimation. In: CVPR, pp. 1669–1676 (2014)
2.
go back to reference Bériault, S., et al.: Automatic SWI venography segmentation using conditional random fields. IEEE TMI 34(12), 2478–2491 (2015) Bériault, S., et al.: Automatic SWI venography segmentation using conditional random fields. IEEE TMI 34(12), 2478–2491 (2015)
3.
go back to reference Burenius, M., et al.: 3D pictorial structures for multiple view articulated pose estimation. In: CVPR, pp. 3618–3625 (2013) Burenius, M., et al.: 3D pictorial structures for multiple view articulated pose estimation. In: CVPR, pp. 3618–3625 (2013)
4.
go back to reference Deschamps, T.: Curve and shape extraction with minimal path an level-sets techniques: applications to 3D Medical Imaging. Ph.D. thesis, University of Paris Dauphine (2001) Deschamps, T.: Curve and shape extraction with minimal path an level-sets techniques: applications to 3D Medical Imaging. Ph.D. thesis, University of Paris Dauphine (2001)
5.
go back to reference Felzenszwalb, P.F., et al.: Pictorial structures for object recognition. IJCV 61(1), 55–79 (2005)CrossRef Felzenszwalb, P.F., et al.: Pictorial structures for object recognition. IJCV 61(1), 55–79 (2005)CrossRef
6.
go back to reference Felzenszwalb, P., Huttenlocher, D.: Distance transforms of sampled functions. Cornell University, Technical report (2004) Felzenszwalb, P., Huttenlocher, D.: Distance transforms of sampled functions. Cornell University, Technical report (2004)
7.
go back to reference Frangi, A.F., Niessen, W.J., Vincken, K.L., Viergever, M.A.: Multiscale vessel enhancement filtering. In: Wells, W.M., Colchester, A., Delp, S. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 130–137. Springer, Heidelberg (1998). doi:10.1007/BFb0056195CrossRef Frangi, A.F., Niessen, W.J., Vincken, K.L., Viergever, M.A.: Multiscale vessel enhancement filtering. In: Wells, W.M., Colchester, A., Delp, S. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 130–137. Springer, Heidelberg (1998). doi:10.​1007/​BFb0056195CrossRef
8.
go back to reference Hinton, G.E., et al.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRef Hinton, G.E., et al.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRef
9.
go back to reference Krissian, K., et al.: A minimal cost path and level set evolution approach for carotid bifurcation segmentation. Midas J. (2009) Krissian, K., et al.: A minimal cost path and level set evolution approach for carotid bifurcation segmentation. Midas J. (2009)
10.
go back to reference Law, M.W.K., Chung, A.C.S.: Three dimensional curvilinear structure detection using optimally oriented flux. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5305, pp. 368–382. Springer, Heidelberg (2008). doi:10.1007/978-3-540-88693-8_27CrossRef Law, M.W.K., Chung, A.C.S.: Three dimensional curvilinear structure detection using optimally oriented flux. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5305, pp. 368–382. Springer, Heidelberg (2008). doi:10.​1007/​978-3-540-88693-8_​27CrossRef
11.
go back to reference Lesage, D., et al.: Adaptive particle filtering for coronary artery segmentation from 3D CT angiograms. CVIU 151, 29–46 (2016) Lesage, D., et al.: Adaptive particle filtering for coronary artery segmentation from 3D CT angiograms. CVIU 151, 29–46 (2016)
12.
go back to reference Li, H., Yezzi, A.: Vessels as 4D curves: Global minimal 4D paths to extract 3D tubular surfaces and centerlines. IEEE TMI 26(9), 1213–1223 (2007) Li, H., Yezzi, A.: Vessels as 4D curves: Global minimal 4D paths to extract 3D tubular surfaces and centerlines. IEEE TMI 26(9), 1213–1223 (2007)
13.
go back to reference Macedo, et al.: A centerline-based estimator of vessel bifurcations in angiography images. In: SPIE Medical Imaging, p. 86703K (2013) Macedo, et al.: A centerline-based estimator of vessel bifurcations in angiography images. In: SPIE Medical Imaging, p. 86703K (2013)
14.
go back to reference Metz, C., et al.: Two point minimum cost path approach for CTA coronary centerline extraction. Insight J., 123 (2008) Metz, C., et al.: Two point minimum cost path approach for CTA coronary centerline extraction. Insight J., 123 (2008)
15.
go back to reference M’hiri, F., et al.: A graph-based approach for spatio-temporal segmentation of coronary arteries in X-ray angiographic sequences. Comput. Biol. Med. 79, 45–58 (2016)CrossRef M’hiri, F., et al.: A graph-based approach for spatio-temporal segmentation of coronary arteries in X-ray angiographic sequences. Comput. Biol. Med. 79, 45–58 (2016)CrossRef
16.
go back to reference Mueller, D.: Fast marching minimal path extraction in ITK. Insight J., 1–8 (2008) Mueller, D.: Fast marching minimal path extraction in ITK. Insight J., 1–8 (2008)
18.
go back to reference Prim, R.C., et al.: Shortest connection networks and some generalizations. Bell Labs Tech. J. 36(6), 1389–1401 (1957)CrossRef Prim, R.C., et al.: Shortest connection networks and some generalizations. Bell Labs Tech. J. 36(6), 1389–1401 (1957)CrossRef
19.
go back to reference Rempfler, M., et al.: Extracting vascular networks under physiological constraints via integer programming. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8674, pp. 505–512. Springer, Cham (2014). doi:10.1007/978-3-319-10470-6_63CrossRef Rempfler, M., et al.: Extracting vascular networks under physiological constraints via integer programming. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8674, pp. 505–512. Springer, Cham (2014). doi:10.​1007/​978-3-319-10470-6_​63CrossRef
20.
go back to reference Robben, D., Türetken, E., Sunaert, S., Thijs, V., Wilms, G., Fua, P., Maes, F., Suetens, P.: Simultaneous segmentation and anatomical labeling of the cerebral vasculature. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8673, pp. 307–314. Springer, Cham (2014). doi:10.1007/978-3-319-10404-1_39CrossRef Robben, D., Türetken, E., Sunaert, S., Thijs, V., Wilms, G., Fua, P., Maes, F., Suetens, P.: Simultaneous segmentation and anatomical labeling of the cerebral vasculature. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8673, pp. 307–314. Springer, Cham (2014). doi:10.​1007/​978-3-319-10404-1_​39CrossRef
21.
go back to reference Schaap, M., et al.: Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms. MIA 13(5), 701–714 (2009) Schaap, M., et al.: Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms. MIA 13(5), 701–714 (2009)
22.
go back to reference Schneider, M., et al.: Joint 3D vessel segmentation and centerline extraction using oblique Hough forests with steerable filters. MIA 19(1), 220–249 (2015) Schneider, M., et al.: Joint 3D vessel segmentation and centerline extraction using oblique Hough forests with steerable filters. MIA 19(1), 220–249 (2015)
23.
go back to reference Skibbe, H., et al.: Efficient Monte Carlo image analysis for the location of vascular entity. IEEE TMI 34(2), 628–643 (2015) Skibbe, H., et al.: Efficient Monte Carlo image analysis for the location of vascular entity. IEEE TMI 34(2), 628–643 (2015)
24.
go back to reference Türetken, E., et al.: Automated reconstruction of dendritic and axonal trees by global optimization with geometric priors. Neuroinformatics 9(2–3), 279–302 (2011)CrossRef Türetken, E., et al.: Automated reconstruction of dendritic and axonal trees by global optimization with geometric priors. Neuroinformatics 9(2–3), 279–302 (2011)CrossRef
25.
go back to reference Türetken, E., et al.: Automated reconstruction of tree structures using path classifiers and mixed integer programming. In: CVPR, pp. 566–573. IEEE (2012) Türetken, E., et al.: Automated reconstruction of tree structures using path classifiers and mixed integer programming. In: CVPR, pp. 566–573. IEEE (2012)
26.
go back to reference Wu, A., et al.: Deep vessel tracking: a generalized probabilistic approach via deep learning. In: IEEE ISBI, pp. 1363–1367 (2016) Wu, A., et al.: Deep vessel tracking: a generalized probabilistic approach via deep learning. In: IEEE ISBI, pp. 1363–1367 (2016)
Metadata
Title
Globally-Optimal Anatomical Tree Extraction from 3D Medical Images Using Pictorial Structures and Minimal Paths
Authors
Zahra Mirikharaji
Mengliu Zhao
Ghassan Hamarneh
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-66185-8_28

Premium Partner