Skip to main content

2018 | OriginalPaper | Buchkapitel

Joint Intensity Fusion Image Synthesis Applied to Multiple Sclerosis Lesion Segmentation

verfasst von : Greg M. Fleishman, Alessandra Valcarcel, Dzung L. Pham, Snehashis Roy, Peter A. Calabresi, Paul Yushkevich, Russell T. Shinohara, Ipek Oguz

Erschienen in: Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We propose a new approach to Multiple Sclerosis lesion segmentation that utilizes synthesized images. A new method of image synthesis is considered: joint intensity fusion (JIF). JIF synthesizes an image from a library of deformably registered and intensity normalized atlases. Each location in the synthesized image is a weighted average of the registered atlases; atlas weights vary spatially. The weights are determined using the joint label fusion (JLF) framework. The primary methodological contribution is the application of JLF to MRI signal directly rather than labels. Synthesized images are then used as additional features in a lesion segmentation task using the OASIS classifier, a logistic regression model on intensities from multiple modalities. The addition of JIF synthesized images improved the Dice-Sorensen coefficient (relative to manually drawn gold standards) of lesion segmentations over the standard model segmentations by \(0.0462 \pm 0.0050\) (mean ± standard deviation) at optimal threshold over all subjects and 10 separate training/testing folds.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Awate, S., Whitaker, R.: Unsupervised, information-theoretic, adaptive image filtering for image restoration. IEEE Trans. PAMI 28, 364–376 (2006)CrossRef Awate, S., Whitaker, R.: Unsupervised, information-theoretic, adaptive image filtering for image restoration. IEEE Trans. PAMI 28, 364–376 (2006)CrossRef
2.
Zurück zum Zitat Buades, A., Coll, B., Morel, J.M.: Nonlocal image and movie denoising. Int. J. Comput. Vis. 76(2), 123–139 (2008)CrossRef Buades, A., Coll, B., Morel, J.M.: Nonlocal image and movie denoising. Int. J. Comput. Vis. 76(2), 123–139 (2008)CrossRef
3.
Zurück zum Zitat Carass, A., et al.: Longitudinal multiple sclerosis lesion segmentation: resource and challenge. NeuroImage 148, 77–102 (2017)CrossRef Carass, A., et al.: Longitudinal multiple sclerosis lesion segmentation: resource and challenge. NeuroImage 148, 77–102 (2017)CrossRef
4.
Zurück zum Zitat Carass, A., Cuzzocreo, J., Wheeler, M.B., Bazin, P.L., Resnick, S.M., Prince, J.L.: Simple paradigm for extra-cerebral tissue removal: algorithm and analysis. NeuroImage 56(4), 1982–1992 (2011)CrossRef Carass, A., Cuzzocreo, J., Wheeler, M.B., Bazin, P.L., Resnick, S.M., Prince, J.L.: Simple paradigm for extra-cerebral tissue removal: algorithm and analysis. NeuroImage 56(4), 1982–1992 (2011)CrossRef
5.
Zurück zum Zitat Cardoso, M.J., Sudre, C.H., Modat, M., Ourselin, S.: Template-based multimodal joint generative model of brain data. In: IPMI, pp. 17–29 (2015) Cardoso, M.J., Sudre, C.H., Modat, M., Ourselin, S.: Template-based multimodal joint generative model of brain data. In: IPMI, pp. 17–29 (2015)
6.
Zurück zum Zitat DeLong, E.R., DeLong, D.M., Clarke-Pearson, D.L.: Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44, 837–845 (1988)CrossRefMATH DeLong, E.R., DeLong, D.M., Clarke-Pearson, D.L.: Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44, 837–845 (1988)CrossRefMATH
7.
Zurück zum Zitat Dendrou, C.A., Fugger, L., Friese, M.A.: Immunopathology of multiple sclerosis. Nat. Rev. Immunol. 15(9), 545–558 (2015)CrossRef Dendrou, C.A., Fugger, L., Friese, M.A.: Immunopathology of multiple sclerosis. Nat. Rev. Immunol. 15(9), 545–558 (2015)CrossRef
8.
Zurück zum Zitat Garcia-Lorenzo, D., Francis, S., Narayanan, S., Arnold, D.L., Collins, D.L.: Review of automatic segmentation methods of multiple sclerosis white matter lesions on conventional magnetic resonance imaging. Med. Image Anal. 17(1), 1–18 (2013)CrossRef Garcia-Lorenzo, D., Francis, S., Narayanan, S., Arnold, D.L., Collins, D.L.: Review of automatic segmentation methods of multiple sclerosis white matter lesions on conventional magnetic resonance imaging. Med. Image Anal. 17(1), 1–18 (2013)CrossRef
9.
Zurück zum Zitat Iglesias, J.E., Sabuncu, M.R.: Multi-atlas segmentation of biomedical images: a survey. Med. Image Anal. 24(1), 205–219 (2015)CrossRef Iglesias, J.E., Sabuncu, M.R.: Multi-atlas segmentation of biomedical images: a survey. Med. Image Anal. 24(1), 205–219 (2015)CrossRef
10.
Zurück zum Zitat Jog, A., Roy, S., Carass, A., Prince, J.L.: Magnetic resonance image synthesis through patch regression. In: Proceedings of IEEE ISBI 2013, pp. 350–353 (2013) Jog, A., Roy, S., Carass, A., Prince, J.L.: Magnetic resonance image synthesis through patch regression. In: Proceedings of IEEE ISBI 2013, pp. 350–353 (2013)
11.
Zurück zum Zitat Landman, B.A., Warfield, S.K.: MICCAI 2012 workshop on multi-atlas labeling. In: MICCAI 2012 Grand Challenge and Workshop on Multi-Atlas Labeling Challenge Results (2012) Landman, B.A., Warfield, S.K.: MICCAI 2012 workshop on multi-atlas labeling. In: MICCAI 2012 Grand Challenge and Workshop on Multi-Atlas Labeling Challenge Results (2012)
12.
Zurück zum Zitat Mazziotta, J.C., Toga, A.W., Evans, A., Fox, P., Lancaster, J.: A probabilistic atlas of the human brain: theory and rationale for its development. NeuroImage 2(2), 89–101 (1995)CrossRef Mazziotta, J.C., Toga, A.W., Evans, A., Fox, P., Lancaster, J.: A probabilistic atlas of the human brain: theory and rationale for its development. NeuroImage 2(2), 89–101 (1995)CrossRef
13.
Zurück zum Zitat Mejia, A.F., Sweeney, E.M., Dewey, B., Nair, G., Sati, P., Shea, C., Reich, D.S., Shinohara, R.T.: Statistical estimation of T1 relaxation times using conventional magnetic resonance imaging. NeuroImage 133, 176–188 (2016)CrossRef Mejia, A.F., Sweeney, E.M., Dewey, B., Nair, G., Sati, P., Shea, C., Reich, D.S., Shinohara, R.T.: Statistical estimation of T1 relaxation times using conventional magnetic resonance imaging. NeuroImage 133, 176–188 (2016)CrossRef
14.
Zurück zum Zitat Roy, S., Agarwal, H., Carass, A., Bai, Y., Pham, D.L., Prince, J.L.: Fuzzy c-means with variable compactness. In: IEEE International Symposium on Biomedical Imaging (2008) Roy, S., Agarwal, H., Carass, A., Bai, Y., Pham, D.L., Prince, J.L.: Fuzzy c-means with variable compactness. In: IEEE International Symposium on Biomedical Imaging (2008)
17.
Zurück zum Zitat Shiee, N., Bazin, P.L., Ozturk, A., Reich, D.S., Calabresi, P.A., Pham, D.L.: A topology-preserving approach to the segmentation of brain images with multiple sclerosis lesions. NeuroImage 49(2), 1524–1535 (2010)CrossRef Shiee, N., Bazin, P.L., Ozturk, A., Reich, D.S., Calabresi, P.A., Pham, D.L.: A topology-preserving approach to the segmentation of brain images with multiple sclerosis lesions. NeuroImage 49(2), 1524–1535 (2010)CrossRef
18.
Zurück zum Zitat Sled, J.G., Zijdenbos, A.P., Evans, A.C.: A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Trans. Med. Imaging 17(1), 87–97 (1998)CrossRef Sled, J.G., Zijdenbos, A.P., Evans, A.C.: A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Trans. Med. Imaging 17(1), 87–97 (1998)CrossRef
19.
Zurück zum Zitat Subbanna, N., Precup, D., Arnold, D., Arbel, T.: Image: iterative multilevel probabilistic graphical model for detection and segmentation of multiple sclerosis lesions in brain MRI. In: IPMI, pp. 514–526 (2015) Subbanna, N., Precup, D., Arnold, D., Arbel, T.: Image: iterative multilevel probabilistic graphical model for detection and segmentation of multiple sclerosis lesions in brain MRI. In: IPMI, pp. 514–526 (2015)
20.
Zurück zum Zitat Suttner, L., Mejia, A., Dewey, B., Sati, P., Reich, D., Shinohara, R.: Statistical estimation of white matter microstructure from conventional MRI. NeuroImage: Clinical 12, 615–623 (2016)CrossRef Suttner, L., Mejia, A., Dewey, B., Sati, P., Reich, D., Shinohara, R.: Statistical estimation of white matter microstructure from conventional MRI. NeuroImage: Clinical 12, 615–623 (2016)CrossRef
21.
Zurück zum Zitat Sweeney, E.M., Shinohara, R.T., Shiee, N., Mateen, F.J., Chudgar, A.A., Cuzzocreo, J.L., Calabresi, P.A., Pham, D.L., Reich, D.S., Crainiceanu, C.M.: OASIS is automated statistical inference for segmentation, with applications to multiple sclerosis lesion segmentation in MRI. NeuroImage: Clinical 2, 402–413 (2013)CrossRef Sweeney, E.M., Shinohara, R.T., Shiee, N., Mateen, F.J., Chudgar, A.A., Cuzzocreo, J.L., Calabresi, P.A., Pham, D.L., Reich, D.S., Crainiceanu, C.M.: OASIS is automated statistical inference for segmentation, with applications to multiple sclerosis lesion segmentation in MRI. NeuroImage: Clinical 2, 402–413 (2013)CrossRef
22.
Zurück zum Zitat Tristán-Vega, A., García-Pérez, V., Aja-Fernández, S., Westin, C.F.: Efficient and robust nonlocal means denoising of MR data based on salient features matching. Comput. Methods Programs Biomed. 105(2), 131–144 (2011)CrossRef Tristán-Vega, A., García-Pérez, V., Aja-Fernández, S., Westin, C.F.: Efficient and robust nonlocal means denoising of MR data based on salient features matching. Comput. Methods Programs Biomed. 105(2), 131–144 (2011)CrossRef
23.
Zurück zum Zitat Tustison, N., Avants, B., Wang, H., Xie, L., Coupe, P., Yushkevich, P., Manjon, J.: A patch-based framework for new ITK functionality: Joint fusion, denoising, and non-local super-resolution. Insight Journal (2017) Tustison, N., Avants, B., Wang, H., Xie, L., Coupe, P., Yushkevich, P., Manjon, J.: A patch-based framework for new ITK functionality: Joint fusion, denoising, and non-local super-resolution. Insight Journal (2017)
24.
Zurück zum Zitat Wang, H., Suh, J.W., Das, S.R., Pluta, J.B., Craige, C., Yushkevich, P.A.: Multi-atlas segmentation with joint label fusion. IEEE Trans. PAMI 35(3), 611–623 (2013)CrossRef Wang, H., Suh, J.W., Das, S.R., Pluta, J.B., Craige, C., Yushkevich, P.A.: Multi-atlas segmentation with joint label fusion. IEEE Trans. PAMI 35(3), 611–623 (2013)CrossRef
25.
Zurück zum Zitat Yushkevich, P.A., et al.: Fast automatic segmentation of hippocampal subfields and medial temporal lobe subregions in 3 Tesla and 7 Tesla T2-weighted MRI. Alzheimer’s & Dement. J. Alzheimer’s Assoc. 12(7), P126–P127 (2016)CrossRef Yushkevich, P.A., et al.: Fast automatic segmentation of hippocampal subfields and medial temporal lobe subregions in 3 Tesla and 7 Tesla T2-weighted MRI. Alzheimer’s & Dement. J. Alzheimer’s Assoc. 12(7), P126–P127 (2016)CrossRef
Metadaten
Titel
Joint Intensity Fusion Image Synthesis Applied to Multiple Sclerosis Lesion Segmentation
verfasst von
Greg M. Fleishman
Alessandra Valcarcel
Dzung L. Pham
Snehashis Roy
Peter A. Calabresi
Paul Yushkevich
Russell T. Shinohara
Ipek Oguz
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-75238-9_4