Skip to main content
Top
Published in:
Cover of the book

2016 | OriginalPaper | Chapter

Fully Automated Patch-Based Image Restoration: Application to Pathology Inpainting

Authors : Ferran Prados, M. Jorge Cardoso, Niamh Cawley, Baris Kanber, Olga Ciccarelli, Claudia A. M. Gandini Wheeler-Kingshott, Sébastien Ourselin

Published in: Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Pathology can have an important impact on MRI analysis. Specifically, white matter hyper-intensities, tumours, infarcts, etc., can influence the results of various image analysis techniques such as segmentation and registration. Several algorithms have been proposed for image inpainting and restoration, mainly in the context of Multiple Sclerosis lesions. These techniques commonly rely on a set of manually segmented pathological regions for inpainting. Rather than relying on prior segmentations for image restoration, we present a combined segmentation and inpainting algorithm for multimodal images. The proposed method is based on an iterative collaboration between two patch-based techniques, PatchMatch and Non-Local Means, where the former is used to estimate the most probable location of the pathological outliers and the latter to gradually fill the segmented areas with the most plausible multimodal texture. We demonstrate that the proposed method is able to automatically restore multimodal intensities in pathological regions within the context of Multiple Sclerosis.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Lladó, X., Oliver, A., Cabezas, M., Freixenet, J., Vilanova, J.C., Quiles, A., Valls, L., Ramió, L., Rovira, A.: Segmentation of multiple sclerosis lesions in brain MRI: a review of automated approaches. Inf. Sci. 186(1), 164–185 (2012)CrossRef Lladó, X., Oliver, A., Cabezas, M., Freixenet, J., Vilanova, J.C., Quiles, A., Valls, L., Ramió, L., Rovira, A.: Segmentation of multiple sclerosis lesions in brain MRI: a review of automated approaches. Inf. Sci. 186(1), 164–185 (2012)CrossRef
2.
go back to reference Gordillo, N., Montseny, E., Sobrevilla, P.: State of the art survey on MRI brain tumor segmentation. Magn. Reson. Imaging 31(8), 1426–1438 (2013)CrossRef Gordillo, N., Montseny, E., Sobrevilla, P.: State of the art survey on MRI brain tumor segmentation. Magn. Reson. Imaging 31(8), 1426–1438 (2013)CrossRef
3.
go back to reference Rekik, I., Allassonnière, S., Carpenter, T.K., Wardlaw, J.M.: Medical image analysis methods in MR/CT-imaged acute-subacute ischemic stroke lesion: segmentation, prediction and insights into dynamic evolution simulation models. A critical appraisal. NeuroImage Clin. 1(1), 164–178 (2012)CrossRef Rekik, I., Allassonnière, S., Carpenter, T.K., Wardlaw, J.M.: Medical image analysis methods in MR/CT-imaged acute-subacute ischemic stroke lesion: segmentation, prediction and insights into dynamic evolution simulation models. A critical appraisal. NeuroImage Clin. 1(1), 164–178 (2012)CrossRef
4.
go back to reference Ceccarelli, A., Jackson, J., Tauhid, S., Arora, A., Gorky, J., Dell’Oglio, E., Bakshi, A., Chitnis, T., Khoury, S., Weiner, H., Guttmann, C., Bakshi, R., Neema, M.: The impact of lesion in-painting and registration methods on voxel-based morphometry in detecting regional cerebral gray matter atrophy in multiple sclerosis. Am. J. Neuroradiol. 33(8), 1579–1585 (2012)CrossRef Ceccarelli, A., Jackson, J., Tauhid, S., Arora, A., Gorky, J., Dell’Oglio, E., Bakshi, A., Chitnis, T., Khoury, S., Weiner, H., Guttmann, C., Bakshi, R., Neema, M.: The impact of lesion in-painting and registration methods on voxel-based morphometry in detecting regional cerebral gray matter atrophy in multiple sclerosis. Am. J. Neuroradiol. 33(8), 1579–1585 (2012)CrossRef
5.
go back to reference Govindarajan, K.A., Datta, S., Hasan, K.M., Choi, S., Rahbar, M.H., Cofield, S.S., Cutter, G.R., Lublin, F.D., Wolinsky, J.S., Narayana, P.A., MRI Analysis Center at Houston, T.C.I.G.: Effect of in-painting on cortical thickness measurements in multiple sclerosis: a large cohort study. Hum. Brain Mapp. 36(10), 3749–3760 (2015) Govindarajan, K.A., Datta, S., Hasan, K.M., Choi, S., Rahbar, M.H., Cofield, S.S., Cutter, G.R., Lublin, F.D., Wolinsky, J.S., Narayana, P.A., MRI Analysis Center at Houston, T.C.I.G.: Effect of in-painting on cortical thickness measurements in multiple sclerosis: a large cohort study. Hum. Brain Mapp. 36(10), 3749–3760 (2015)
6.
go back to reference Sdika, M., Pelletier, D.: Nonrigid registration of MS brain images using lesion inpainting for morphometry or lesion mapping. Hum. Brain Mapp. 30(4), 1060–1067 (2009)CrossRef Sdika, M., Pelletier, D.: Nonrigid registration of MS brain images using lesion inpainting for morphometry or lesion mapping. Hum. Brain Mapp. 30(4), 1060–1067 (2009)CrossRef
7.
go back to reference Chard, D.T., Jackson, J.S., Miller, D.H., Wheeler-Kingshott, C.: Reducing the impact of white matter lesions on automated measures of brain gray and white matter volumes. J. Magn. Reson. Imaging 32(1), 223–228 (2010)CrossRef Chard, D.T., Jackson, J.S., Miller, D.H., Wheeler-Kingshott, C.: Reducing the impact of white matter lesions on automated measures of brain gray and white matter volumes. J. Magn. Reson. Imaging 32(1), 223–228 (2010)CrossRef
8.
go back to reference Battaglini, M., Jenkinson, M., De Stefano, N.: Evaluating and reducing the impact of white matter lesions on brain volume measurements. HBM 33(9), 2062–71 (2012)CrossRef Battaglini, M., Jenkinson, M., De Stefano, N.: Evaluating and reducing the impact of white matter lesions on brain volume measurements. HBM 33(9), 2062–71 (2012)CrossRef
9.
go back to reference Guizard, N., Nakamura, K., Coupe, P., Arnold, D.L., Collins, D.L.: Non-local MS MRI lesion inpainting method for image processing. In: The endMS Conference (2013) Guizard, N., Nakamura, K., Coupe, P., Arnold, D.L., Collins, D.L.: Non-local MS MRI lesion inpainting method for image processing. In: The endMS Conference (2013)
10.
go back to reference Prados, F., Cardoso, M.J., MacManus, D., Wheeler-Kingshott, C.A.M., Ourselin, S.: A modality-agnostic patch-based technique for lesion filling in multiple sclerosis. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8674, pp. 781–788. Springer, Cham (2014). doi:10.1007/978-3-319-10470-6_97 Prados, F., Cardoso, M.J., MacManus, D., Wheeler-Kingshott, C.A.M., Ourselin, S.: A modality-agnostic patch-based technique for lesion filling in multiple sclerosis. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8674, pp. 781–788. Springer, Cham (2014). doi:10.​1007/​978-3-319-10470-6_​97
11.
go back to reference Guizard, N., Nakamura, K., Coupé, P., Vladimir, S., Fonov, V., Arnold, D., Collins, D.: Non-local means inpainting of MS lesions in longitudinal image processing. Front. Neurosci. 9, 456 (2015)CrossRef Guizard, N., Nakamura, K., Coupé, P., Vladimir, S., Fonov, V., Arnold, D., Collins, D.: Non-local means inpainting of MS lesions in longitudinal image processing. Front. Neurosci. 9, 456 (2015)CrossRef
12.
go back to reference Prados, F., Cardoso, M.J., Kanber, B., Ciccarelli, O., Kapoor, R., Wheeler-Kingshott, C.A.G., Ourselin, S.: A multi-time-point modality-agnostic patch-based method for lesion filling in multiple sclerosis. NeuroImage 139, 376–384 (2016)CrossRef Prados, F., Cardoso, M.J., Kanber, B., Ciccarelli, O., Kapoor, R., Wheeler-Kingshott, C.A.G., Ourselin, S.: A multi-time-point modality-agnostic patch-based method for lesion filling in multiple sclerosis. NeuroImage 139, 376–384 (2016)CrossRef
13.
go back to reference Barnes, C., Shechtman, E., Goldman, D.B., Finkelstein, A.: The generalized patchmatch correspondence algorithm. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6313, pp. 29–43. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15558-1_3 CrossRef Barnes, C., Shechtman, E., Goldman, D.B., Finkelstein, A.: The generalized patchmatch correspondence algorithm. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6313, pp. 29–43. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-15558-1_​3 CrossRef
14.
go back to reference Shi, W., Caballero, J., Ledig, C., Zhuang, X., Bai, W., Bhatia, K., Marvao, A.M.S.M., Dawes, T., O’Regan, D., Rueckert, D.: Cardiac image super-resolution with global correspondence using multi-atlas PatchMatch. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013. LNCS, vol. 8151, pp. 9–16. Springer, Heidelberg (2013). doi:10.1007/978-3-642-40760-4_2 CrossRef Shi, W., Caballero, J., Ledig, C., Zhuang, X., Bai, W., Bhatia, K., Marvao, A.M.S.M., Dawes, T., O’Regan, D., Rueckert, D.: Cardiac image super-resolution with global correspondence using multi-atlas PatchMatch. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013. LNCS, vol. 8151, pp. 9–16. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-40760-4_​2 CrossRef
15.
go back to reference Ta, V.-T., Giraud, R., Collins, D.L., Coupé, P.: Optimized PatchMatch for near real time and accurate label fusion. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8675, pp. 105–112. Springer, Cham (2014). doi:10.1007/978-3-319-10443-0_14 Ta, V.-T., Giraud, R., Collins, D.L., Coupé, P.: Optimized PatchMatch for near real time and accurate label fusion. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8675, pp. 105–112. Springer, Cham (2014). doi:10.​1007/​978-3-319-10443-0_​14
16.
go back to reference Giraud, R., Ta, V.T., Papadakis, N., Manjon, J.V., Collins, D.L., Coupe, P.: An optimized patchmatch for multi-scale and multi-feature label fusion. NeuroImage 124(Pt. A), 770–782 (2016) Giraud, R., Ta, V.T., Papadakis, N., Manjon, J.V., Collins, D.L., Coupe, P.: An optimized patchmatch for multi-scale and multi-feature label fusion. NeuroImage 124(Pt. A), 770–782 (2016)
17.
go back to reference Prados, F., Cardoso, M.J., Cawley, N., Ciccarelli, O., Wheeler-Kingshott, C.A., Ourselin, S.: Multi-contrast patchmatch algorithm for multiple sclerosis lesion detection. In: ISBI 2015 - Longitudinal MS Lesion Segmentation Challenge, pp. 1–2 (2015) Prados, F., Cardoso, M.J., Cawley, N., Ciccarelli, O., Wheeler-Kingshott, C.A., Ourselin, S.: Multi-contrast patchmatch algorithm for multiple sclerosis lesion detection. In: ISBI 2015 - Longitudinal MS Lesion Segmentation Challenge, pp. 1–2 (2015)
18.
go back to reference Xu, Z., Bagci, U., Seidel, J., Thomasson, D., Solomon, J., Mollura, D.J.: Segmentation based denoising of PET images: an iterative approach via regional means and affinity propagation. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8673, pp. 698–705. Springer, Cham (2014). doi:10.1007/978-3-319-10404-1_87 Xu, Z., Bagci, U., Seidel, J., Thomasson, D., Solomon, J., Mollura, D.J.: Segmentation based denoising of PET images: an iterative approach via regional means and affinity propagation. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8673, pp. 698–705. Springer, Cham (2014). doi:10.​1007/​978-3-319-10404-1_​87
19.
go back to reference Boyes, R.G., Gunter, J.L., Frost, C., Janke, A.L., Yeatman, T., Hill, D.L.G., Bernstein, M.A., Thompson, P.M., Weiner, M.W., Schuff, N., Alexander, G.E., Killiany, R.J., DeCarli, C., Jack, C.R., Fox, N.C.: Intensity non-uniformity correction using N3 on 3-T scanners. NeuroImage 39(4), 1752–1762 (2008) Boyes, R.G., Gunter, J.L., Frost, C., Janke, A.L., Yeatman, T., Hill, D.L.G., Bernstein, M.A., Thompson, P.M., Weiner, M.W., Schuff, N., Alexander, G.E., Killiany, R.J., DeCarli, C., Jack, C.R., Fox, N.C.: Intensity non-uniformity correction using N3 on 3-T scanners. NeuroImage 39(4), 1752–1762 (2008)
20.
go back to reference Buades, A., Coll, B., Morel, J.M.: A review of image denoising algorithms, with a new one. Multiscale Model. Simul. 4(2), 490–530 (2005)MathSciNetCrossRefMATH Buades, A., Coll, B., Morel, J.M.: A review of image denoising algorithms, with a new one. Multiscale Model. Simul. 4(2), 490–530 (2005)MathSciNetCrossRefMATH
21.
go back to reference Cardoso, M.J., Wolz, R., Modat, M., Fox, N.C., Rueckert, D., Ourselin, S.: Geodesic information flows. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds.) MICCAI 2012. LNCS, vol. 7511, pp. 262–270. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33418-4_33 CrossRef Cardoso, M.J., Wolz, R., Modat, M., Fox, N.C., Rueckert, D., Ourselin, S.: Geodesic information flows. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds.) MICCAI 2012. LNCS, vol. 7511, pp. 262–270. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33418-4_​33 CrossRef
Metadata
Title
Fully Automated Patch-Based Image Restoration: Application to Pathology Inpainting
Authors
Ferran Prados
M. Jorge Cardoso
Niamh Cawley
Baris Kanber
Olga Ciccarelli
Claudia A. M. Gandini Wheeler-Kingshott
Sébastien Ourselin
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-55524-9_1

Premium Partner