Skip to main content

2019 | OriginalPaper | Buchkapitel

Image Inpainting Based on Local Patch Search Supported by Image Segmentation

verfasst von : Sarah Almeida Carneiro, Helio Pedrini, Silvio Jamil Ferzoli Guimarães

Erschienen in: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Image inpainting can be defined as a restoration process in which damaged or selected regions are repaired by taking into account the image content. In this work, we employ a local-based strategy instead of a global one to identify the best existing patch with information to replace the damaged/selected patch. In order to properly identify the most representative patches, we propose a method based on the (i) creation of a local graph using a similarity of patches in the original image and (ii) partition of the image into regions according to hierarchical image segmentation to support the local patch identification. The experimental results demonstrate that our local search outperformed the results of image inpainting in terms of both qualitative and quantitative aspects, when compared to global search of patches.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ambrosio, L., Fusco, N., Hutchinson, J.E.: Higher integrability of the gradient and dimension of the singular set for minimisers of the Mumford-Shah functional. Calc. Var. Partial. Differ. Equ. 16(2), 187–215 (2003)MathSciNetCrossRef Ambrosio, L., Fusco, N., Hutchinson, J.E.: Higher integrability of the gradient and dimension of the singular set for minimisers of the Mumford-Shah functional. Calc. Var. Partial. Differ. Equ. 16(2), 187–215 (2003)MathSciNetCrossRef
2.
Zurück zum Zitat Bertalmio, M., Bertozzi, A.L., Sapiro, G.: Navier-stokes, fluid dynamics, and image and video inpainting. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1. IEEE (2001) Bertalmio, M., Bertozzi, A.L., Sapiro, G.: Navier-stokes, fluid dynamics, and image and video inpainting. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1. IEEE (2001)
3.
Zurück zum Zitat Bertalmio, M., Caselles, V., Masnou, S., Sapiro, G.: Inpainting. Technical report, Duke University (2011) Bertalmio, M., Caselles, V., Masnou, S., Sapiro, G.: Inpainting. Technical report, Duke University (2011)
4.
Zurück zum Zitat Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 417–424. ACM Press/Addison-Wesley Publishing Co. (2000) Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 417–424. ACM Press/Addison-Wesley Publishing Co. (2000)
5.
Zurück zum Zitat Cousty, J., Najman, L., Kenmochi, Y., Guimarães, S.: Hierarchical segmentations with graphs: quasi-flat zones, minimum spanning trees, and saliency maps. J. Math. Imaging Vis. 60, 479–502 (2017)MathSciNetCrossRef Cousty, J., Najman, L., Kenmochi, Y., Guimarães, S.: Hierarchical segmentations with graphs: quasi-flat zones, minimum spanning trees, and saliency maps. J. Math. Imaging Vis. 60, 479–502 (2017)MathSciNetCrossRef
6.
Zurück zum Zitat Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2004)CrossRef Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2004)CrossRef
7.
Zurück zum Zitat Defferrard, M.: Graph-based image inpainting. Technical report, École Polytechnique Fédérale de Lausanne (EFPL) (2014) Defferrard, M.: Graph-based image inpainting. Technical report, École Polytechnique Fédérale de Lausanne (EFPL) (2014)
8.
Zurück zum Zitat Efros, A., Leung, T.: Texture synthesis by non-parametric sampling. In: Seventh IEEE International Conference on Computer Vision, p. 1033. IEEE, September 1999 Efros, A., Leung, T.: Texture synthesis by non-parametric sampling. In: Seventh IEEE International Conference on Computer Vision, p. 1033. IEEE, September 1999
9.
Zurück zum Zitat Fan, Q., Zhang, L.: A novel patch matching algorithm for exemplar-based image inpainting. Multimedia Tools Appl. 77, 1–15 (2017) Fan, Q., Zhang, L.: A novel patch matching algorithm for exemplar-based image inpainting. Multimedia Tools Appl. 77, 1–15 (2017)
10.
Zurück zum Zitat Guillemot, C., Le Meur, O.: Image inpainting: overview and recent advances. IEEE Signal Process. Mag. 31(1), 127–144 (2014)CrossRef Guillemot, C., Le Meur, O.: Image inpainting: overview and recent advances. IEEE Signal Process. Mag. 31(1), 127–144 (2014)CrossRef
11.
Zurück zum Zitat Karaca, E., Tunga, M.A.: An interpolation-based texture and pattern preserving algorithm for inpainting color image. Expert Syst. Appl. 91, 223–234 (2018)CrossRef Karaca, E., Tunga, M.A.: An interpolation-based texture and pattern preserving algorithm for inpainting color image. Expert Syst. Appl. 91, 223–234 (2018)CrossRef
12.
Zurück zum Zitat Masnou, S., Morel, J.-M.: Level Lines based disocclusion. In: International Conference on Image Processing, pp. 259–263. IEEE (1998) Masnou, S., Morel, J.-M.: Level Lines based disocclusion. In: International Conference on Image Processing, pp. 259–263. IEEE (1998)
13.
Zurück zum Zitat Ogden, J.M., Adelson, E.H., Bergen, J.R., Burt, P.J.: Pyramid-based computer graphics. RCA Eng. 30(5), 4–15 (1985) Ogden, J.M., Adelson, E.H., Bergen, J.R., Burt, P.J.: Pyramid-based computer graphics. RCA Eng. 30(5), 4–15 (1985)
14.
Zurück zum Zitat Perret, B., Cousty, J., Guimarães, S.J.F., Maia, D.S.: Evaluation of hierarchical watersheds. IEEE Trans. Image Process. 27(4), 1676–1688 (2018)MathSciNetCrossRef Perret, B., Cousty, J., Guimarães, S.J.F., Maia, D.S.: Evaluation of hierarchical watersheds. IEEE Trans. Image Process. 27(4), 1676–1688 (2018)MathSciNetCrossRef
15.
Zurück zum Zitat Qureshi, M.A., Deriche, M., Beghdadi, A., Amin, A.: A critical survey of state-of-the-art image inpainting quality assessment metrics. J. Vis. Commun. Image Represent. 49, 177–191 (2017)CrossRef Qureshi, M.A., Deriche, M., Beghdadi, A., Amin, A.: A critical survey of state-of-the-art image inpainting quality assessment metrics. J. Vis. Commun. Image Represent. 49, 177–191 (2017)CrossRef
17.
Zurück zum Zitat Wang, H., Jiang, L., Liang, R., Li, X.-X.: Exemplar-based image inpainting using structure consistent patch matching. Neurocomputing 269, 90–96 (2017)CrossRef Wang, H., Jiang, L., Liang, R., Li, X.-X.: Exemplar-based image inpainting using structure consistent patch matching. Neurocomputing 269, 90–96 (2017)CrossRef
18.
Zurück zum Zitat Yang, C., Lu, X., Lin, Z., Shechtman, E., Wang, O., Li, H.: High-resolution image inpainting using multi-scale neural patch synthesis. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, p. 3 (2017) Yang, C., Lu, X., Lin, Z., Shechtman, E., Wang, O., Li, H.: High-resolution image inpainting using multi-scale neural patch synthesis. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, p. 3 (2017)
19.
Zurück zum Zitat Zhao, G., Liu, J., Jiang, J., Wang, W.: A deep cascade of neural networks for image inpainting, deblurring and denoising. Multimed. Tools Appl. 77, 1–16 (2017) Zhao, G., Liu, J., Jiang, J., Wang, W.: A deep cascade of neural networks for image inpainting, deblurring and denoising. Multimed. Tools Appl. 77, 1–16 (2017)
Metadaten
Titel
Image Inpainting Based on Local Patch Search Supported by Image Segmentation
verfasst von
Sarah Almeida Carneiro
Helio Pedrini
Silvio Jamil Ferzoli Guimarães
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-13469-3_49

Premium Partner