Skip to main content
Top

2017 | OriginalPaper | Chapter

Scale-Invariant Image Inpainting Using Gradient-Based Image Composition

Authors : Mrinmoy Ghorai, Soumitra Samanta, Bhabatosh Chanda

Published in: Computer Vision, Graphics, and Image Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose a novel scale-invariant image inpainting algorithm that combines several inpainted images obtained from multiple pyramids of different coarsest scales. To achieve this, first we build the pyramids and then we run an image inpainting algorithm individually on each of the pyramids to obtain different inpainted images. Finally, we combine those inpainted images by a gradient based approach to obtain the final inpainted image. The motivation of this approach is to solve the problem of appearing artifacts in traditional single pyramid-based approach since the results depend on the starting scale of the pyramid. Here we assume that most of the inpainted images produced by the pyramids are quite good. However, some of them may have artifacts and these artifacts are eliminated by gradient based image composition. We test the proposed algorithm on a large number of natural images and compare the results with some of the existing methods to demonstrate the efficacy and superiority of the proposed method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: Patch-Match: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28(3), 1–11 (2009)CrossRef Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: Patch-Match: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28(3), 1–11 (2009)CrossRef
2.
go back to reference Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2004)CrossRef Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2004)CrossRef
3.
go back to reference Darabi, S., Shechtman, E., Barnes, C., Goldman, D.B., Sen, P.: Image melding: combining inconsistent images using patch-based synthesis. ACM Trans. Graph. (TOG) 31(4), 82:1–82:10 (2012)CrossRef Darabi, S., Shechtman, E., Barnes, C., Goldman, D.B., Sen, P.: Image melding: combining inconsistent images using patch-based synthesis. ACM Trans. Graph. (TOG) 31(4), 82:1–82:10 (2012)CrossRef
4.
go back to reference Efros, A., Leung, T.: Texture synthesis by non-parametric sampling. In: Proceedings of the IEEE International Conference on Computer Vision, vol. 2, pp. 1033–1038 (1999) Efros, A., Leung, T.: Texture synthesis by non-parametric sampling. In: Proceedings of the IEEE International Conference on Computer Vision, vol. 2, pp. 1033–1038 (1999)
5.
go back to reference Fadili, M.J., Starck, J.L., Murtagh, F.: Inpainting and zooming using sparse representations. Comput. J. 52(1), 64–79 (2009)CrossRef Fadili, M.J., Starck, J.L., Murtagh, F.: Inpainting and zooming using sparse representations. Comput. J. 52(1), 64–79 (2009)CrossRef
6.
go back to reference Fang, C.-W., Lien, J.-J.J.: Rapid image completion system using multiresolution patch-based directional and nondirectional approaches. IEEE Trans. Image Process. 18(12), 2769–2779 (2009)CrossRefMATHMathSciNet Fang, C.-W., Lien, J.-J.J.: Rapid image completion system using multiresolution patch-based directional and nondirectional approaches. IEEE Trans. Image Process. 18(12), 2769–2779 (2009)CrossRefMATHMathSciNet
7.
go back to reference Freedman, G., Fattal, R.: Image and video upscaling from local self-examples. ACM Trans. Graph. (TOG) 30(2), 12 (2011)CrossRef Freedman, G., Fattal, R.: Image and video upscaling from local self-examples. ACM Trans. Graph. (TOG) 30(2), 12 (2011)CrossRef
8.
go back to reference Ghorai, M., Chanda, B.: An image inpainting algorithm using higher order singular value decomposition. In: 2014 22nd International Conference on Pattern Recognition (ICPR), pp. 2867–2872. IEEE (2014) Ghorai, M., Chanda, B.: An image inpainting algorithm using higher order singular value decomposition. In: 2014 22nd International Conference on Pattern Recognition (ICPR), pp. 2867–2872. IEEE (2014)
9.
go back to reference Ghorai, M., Chanda, B.: An image inpainting method using pLSA-based search space estimation. Mach. Vis. Appl. 26(1), 69–87 (2015)CrossRef Ghorai, M., Chanda, B.: An image inpainting method using pLSA-based search space estimation. Mach. Vis. Appl. 26(1), 69–87 (2015)CrossRef
10.
go back to reference Komodakis, N., Tziritas, G.: Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE Trans. Image Process. 16(11), 2649–2661 (2007)CrossRefMathSciNet Komodakis, N., Tziritas, G.: Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE Trans. Image Process. 16(11), 2649–2661 (2007)CrossRefMathSciNet
11.
go back to reference Le Meur, O., Gautier, J., Guillemot, C.: Examplar-based inpainting based on local geometry. In: 2011 18th IEEE International Conference on Image Processing, pp. 3401–3404. IEEE (2011) Le Meur, O., Gautier, J., Guillemot, C.: Examplar-based inpainting based on local geometry. In: 2011 18th IEEE International Conference on Image Processing, pp. 3401–3404. IEEE (2011)
12.
go back to reference Li, Z., He, H., Tai, H.-M., Yin, Z., Chen, F.: Color-direction patch-sparsity-based image inpainting using multidirection features. IEEE Trans. Image Process. 24(3), 1138–1152 (2015)CrossRefMathSciNet Li, Z., He, H., Tai, H.-M., Yin, Z., Chen, F.: Color-direction patch-sparsity-based image inpainting using multidirection features. IEEE Trans. Image Process. 24(3), 1138–1152 (2015)CrossRefMathSciNet
13.
go back to reference Liu, Y., Caselles, V.: Exemplar-based image inpainting using multiscale graph cuts. IEEE Trans. Image Process. 22(5), 1699–1711 (2013)CrossRefMATHMathSciNet Liu, Y., Caselles, V.: Exemplar-based image inpainting using multiscale graph cuts. IEEE Trans. Image Process. 22(5), 1699–1711 (2013)CrossRefMATHMathSciNet
14.
go back to reference Mertens, T., Kautz, J., Van Reeth, F.: Exposure fusion: a simple and practical alternative to high dynamic range photography. In: Computer Graphics Forum, vol. 28, pp. 161–171. Wiley Online Library (2009) Mertens, T., Kautz, J., Van Reeth, F.: Exposure fusion: a simple and practical alternative to high dynamic range photography. In: Computer Graphics Forum, vol. 28, pp. 161–171. Wiley Online Library (2009)
15.
go back to reference Qin, Y., Wang, F.: A curvature constraint exemplar-based image inpainting. In: International Conference on Image Processing and Signal Processing, pp. 263–267 (2010) Qin, Y., Wang, F.: A curvature constraint exemplar-based image inpainting. In: International Conference on Image Processing and Signal Processing, pp. 263–267 (2010)
16.
go back to reference Shen, B., Hu, W., Zhang, Y., Zhang, Y.: Image inpainting via sparse representation. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 697–700 (2009) Shen, B., Hu, W., Zhang, Y., Zhang, Y.: Image inpainting via sparse representation. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 697–700 (2009)
17.
go back to reference Sun, J., Yuan, L., Jia, J., Shum, H.: Image completion with structure propagation. In: Proceedings of the SIGGRAPH2005, pp. 861–868 (2005) Sun, J., Yuan, L., Jia, J., Shum, H.: Image completion with structure propagation. In: Proceedings of the SIGGRAPH2005, pp. 861–868 (2005)
18.
go back to reference Wohlberg, B.: Inpainting by joint optimization of linear combinations of exemplars. IEEE Signal Process. Lett. 18(1), 75–78 (2011)CrossRef Wohlberg, B.: Inpainting by joint optimization of linear combinations of exemplars. IEEE Signal Process. Lett. 18(1), 75–78 (2011)CrossRef
19.
go back to reference Wu, J., Ruan, Q.: Object removal by cross isophotes exemplar-based inpainting. In: Proceedings of the 18th International Conference on Pattern Recognition, vol. 3, pp. 810–813 (2006) Wu, J., Ruan, Q.: Object removal by cross isophotes exemplar-based inpainting. In: Proceedings of the 18th International Conference on Pattern Recognition, vol. 3, pp. 810–813 (2006)
20.
21.
go back to reference Yang, M.-C., Wang, C.-H., Hu, T.-Y., Wang, Y.-C.F.: Learning context-aware sparse representation for single image super-resolution. In: 2011 18th IEEE International Conference on Image Processing, pp. 1349–1352. IEEE (2011) Yang, M.-C., Wang, C.-H., Hu, T.-Y., Wang, Y.-C.F.: Learning context-aware sparse representation for single image super-resolution. In: 2011 18th IEEE International Conference on Image Processing, pp. 1349–1352. IEEE (2011)
22.
go back to reference Zhang, K., Gao, X., Tao, D., Li, X.: Single image super-resolution with multiscale similarity learning. IEEE Trans. Neural Netw. Learn. Syst. 24(10), 1648–1659 (2013)CrossRef Zhang, K., Gao, X., Tao, D., Li, X.: Single image super-resolution with multiscale similarity learning. IEEE Trans. Neural Netw. Learn. Syst. 24(10), 1648–1659 (2013)CrossRef
23.
Metadata
Title
Scale-Invariant Image Inpainting Using Gradient-Based Image Composition
Authors
Mrinmoy Ghorai
Soumitra Samanta
Bhabatosh Chanda
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-68124-5_9

Premium Partner