Skip to main content
Top

2015 | OriginalPaper | Chapter

A Two-Step Image Inpainting Algorithm Using Tensor SVD

Authors : Mrinmoy Ghorai, Sekhar Mandal, Bhabatosh Chanda

Published in: Computer Vision - ACCV 2014 Workshops

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we present a novel exemplar-based image inpainting algorithm using the higher order singular value decomposition (HOSVD). The proposed method performs inpainting of the target image in two steps. At the first step, the target region is inpainted using HOSVD-based filtering of the candidate patches selected from the source region. It helps to propagate the structure and color smoothly in the target region and restrict to appear unwanted artifacts. But a smoothing effect may be visible in the texture regions due to the filtering. In the second step, we recover the texture by an efficient heuristic approach using the already inpainted image. The experimental results show the superiority of the proposed method compared to the state of the art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Bertalmio, M., Sapiro, G.: Image inpainting. In: Proceedings of the ACM SIGGRAPH Conference on Computer Graphics, New York, USA, pp. 417–424 (2000) Bertalmio, M., Sapiro, G.: Image inpainting. In: Proceedings of the ACM SIGGRAPH Conference on Computer Graphics, New York, USA, pp. 417–424 (2000)
2.
go back to reference Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Process. 13, 1200–1212 (2004)CrossRef Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Process. 13, 1200–1212 (2004)CrossRef
3.
go back to reference Chan, T., Shen, J.: Non-texture inpainting by curvature-driven diffusions. J. Vis. Commun. Image Represent. 12, 436–449 (2001)CrossRef Chan, T., Shen, J.: Non-texture inpainting by curvature-driven diffusions. J. Vis. Commun. Image Represent. 12, 436–449 (2001)CrossRef
4.
go back to reference Efros, A., Leung, T.: Texture synthesis by non-parametric sampling. In: Proceedings of the IEEE International Conference on Computer Vision, vol. 2, pp. 1033–1038 (1999) Efros, A., Leung, T.: Texture synthesis by non-parametric sampling. In: Proceedings of the IEEE International Conference on Computer Vision, vol. 2, pp. 1033–1038 (1999)
5.
go back to reference Fadili, M.J., Starck, J.L., Murtagh, F.: Inpainting and zooming using sparse representations. Comput. J. 52, 64–79 (2009)CrossRef Fadili, M.J., Starck, J.L., Murtagh, F.: Inpainting and zooming using sparse representations. Comput. J. 52, 64–79 (2009)CrossRef
6.
go back to reference Shen, B., Hu, W., Zhang, Y., Zhang, Y.: Image inpainting via sparse representation. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 697–700 (2009) Shen, B., Hu, W., Zhang, Y., Zhang, Y.: Image inpainting via sparse representation. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 697–700 (2009)
7.
go back to reference Xu, Z., Sun, J.: Image inpainting by patch propagation using patch sparsity. IEEE Trans. Image Process. 19, 1153–1165 (2010)CrossRefMathSciNet Xu, Z., Sun, J.: Image inpainting by patch propagation using patch sparsity. IEEE Trans. Image Process. 19, 1153–1165 (2010)CrossRefMathSciNet
8.
go back to reference Komodakis, N., Tziritas, G.: Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE Trans. Image Process. 16, 2649–2661 (2007)CrossRefMathSciNet Komodakis, N., Tziritas, G.: Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE Trans. Image Process. 16, 2649–2661 (2007)CrossRefMathSciNet
9.
go back to reference Liu, Y., Caselles, V.: Exemplar-based image inpainting using multiscale graph cuts. IEEE Trans. Image Process. 22, 1699–1711 (2013)CrossRefMathSciNet Liu, Y., Caselles, V.: Exemplar-based image inpainting using multiscale graph cuts. IEEE Trans. Image Process. 22, 1699–1711 (2013)CrossRefMathSciNet
10.
go back to reference Le Meur, O., Guillemot, C.: Super-resolution-based inpainting. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VI. LNCS, vol. 7577, pp. 554–567. Springer, Heidelberg (2012) CrossRef Le Meur, O., Guillemot, C.: Super-resolution-based inpainting. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VI. LNCS, vol. 7577, pp. 554–567. Springer, Heidelberg (2012) CrossRef
11.
go back to reference Meur, O.L., Ebdelli, M., Guillemot, C.: Heigherchical super-resolution-based inpainting. IEEE Trans. Image Process. 22, 3779–3790 (2013)CrossRefMathSciNet Meur, O.L., Ebdelli, M., Guillemot, C.: Heigherchical super-resolution-based inpainting. IEEE Trans. Image Process. 22, 3779–3790 (2013)CrossRefMathSciNet
12.
go back to reference Constantini, R., Sbaiz, L., Susstrunk, S.: Higher order SVD analysis for dynamic texture synthesis. IEEE Trans. Image Process. 17, 42–52 (2008)CrossRefMathSciNet Constantini, R., Sbaiz, L., Susstrunk, S.: Higher order SVD analysis for dynamic texture synthesis. IEEE Trans. Image Process. 17, 42–52 (2008)CrossRefMathSciNet
13.
go back to reference Rajwade, A., Rangarajan, A., Banerjee, A.: Image denoising using the higher order singular value decomposition. IEEE Trans. Pattern Anal. Mach. Intell. 35, 849–862 (2013)CrossRef Rajwade, A., Rangarajan, A., Banerjee, A.: Image denoising using the higher order singular value decomposition. IEEE Trans. Pattern Anal. Mach. Intell. 35, 849–862 (2013)CrossRef
14.
go back to reference Bugeau, A., Bertalmio, M., Caselles, V.: A comprehensive framework for image inpainting. IEEE Trans. Image Process. 19, 2634–2645 (2010)CrossRefMathSciNet Bugeau, A., Bertalmio, M., Caselles, V.: A comprehensive framework for image inpainting. IEEE Trans. Image Process. 19, 2634–2645 (2010)CrossRefMathSciNet
15.
go back to reference Wexler, Y., Shechtman, E., Irani, M.: Space-time completion of video. IEEE Trans. Pattern Anal. Mach. Intell. 29, 463–476 (2007)CrossRef Wexler, Y., Shechtman, E., Irani, M.: Space-time completion of video. IEEE Trans. Pattern Anal. Mach. Intell. 29, 463–476 (2007)CrossRef
16.
go back to reference Lathauwer, L.D.: Signal processing based on multilinear algebre. Ph.D. dissertation, Katholieke Universiteit Leuven, April 2013 Lathauwer, L.D.: Signal processing based on multilinear algebre. Ph.D. dissertation, Katholieke Universiteit Leuven, April 2013
17.
go back to reference Yedidia, J., Freeman, W., Weiss, Y.: Constructing free energy approximations and generalized belief propagation algorithms. IEEE Trans. Inf. Theor. 51, 2282–2312 (2005)CrossRefMATHMathSciNet Yedidia, J., Freeman, W., Weiss, Y.: Constructing free energy approximations and generalized belief propagation algorithms. IEEE Trans. Inf. Theor. 51, 2282–2312 (2005)CrossRefMATHMathSciNet
18.
go back to reference Aharon, M., Elad, M., Bruckstein, A.: The K-SVD: an algorithm for designing of overcomplete dictionaries for sparse representation. IEEE. Trans. Signal Process. 54, 4311–4322 (2006)CrossRef Aharon, M., Elad, M., Bruckstein, A.: The K-SVD: an algorithm for designing of overcomplete dictionaries for sparse representation. IEEE. Trans. Signal Process. 54, 4311–4322 (2006)CrossRef
19.
go back to reference Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process 16, 2080–2095 (2007)CrossRefMathSciNet Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process 16, 2080–2095 (2007)CrossRefMathSciNet
20.
go back to reference Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 151–158, September 2009 Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 151–158, September 2009
21.
go back to reference He, K., Sun, J.: Statistics of patch offsets for image completion. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 16–29. Springer, Heidelberg (2012) CrossRef He, K., Sun, J.: Statistics of patch offsets for image completion. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 16–29. Springer, Heidelberg (2012) CrossRef
Metadata
Title
A Two-Step Image Inpainting Algorithm Using Tensor SVD
Authors
Mrinmoy Ghorai
Sekhar Mandal
Bhabatosh Chanda
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-16631-5_5

Premium Partner