Skip to main content
Erschienen in: Neural Computing and Applications 1/2018

16.09.2015 | Recent advances in Pattern Recognition and Artificial Intelligence

Nonlocal image denoising via adaptive tensor nuclear norm minimization

verfasst von: Chenyang Zhang, Wenrui Hu, Tianyu Jin, Zhonglei Mei

Erschienen in: Neural Computing and Applications | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nonlocal self-similarity shows great potential in image denoising. Therefore, the denoising performance can be attained by accurately exploiting the nonlocal prior. In this paper, we model nonlocal similar patches through the multi-linear approach and then propose two tensor-based methods for image denoising. Our methods are based on the study of low-rank tensor estimation (LRTE). By exploiting low-rank prior in the tensor presentation of similar patches, we devise two new adaptive tensor nuclear norms (i.e., ATNN-1 and ATNN-2) for the LRTE problem. Among them, ATNN-1 relaxes the general tensor N-rank in a weighting scheme, while ATNN-2 is defined based on a novel tensor singular-value decomposition (t-SVD). Both ATNN-1 and ATNN-2 construct the stronger spatial relationship between patches than the matrix nuclear norm. Regularized by ATNN-1 and ATNN-2 respectively, the derived two LRTE algorithms are implemented through the adaptive singular-value thresholding with global optimal guarantee. Then, we embed the two algorithms into a residual-based iterative framework to perform nonlocal image denoising. Experiments validate the rationality of our tensor low-rank assumption, and the denoising results demonstrate that our proposed two methods are exceeding the state-of-the-art methods, both visually and quantitatively.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Milanfar P (2013) A tour of modern image filtering: new insights and methods, both practical and theoretical. IEEE Signal Process Mag 30(1):106–128CrossRef Milanfar P (2013) A tour of modern image filtering: new insights and methods, both practical and theoretical. IEEE Signal Process Mag 30(1):106–128CrossRef
2.
Zurück zum Zitat Budak C, Tiirk M, Toprak A (2015) Reduction in impulse noise in digital images through a new adaptive artificial neural network model. Neural Comput Appl 26:835–843CrossRef Budak C, Tiirk M, Toprak A (2015) Reduction in impulse noise in digital images through a new adaptive artificial neural network model. Neural Comput Appl 26:835–843CrossRef
4.
Zurück zum Zitat Buades A, Coll B, Morel J (2005) A non-local algorithm for image denoising. CVPR 2:60–65MATH Buades A, Coll B, Morel J (2005) A non-local algorithm for image denoising. CVPR 2:60–65MATH
5.
Zurück zum Zitat Shao L, Yan R, Li X, Liu Y (2014) From heuristic optimization to dictionary learning: a review and comprehensive comparison of image denoising algorithms. IEEE Trans Cybern 44(7):1001–1013CrossRef Shao L, Yan R, Li X, Liu Y (2014) From heuristic optimization to dictionary learning: a review and comprehensive comparison of image denoising algorithms. IEEE Trans Cybern 44(7):1001–1013CrossRef
6.
Zurück zum Zitat Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3D transform-domain collaborative filtering. IEEE Trans Image Process 16(8):2080–2095MathSciNetCrossRef Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3D transform-domain collaborative filtering. IEEE Trans Image Process 16(8):2080–2095MathSciNetCrossRef
7.
Zurück zum Zitat Mairal J, Bach F, Ponce J et al (2009) Non-local sparse models for image restoration. In: 2009 IEEE 12th international conference on computer vision, Kyoto, 29 September–2 October 2009, pp 2272–2279. doi:10.1109/ICCV.2009.5459452 Mairal J, Bach F, Ponce J et al (2009) Non-local sparse models for image restoration. In: 2009 IEEE 12th international conference on computer vision, Kyoto, 29 September–2 October 2009, pp 2272–2279. doi:10.​1109/​ICCV.​2009.​5459452
8.
Zurück zum Zitat Dong W, Zhang L, Shi G, Li X (2013) Nonlocally centralized sparse representation for image restoration. IEEE Trans Image Process 22(4):1620–1630MathSciNetCrossRefMATH Dong W, Zhang L, Shi G, Li X (2013) Nonlocally centralized sparse representation for image restoration. IEEE Trans Image Process 22(4):1620–1630MathSciNetCrossRefMATH
9.
Zurück zum Zitat Wang S, Zhang L, Liang Y (2012) Nonlocal spectral prior model for low-level vision. In: Lee KM, Matsushita Y, Rehg JM, Hu Z (eds) Computer vision – ACCV 2012, vol 7726, pp 231–244 Wang S, Zhang L, Liang Y (2012) Nonlocal spectral prior model for low-level vision. In: Lee KM, Matsushita Y, Rehg JM, Hu Z (eds) Computer vision – ACCV 2012,  vol 7726, pp 231–244
10.
Zurück zum Zitat Dong W, Shi G, Li X (2013) Nonlocal image restoration with bilateral variance estimation: a low-rank approach. IEEE Trans Image Process 22(2):700–711MathSciNetCrossRefMATH Dong W, Shi G, Li X (2013) Nonlocal image restoration with bilateral variance estimation: a low-rank approach. IEEE Trans Image Process 22(2):700–711MathSciNetCrossRefMATH
11.
Zurück zum Zitat Andrews H, Patterson C (1976) Singular value decompositions and digital image processing. IEEE Trans Acoust Speech Signal Process 24(1):26–53CrossRef Andrews H, Patterson C (1976) Singular value decompositions and digital image processing. IEEE Trans Acoust Speech Signal Process 24(1):26–53CrossRef
12.
Zurück zum Zitat Chang S, Yu B, Vetterli M (2000) Adaptive wavelet thresholding for image denoising and compression. IEEE Trans Image Process 9(9):1532–1546MathSciNetCrossRefMATH Chang S, Yu B, Vetterli M (2000) Adaptive wavelet thresholding for image denoising and compression. IEEE Trans Image Process 9(9):1532–1546MathSciNetCrossRefMATH
14.
15.
16.
Zurück zum Zitat Gu S, Zhang L, Zuo W, Feng X (2014) Weighted nuclear norm minimization with application to image denoising. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR), Columbus, 23–28 June 2014, pp 2862–2869. doi:10.1109/CVPR.2014.366 Gu S, Zhang L, Zuo W, Feng X (2014) Weighted nuclear norm minimization with application to image denoising. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR), Columbus, 23–28 June 2014, pp 2862–2869. doi:10.​1109/​CVPR.​2014.​366
17.
Zurück zum Zitat Nguyen T, Park J, Kim S, Lee G (2011) Automatically improving image quality using tensor voting. Neural Comput Appl 20:1017–1026CrossRef Nguyen T, Park J, Kim S, Lee G (2011) Automatically improving image quality using tensor voting. Neural Comput Appl 20:1017–1026CrossRef
18.
Zurück zum Zitat Zhang M, Ding C (2013) Robust tucker tensor decomposition for effective image representation. In: 2013 IEEE international conference on computer vision, Sydney, 1–8 December 2013, pp 2448–2455. doi:10.1109/ICCV.2013.304 Zhang M, Ding C (2013) Robust tucker tensor decomposition for effective image representation. In: 2013 IEEE international conference on computer vision, Sydney, 1–8 December 2013, pp 2448–2455. doi:10.​1109/​ICCV.​2013.​304
19.
Zurück zum Zitat Rajwade A, Rangarajan A, Banerjee A (2013) Image denoising using the higher order singular value decomposition. IEEE Trans Pattern Anal Mach Intell 35(4):849–862CrossRef Rajwade A, Rangarajan A, Banerjee A (2013) Image denoising using the higher order singular value decomposition. IEEE Trans Pattern Anal Mach Intell 35(4):849–862CrossRef
20.
Zurück zum Zitat Lathauwer L, Moor B, Vandewalle J (2000) A multilinear singular value decomposition. SIAM J Matrix Anal Appl 21(4):1253–1278MathSciNetCrossRefMATH Lathauwer L, Moor B, Vandewalle J (2000) A multilinear singular value decomposition. SIAM J Matrix Anal Appl 21(4):1253–1278MathSciNetCrossRefMATH
22.
Zurück zum Zitat Gandy S, Recht B, Yamada I (2011) Tensor completion and low-n-rank tensor recovery via convex optimization. Inverse Probl 27(2):025010MathSciNetCrossRefMATH Gandy S, Recht B, Yamada I (2011) Tensor completion and low-n-rank tensor recovery via convex optimization. Inverse Probl 27(2):025010MathSciNetCrossRefMATH
23.
Zurück zum Zitat Chen Y, Hsu C, Liao H (2014) Simultaneous tensor decomposition and completion using factor priors. IEEE Trans Pattern Anal Mach Intell 36(3):577–591CrossRef Chen Y, Hsu C, Liao H (2014) Simultaneous tensor decomposition and completion using factor priors. IEEE Trans Pattern Anal Mach Intell 36(3):577–591CrossRef
24.
Zurück zum Zitat Chen J, Saad Y (2009) On the tensor SVD and the optimal low rank orthogonal approximation of tensors. SIAM J Matrix Anal Appl 30(4):1709–1734MathSciNetCrossRefMATH Chen J, Saad Y (2009) On the tensor SVD and the optimal low rank orthogonal approximation of tensors. SIAM J Matrix Anal Appl 30(4):1709–1734MathSciNetCrossRefMATH
25.
Zurück zum Zitat Acar E, Dunlavy D, Kolda T, Morup M (2011) Scalable tensor factorization for incomplete data. Chemometrics Intell Lab Syst 106(1):41–56CrossRef Acar E, Dunlavy D, Kolda T, Morup M (2011) Scalable tensor factorization for incomplete data. Chemometrics Intell Lab Syst 106(1):41–56CrossRef
26.
Zurück zum Zitat Liu J, Musialski P, Wonka P, Ye J (2013) Tensor completion for estimating missing values in visual data. IEEE Trans Pattern Anal Mach Intell 35(1):208–220CrossRef Liu J, Musialski P, Wonka P, Ye J (2013) Tensor completion for estimating missing values in visual data. IEEE Trans Pattern Anal Mach Intell 35(1):208–220CrossRef
27.
Zurück zum Zitat Tomioka R, Suzuki T (2013) Convex tensor decomposition via structured schatten norm regularization. In: Advances in neural information processing systems 26, pp 1331–1339 Tomioka R, Suzuki T (2013) Convex tensor decomposition via structured schatten norm regularization. In: Advances in neural information processing systems 26, pp 1331–1339
28.
Zurück zum Zitat Signoretto M, Dinh Q, Lathauwer L, Suykens J (2014) Learning with tensors: a framework based on convex optimization and spectral regularization. Mach Learn 94:303–351MathSciNetCrossRefMATH Signoretto M, Dinh Q, Lathauwer L, Suykens J (2014) Learning with tensors: a framework based on convex optimization and spectral regularization. Mach Learn 94:303–351MathSciNetCrossRefMATH
29.
Zurück zum Zitat Fazel M (2002) Matrix rank minimization with applications. Ph.D. dissertation, Stanford University Fazel M (2002) Matrix rank minimization with applications. Ph.D. dissertation, Stanford University
30.
Zurück zum Zitat Semerci O, Hao Ning, Kilmer M, Milller E (2014) Tensor-based factorization and nuclear norm regularization for multienergy computed tomography. IEEE Trans Image Process 23(4):1678–1693MathSciNetCrossRefMATH Semerci O, Hao Ning, Kilmer M, Milller E (2014) Tensor-based factorization and nuclear norm regularization for multienergy computed tomography. IEEE Trans Image Process 23(4):1678–1693MathSciNetCrossRefMATH
31.
Zurück zum Zitat Kilmer M, Braman K, Hao N, Hoover R (2013) Third-order tensors as operators on matrices: a theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34(1):148–172MathSciNetCrossRefMATH Kilmer M, Braman K, Hao N, Hoover R (2013) Third-order tensors as operators on matrices: a theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34(1):148–172MathSciNetCrossRefMATH
32.
Zurück zum Zitat Zhang Z, Ely G, Aeron S et al (2014) Novel methods for multilinear data completion and de-noising based on tensor-SVD. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR), pp 3842–3849. doi:10.1109/CVPR.2014.485 Zhang Z, Ely G, Aeron S et al (2014) Novel methods for multilinear data completion and de-noising based on tensor-SVD. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR), pp 3842–3849. doi:10.​1109/​CVPR.​2014.​485
33.
Zurück zum Zitat Georges F, Nadakuditi R (2012) The singular values and vectors of low rank perturbations of large rectangular random matrices. J Multivar Anal 111:120–135MathSciNetCrossRefMATH Georges F, Nadakuditi R (2012) The singular values and vectors of low rank perturbations of large rectangular random matrices. J Multivar Anal 111:120–135MathSciNetCrossRefMATH
34.
Zurück zum Zitat Stewart G (1990) Perturbation theory for the singular value decomposition. Technical Report UMIACS-TR-90-124 Stewart G (1990) Perturbation theory for the singular value decomposition. Technical Report UMIACS-TR-90-124
35.
Zurück zum Zitat Golub G, Hoffman A, Stewart G (1987) A generalization of the Eckart-Young-Mirsky matrix approximation theorem. Linear Algebra Appl 88:317–327MathSciNetCrossRefMATH Golub G, Hoffman A, Stewart G (1987) A generalization of the Eckart-Young-Mirsky matrix approximation theorem. Linear Algebra Appl 88:317–327MathSciNetCrossRefMATH
36.
Zurück zum Zitat Nadakuditi R (2014) OptShrink: an algorithm for improved low-rank signal matrix denoising by optimal, data-driven singular value shrinkage. IEEE Trans Inf Theory 60(5):3002–3018MathSciNetCrossRefMATH Nadakuditi R (2014) OptShrink: an algorithm for improved low-rank signal matrix denoising by optimal, data-driven singular value shrinkage. IEEE Trans Inf Theory 60(5):3002–3018MathSciNetCrossRefMATH
37.
Zurück zum Zitat Boyd S, Parikh N, Chu E et al (2010) Distributed optimization and statistical learning via the alternating direction method and multipliers. Found Trends Mach Learn 3(1):1–122CrossRefMATH Boyd S, Parikh N, Chu E et al (2010) Distributed optimization and statistical learning via the alternating direction method and multipliers. Found Trends Mach Learn 3(1):1–122CrossRefMATH
38.
Zurück zum Zitat Lin Z, Chen M, Ma Y (2009) The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices. Technical report UILU-ENG-09-2215, UIUC (arXiv:1009.5055) Lin Z, Chen M, Ma Y (2009) The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices. Technical report UILU-ENG-09-2215, UIUC (arXiv:​1009.​5055)
39.
40.
Zurück zum Zitat Osher S, Burger M, Goldfarb D et al (2005) An iterative regularization method for total variation-based image restoration. Multiscale Model Simul 4(2):460–489MathSciNetCrossRefMATH Osher S, Burger M, Goldfarb D et al (2005) An iterative regularization method for total variation-based image restoration. Multiscale Model Simul 4(2):460–489MathSciNetCrossRefMATH
41.
Zurück zum Zitat Charest M, Milanfar P (2008) On iterative regularization and its application. IEEE Trans Circuits Syst Video Technol 18(3):406–411CrossRef Charest M, Milanfar P (2008) On iterative regularization and its application. IEEE Trans Circuits Syst Video Technol 18(3):406–411CrossRef
43.
Zurück zum Zitat Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRef Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRef
45.
46.
Zurück zum Zitat Nie F, Huang H, Ding C (2012) Low-rank matrix recovery via efficient Schatten p-norm minimization. In: Proceedings of the twenty-sixth (AAAI) conference on artificial intelligence, Toronto, 22–26 July 2012, pp 655–661 Nie F, Huang H, Ding C (2012) Low-rank matrix recovery via efficient Schatten p-norm minimization. In: Proceedings of the twenty-sixth (AAAI) conference on artificial intelligence, Toronto, 22–26 July 2012, pp 655–661
47.
Zurück zum Zitat Hu Y, Zhang D, Ye J et al (2013) Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans Pattern Anal Mach Intell 35(9):2117–2130CrossRef Hu Y, Zhang D, Ye J et al (2013) Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans Pattern Anal Mach Intell 35(9):2117–2130CrossRef
48.
Zurück zum Zitat Lu C, Tang J, Yan S, Lin Z (2014) Generalized nonconvex nonsmooth low-rank minimization. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR), Columbus, 23–28 June 2014, pp 4130–4137. doi:10.1109/CVPR.2014.526 Lu C, Tang J, Yan S, Lin Z (2014) Generalized nonconvex nonsmooth low-rank minimization. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR), Columbus, 23–28 June 2014, pp 4130–4137. doi:10.​1109/​CVPR.​2014.​526
Metadaten
Titel
Nonlocal image denoising via adaptive tensor nuclear norm minimization
verfasst von
Chenyang Zhang
Wenrui Hu
Tianyu Jin
Zhonglei Mei
Publikationsdatum
16.09.2015
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 1/2018
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-015-2050-5

Weitere Artikel der Ausgabe 1/2018

Neural Computing and Applications 1/2018 Zur Ausgabe

Recent advances in Pattern Recognition and Artificial Intelligence

Efficient subspace clustering based on self-representation and grouping effect