Skip to main content
Erschienen in: Pattern Analysis and Applications 4/2022

21.06.2022 | Short Paper

Parallel matrix factorization-based collaborative sparsity and smooth prior for estimating missing values in multidimensional data

verfasst von: Souad Mohaoui, Abdelilah Hakim, Said Raghay

Erschienen in: Pattern Analysis and Applications | Ausgabe 4/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Parallel matrix factorization has recently emerged as a powerful tool for low-rank tensor recovery problems. However, using only the low-rank property is often not sufficient for recovering valuable details in images. Generally, incorporating additional prior knowledge shows significant improvement in the recovered results. Therefore, smooth matrix factorization has been introduced for tensor completion in which the smoothness of its spectral factor over the third mode has been recently considered. However, these models may not efficiently characterize the smoothness of the target tensor. Thus, in this work, we are interested in boosting the piecewise smoothness by using the third-mode smoothness of the underlying tensor combined with spectral sparsity of the third factor of the factorization. Therefore, we propose in this paper a parallel matrix factorization-based sparsity constraint with a smoothness prior to the third mode of the target tensor. We develop a multi-block proximal alternating minimization algorithm for solving the proposed model. Theoretically, we show that the generated sequence globally converges to a critical point. The superiority of our model over other tensor completion methods in terms of several evaluation metrics is reported via extensive experiments conducted on real data such as videos, hyperspectral images, and MRI data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Banouar O, Mohaoui S, Raghay S (2018) Collaborating filtering using unsupervised learning for image reconstruction from missing data. EURASIP J Adv Signal Process 2018(1):1–12CrossRef Banouar O, Mohaoui S, Raghay S (2018) Collaborating filtering using unsupervised learning for image reconstruction from missing data. EURASIP J Adv Signal Process 2018(1):1–12CrossRef
2.
Zurück zum Zitat Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imag Sci 2(1):183–202MathSciNetCrossRef Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imag Sci 2(1):183–202MathSciNetCrossRef
3.
Zurück zum Zitat Bengua JA, Phien HN, Tuan HD, Do MN (2017) Efficient tensor completion for color image and video recovery: Low-rank tensor train. IEEE Trans Image Process 26(5):2466–2479MathSciNetCrossRef Bengua JA, Phien HN, Tuan HD, Do MN (2017) Efficient tensor completion for color image and video recovery: Low-rank tensor train. IEEE Trans Image Process 26(5):2466–2479MathSciNetCrossRef
4.
Zurück zum Zitat Bolte J, Daniilidis A, Lewis A (2007) The łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems. SIAM J Optim 17(4):1205–1223CrossRef Bolte J, Daniilidis A, Lewis A (2007) The łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems. SIAM J Optim 17(4):1205–1223CrossRef
5.
Zurück zum Zitat Bredies K, Lorenz DA (2008) Linear convergence of iterative soft-thresholding. J Fourier Anal Appl 14(5–6):813–837MathSciNetCrossRef Bredies K, Lorenz DA (2008) Linear convergence of iterative soft-thresholding. J Fourier Anal Appl 14(5–6):813–837MathSciNetCrossRef
6.
Zurück zum Zitat Candes EJ, Recht B (2008) Exact low-rank matrix completion via convex optimization. In: 2008 46th annual allerton conference on communication, control, and computing, IEEE, pp 806–812 Candes EJ, Recht B (2008) Exact low-rank matrix completion via convex optimization. In: 2008 46th annual allerton conference on communication, control, and computing, IEEE, pp 806–812
7.
Zurück zum Zitat Carroll JD, Pruzansky S, Kruskal JB (1980) Candelinc: a general approach to multidimensional analysis of many-way arrays with linear constraints on parameters. Psychometrika 45(1):3–24MathSciNetCrossRef Carroll JD, Pruzansky S, Kruskal JB (1980) Candelinc: a general approach to multidimensional analysis of many-way arrays with linear constraints on parameters. Psychometrika 45(1):3–24MathSciNetCrossRef
8.
Zurück zum Zitat Combettes PL, Wajs VR (2005) Signal recovery by proximal forward-backward splitting. Multiscale Model Simul 4(4):1168–1200MathSciNetCrossRef Combettes PL, Wajs VR (2005) Signal recovery by proximal forward-backward splitting. Multiscale Model Simul 4(4):1168–1200MathSciNetCrossRef
9.
Zurück zum Zitat Grippo L, Sciandrone M (2000) On the convergence of the block nonlinear gauss-seidel method under convex constraints. Oper Res Lett 26(3):127–136MathSciNetCrossRef Grippo L, Sciandrone M (2000) On the convergence of the block nonlinear gauss-seidel method under convex constraints. Oper Res Lett 26(3):127–136MathSciNetCrossRef
10.
Zurück zum Zitat He J, Zheng X, Gao P, Zhou Y (2022) Low-rank tensor completion based on tensor train rank with partially overlapped sub-blocks. Signal Process 190:108339CrossRef He J, Zheng X, Gao P, Zhou Y (2022) Low-rank tensor completion based on tensor train rank with partially overlapped sub-blocks. Signal Process 190:108339CrossRef
11.
Zurück zum Zitat Hu Y, Zhang D, Ye J, Li X, He X (2012) Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans Pattern Anal Mach Intell 35(9):2117–2130CrossRef Hu Y, Zhang D, Ye J, Li X, He X (2012) Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans Pattern Anal Mach Intell 35(9):2117–2130CrossRef
12.
Zurück zum Zitat Iordache M-D, Bioucas-Dias JM, Plaza A (2012) Total variation spatial regularization for sparse hyperspectral unmixing. IEEE Trans Geosci Remote Sens 50(11):4484–4502CrossRef Iordache M-D, Bioucas-Dias JM, Plaza A (2012) Total variation spatial regularization for sparse hyperspectral unmixing. IEEE Trans Geosci Remote Sens 50(11):4484–4502CrossRef
13.
Zurück zum Zitat Ji T-Y, Huang T-Z, Zhao X-L, Ma T-H, Liu G (2016) Tensor completion using total variation and low-rank matrix factorization. Inf Sci 326:243–257MathSciNetCrossRef Ji T-Y, Huang T-Z, Zhao X-L, Ma T-H, Liu G (2016) Tensor completion using total variation and low-rank matrix factorization. Inf Sci 326:243–257MathSciNetCrossRef
14.
Zurück zum Zitat Jiang T-X, Huang T-Z, Zhao X-L, Deng L-J (2020) Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear norm. J Comput Appl Math 372:112680MathSciNetCrossRef Jiang T-X, Huang T-Z, Zhao X-L, Deng L-J (2020) Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear norm. J Comput Appl Math 372:112680MathSciNetCrossRef
15.
Zurück zum Zitat Jiang T-X, Huang T-Z, Zhao X-L, Ji T-Y, Deng L-J (2018) Matrix factorization for low-rank tensor completion using framelet prior. Inf Sci 436:403–417MathSciNetCrossRef Jiang T-X, Huang T-Z, Zhao X-L, Ji T-Y, Deng L-J (2018) Matrix factorization for low-rank tensor completion using framelet prior. Inf Sci 436:403–417MathSciNetCrossRef
16.
Zurück zum Zitat Jiang T-X, Ng MK, Zhao X-L, Huang T-Z (2020) Framelet representation of tensor nuclear norm for third-order tensor completion. IEEE Trans Image Process 29:7233–7244MathSciNetCrossRef Jiang T-X, Ng MK, Zhao X-L, Huang T-Z (2020) Framelet representation of tensor nuclear norm for third-order tensor completion. IEEE Trans Image Process 29:7233–7244MathSciNetCrossRef
17.
Zurück zum Zitat Kilmer ME, Braman K, Hao N, Hoover RC (2013) Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34(1):148–172MathSciNetCrossRef Kilmer ME, Braman K, Hao N, Hoover RC (2013) Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34(1):148–172MathSciNetCrossRef
18.
Zurück zum Zitat Kilmer ME, Martin CD (2011) Factorization strategies for third-order tensors. Linear Algebra Appl 435(3):641–658MathSciNetCrossRef Kilmer ME, Martin CD (2011) Factorization strategies for third-order tensors. Linear Algebra Appl 435(3):641–658MathSciNetCrossRef
19.
Zurück zum Zitat Liu J, Musialski P, Wonka P, Ye J (2012) Tensor completion for estimating missing values in visual data. IEEE Trans Pattern Anal Mach Intell 35(1):208–220CrossRef Liu J, Musialski P, Wonka P, Ye J (2012) Tensor completion for estimating missing values in visual data. IEEE Trans Pattern Anal Mach Intell 35(1):208–220CrossRef
20.
Zurück zum Zitat Liu Y, Shang F (2013) An efficient matrix factorization method for tensor completion. IEEE Signal Process Lett 20(4):307–310CrossRef Liu Y, Shang F (2013) An efficient matrix factorization method for tensor completion. IEEE Signal Process Lett 20(4):307–310CrossRef
21.
Zurück zum Zitat Ma S, Goldfarb D, Chen L (2011) Fixed point and bregman iterative methods for matrix rank minimization. Math Program 128(1):321–353MathSciNetCrossRef Ma S, Goldfarb D, Chen L (2011) Fixed point and bregman iterative methods for matrix rank minimization. Math Program 128(1):321–353MathSciNetCrossRef
22.
Zurück zum Zitat Mohaoui S, Hakim A, Raghay S (2021) Tensor completion via bilevel minimization with fixed-point constraint to estimate missing elements in noisy data. Adv Comput Math 47(1):1–27MathSciNetCrossRef Mohaoui S, Hakim A, Raghay S (2021) Tensor completion via bilevel minimization with fixed-point constraint to estimate missing elements in noisy data. Adv Comput Math 47(1):1–27MathSciNetCrossRef
23.
Zurück zum Zitat Mohaoui S, Hakim A, Raghay S (2022) Smooth tensor robust principal component analysis with application to color image recovery. Digit Signal Process, p 103390 Mohaoui S, Hakim A, Raghay S (2022) Smooth tensor robust principal component analysis with application to color image recovery. Digit Signal Process, p 103390
24.
25.
Zurück zum Zitat Nesterov YE (1983) A method for solving the convex programming problem with convergence rate o (1/k\(^{2}\)). Dokl akad nauk Sssr 269:543–547MathSciNet Nesterov YE (1983) A method for solving the convex programming problem with convergence rate o (1/k\(^{2}\)). Dokl akad nauk Sssr 269:543–547MathSciNet
27.
Zurück zum Zitat Qian Y, Jia S, Zhou J, Robles-Kelly A (2011) Hyperspectral unmixing via \( l_ 1/2 \) sparsity-constrained nonnegative matrix factorization. IEEE Trans Geosci Remote Sens 49(11):4282–4297CrossRef Qian Y, Jia S, Zhou J, Robles-Kelly A (2011) Hyperspectral unmixing via \( l_ 1/2 \) sparsity-constrained nonnegative matrix factorization. IEEE Trans Geosci Remote Sens 49(11):4282–4297CrossRef
28.
Zurück zum Zitat Sargent R, Sebastian D (1973) On the convergence of sequential minimization algorithms. J Optim Theory Appl 12(6):567–575MathSciNetCrossRef Sargent R, Sebastian D (1973) On the convergence of sequential minimization algorithms. J Optim Theory Appl 12(6):567–575MathSciNetCrossRef
29.
Zurück zum Zitat Semerci O, Hao N, Kilmer ME, Miller EL (2014) Tensor-based formulation and nuclear norm regularization for multienergy computed tomography. IEEE Trans Image Process 23(4):1678–1693MathSciNetCrossRef Semerci O, Hao N, Kilmer ME, Miller EL (2014) Tensor-based formulation and nuclear norm regularization for multienergy computed tomography. IEEE Trans Image Process 23(4):1678–1693MathSciNetCrossRef
30.
Zurück zum Zitat Tan H, Cheng B, Wang W, Zhang Y-J, Ran B (2014) Tensor completion via a multi-linear low-n-rank factorization model. Neurocomputing 133:161–169CrossRef Tan H, Cheng B, Wang W, Zhang Y-J, Ran B (2014) Tensor completion via a multi-linear low-n-rank factorization model. Neurocomputing 133:161–169CrossRef
31.
33.
Zurück zum Zitat Wen Z, Yin W, Zhang Y (2012) Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math Program Comput 4(4):333–361MathSciNetCrossRef Wen Z, Yin W, Zhang Y (2012) Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math Program Comput 4(4):333–361MathSciNetCrossRef
34.
Zurück zum Zitat Xu Y, Hao R, Yin W, Su Z (2013) Parallel matrix factorization for low-rank tensor completion. arXiv preprint arXiv:1312.1254 Xu Y, Hao R, Yin W, Su Z (2013) Parallel matrix factorization for low-rank tensor completion. arXiv preprint arXiv:​1312.​1254
35.
Zurück zum Zitat Xu Y, Yin W (2013) A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion. SIAM J Imag Sci 6(3):1758–1789MathSciNetCrossRef Xu Y, Yin W (2013) A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion. SIAM J Imag Sci 6(3):1758–1789MathSciNetCrossRef
36.
Zurück zum Zitat Xue S, Qiu W, Liu F, Jin X (2018) Low-rank tensor completion by truncated nuclear norm regularization. In: 2018 24th international conference on pattern recognition (ICPR), IEEE, pp 2600–2605 Xue S, Qiu W, Liu F, Jin X (2018) Low-rank tensor completion by truncated nuclear norm regularization. In: 2018 24th international conference on pattern recognition (ICPR), IEEE, pp 2600–2605
37.
Zurück zum Zitat Zhang Z, Ely G, Aeron S, Hao N, Kilmer M (2014) Novel methods for multilinear data completion and de-noising based on tensor-svd. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3842–3849 Zhang Z, Ely G, Aeron S, Hao N, Kilmer M (2014) Novel methods for multilinear data completion and de-noising based on tensor-svd. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3842–3849
Metadaten
Titel
Parallel matrix factorization-based collaborative sparsity and smooth prior for estimating missing values in multidimensional data
verfasst von
Souad Mohaoui
Abdelilah Hakim
Said Raghay
Publikationsdatum
21.06.2022
Verlag
Springer London
Erschienen in
Pattern Analysis and Applications / Ausgabe 4/2022
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-022-01082-3

Weitere Artikel der Ausgabe 4/2022

Pattern Analysis and Applications 4/2022 Zur Ausgabe

Premium Partner