Skip to main content
Top
Published in: Pattern Analysis and Applications 4/2022

21-06-2022 | Short Paper

Parallel matrix factorization-based collaborative sparsity and smooth prior for estimating missing values in multidimensional data

Authors: Souad Mohaoui, Abdelilah Hakim, Said Raghay

Published in: Pattern Analysis and Applications | Issue 4/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Parallel matrix factorization has recently emerged as a powerful tool for low-rank tensor recovery problems. However, using only the low-rank property is often not sufficient for recovering valuable details in images. Generally, incorporating additional prior knowledge shows significant improvement in the recovered results. Therefore, smooth matrix factorization has been introduced for tensor completion in which the smoothness of its spectral factor over the third mode has been recently considered. However, these models may not efficiently characterize the smoothness of the target tensor. Thus, in this work, we are interested in boosting the piecewise smoothness by using the third-mode smoothness of the underlying tensor combined with spectral sparsity of the third factor of the factorization. Therefore, we propose in this paper a parallel matrix factorization-based sparsity constraint with a smoothness prior to the third mode of the target tensor. We develop a multi-block proximal alternating minimization algorithm for solving the proposed model. Theoretically, we show that the generated sequence globally converges to a critical point. The superiority of our model over other tensor completion methods in terms of several evaluation metrics is reported via extensive experiments conducted on real data such as videos, hyperspectral images, and MRI data.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Banouar O, Mohaoui S, Raghay S (2018) Collaborating filtering using unsupervised learning for image reconstruction from missing data. EURASIP J Adv Signal Process 2018(1):1–12CrossRef Banouar O, Mohaoui S, Raghay S (2018) Collaborating filtering using unsupervised learning for image reconstruction from missing data. EURASIP J Adv Signal Process 2018(1):1–12CrossRef
2.
go back to reference Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imag Sci 2(1):183–202MathSciNetCrossRef Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imag Sci 2(1):183–202MathSciNetCrossRef
3.
go back to reference Bengua JA, Phien HN, Tuan HD, Do MN (2017) Efficient tensor completion for color image and video recovery: Low-rank tensor train. IEEE Trans Image Process 26(5):2466–2479MathSciNetCrossRef Bengua JA, Phien HN, Tuan HD, Do MN (2017) Efficient tensor completion for color image and video recovery: Low-rank tensor train. IEEE Trans Image Process 26(5):2466–2479MathSciNetCrossRef
4.
go back to reference Bolte J, Daniilidis A, Lewis A (2007) The łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems. SIAM J Optim 17(4):1205–1223CrossRef Bolte J, Daniilidis A, Lewis A (2007) The łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems. SIAM J Optim 17(4):1205–1223CrossRef
5.
go back to reference Bredies K, Lorenz DA (2008) Linear convergence of iterative soft-thresholding. J Fourier Anal Appl 14(5–6):813–837MathSciNetCrossRef Bredies K, Lorenz DA (2008) Linear convergence of iterative soft-thresholding. J Fourier Anal Appl 14(5–6):813–837MathSciNetCrossRef
6.
go back to reference Candes EJ, Recht B (2008) Exact low-rank matrix completion via convex optimization. In: 2008 46th annual allerton conference on communication, control, and computing, IEEE, pp 806–812 Candes EJ, Recht B (2008) Exact low-rank matrix completion via convex optimization. In: 2008 46th annual allerton conference on communication, control, and computing, IEEE, pp 806–812
7.
go back to reference Carroll JD, Pruzansky S, Kruskal JB (1980) Candelinc: a general approach to multidimensional analysis of many-way arrays with linear constraints on parameters. Psychometrika 45(1):3–24MathSciNetCrossRef Carroll JD, Pruzansky S, Kruskal JB (1980) Candelinc: a general approach to multidimensional analysis of many-way arrays with linear constraints on parameters. Psychometrika 45(1):3–24MathSciNetCrossRef
8.
go back to reference Combettes PL, Wajs VR (2005) Signal recovery by proximal forward-backward splitting. Multiscale Model Simul 4(4):1168–1200MathSciNetCrossRef Combettes PL, Wajs VR (2005) Signal recovery by proximal forward-backward splitting. Multiscale Model Simul 4(4):1168–1200MathSciNetCrossRef
9.
go back to reference Grippo L, Sciandrone M (2000) On the convergence of the block nonlinear gauss-seidel method under convex constraints. Oper Res Lett 26(3):127–136MathSciNetCrossRef Grippo L, Sciandrone M (2000) On the convergence of the block nonlinear gauss-seidel method under convex constraints. Oper Res Lett 26(3):127–136MathSciNetCrossRef
10.
go back to reference He J, Zheng X, Gao P, Zhou Y (2022) Low-rank tensor completion based on tensor train rank with partially overlapped sub-blocks. Signal Process 190:108339CrossRef He J, Zheng X, Gao P, Zhou Y (2022) Low-rank tensor completion based on tensor train rank with partially overlapped sub-blocks. Signal Process 190:108339CrossRef
11.
go back to reference Hu Y, Zhang D, Ye J, Li X, He X (2012) Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans Pattern Anal Mach Intell 35(9):2117–2130CrossRef Hu Y, Zhang D, Ye J, Li X, He X (2012) Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans Pattern Anal Mach Intell 35(9):2117–2130CrossRef
12.
go back to reference Iordache M-D, Bioucas-Dias JM, Plaza A (2012) Total variation spatial regularization for sparse hyperspectral unmixing. IEEE Trans Geosci Remote Sens 50(11):4484–4502CrossRef Iordache M-D, Bioucas-Dias JM, Plaza A (2012) Total variation spatial regularization for sparse hyperspectral unmixing. IEEE Trans Geosci Remote Sens 50(11):4484–4502CrossRef
13.
go back to reference Ji T-Y, Huang T-Z, Zhao X-L, Ma T-H, Liu G (2016) Tensor completion using total variation and low-rank matrix factorization. Inf Sci 326:243–257MathSciNetCrossRef Ji T-Y, Huang T-Z, Zhao X-L, Ma T-H, Liu G (2016) Tensor completion using total variation and low-rank matrix factorization. Inf Sci 326:243–257MathSciNetCrossRef
14.
go back to reference Jiang T-X, Huang T-Z, Zhao X-L, Deng L-J (2020) Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear norm. J Comput Appl Math 372:112680MathSciNetCrossRef Jiang T-X, Huang T-Z, Zhao X-L, Deng L-J (2020) Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear norm. J Comput Appl Math 372:112680MathSciNetCrossRef
15.
go back to reference Jiang T-X, Huang T-Z, Zhao X-L, Ji T-Y, Deng L-J (2018) Matrix factorization for low-rank tensor completion using framelet prior. Inf Sci 436:403–417MathSciNetCrossRef Jiang T-X, Huang T-Z, Zhao X-L, Ji T-Y, Deng L-J (2018) Matrix factorization for low-rank tensor completion using framelet prior. Inf Sci 436:403–417MathSciNetCrossRef
16.
go back to reference Jiang T-X, Ng MK, Zhao X-L, Huang T-Z (2020) Framelet representation of tensor nuclear norm for third-order tensor completion. IEEE Trans Image Process 29:7233–7244MathSciNetCrossRef Jiang T-X, Ng MK, Zhao X-L, Huang T-Z (2020) Framelet representation of tensor nuclear norm for third-order tensor completion. IEEE Trans Image Process 29:7233–7244MathSciNetCrossRef
17.
go back to reference Kilmer ME, Braman K, Hao N, Hoover RC (2013) Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34(1):148–172MathSciNetCrossRef Kilmer ME, Braman K, Hao N, Hoover RC (2013) Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34(1):148–172MathSciNetCrossRef
18.
19.
go back to reference Liu J, Musialski P, Wonka P, Ye J (2012) Tensor completion for estimating missing values in visual data. IEEE Trans Pattern Anal Mach Intell 35(1):208–220CrossRef Liu J, Musialski P, Wonka P, Ye J (2012) Tensor completion for estimating missing values in visual data. IEEE Trans Pattern Anal Mach Intell 35(1):208–220CrossRef
20.
go back to reference Liu Y, Shang F (2013) An efficient matrix factorization method for tensor completion. IEEE Signal Process Lett 20(4):307–310CrossRef Liu Y, Shang F (2013) An efficient matrix factorization method for tensor completion. IEEE Signal Process Lett 20(4):307–310CrossRef
21.
go back to reference Ma S, Goldfarb D, Chen L (2011) Fixed point and bregman iterative methods for matrix rank minimization. Math Program 128(1):321–353MathSciNetCrossRef Ma S, Goldfarb D, Chen L (2011) Fixed point and bregman iterative methods for matrix rank minimization. Math Program 128(1):321–353MathSciNetCrossRef
22.
go back to reference Mohaoui S, Hakim A, Raghay S (2021) Tensor completion via bilevel minimization with fixed-point constraint to estimate missing elements in noisy data. Adv Comput Math 47(1):1–27MathSciNetCrossRef Mohaoui S, Hakim A, Raghay S (2021) Tensor completion via bilevel minimization with fixed-point constraint to estimate missing elements in noisy data. Adv Comput Math 47(1):1–27MathSciNetCrossRef
23.
go back to reference Mohaoui S, Hakim A, Raghay S (2022) Smooth tensor robust principal component analysis with application to color image recovery. Digit Signal Process, p 103390 Mohaoui S, Hakim A, Raghay S (2022) Smooth tensor robust principal component analysis with application to color image recovery. Digit Signal Process, p 103390
25.
go back to reference Nesterov YE (1983) A method for solving the convex programming problem with convergence rate o (1/k\(^{2}\)). Dokl akad nauk Sssr 269:543–547MathSciNet Nesterov YE (1983) A method for solving the convex programming problem with convergence rate o (1/k\(^{2}\)). Dokl akad nauk Sssr 269:543–547MathSciNet
27.
go back to reference Qian Y, Jia S, Zhou J, Robles-Kelly A (2011) Hyperspectral unmixing via \( l_ 1/2 \) sparsity-constrained nonnegative matrix factorization. IEEE Trans Geosci Remote Sens 49(11):4282–4297CrossRef Qian Y, Jia S, Zhou J, Robles-Kelly A (2011) Hyperspectral unmixing via \( l_ 1/2 \) sparsity-constrained nonnegative matrix factorization. IEEE Trans Geosci Remote Sens 49(11):4282–4297CrossRef
28.
go back to reference Sargent R, Sebastian D (1973) On the convergence of sequential minimization algorithms. J Optim Theory Appl 12(6):567–575MathSciNetCrossRef Sargent R, Sebastian D (1973) On the convergence of sequential minimization algorithms. J Optim Theory Appl 12(6):567–575MathSciNetCrossRef
29.
go back to reference Semerci O, Hao N, Kilmer ME, Miller EL (2014) Tensor-based formulation and nuclear norm regularization for multienergy computed tomography. IEEE Trans Image Process 23(4):1678–1693MathSciNetCrossRef Semerci O, Hao N, Kilmer ME, Miller EL (2014) Tensor-based formulation and nuclear norm regularization for multienergy computed tomography. IEEE Trans Image Process 23(4):1678–1693MathSciNetCrossRef
30.
go back to reference Tan H, Cheng B, Wang W, Zhang Y-J, Ran B (2014) Tensor completion via a multi-linear low-n-rank factorization model. Neurocomputing 133:161–169CrossRef Tan H, Cheng B, Wang W, Zhang Y-J, Ran B (2014) Tensor completion via a multi-linear low-n-rank factorization model. Neurocomputing 133:161–169CrossRef
33.
go back to reference Wen Z, Yin W, Zhang Y (2012) Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math Program Comput 4(4):333–361MathSciNetCrossRef Wen Z, Yin W, Zhang Y (2012) Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math Program Comput 4(4):333–361MathSciNetCrossRef
34.
35.
go back to reference Xu Y, Yin W (2013) A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion. SIAM J Imag Sci 6(3):1758–1789MathSciNetCrossRef Xu Y, Yin W (2013) A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion. SIAM J Imag Sci 6(3):1758–1789MathSciNetCrossRef
36.
go back to reference Xue S, Qiu W, Liu F, Jin X (2018) Low-rank tensor completion by truncated nuclear norm regularization. In: 2018 24th international conference on pattern recognition (ICPR), IEEE, pp 2600–2605 Xue S, Qiu W, Liu F, Jin X (2018) Low-rank tensor completion by truncated nuclear norm regularization. In: 2018 24th international conference on pattern recognition (ICPR), IEEE, pp 2600–2605
37.
go back to reference Zhang Z, Ely G, Aeron S, Hao N, Kilmer M (2014) Novel methods for multilinear data completion and de-noising based on tensor-svd. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3842–3849 Zhang Z, Ely G, Aeron S, Hao N, Kilmer M (2014) Novel methods for multilinear data completion and de-noising based on tensor-svd. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3842–3849
Metadata
Title
Parallel matrix factorization-based collaborative sparsity and smooth prior for estimating missing values in multidimensional data
Authors
Souad Mohaoui
Abdelilah Hakim
Said Raghay
Publication date
21-06-2022
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 4/2022
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-022-01082-3

Other articles of this Issue 4/2022

Pattern Analysis and Applications 4/2022 Go to the issue

Premium Partner