Skip to main content
Top
Published in: Journal of Scientific Computing 3/2019

15-07-2019

Low-Rank Tensor Completion Based on Log-Det Rank Approximation and Matrix Factorization

Authors: Chengfei Shi, Zhengdong Huang, Li Wan, Tifan Xiong

Published in: Journal of Scientific Computing | Issue 3/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Rank evaluation plays a key role in low-rank tensor completion and tensor nuclear norm is often used as a substitute of rank in the optimization due to its convex property. However, this replacement often incurs unexpected errors, and since singular value decomposition is frequently involved, the computation cost of the norm is high, especially in handling large scale matrices from the mode-n unfolding of a tensor. This paper presents a novel tensor completion method, in which a non-convex logDet function is utilized to approximate the rank and a matrix factorization is adopted to reduce the evaluation cost of the function. The study shows that the logDet function is a much tighter rank approximation than the nuclear norm and the matrix factorization can significantly reduce the size of matrix that needs to be evaluated. In the implementation of the method, alternating direction method of multipliers is employed to obtain the optimal tensor completion. Several experiments are carried out to validate the method and the results show that the proposed method is effective.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference De Lathauwer, L., Vandewalle, J.: Dimensionality reduction in higher-order signal processing and rank-(R1, R2, …, RN) reduction in multilinear algebra. Linear Algebra Appl. 391, 31–55 (2004)MathSciNetCrossRefMATH De Lathauwer, L., Vandewalle, J.: Dimensionality reduction in higher-order signal processing and rank-(R1, R2, …, RN) reduction in multilinear algebra. Linear Algebra Appl. 391, 31–55 (2004)MathSciNetCrossRefMATH
2.
go back to reference Vlasic, D., Brand, M., Pfister, H., Popovic, J.: Face transfer with multilinear models. ACM Trans. Graph. 24(3), 426–433 (2005)CrossRef Vlasic, D., Brand, M., Pfister, H., Popovic, J.: Face transfer with multilinear models. ACM Trans. Graph. 24(3), 426–433 (2005)CrossRef
3.
go back to reference Beylkin, G., Mohlenkamp, M.J.: Numerical operator calculus in higher dimensions. Proc Natl Acad Sci USA 99(16), 10246–10251 (2002)MathSciNetCrossRefMATH Beylkin, G., Mohlenkamp, M.J.: Numerical operator calculus in higher dimensions. Proc Natl Acad Sci USA 99(16), 10246–10251 (2002)MathSciNetCrossRefMATH
4.
go back to reference Mørup, M.: Applications of tensor (multiway array) factorizations and decompositions in data mining. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 1(1), 24–40 (2011)CrossRef Mørup, M.: Applications of tensor (multiway array) factorizations and decompositions in data mining. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 1(1), 24–40 (2011)CrossRef
5.
go back to reference Komodakis, N.: Image completion using global optimization. In: Proceedings of the CVPR IEEE, pp. 442–452 (2006) Komodakis, N.: Image completion using global optimization. In: Proceedings of the CVPR IEEE, pp. 442–452 (2006)
6.
go back to reference Patwardhan, K.A., Sapiro, G., Bertalmio, M.: Video inpainting under constrained camera motion. IEEE Trans. Image Process. 16(2), 545–553 (2007)MathSciNetCrossRef Patwardhan, K.A., Sapiro, G., Bertalmio, M.: Video inpainting under constrained camera motion. IEEE Trans. Image Process. 16(2), 545–553 (2007)MathSciNetCrossRef
7.
go back to reference Varghees, V.N., Manikandan, M.S., Gini, R.: Adaptive MRI image denoising using total-variation and local noise estimation. In: International Conference on Advances in Engineering, Science and Management, pp. 506–511. IEEE (2012) Varghees, V.N., Manikandan, M.S., Gini, R.: Adaptive MRI image denoising using total-variation and local noise estimation. In: International Conference on Advances in Engineering, Science and Management, pp. 506–511. IEEE (2012)
8.
go back to reference Li, N., Li, B.X.: Tensor completion for on-board compression of hyperspectral images. In: IEEE International Conference on Image Processing, pp. 517–520. IEEE (2010) Li, N., Li, B.X.: Tensor completion for on-board compression of hyperspectral images. In: IEEE International Conference on Image Processing, pp. 517–520. IEEE (2010)
9.
go back to reference Gillis, N., Glineur, F.: Low-rank matrix approximation with weights or missing data is NP-hard. SIAM. J. Matrix. Anal. A 32(4), 1149–1165 (2011)MathSciNetCrossRefMATH Gillis, N., Glineur, F.: Low-rank matrix approximation with weights or missing data is NP-hard. SIAM. J. Matrix. Anal. A 32(4), 1149–1165 (2011)MathSciNetCrossRefMATH
10.
go back to reference Cai, J.F., Candès, E.J., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 1956–1982 (2010)MathSciNetCrossRefMATH Cai, J.F., Candès, E.J., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 1956–1982 (2010)MathSciNetCrossRefMATH
12.
go back to reference Kang, Z., Peng, C., Cheng, Q.: Robust PCA via non-convex rank approximation. In: IEEE International Conference on Data Mining, pp. 211–220. IEEE Computer Society (2015) Kang, Z., Peng, C., Cheng, Q.: Robust PCA via non-convex rank approximation. In: IEEE International Conference on Data Mining, pp. 211–220. IEEE Computer Society (2015)
13.
go back to reference Fazel, M., Hindi, H., Boyd, S.P.: Log-det heuristic for matrix rank minimization with applications to Hankel and Euclidean distance matrices. Proc. Am. Contrib. Conf. 3, 2156–2162 (2003) Fazel, M., Hindi, H., Boyd, S.P.: Log-det heuristic for matrix rank minimization with applications to Hankel and Euclidean distance matrices. Proc. Am. Contrib. Conf. 3, 2156–2162 (2003)
14.
go back to reference Kang, Z., Peng, C., Cheng, Q.: Top-N recommender system via matrix completion. In: AAAI (2016) Kang, Z., Peng, C., Cheng, Q.: Top-N recommender system via matrix completion. In: AAAI (2016)
15.
go back to reference Gu, S.H., Zhang, L., Zuo, W.M., Feng, X.C.: Weighted nuclear norm minimization with application to image denoising. In: Proceedings of the CVPR IEEE, pp. 2862–2869 (2014) Gu, S.H., Zhang, L., Zuo, W.M., Feng, X.C.: Weighted nuclear norm minimization with application to image denoising. In: Proceedings of the CVPR IEEE, pp. 2862–2869 (2014)
16.
go back to reference Liu, J., Musialski, P., Wonka, P., Ye, J.: Tensor completion for estimating missing values in visual data. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 208–220 (2013)CrossRef Liu, J., Musialski, P., Wonka, P., Ye, J.: Tensor completion for estimating missing values in visual data. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 208–220 (2013)CrossRef
17.
go back to reference Xu, Y.Y., Hao, R.R., Yin, W.T., Su, Z.X.: Parallel matrix factorization for low-rank tensor completion. Inverse Probl. Imaging 9(2), 601–624 (2015)MathSciNetCrossRefMATH Xu, Y.Y., Hao, R.R., Yin, W.T., Su, Z.X.: Parallel matrix factorization for low-rank tensor completion. Inverse Probl. Imaging 9(2), 601–624 (2015)MathSciNetCrossRefMATH
18.
19.
go back to reference Ma, S.Q., Goldfarb, D., Chen, L.F.: Fixed point and Bregman iterative methods for matrix rank minimization. Math. Progr. 128(1–2), 321–353 (2011)MathSciNetCrossRefMATH Ma, S.Q., Goldfarb, D., Chen, L.F.: Fixed point and Bregman iterative methods for matrix rank minimization. Math. Progr. 128(1–2), 321–353 (2011)MathSciNetCrossRefMATH
20.
go back to reference Toh, K.C., Yun, S.: An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems. Pac. J. Optim. 6(3), 615–640 (2010)MathSciNetMATH Toh, K.C., Yun, S.: An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems. Pac. J. Optim. 6(3), 615–640 (2010)MathSciNetMATH
21.
go back to reference Wen, Z., Yin, W., Zhang, Y.: Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math. Progr. Comput. 4(4), 333–361 (2012)MathSciNetCrossRefMATH Wen, Z., Yin, W., Zhang, Y.: Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math. Progr. Comput. 4(4), 333–361 (2012)MathSciNetCrossRefMATH
22.
go back to reference Chen, C.H., He, B.S., Yuan, X.M.: Matrix completion via an alternating direction method. IMA J. Numer. Anal. 32(1), 227–245 (2012)MathSciNetCrossRefMATH Chen, C.H., He, B.S., Yuan, X.M.: Matrix completion via an alternating direction method. IMA J. Numer. Anal. 32(1), 227–245 (2012)MathSciNetCrossRefMATH
23.
go back to reference Liu, Y.Y., Jiao, L.C., Shang, F.H.: An efficient matrix factorization based low-rank representation for subspace clustering. Pattern Recogn. 46(1), 284–292 (2013)CrossRefMATH Liu, Y.Y., Jiao, L.C., Shang, F.H.: An efficient matrix factorization based low-rank representation for subspace clustering. Pattern Recogn. 46(1), 284–292 (2013)CrossRefMATH
24.
go back to reference Liu, Y.Y., Shang, F.H.: An efficient matrix factorization method for tensor completion. IEEE Signal Proc. Lett. 20(4), 307–310 (2013)CrossRef Liu, Y.Y., Shang, F.H.: An efficient matrix factorization method for tensor completion. IEEE Signal Proc. Lett. 20(4), 307–310 (2013)CrossRef
25.
go back to reference Ji, T.Y., Huang, T.Z., Zhao, X.L., et al.: A non-convex tensor rank approximation for tensor completion. Appl. Math. Model. 48, 410–422 (2017)MathSciNetCrossRef Ji, T.Y., Huang, T.Z., Zhao, X.L., et al.: A non-convex tensor rank approximation for tensor completion. Appl. Math. Model. 48, 410–422 (2017)MathSciNetCrossRef
26.
go back to reference Kang, Z., Peng, C., Li, H., et al.: Subspace clustering using log-determinant rank approximation. In: ACM KDD (2015) Kang, Z., Peng, C., Li, H., et al.: Subspace clustering using log-determinant rank approximation. In: ACM KDD (2015)
27.
go back to reference Kang, Z., Peng, C., Cheng, Q.: Robust subspace clustering via smoothed rank approximation. IEEE Signal Proc. Lett. 22(11), 2088–2092 (2015)CrossRef Kang, Z., Peng, C., Cheng, Q.: Robust subspace clustering via smoothed rank approximation. IEEE Signal Proc. Lett. 22(11), 2088–2092 (2015)CrossRef
28.
go back to reference Kang, Z., Peng, C., Cheng, J., Cheng, Q.: LogDet Rank Minimization with Application to Subspace Clustering. Comput. Intel, Neurosc (2015)CrossRef Kang, Z., Peng, C., Cheng, J., Cheng, Q.: LogDet Rank Minimization with Application to Subspace Clustering. Comput. Intel, Neurosc (2015)CrossRef
29.
go back to reference Li, Y.F., Zhang, Y., Huang, Z.H.: A reweighted nuclear norm minimization algorithm for low rank matrix recovery. Elsevier, Amsterdam (2014)CrossRefMATH Li, Y.F., Zhang, Y., Huang, Z.H.: A reweighted nuclear norm minimization algorithm for low rank matrix recovery. Elsevier, Amsterdam (2014)CrossRefMATH
30.
go back to reference He, B., Tao, M., Yuan, X.: Alternating direction method with Gaussian back substitution for separable convex programming. SIAM J. Optim. 22(2), 313–340 (2014)MathSciNetCrossRefMATH He, B., Tao, M., Yuan, X.: Alternating direction method with Gaussian back substitution for separable convex programming. SIAM J. Optim. 22(2), 313–340 (2014)MathSciNetCrossRefMATH
31.
go back to reference Gandy, S., Recht, B., Yamada, I.: Tensor completion and low-n-rank tensor recovery via convex optimization. Inverse Probl. 27(2), 025010 (2011)MathSciNetCrossRefMATH Gandy, S., Recht, B., Yamada, I.: Tensor completion and low-n-rank tensor recovery via convex optimization. Inverse Probl. 27(2), 025010 (2011)MathSciNetCrossRefMATH
32.
go back to reference Wang, Z., Bovik, A.C., Sheikh, H.R., et al.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef Wang, Z., Bovik, A.C., Sheikh, H.R., et al.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef
33.
go back to reference Bai, M.R., Zhang, X.J., Ni, G.Y., Cui, C.F.: An adaptive correction approach for tensor completion. SIAM J. Imaging. Sci. 9(3), 1298–1323 (2016)MathSciNetCrossRefMATH Bai, M.R., Zhang, X.J., Ni, G.Y., Cui, C.F.: An adaptive correction approach for tensor completion. SIAM J. Imaging. Sci. 9(3), 1298–1323 (2016)MathSciNetCrossRefMATH
34.
go back to reference Kajo, I., Kamel, N., Ruichek, Y., Malik, A.S.: SVD-based tensor-completion technique for background initialization. IEEE Trans. Image Process. 27(6), 3114–3126 (2018)MathSciNetCrossRefMATH Kajo, I., Kamel, N., Ruichek, Y., Malik, A.S.: SVD-based tensor-completion technique for background initialization. IEEE Trans. Image Process. 27(6), 3114–3126 (2018)MathSciNetCrossRefMATH
35.
go back to reference Zhou, P., Lu, C.Y., Lin, Z.C., Zhang, C.: Tensor factorization for low-rank tensor completion. IEEE Trans. Image Process. 27(3), 1152–1163 (2018)MathSciNetCrossRefMATH Zhou, P., Lu, C.Y., Lin, Z.C., Zhang, C.: Tensor factorization for low-rank tensor completion. IEEE Trans. Image Process. 27(3), 1152–1163 (2018)MathSciNetCrossRefMATH
36.
go back to reference Bengua, J.A., Phien, H.N., Tuan, H.D., Do, M.N.: Efficient tensor completion for color image and video recovery: low-rank tensor train. IEEE Trans. Image Process. 26, 2466–2479 (2017)MathSciNetCrossRefMATH Bengua, J.A., Phien, H.N., Tuan, H.D., Do, M.N.: Efficient tensor completion for color image and video recovery: low-rank tensor train. IEEE Trans. Image Process. 26, 2466–2479 (2017)MathSciNetCrossRefMATH
37.
go back to reference Che, M.L., Wei, Y.M.: Randomized algorithms for the approximations of Tucker and the tensor train decompositions. Adv. Comput. Math. 45, 395–428 (2019)MathSciNetCrossRefMATH Che, M.L., Wei, Y.M.: Randomized algorithms for the approximations of Tucker and the tensor train decompositions. Adv. Comput. Math. 45, 395–428 (2019)MathSciNetCrossRefMATH
39.
go back to reference Mu, C., Huang, B., Wright, J., et al.: Square Deal: Lower Bounds and Improved Relaxations for Tensor Recovery (2013) Mu, C., Huang, B., Wright, J., et al.: Square Deal: Lower Bounds and Improved Relaxations for Tensor Recovery (2013)
Metadata
Title
Low-Rank Tensor Completion Based on Log-Det Rank Approximation and Matrix Factorization
Authors
Chengfei Shi
Zhengdong Huang
Li Wan
Tifan Xiong
Publication date
15-07-2019
Publisher
Springer US
Published in
Journal of Scientific Computing / Issue 3/2019
Print ISSN: 0885-7474
Electronic ISSN: 1573-7691
DOI
https://doi.org/10.1007/s10915-019-01009-x

Other articles of this Issue 3/2019

Journal of Scientific Computing 3/2019 Go to the issue

Premium Partner