Skip to main content
Top

2018 | OriginalPaper | Chapter

Image Completion with Smooth Nonnegative Matrix Factorization

Authors : Tomasz Sadowski, Rafał Zdunek

Published in: Artificial Intelligence and Soft Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nonnegative matrix factorization is an unsupervised learning method for part-based feature extraction and dimensionality reduction of nonnegative data with a variety of models, algorithms, structures, and applications. Smooth nonnegative matrix factorization assumes the estimated latent factors are locally smooth, and the smoothness is enforced by the underlying model or the algorithm. In this study, we extended one of the algorithms for this kind of factorization to an image completion problem. It is the B-splines ADMM-NMF (Nonnegative Matrix Factorization with Alternating Direction Method of Multipliers) that enforces smooth feature vectors by assuming they are represented by a linear combination of smooth basis functions, i.e. B-splines. The numerical experiments performed on several incomplete images show that the proposed method outperforms the other algorithms in terms of the quality of recovered images.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cichocki, A., Zdunek, R., Phan, A.H., Amari, S.I.: Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation. Wiley, Hoboken (2009)CrossRef Cichocki, A., Zdunek, R., Phan, A.H., Amari, S.I.: Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation. Wiley, Hoboken (2009)CrossRef
2.
go back to reference Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401, 788–791 (1999)CrossRef Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401, 788–791 (1999)CrossRef
3.
go back to reference Zhang, H., He, W., Zhang, L., Shen, H., Yuan, Q.: Hyperspectral image restoration using low-rank matrix recovery. IEEE Trans. Geosci. Remote Sens. 52(8), 4729–4743 (2014)CrossRef Zhang, H., He, W., Zhang, L., Shen, H., Yuan, Q.: Hyperspectral image restoration using low-rank matrix recovery. IEEE Trans. Geosci. Remote Sens. 52(8), 4729–4743 (2014)CrossRef
4.
go back to reference Miao, L., Qi, H.: Endmember extraction from highly mixed data using minimum volume constrained nonnegative matrix factorization. IEEE Trans. Geosci. Remote Sens. 45(3), 765–777 (2007)CrossRef Miao, L., Qi, H.: Endmember extraction from highly mixed data using minimum volume constrained nonnegative matrix factorization. IEEE Trans. Geosci. Remote Sens. 45(3), 765–777 (2007)CrossRef
5.
go back to reference Jia, S., Qian, Y.: Constrained nonnegative matrix factorization for hyperspectral unmixing. IEEE Trans. Geosci. Remote Sens. 47(1), 161–173 (2009)CrossRef Jia, S., Qian, Y.: Constrained nonnegative matrix factorization for hyperspectral unmixing. IEEE Trans. Geosci. Remote Sens. 47(1), 161–173 (2009)CrossRef
6.
go back to reference Xu, W., Liu, X., Gong, Y.: Document clustering based on non-negative matrix factorization. In: SIGIR 2003: Proceedings of 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 267–273. ACM Press, New York (2003) Xu, W., Liu, X., Gong, Y.: Document clustering based on non-negative matrix factorization. In: SIGIR 2003: Proceedings of 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 267–273. ACM Press, New York (2003)
7.
go back to reference Pauca, V.P., Shahnaz, F., Berry, M.W., Plemmons, R.J.: Text mining using non-negative matrix factorizations. In: Proceedings of SIAM Interernational Conferene on Data Mining, Orlando, FL, pp. 452–456 (2004) Pauca, V.P., Shahnaz, F., Berry, M.W., Plemmons, R.J.: Text mining using non-negative matrix factorizations. In: Proceedings of SIAM Interernational Conferene on Data Mining, Orlando, FL, pp. 452–456 (2004)
8.
go back to reference Kersting, K., Wahabzada, M., Thurau, C., Bauckhage, C.: Hierarchical convex NMF for clustering massive data. In: Proceedings of 2nd Asian Conference on Machine Learning, ACML, Tokyo, Japan, pp. 253–268 (2010) Kersting, K., Wahabzada, M., Thurau, C., Bauckhage, C.: Hierarchical convex NMF for clustering massive data. In: Proceedings of 2nd Asian Conference on Machine Learning, ACML, Tokyo, Japan, pp. 253–268 (2010)
9.
go back to reference Virtanen, T.: Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria. IEEE Trans. Audio Speech Lang. Process. 15(3), 1066–1074 (2007)CrossRef Virtanen, T.: Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria. IEEE Trans. Audio Speech Lang. Process. 15(3), 1066–1074 (2007)CrossRef
11.
go back to reference Févotte, C., Bertin, N., Durrieu, J.L.: Nonnegative matrix factorization with the Itakura-Saito divergence: with application to music analysis. Neural Comput. 21(3), 793–830 (2009)CrossRef Févotte, C., Bertin, N., Durrieu, J.L.: Nonnegative matrix factorization with the Itakura-Saito divergence: with application to music analysis. Neural Comput. 21(3), 793–830 (2009)CrossRef
13.
go back to reference Zdunek, R., Cichocki, A., Yokota, T.: B-spline smoothing of feature vectors in nonnegative matrix factorization. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2014. LNCS (LNAI), vol. 8468, pp. 72–81. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07176-3_7CrossRef Zdunek, R., Cichocki, A., Yokota, T.: B-spline smoothing of feature vectors in nonnegative matrix factorization. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2014. LNCS (LNAI), vol. 8468, pp. 72–81. Springer, Cham (2014). https://​doi.​org/​10.​1007/​978-3-319-07176-3_​7CrossRef
14.
go back to reference Zdunek, R.: Alternating direction method for approximating smooth feature vectors in nonnegative matrix factorization. In: IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2014, Reims, France, 21–24 September 2014, pp. 1–6 (2014) Zdunek, R.: Alternating direction method for approximating smooth feature vectors in nonnegative matrix factorization. In: IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2014, Reims, France, 21–24 September 2014, pp. 1–6 (2014)
15.
go back to reference Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. In: Foundations and Trends in Machine Learning. vol. 3, pp. 1–122. NOW Publishers (2011) Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. In: Foundations and Trends in Machine Learning. vol. 3, pp. 1–122. NOW Publishers (2011)
16.
go back to reference Goldstein, T., O’Donoghue, B., Setzer, S., Baraniuk, R.G.: Fast alternating direction optimization methods. SIAM J. Imaging Sci. 7, 1588–1623 (2014)MathSciNetCrossRef Goldstein, T., O’Donoghue, B., Setzer, S., Baraniuk, R.G.: Fast alternating direction optimization methods. SIAM J. Imaging Sci. 7, 1588–1623 (2014)MathSciNetCrossRef
17.
go back to reference Hajinezhad, D., Chang, T., Wang, X., Shi, Q., Hong, M.: Nonnegative matrix factorization using ADMM: algorithm and convergence analysis. In: ICASSP, pp. 4742–4746. IEEE (2016) Hajinezhad, D., Chang, T., Wang, X., Shi, Q., Hong, M.: Nonnegative matrix factorization using ADMM: algorithm and convergence analysis. In: ICASSP, pp. 4742–4746. IEEE (2016)
18.
go back to reference Sun, D.L., Fevotte, C.: Alternating direction method of multipliers for non-negative matrix factorization with the beta-divergence. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy (2014) Sun, D.L., Fevotte, C.: Alternating direction method of multipliers for non-negative matrix factorization with the beta-divergence. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy (2014)
19.
go back to reference Esser, E., Möller, M., Osher, S., Sapiro, G., Xin, J.: A convex model for nonnegative matrix factorization and dimensionality reduction on physical space. IEEE Trans. Image Process. 21(7), 3239–3252 (2012)MathSciNetCrossRef Esser, E., Möller, M., Osher, S., Sapiro, G., Xin, J.: A convex model for nonnegative matrix factorization and dimensionality reduction on physical space. IEEE Trans. Image Process. 21(7), 3239–3252 (2012)MathSciNetCrossRef
20.
go back to reference Xu, Y.: Alternating proximal gradient method for nonnegative matrix factorization. CoRR abs/1112.5407 (2011) Xu, Y.: Alternating proximal gradient method for nonnegative matrix factorization. CoRR abs/1112.5407 (2011)
21.
go back to reference Xu, Y., Yin, W., Wen, Z., Zhang, Y.: An alternating direction algorithm for matrix completion with nonnegative factors. Front. Math. China 7(2), 365–384 (2012)MathSciNetCrossRef Xu, Y., Yin, W., Wen, Z., Zhang, Y.: An alternating direction algorithm for matrix completion with nonnegative factors. Front. Math. China 7(2), 365–384 (2012)MathSciNetCrossRef
22.
go back to reference Sun, D.L., Mazumder, R.: Non-negative matrix completion for bandwidth extension: a convex optimization approach. In: Proceedings of IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2013), Southampton, UK (2013) Sun, D.L., Mazumder, R.: Non-negative matrix completion for bandwidth extension: a convex optimization approach. In: Proceedings of IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2013), Southampton, UK (2013)
23.
go back to reference Yuan, X., Yang, J.F.: Sparse and low rank matrix decomposition via alternating direction method. Pac. J. Optim. 9(1), 167–180 (2013)MathSciNetMATH Yuan, X., Yang, J.F.: Sparse and low rank matrix decomposition via alternating direction method. Pac. J. Optim. 9(1), 167–180 (2013)MathSciNetMATH
24.
go back to reference Yokota, T., Zhao, Q., Cichocki, A.: Smooth PARAFAC decomposition for tensor completion. IEEE Trans. Sig. Process. 64(20), 5423–5436 (2016)MathSciNetCrossRef Yokota, T., Zhao, Q., Cichocki, A.: Smooth PARAFAC decomposition for tensor completion. IEEE Trans. Sig. Process. 64(20), 5423–5436 (2016)MathSciNetCrossRef
26.
go back to reference Guo, X., Ma, Y.: Generalized tensor total variation minimization for visual data recovery. In: Proceedigngs of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015) Guo, X., Ma, Y.: Generalized tensor total variation minimization for visual data recovery. In: Proceedigngs of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015)
27.
go back to reference Cai, J.F., Candès, E.J., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 1956–1982 (2010)MathSciNetCrossRef Cai, J.F., Candès, E.J., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 1956–1982 (2010)MathSciNetCrossRef
28.
go back to reference Wen, Z., Yin, W., Zhang, Y.: Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math. Program. Comput. 4(4), 333–361 (2012)MathSciNetCrossRef Wen, Z., Yin, W., Zhang, Y.: Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math. Program. Comput. 4(4), 333–361 (2012)MathSciNetCrossRef
29.
go back to reference Chugh, T., Cao, K., Zhou, J., Tabassi, E., Jain, A.K.: Latent fingerprint value prediction: crowd-based learning. IEEE Trans. Inf. Forensics Secur. 13(1), 20–34 (2018)CrossRef Chugh, T., Cao, K., Zhou, J., Tabassi, E., Jain, A.K.: Latent fingerprint value prediction: crowd-based learning. IEEE Trans. Inf. Forensics Secur. 13(1), 20–34 (2018)CrossRef
30.
go back to reference Pei, S.C., Tsai, Y.T., Lee, C.Y.: Removing rain and snow in a single image using saturation and visibility features. In: IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–6 (2014) Pei, S.C., Tsai, Y.T., Lee, C.Y.: Removing rain and snow in a single image using saturation and visibility features. In: IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–6 (2014)
31.
go back to reference Barnum, P., Kanade, T., Narasimhan, S.G.: Spatio-temporal frequency analysis for removing rain and snow from videos. In: Workshop on Photometric Analysis For Computer Vision (PACV), in Conjunction with ICCV, Pittsburgh, PA (2007) Barnum, P., Kanade, T., Narasimhan, S.G.: Spatio-temporal frequency analysis for removing rain and snow from videos. In: Workshop on Photometric Analysis For Computer Vision (PACV), in Conjunction with ICCV, Pittsburgh, PA (2007)
32.
go back to reference Demirkaya, O., Asyali, M., Sahoo, P.: Image Processing with MATLAB: Applications in Medicine and Biology, 2nd edn. Taylor and Francis, Oxford (2015) Demirkaya, O., Asyali, M., Sahoo, P.: Image Processing with MATLAB: Applications in Medicine and Biology, 2nd edn. Taylor and Francis, Oxford (2015)
Metadata
Title
Image Completion with Smooth Nonnegative Matrix Factorization
Authors
Tomasz Sadowski
Rafał Zdunek
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-91262-2_6

Premium Partner