Skip to main content
Top

2019 | OriginalPaper | Chapter

Robust Nonnegative Matrix Factorization Based on Cosine Similarity Induced Metric

Authors : Wen-Sheng Chen, Haitao Chen, Binbin Pan, Bo Chen

Published in: Intelligence Science and Big Data Engineering. Big Data and Machine Learning

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nonnegative matrix factorization (NMF) is a low-rank decomposition based image representation method under the nonnegativity constraint. However, a lot of NMF based approaches utilize Frobenius-norm or KL-divergence as the metrics to model the loss functions. These metrics are not dilation-invariant and thus sensitive to the scale-change illuminations. To solve this problem, this paper proposes a novel robust NMF method (CSNMF) using cosine similarity induced metric, which is both rotation-invariant and dilation-invariant. The invariant properties are beneficial to improving the performance of our method. Based on cosine similarity induced metric and auxiliary function technique, the update rules of CSNMF are derived and theoretically shown to be convergent. Finally, we empirically evaluate the performance and convergence of the proposed CSNMF algorithm. Compared with the state-of-the-art NMF-based algorithms on face recognition, experimental results demonstrate that the proposed CSNMF method has superior performance and is more robust to the variation of illumination.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Li, S.-Z., Hou, X., Zhang, H., Cheng, Q.: Learning spatially localized, parts-based representation. In: Proceedings of International Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 606–610 (2001) Li, S.-Z., Hou, X., Zhang, H., Cheng, Q.: Learning spatially localized, parts-based representation. In: Proceedings of International Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 606–610 (2001)
2.
go back to reference Xu, W., Liu, X., Gong, Y.: Document clustering based on non-negative matrix factorization. In: Proceedings of ACM SIGIR, pp. 267–273 (2003) Xu, W., Liu, X., Gong, Y.: Document clustering based on non-negative matrix factorization. In: Proceedings of ACM SIGIR, pp. 267–273 (2003)
3.
go back to reference Jia, S., Qian, Y.: Constrained nonnegative matrix factorization for hyperspectral unmixing. IEEE Trans. Geosci. Remote Sens. 47(1), 161–173 (2009)CrossRef Jia, S., Qian, Y.: Constrained nonnegative matrix factorization for hyperspectral unmixing. IEEE Trans. Geosci. Remote Sens. 47(1), 161–173 (2009)CrossRef
4.
go back to reference Feng, X.-R., Li, H.-C., Li, J.: Hyperspectral unmixing using sparsity-constrained deep nonnegative matrix factorization with total variation. IEEE Trans. Geosci. Remote Sens. 56(10), 6245–6257 (2018)CrossRef Feng, X.-R., Li, H.-C., Li, J.: Hyperspectral unmixing using sparsity-constrained deep nonnegative matrix factorization with total variation. IEEE Trans. Geosci. Remote Sens. 56(10), 6245–6257 (2018)CrossRef
5.
go back to reference Lee, D.-D., Seung, H.-S.: Algorithm for non-negative matrix factorization. In: Proceedings of NIPS (2001) Lee, D.-D., Seung, H.-S.: Algorithm for non-negative matrix factorization. In: Proceedings of NIPS (2001)
6.
go back to reference Lee, D.-D., Seung, H.-S.: Learning the parts of the objects by nonnegative matrix factorization. Nature 401(6755), 788–791 (1999)CrossRef Lee, D.-D., Seung, H.-S.: Learning the parts of the objects by nonnegative matrix factorization. Nature 401(6755), 788–791 (1999)CrossRef
7.
go back to reference Cai, D., He, X., Han, J.: Graph regularized non-negative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2011)CrossRef Cai, D., He, X., Han, J.: Graph regularized non-negative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2011)CrossRef
8.
go back to reference Li, Z., Wu, X., Peng, H.: Nonnegative matrix factorization on orthogonal subspace. Pattern Recogn. Lett. 31(9), 905–911 (2010)CrossRef Li, Z., Wu, X., Peng, H.: Nonnegative matrix factorization on orthogonal subspace. Pattern Recogn. Lett. 31(9), 905–911 (2010)CrossRef
9.
go back to reference Li, X., Shen, Y.: Robust nonnegative matrix factorization via half-quadratic minimization. In: 2012 IEEE 12th International Conference on Data Mining. IEEE Computer Society (2012) Li, X., Shen, Y.: Robust nonnegative matrix factorization via half-quadratic minimization. In: 2012 IEEE 12th International Conference on Data Mining. IEEE Computer Society (2012)
10.
go back to reference Li, Z., Tang, J., He, X.: Robust structured nonnegative matrix factorization for image representation. IEEE Trans. Neural Netw. Learn. Syst. 29(5), 1947–1960 (2018)MathSciNetCrossRef Li, Z., Tang, J., He, X.: Robust structured nonnegative matrix factorization for image representation. IEEE Trans. Neural Netw. Learn. Syst. 29(5), 1947–1960 (2018)MathSciNetCrossRef
11.
go back to reference He, Z., Xie, S., Zdunek, R.: Symmetric nonnegative matrix factorization: algorithms and applications to probabilistic clustering. IEEE Trans. Neural Netw. 22(12), 2117–2131 (2011) CrossRef He, Z., Xie, S., Zdunek, R.: Symmetric nonnegative matrix factorization: algorithms and applications to probabilistic clustering. IEEE Trans. Neural Netw. 22(12), 2117–2131 (2011) CrossRef
12.
go back to reference Phillips, P.-J., Moon, H., Rizvi, S.-A., Rauss, P.-J.: The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1090–1104 (2000)CrossRef Phillips, P.-J., Moon, H., Rizvi, S.-A., Rauss, P.-J.: The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1090–1104 (2000)CrossRef
13.
go back to reference Georghiades, A.-S., Belhumeur, P.-N., Kriegman, D.-J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 643–660 (2001)CrossRef Georghiades, A.-S., Belhumeur, P.-N., Kriegman, D.-J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 643–660 (2001)CrossRef
Metadata
Title
Robust Nonnegative Matrix Factorization Based on Cosine Similarity Induced Metric
Authors
Wen-Sheng Chen
Haitao Chen
Binbin Pan
Bo Chen
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-36204-1_23

Premium Partner