Skip to main content
Top

2015 | OriginalPaper | Chapter

Evolutionary Nonnegative Matrix Factorization for Data Compression

Authors : Liyun Gong, Tingting Mu, John Y. Goulermas

Published in: Intelligent Computing Theories and Methodologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper aims at improving non-negative matrix factorization (NMF) to facilitate data compression. An evolutionary updating strategy is proposed to solve the NMF problem iteratively based on three sets of updating rules including multiplicative, firefly and survival of the fittest rules. For data compression application, the quality of the factorized matrices can be evaluated by measurements such as sparsity, orthogonality and factorization error to assess compression quality in terms of storage space consumption, redundancy in data matrix and data approximation accuracy. Thus, the fitness score function that drives the evolving procedure is designed as a composite score that takes into account all these measurements. A hybrid initialization scheme is performed to improve the rate of convergence, allowing multiple initial candidates generated by different types of NMF initialization approaches. Effectiveness of the proposed method is demonstrated using Yale and ORL image datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bezdek, J.C., Ehrlich, R., Full, W.: FCM: the fuzzy c-means clustering algorithm. Comput. Geosoci 10(2–3), 191–203 (1984)CrossRef Bezdek, J.C., Ehrlich, R., Full, W.: FCM: the fuzzy c-means clustering algorithm. Comput. Geosoci 10(2–3), 191–203 (1984)CrossRef
2.
go back to reference Forgy, E.W.: Cluster analysis of multivariate data: efficiency versus interpretability of classifications. Biometrics 21, 768–769 (1965) Forgy, E.W.: Cluster analysis of multivariate data: efficiency versus interpretability of classifications. Biometrics 21, 768–769 (1965)
3.
go back to reference Langville, A.N., Meyer, C.D., Albright, R.: Initializations for the nonnegative matrix factorization. In: Proceeding of the Twelfth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2006) Langville, A.N., Meyer, C.D., Albright, R.: Initializations for the nonnegative matrix factorization. In: Proceeding of the Twelfth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2006)
4.
go back to reference Lawson, C.L., Hanson, R.J.: Solving Least Squares Problems. Prentice Hall, Englewood Cliffs (1974)MATH Lawson, C.L., Hanson, R.J.: Solving Least Squares Problems. Prentice Hall, Englewood Cliffs (1974)MATH
5.
go back to reference Nikitidis, S., Tefas, A., Pitas, I.: Projected gradients for subclass discriminant nonnegative subspace learning. IEEE Transactions on Cybernetics. In press (2014). doi:10.1109/TCYB.2014.2317174 Nikitidis, S., Tefas, A., Pitas, I.: Projected gradients for subclass discriminant nonnegative subspace learning. IEEE Transactions on Cybernetics. In press (2014). doi:10.​1109/​TCYB.​2014.​2317174
6.
go back to reference Rand, W.M.: Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. Theor. Methods Sect. 66, 846–850 (1971)CrossRef Rand, W.M.: Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. Theor. Methods Sect. 66, 846–850 (1971)CrossRef
7.
go back to reference Rezaei, M., Boostani, R., Rezaei, M.: An efficient initialization method for non- negative matrix factorization. J. Appl. Sci. 11, 354–359 (2011)CrossRefMATH Rezaei, M., Boostani, R., Rezaei, M.: An efficient initialization method for non- negative matrix factorization. J. Appl. Sci. 11, 354–359 (2011)CrossRefMATH
8.
go back to reference Wild, S.: Seeding Non-negative Matrix Factorizations with The Spherical K-means Clustering. Master’s thesis, Master of Science thesis, University of Colorado (2003) Wild, S.: Seeding Non-negative Matrix Factorizations with The Spherical K-means Clustering. Master’s thesis, Master of Science thesis, University of Colorado (2003)
9.
go back to reference Yang, X.S.: Firefly Algorithm, Stochastic Test Functions and Design Optimization Yang, X.S.: Firefly Algorithm, Stochastic Test Functions and Design Optimization
10.
go back to reference Zhao, L., Zhuang, G., Xu, X.: Facial expression recognition based on PCA and NMF. In: Proceedings of the 7th World Congress on Intelligent Control and Automation, pp. 6826–6829 (2008) Zhao, L., Zhuang, G., Xu, X.: Facial expression recognition based on PCA and NMF. In: Proceedings of the 7th World Congress on Intelligent Control and Automation, pp. 6826–6829 (2008)
11.
go back to reference Zheng, Z., Yang, X., Zhu, Y.: Initialization Enhancer for Non-negative Matrix Factorization. Eng. Appl. Artif. Intell. 20, 101–110 (2007)CrossRefMATH Zheng, Z., Yang, X., Zhu, Y.: Initialization Enhancer for Non-negative Matrix Factorization. Eng. Appl. Artif. Intell. 20, 101–110 (2007)CrossRefMATH
12.
go back to reference Zhi, R., Flierl, M., Ruan, Q., Kleijn, W.B.: Graph-preserving sparse nonnegative matrix factorization with application to facial expression recognition. IEEE Trans. Cybern. 41, 38–52 (2011)CrossRef Zhi, R., Flierl, M., Ruan, Q., Kleijn, W.B.: Graph-preserving sparse nonnegative matrix factorization with application to facial expression recognition. IEEE Trans. Cybern. 41, 38–52 (2011)CrossRef
Metadata
Title
Evolutionary Nonnegative Matrix Factorization for Data Compression
Authors
Liyun Gong
Tingting Mu
John Y. Goulermas
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-22180-9_3

Premium Partner