Skip to main content

2017 | OriginalPaper | Buchkapitel

GNMF Revisited: Joint Robust k-NN Graph and Reconstruction-Based Graph Regularization for Image Clustering

verfasst von : Feng Gu, Wenju Zhang, Xiang Zhang, Chenxu Wang, Xuhui Huang, Zhigang Luo

Erschienen in: Artificial Neural Networks and Machine Learning – ICANN 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Clustering has long been a popular topic in machine learning and is the basic task of many vision applications. Graph regularized NMF (GNMF) and its variants as extensions of NMF decompose the whole dataset as the product of two low-rank matrices which respectively indicate centroids of clusters and cluster memberships for each sample. Although they utilize graph structure to reveal the geometrical structure within datasets, these methods completely ignore the robustness of graph structure. To address the issue above, this paper jointly incorporates a novel Robust Graph and Reconstruction-based Graph regularization into NMF (RG\(^2\)NMF) to promote the gain in clustering performance. Particularly, RG\(^2\)NMF stabilizes the objective of GNMF through the reconstruction regularization, and meanwhile exploits a learning procedure to derive the robust graph. Experiments of image clustering on two popular datasets illustrate the effectiveness of RG\(^2\)NMF compared with the baseline methods in quantities.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wu, X., Kumar, V., Quinlan, J.R., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G.J., Ng, A., Liu, B., Philip, S.Y., et al.: Top 10 algorithms in data mining. Knowl. Inf. Syst. 14(1), 1–37 (2008)CrossRef Wu, X., Kumar, V., Quinlan, J.R., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G.J., Ng, A., Liu, B., Philip, S.Y., et al.: Top 10 algorithms in data mining. Knowl. Inf. Syst. 14(1), 1–37 (2008)CrossRef
2.
Zurück zum Zitat Bauckhage, C.: K-means clustering is matrix factorization. CoRR abs/1512.07548 (2015) Bauckhage, C.: K-means clustering is matrix factorization. CoRR abs/1512.07548 (2015)
3.
Zurück zum Zitat Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401(6755), 788–791 (1999)CrossRefMATH Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401(6755), 788–791 (1999)CrossRefMATH
4.
Zurück zum Zitat Shahnaz, F., Berry, M.W., Pauca, V.P., Plemmons, R.J.: Document clustering using nonnegative matrix factorization. Inf. Process. Manag. 42(2), 373–386 (2006)CrossRefMATH Shahnaz, F., Berry, M.W., Pauca, V.P., Plemmons, R.J.: Document clustering using nonnegative matrix factorization. Inf. Process. Manag. 42(2), 373–386 (2006)CrossRefMATH
5.
Zurück zum Zitat Zhang, T., Fang, B., Tang, Y.Y., He, G., Wen, J.: Topology preserving non-negative matrix factorization for face recognition. IEEE Trans. Image Process. 17(4), 574–584 (2008)CrossRefMathSciNet Zhang, T., Fang, B., Tang, Y.Y., He, G., Wen, J.: Topology preserving non-negative matrix factorization for face recognition. IEEE Trans. Image Process. 17(4), 574–584 (2008)CrossRefMathSciNet
6.
Zurück zum Zitat Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2011)CrossRef Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2011)CrossRef
7.
Zurück zum Zitat Yang, J., Yang, S., Fu, Y., Li, X., Huang, T.S.: Non-negative graph embedding. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2008) Yang, J., Yang, S., Fu, Y., Li, X., Huang, T.S.: Non-negative graph embedding. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2008)
8.
Zurück zum Zitat Peng, C., Kang, Z., Hu, Y., Cheng, J., Cheng, Q.: Nonnegative matrix factorization with integrated graph and feature learning. ACM Trans. Intell. Syst. Technol. 8(3), 42 (2017)CrossRef Peng, C., Kang, Z., Hu, Y., Cheng, J., Cheng, Q.: Nonnegative matrix factorization with integrated graph and feature learning. ACM Trans. Intell. Syst. Technol. 8(3), 42 (2017)CrossRef
9.
Zurück zum Zitat Pei, X., Chen, C., Gong, W.: Concept factorization with adaptive neighbors for document clustering. IEEE Trans. Neural Netw. Learn. Syst. PP(99), 1–10 (2016) Pei, X., Chen, C., Gong, W.: Concept factorization with adaptive neighbors for document clustering. IEEE Trans. Neural Netw. Learn. Syst. PP(99), 1–10 (2016)
10.
Zurück zum Zitat Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRef Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRef
11.
Zurück zum Zitat Saenko, K., Kulis, B., Fritz, M., Darrell, T.: Adapting visual category models to new domains. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 213–226. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15561-1_16 CrossRef Saenko, K., Kulis, B., Fritz, M., Darrell, T.: Adapting visual category models to new domains. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 213–226. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-15561-1_​16 CrossRef
12.
Zurück zum Zitat Liu, H., Yang, Z., Yang, J., Wu, Z., Li, X.: Local coordinate concept factorization for image representation. IEEE Trans. Neural Netw. Learn. Syst. 25(6), 1071–1082 (2014)CrossRef Liu, H., Yang, Z., Yang, J., Wu, Z., Li, X.: Local coordinate concept factorization for image representation. IEEE Trans. Neural Netw. Learn. Syst. 25(6), 1071–1082 (2014)CrossRef
13.
Zurück zum Zitat Chen, Y., Zhang, J., Cai, D., Liu, W., He, X.: Nonnegative local coordinate factorization for image representation. IEEE Trans. Image Process. 22(3), 969–979 (2013)CrossRefMathSciNetMATH Chen, Y., Zhang, J., Cai, D., Liu, W., He, X.: Nonnegative local coordinate factorization for image representation. IEEE Trans. Image Process. 22(3), 969–979 (2013)CrossRefMathSciNetMATH
14.
Zurück zum Zitat Cheng, B., Yang, J., Yan, S., Fu, Y.: Learning with \(\ell ^{1}\)-graph for image analysis. IEEE Trans. Image Process. 19(4), 858–866 (2010)CrossRefMATHMathSciNet Cheng, B., Yang, J., Yan, S., Fu, Y.: Learning with \(\ell ^{1}\)-graph for image analysis. IEEE Trans. Image Process. 19(4), 858–866 (2010)CrossRefMATHMathSciNet
15.
Zurück zum Zitat Liu, G., Lin, Z., Yu, Y.: Robust subspace segmentation by low-rank representation. In: 27th International Conference on Machine Learning, pp. 663–670 (2010) Liu, G., Lin, Z., Yu, Y.: Robust subspace segmentation by low-rank representation. In: 27th International Conference on Machine Learning, pp. 663–670 (2010)
Metadaten
Titel
GNMF Revisited: Joint Robust k-NN Graph and Reconstruction-Based Graph Regularization for Image Clustering
verfasst von
Feng Gu
Wenju Zhang
Xiang Zhang
Chenxu Wang
Xuhui Huang
Zhigang Luo
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-68612-7_50

Premium Partner