Skip to main content
Top

2017 | OriginalPaper | Chapter

GNMF Revisited: Joint Robust k-NN Graph and Reconstruction-Based Graph Regularization for Image Clustering

Authors : Feng Gu, Wenju Zhang, Xiang Zhang, Chenxu Wang, Xuhui Huang, Zhigang Luo

Published in: Artificial Neural Networks and Machine Learning – ICANN 2017

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Clustering has long been a popular topic in machine learning and is the basic task of many vision applications. Graph regularized NMF (GNMF) and its variants as extensions of NMF decompose the whole dataset as the product of two low-rank matrices which respectively indicate centroids of clusters and cluster memberships for each sample. Although they utilize graph structure to reveal the geometrical structure within datasets, these methods completely ignore the robustness of graph structure. To address the issue above, this paper jointly incorporates a novel Robust Graph and Reconstruction-based Graph regularization into NMF (RG\(^2\)NMF) to promote the gain in clustering performance. Particularly, RG\(^2\)NMF stabilizes the objective of GNMF through the reconstruction regularization, and meanwhile exploits a learning procedure to derive the robust graph. Experiments of image clustering on two popular datasets illustrate the effectiveness of RG\(^2\)NMF compared with the baseline methods in quantities.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wu, X., Kumar, V., Quinlan, J.R., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G.J., Ng, A., Liu, B., Philip, S.Y., et al.: Top 10 algorithms in data mining. Knowl. Inf. Syst. 14(1), 1–37 (2008)CrossRef Wu, X., Kumar, V., Quinlan, J.R., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G.J., Ng, A., Liu, B., Philip, S.Y., et al.: Top 10 algorithms in data mining. Knowl. Inf. Syst. 14(1), 1–37 (2008)CrossRef
2.
go back to reference Bauckhage, C.: K-means clustering is matrix factorization. CoRR abs/1512.07548 (2015) Bauckhage, C.: K-means clustering is matrix factorization. CoRR abs/1512.07548 (2015)
3.
go back to reference Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401(6755), 788–791 (1999)CrossRefMATH Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401(6755), 788–791 (1999)CrossRefMATH
4.
go back to reference Shahnaz, F., Berry, M.W., Pauca, V.P., Plemmons, R.J.: Document clustering using nonnegative matrix factorization. Inf. Process. Manag. 42(2), 373–386 (2006)CrossRefMATH Shahnaz, F., Berry, M.W., Pauca, V.P., Plemmons, R.J.: Document clustering using nonnegative matrix factorization. Inf. Process. Manag. 42(2), 373–386 (2006)CrossRefMATH
5.
go back to reference Zhang, T., Fang, B., Tang, Y.Y., He, G., Wen, J.: Topology preserving non-negative matrix factorization for face recognition. IEEE Trans. Image Process. 17(4), 574–584 (2008)CrossRefMathSciNet Zhang, T., Fang, B., Tang, Y.Y., He, G., Wen, J.: Topology preserving non-negative matrix factorization for face recognition. IEEE Trans. Image Process. 17(4), 574–584 (2008)CrossRefMathSciNet
6.
go back to reference Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2011)CrossRef Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2011)CrossRef
7.
go back to reference Yang, J., Yang, S., Fu, Y., Li, X., Huang, T.S.: Non-negative graph embedding. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2008) Yang, J., Yang, S., Fu, Y., Li, X., Huang, T.S.: Non-negative graph embedding. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2008)
8.
go back to reference Peng, C., Kang, Z., Hu, Y., Cheng, J., Cheng, Q.: Nonnegative matrix factorization with integrated graph and feature learning. ACM Trans. Intell. Syst. Technol. 8(3), 42 (2017)CrossRef Peng, C., Kang, Z., Hu, Y., Cheng, J., Cheng, Q.: Nonnegative matrix factorization with integrated graph and feature learning. ACM Trans. Intell. Syst. Technol. 8(3), 42 (2017)CrossRef
9.
go back to reference Pei, X., Chen, C., Gong, W.: Concept factorization with adaptive neighbors for document clustering. IEEE Trans. Neural Netw. Learn. Syst. PP(99), 1–10 (2016) Pei, X., Chen, C., Gong, W.: Concept factorization with adaptive neighbors for document clustering. IEEE Trans. Neural Netw. Learn. Syst. PP(99), 1–10 (2016)
10.
go back to reference Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRef Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRef
11.
go back to reference Saenko, K., Kulis, B., Fritz, M., Darrell, T.: Adapting visual category models to new domains. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 213–226. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15561-1_16 CrossRef Saenko, K., Kulis, B., Fritz, M., Darrell, T.: Adapting visual category models to new domains. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 213–226. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-15561-1_​16 CrossRef
12.
go back to reference Liu, H., Yang, Z., Yang, J., Wu, Z., Li, X.: Local coordinate concept factorization for image representation. IEEE Trans. Neural Netw. Learn. Syst. 25(6), 1071–1082 (2014)CrossRef Liu, H., Yang, Z., Yang, J., Wu, Z., Li, X.: Local coordinate concept factorization for image representation. IEEE Trans. Neural Netw. Learn. Syst. 25(6), 1071–1082 (2014)CrossRef
13.
go back to reference Chen, Y., Zhang, J., Cai, D., Liu, W., He, X.: Nonnegative local coordinate factorization for image representation. IEEE Trans. Image Process. 22(3), 969–979 (2013)CrossRefMathSciNetMATH Chen, Y., Zhang, J., Cai, D., Liu, W., He, X.: Nonnegative local coordinate factorization for image representation. IEEE Trans. Image Process. 22(3), 969–979 (2013)CrossRefMathSciNetMATH
14.
go back to reference Cheng, B., Yang, J., Yan, S., Fu, Y.: Learning with \(\ell ^{1}\)-graph for image analysis. IEEE Trans. Image Process. 19(4), 858–866 (2010)CrossRefMATHMathSciNet Cheng, B., Yang, J., Yan, S., Fu, Y.: Learning with \(\ell ^{1}\)-graph for image analysis. IEEE Trans. Image Process. 19(4), 858–866 (2010)CrossRefMATHMathSciNet
15.
go back to reference Liu, G., Lin, Z., Yu, Y.: Robust subspace segmentation by low-rank representation. In: 27th International Conference on Machine Learning, pp. 663–670 (2010) Liu, G., Lin, Z., Yu, Y.: Robust subspace segmentation by low-rank representation. In: 27th International Conference on Machine Learning, pp. 663–670 (2010)
Metadata
Title
GNMF Revisited: Joint Robust k-NN Graph and Reconstruction-Based Graph Regularization for Image Clustering
Authors
Feng Gu
Wenju Zhang
Xiang Zhang
Chenxu Wang
Xuhui Huang
Zhigang Luo
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-68612-7_50

Premium Partner