Skip to main content

2018 | OriginalPaper | Buchkapitel

Multi-view Proximity Learning for Clustering

verfasst von : Kun-Yu Lin, Ling Huang, Chang-Dong Wang, Hong-Yang Chao

Erschienen in: Database Systems for Advanced Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In recent years, multi-view clustering has become a hot research topic due to the increasing amount of multi-view data. Among existing multi-view clustering methods, proximity-based method is a typical class and achieves much success. Usually, these methods need proximity matrices as inputs, which can be constructed by some nearest-neighbors-based approaches. However, in this way, neither the intra-view cluster structure nor the inter-view correlation is considered in constructing proximity matrices. To address this issue, we propose a novel method, named multi-view proximity learning. By introducing the idea of representative, our model can consider both the relations between data objects and the cluster structure within individual views. Besides, the spectral-embedding-based scheme is adopted for modeling the correlations across different views, i.e. the view consistency and complement properties. Extensive experiments on both synthetic and real-world datasets demonstrate the effectiveness of our method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Müller, E., Assent, I., Sánchez, I.P., Mülle, Y., Böhm, K.: Outlier ranking via subspace analysis in multiple views of the data. In: 12th IEEE International Conference on Data Mining, pp. 529–538. IEEE (2012) Müller, E., Assent, I., Sánchez, I.P., Mülle, Y., Böhm, K.: Outlier ranking via subspace analysis in multiple views of the data. In: 12th IEEE International Conference on Data Mining, pp. 529–538. IEEE (2012)
3.
Zurück zum Zitat Chen, C., He, J., Bliss, N., Tong, H.: Towards optimal connectivity on multi-layered networks. IEEE Trans. Knowl. Data Eng. 29(10), 2332–2346 (2017)CrossRef Chen, C., He, J., Bliss, N., Tong, H.: Towards optimal connectivity on multi-layered networks. IEEE Trans. Knowl. Data Eng. 29(10), 2332–2346 (2017)CrossRef
4.
Zurück zum Zitat Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the 11th Annual Conference on Computational Learning Theory, pp. 92–100 (1998) Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the 11th Annual Conference on Computational Learning Theory, pp. 92–100 (1998)
5.
Zurück zum Zitat Amini, M., Usunier, N., Goutte, C.: Learning from multiple partially observed views-an application to multilingual text categorization. Adv. Neural Inf. Process. Syst. 22, 28–36 (2009) Amini, M., Usunier, N., Goutte, C.: Learning from multiple partially observed views-an application to multilingual text categorization. Adv. Neural Inf. Process. Syst. 22, 28–36 (2009)
6.
Zurück zum Zitat Xu, Y.M., Wang, C.D., Lai, J.H.: Weighted multi-view clustering with feature selection. Pattern Recogn. 53, 25–35 (2016)CrossRef Xu, Y.M., Wang, C.D., Lai, J.H.: Weighted multi-view clustering with feature selection. Pattern Recogn. 53, 25–35 (2016)CrossRef
7.
Zurück zum Zitat Zhang, G.Y., Wang, C.D., Huang, D., Zheng, W.S.: Multi-view collaborative locally adaptive clustering with Minkowski metric. Expert Syst. Appl. 86, 307–320 (2017)CrossRef Zhang, G.Y., Wang, C.D., Huang, D., Zheng, W.S.: Multi-view collaborative locally adaptive clustering with Minkowski metric. Expert Syst. Appl. 86, 307–320 (2017)CrossRef
8.
Zurück zum Zitat Huang, L., Chao, H.Y., Wang, C.D.: Multi-view intact space clustering. In: Proceedings of the 4th Asian Conference on Pattern Recognition, pp. 500–505 (2017) Huang, L., Chao, H.Y., Wang, C.D.: Multi-view intact space clustering. In: Proceedings of the 4th Asian Conference on Pattern Recognition, pp. 500–505 (2017)
9.
Zurück zum Zitat Xu, R., Wunsch, D.C.: Survey of clustering algorithms. IEEE Trans. Neural Netw. 16(3), 645–678 (2005)CrossRef Xu, R., Wunsch, D.C.: Survey of clustering algorithms. IEEE Trans. Neural Netw. 16(3), 645–678 (2005)CrossRef
10.
Zurück zum Zitat Xu, C., Tao, D., Xu, C.: A survey on multi-view learning. CoRR abs/1304.5634 (2013) Xu, C., Tao, D., Xu, C.: A survey on multi-view learning. CoRR abs/1304.5634 (2013)
11.
Zurück zum Zitat Xia, T., Tao, D., Mei, T., Zhang, Y.: Multiview spectral embedding. IEEE Trans. Syst. Man Cybern. Part B 40(6), 1438–1446 (2010)CrossRef Xia, T., Tao, D., Mei, T., Zhang, Y.: Multiview spectral embedding. IEEE Trans. Syst. Man Cybern. Part B 40(6), 1438–1446 (2010)CrossRef
12.
Zurück zum Zitat Tzortzis, G., Likas, A.: Kernel-based weighted multi-view clustering. In: 12th IEEE International Conference on Data Mining, pp. 675–684 (2012) Tzortzis, G., Likas, A.: Kernel-based weighted multi-view clustering. In: 12th IEEE International Conference on Data Mining, pp. 675–684 (2012)
13.
Zurück zum Zitat Kumar, A., Daumé, H.: A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th International Conference on Machine Learning, pp. 393–400 (2011) Kumar, A., Daumé, H.: A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th International Conference on Machine Learning, pp. 393–400 (2011)
14.
Zurück zum Zitat Son, J.W., Jeon, J., Lee, A., Kim, S.J.: Spectral clustering with brainstorming process for multi-view data. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 2548–2554 (2017) Son, J.W., Jeon, J., Lee, A., Kim, S.J.: Spectral clustering with brainstorming process for multi-view data. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 2548–2554 (2017)
15.
Zurück zum Zitat Kumar, A., Rai, P., Daumé, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1421 (2011) Kumar, A., Rai, P., Daumé, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1421 (2011)
16.
Zurück zum Zitat Lu, C., Yan, S., Lin, Z.: Convex sparse spectral clustering: single-view to multi-view. IEEE Trans. Image Process. 25(6), 2833–2843 (2016)MathSciNetCrossRef Lu, C., Yan, S., Lin, Z.: Convex sparse spectral clustering: single-view to multi-view. IEEE Trans. Image Process. 25(6), 2833–2843 (2016)MathSciNetCrossRef
17.
Zurück zum Zitat Wang, C.D., Lai, J.H., Yu, P.: Multi-view clustering based on belief propagation. IEEE Trans. Knowl. Data Eng. 28(4), 1007–1021 (2016)CrossRef Wang, C.D., Lai, J.H., Yu, P.: Multi-view clustering based on belief propagation. IEEE Trans. Knowl. Data Eng. 28(4), 1007–1021 (2016)CrossRef
18.
Zurück zum Zitat Xia, R., Pan, Y., Du, L., Yin, J.: Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp. 2149–2155 (2014) Xia, R., Pan, Y., Du, L., Yin, J.: Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp. 2149–2155 (2014)
20.
Zurück zum Zitat Zelnik-Manor, L., Perona, P.: Self-tuning spectral clustering. Adv. Neural Inf. Process. Syst. 17, 1601–1608 (2005) Zelnik-Manor, L., Perona, P.: Self-tuning spectral clustering. Adv. Neural Inf. Process. Syst. 17, 1601–1608 (2005)
21.
Zurück zum Zitat Shah, S.A., Koltun, V.: Robust continuous clustering. Proc. Nat. Acad. Sci. U.S.A. 114(37), 9814 (2017)CrossRef Shah, S.A., Koltun, V.: Robust continuous clustering. Proc. Nat. Acad. Sci. U.S.A. 114(37), 9814 (2017)CrossRef
22.
Zurück zum Zitat Nie, F., Wang, X., Huang, H.: Clustering and projected clustering with adaptive neighbors. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 977–986 (2014) Nie, F., Wang, X., Huang, H.: Clustering and projected clustering with adaptive neighbors. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 977–986 (2014)
23.
Zurück zum Zitat Wang, W., Carreira-Perpinán, M.A.: Projection onto the probability simplex: an efficient algorithm with a simple proof, and an application. CoRR abs/1309.1541 (2013) Wang, W., Carreira-Perpinán, M.A.: Projection onto the probability simplex: an efficient algorithm with a simple proof, and an application. CoRR abs/1309.1541 (2013)
25.
Zurück zum Zitat Li, F.F., Fergus, R., Perona, P.: Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2004, p. 178 (2004) Li, F.F., Fergus, R., Perona, P.: Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2004, p. 178 (2004)
26.
Zurück zum Zitat Li, Y., Nie, F., Huang, H., Huang, J.: Large-scale multi-view spectral clustering via bipartite graph. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence, pp. 2750–2756 (2015) Li, Y., Nie, F., Huang, H., Huang, J.: Large-scale multi-view spectral clustering via bipartite graph. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence, pp. 2750–2756 (2015)
27.
Zurück zum Zitat MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297 (1967) MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297 (1967)
28.
Zurück zum Zitat Cai, X., Nie, F., Huang, H.: Multi-view \(k\)-means clustering on big data. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence, pp. 2598–2604 (2013) Cai, X., Nie, F., Huang, H.: Multi-view \(k\)-means clustering on big data. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence, pp. 2598–2604 (2013)
29.
Zurück zum Zitat Nie, F., Cai, G., Li, X.: Multi-view clustering and semi-supervised classification with adaptive neighbours. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 2408–2414 (2017) Nie, F., Cai, G., Li, X.: Multi-view clustering and semi-supervised classification with adaptive neighbours. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 2408–2414 (2017)
30.
Zurück zum Zitat Nie, F., Wang, X., Jordan, M.I., Huang, H.: The constrained Laplacian rank algorithm for graph-based clustering. In: Proceedings of the 30th AAAI Conference on Artificial Intelligence, pp. 1969–1976 (2016) Nie, F., Wang, X., Jordan, M.I., Huang, H.: The constrained Laplacian rank algorithm for graph-based clustering. In: Proceedings of the 30th AAAI Conference on Artificial Intelligence, pp. 1969–1976 (2016)
Metadaten
Titel
Multi-view Proximity Learning for Clustering
verfasst von
Kun-Yu Lin
Ling Huang
Chang-Dong Wang
Hong-Yang Chao
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91458-9_25