Top

Published in:

2019 | OriginalPaper | Chapter

A Three-Way Clustering Algorithm via Decomposing Similarity Matrices for Multi-view Data with Noise

Authors : Jing Xiong, Hong Yu

Published in: Rough Sets

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The multiple views of data can provide complementary information to each other, a large number of studies have demonstrated that one can achieve the better clustering performance by integrating information from multiple views than using only a single view. However, identifying the explicit cluster structure in the multi-view data with noise and reflecting uncertain relationships between objects and clusters is still a problem that has not been satisfactorily solved. To address the problem, this paper propose a three-way clustering algorithm for multi-view data with noise. The algorithm is mainly divided into two stages. In the first stage, we decompose the similarity matrix of each view into the good data and the corruptions to eliminate the noise contained in the multi-view data. In the second stage, only the clean data of each view is used to obtain the consistency information, and the final three-way clustering results are generated based on the theory of three-way decisions. The experimental results show that the proposed algorithm has better clustering performance in dealing with multi-view data with noise.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter The Prototype View of Concepts

next chapter A Scalable Approach to Fuzzy Rough Nearest Neighbour Classification with Ordered Weighted Averaging Operators

http://archive.ics.uci.edu/ml/.

http://mlg.ucd.ie/datasets/3sources.html.

https://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/multiclass.html.

https://archive.ics.uci.edu/ml/datasets.html.

Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceeding of the Eleventh Annual Conference on Computational Learning Theory, pp. 92–100. ACM (1998)

Bojchevski, A., Matkovic, Y., Gnnemann, S.: Robust spectral clustering for noisy data: modeling sparse corruptions improves latent embeddings. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 737–746. ACM (2017)

Bruno, E., Marchand-Maillet, S.: Multiview clustering: a late fusion approach using latent models. In: Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 736–737. ACM (2009)

Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 129–136. ACM (2009)

Danon, L., Daz-Guilera, A., Duch, J., Arenas, A.: Comparing community structure identification. J. Stat. Mech.: Theory Exp. 2005(09), P09008 (2005)CrossRef

Filippone, M., Camastra, F., Masulli, F., Rovetta, S.: A survey of kernel and spectral methods for clustering. Pattern Recognit. 41(1), 176–190 (2008)CrossRef

Gao, H.C., Nie, F.P., Li, X.L., Huang, H.: Multi-view subspace clustering. In: IEEE international Conference on Computer Vision, pp. 4238–4246. IEEE (2015)

Greene, D., Cunningham, P.: A matrix factorization approach for integrating multiple data views. In: Buntine, W., Grobelnik, M., Mladenić, D., Shawe-Taylor, J. (eds.) ECML PKDD 2009. LNCS (LNAI), vol. 5781, pp. 423–438. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-04180-8_45CrossRef

Houthuys, L., Langone, R., Suykens, A.K.J.: Multi-view kernel spectral clustering. Inf. Fusion 44, 46–56 (2018)CrossRef

10.

Jain, A.K.: Data clustering: 50 years beyond k-means. Pattern Recognit. Lett. 31(8), 651–666 (2010)CrossRef

11.

Jiang, Y.Z., Chung, F.L., Wang, S.T., Deng, Z.H., Wang, J., Qian, P.J.: Collaborative fuzzy clustering from multiple weighted views. IEEE Trans. Cybern. 45(4), 688–701 (2015)CrossRef

12.

Kanaan-Izquierdo, S., Ziyatdinov, A., Perera-Lluna, A.: Multiview and multifeature spectral clustering using common eigenvectors. Pattern Recognit. Lett. 102, 30–36 (2018)CrossRef

13.

Kumar, A., Daum, H.: A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th International Conference on Machine Learning (ICML 2011), pp. 393–400 (2011)

14.

Kumar, A., Rai, P., Daume, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1421 (2011)

15.

Li, K., Li, S., Ding, Z.M., Zhang, W.D., Fu, Y.: Latent discriminant subspace representations for multi-view outlier detection. In: Proceedings of the 32th AAAI Conference on Artificial Intelligence, pp. 3522–3529 (2018)

16.

Li, Y., Nie, F., Huang, H., Huang, J.: Large-scale multi-view spectral clustering via bipartite graph. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence, pp. 2750–2756 (2015)

17.

Lee, T.L., Liu, T.L.: Guided co-training for large-scale multi-view spectral clustering. arXiv preprint arXiv:1707.09866 (2017)

18.

Luo, S.R., Zhang, C.Q., Zhang, W., Cao, X.C.: Consistent and specific multi-view subspace clustering. In: Proceedings of the 32th AAAI Conference on Artificial Intelligence, pp. 3730–3737 (2018)

19.

Luxburg, U.V.: A tutorial on spectral clustering. Stat. Comput. 17(4), 395–416 (2007)MathSciNetCrossRef

20.

Ng, A.Y., Jordan, M.I., Weiss, Y.: On spectral clustering: analysis and an algorithm. In: Advances in Neural Information Processing Systems, pp. 849–856 (2001)

21.

Ren, P.Z., et al.: Robust auto-weighted multi-view clustering. In: 27th International Joint Conference on Artificial Intelligence (IJCAI), pp. 2644–2650 (2018)

22.

Steinley, D.: Properties of the hubert-arable adjusted rand index. Psychol. Methods 9(3), 386 (2004)CrossRef

23.

Sun, S.: A survey of multi-view machine learning. Neural Comput. Appl. 23(7–8), 2031–2038 (2013)CrossRef

24.

Wang, H., Nie, F., Huang, H.: Multi-view clustering and feature learning via structured sparsity, In: Proceedings of the 30th International Conference on Machine Learning (ICML 2013), pp. 352–360 (2013)

25.

Wang, X., Zhang, T., Gao, X.: Multiview clustering based on non-negative matrix factorization and pairwise measurements. IEEE Trans. Cybern. 99, 1–14 (2018)

26.

Wang, Y., Chen, L.: Multi-view fuzzy clustering with minimax optimization for effective clustering of data from multiple sources. Expert Syst. Appl. 72, 457–466 (2017)CrossRef

27.

Wen, J., Xu, Y., Liu, H.: Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans. Cybern. 1–12 (2018)

28.

Xia, R., Pan, Y., Du, L., Jin, Y.: Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp. 2149–2155 (2014)

29.

Xu, R., Wunsch, D.: Survey of clustering algorithms. IEEE Trans. Neural Netw. 16(3), 645–678 (2005)CrossRef

30.

Yao, Y.: An outline of a theory of three-way decisions. In: Yao, J.T., et al. (eds.) RSCTC 2012. LNCS (LNAI), vol. 7413, pp. 1–17. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-32115-3_1CrossRef

31.

Yao, Y.Y.: Three-way decisions and cognitive computing. Cogn. Comput. 8(4), 543–554 (2016)MathSciNetCrossRef

32.

Yu, H.: A framework of three-way cluster analysis. In: Polkowski, L., et al. (eds.) IJCRS 2017. LNCS (LNAI), vol. 10314, pp. 300–312. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60840-2_22CrossRef

33.

Yu, H., Wang, X.C., Wang, G.Y., Zeng, X.H.: An active three-way clustering method via low-rank matrices for multi-view data. Inf. Sci. 000, 1–17 (2018)CrossRef

34.

Zhang, G.Y., Wang, C.D., Huang, D., Zheng, W.X., Zhou, Y.R.: TW-Co-k-means: two-level weighted collaborative k-means for multi-view clustering. Knowl.-Based Syst. 150, 127–138 (2018)CrossRef

Title: A Three-Way Clustering Algorithm via Decomposing Similarity Matrices for Multi-view Data with Noise
Authors: Jing Xiong
Hong Yu
Publisher: Springer International Publishing
Book: Rough Sets
Print ISBN: 978-3-030-22814-9

Electronic ISBN: 978-3-030-22815-6

Copyright Year: 2019
DOI: https://doi.org/10.1007/978-3-030-22815-6_15

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner