Skip to main content

2019 | OriginalPaper | Buchkapitel

A Three-Way Clustering Algorithm via Decomposing Similarity Matrices for Multi-view Data with Noise

verfasst von : Jing Xiong, Hong Yu

Erschienen in: Rough Sets

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The multiple views of data can provide complementary information to each other, a large number of studies have demonstrated that one can achieve the better clustering performance by integrating information from multiple views than using only a single view. However, identifying the explicit cluster structure in the multi-view data with noise and reflecting uncertain relationships between objects and clusters is still a problem that has not been satisfactorily solved. To address the problem, this paper propose a three-way clustering algorithm for multi-view data with noise. The algorithm is mainly divided into two stages. In the first stage, we decompose the similarity matrix of each view into the good data and the corruptions to eliminate the noise contained in the multi-view data. In the second stage, only the clean data of each view is used to obtain the consistency information, and the final three-way clustering results are generated based on the theory of three-way decisions. The experimental results show that the proposed algorithm has better clustering performance in dealing with multi-view data with noise.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceeding of the Eleventh Annual Conference on Computational Learning Theory, pp. 92–100. ACM (1998) Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceeding of the Eleventh Annual Conference on Computational Learning Theory, pp. 92–100. ACM (1998)
2.
Zurück zum Zitat Bojchevski, A., Matkovic, Y., Gnnemann, S.: Robust spectral clustering for noisy data: modeling sparse corruptions improves latent embeddings. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 737–746. ACM (2017) Bojchevski, A., Matkovic, Y., Gnnemann, S.: Robust spectral clustering for noisy data: modeling sparse corruptions improves latent embeddings. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 737–746. ACM (2017)
3.
Zurück zum Zitat Bruno, E., Marchand-Maillet, S.: Multiview clustering: a late fusion approach using latent models. In: Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 736–737. ACM (2009) Bruno, E., Marchand-Maillet, S.: Multiview clustering: a late fusion approach using latent models. In: Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 736–737. ACM (2009)
4.
Zurück zum Zitat Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 129–136. ACM (2009) Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 129–136. ACM (2009)
5.
Zurück zum Zitat Danon, L., Daz-Guilera, A., Duch, J., Arenas, A.: Comparing community structure identification. J. Stat. Mech.: Theory Exp. 2005(09), P09008 (2005)CrossRef Danon, L., Daz-Guilera, A., Duch, J., Arenas, A.: Comparing community structure identification. J. Stat. Mech.: Theory Exp. 2005(09), P09008 (2005)CrossRef
6.
Zurück zum Zitat Filippone, M., Camastra, F., Masulli, F., Rovetta, S.: A survey of kernel and spectral methods for clustering. Pattern Recognit. 41(1), 176–190 (2008)CrossRef Filippone, M., Camastra, F., Masulli, F., Rovetta, S.: A survey of kernel and spectral methods for clustering. Pattern Recognit. 41(1), 176–190 (2008)CrossRef
7.
Zurück zum Zitat Gao, H.C., Nie, F.P., Li, X.L., Huang, H.: Multi-view subspace clustering. In: IEEE international Conference on Computer Vision, pp. 4238–4246. IEEE (2015) Gao, H.C., Nie, F.P., Li, X.L., Huang, H.: Multi-view subspace clustering. In: IEEE international Conference on Computer Vision, pp. 4238–4246. IEEE (2015)
9.
Zurück zum Zitat Houthuys, L., Langone, R., Suykens, A.K.J.: Multi-view kernel spectral clustering. Inf. Fusion 44, 46–56 (2018)CrossRef Houthuys, L., Langone, R., Suykens, A.K.J.: Multi-view kernel spectral clustering. Inf. Fusion 44, 46–56 (2018)CrossRef
10.
Zurück zum Zitat Jain, A.K.: Data clustering: 50 years beyond k-means. Pattern Recognit. Lett. 31(8), 651–666 (2010)CrossRef Jain, A.K.: Data clustering: 50 years beyond k-means. Pattern Recognit. Lett. 31(8), 651–666 (2010)CrossRef
11.
Zurück zum Zitat Jiang, Y.Z., Chung, F.L., Wang, S.T., Deng, Z.H., Wang, J., Qian, P.J.: Collaborative fuzzy clustering from multiple weighted views. IEEE Trans. Cybern. 45(4), 688–701 (2015)CrossRef Jiang, Y.Z., Chung, F.L., Wang, S.T., Deng, Z.H., Wang, J., Qian, P.J.: Collaborative fuzzy clustering from multiple weighted views. IEEE Trans. Cybern. 45(4), 688–701 (2015)CrossRef
12.
Zurück zum Zitat Kanaan-Izquierdo, S., Ziyatdinov, A., Perera-Lluna, A.: Multiview and multifeature spectral clustering using common eigenvectors. Pattern Recognit. Lett. 102, 30–36 (2018)CrossRef Kanaan-Izquierdo, S., Ziyatdinov, A., Perera-Lluna, A.: Multiview and multifeature spectral clustering using common eigenvectors. Pattern Recognit. Lett. 102, 30–36 (2018)CrossRef
13.
Zurück zum Zitat Kumar, A., Daum, H.: A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th International Conference on Machine Learning (ICML 2011), pp. 393–400 (2011) Kumar, A., Daum, H.: A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th International Conference on Machine Learning (ICML 2011), pp. 393–400 (2011)
14.
Zurück zum Zitat Kumar, A., Rai, P., Daume, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1421 (2011) Kumar, A., Rai, P., Daume, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1421 (2011)
15.
Zurück zum Zitat Li, K., Li, S., Ding, Z.M., Zhang, W.D., Fu, Y.: Latent discriminant subspace representations for multi-view outlier detection. In: Proceedings of the 32th AAAI Conference on Artificial Intelligence, pp. 3522–3529 (2018) Li, K., Li, S., Ding, Z.M., Zhang, W.D., Fu, Y.: Latent discriminant subspace representations for multi-view outlier detection. In: Proceedings of the 32th AAAI Conference on Artificial Intelligence, pp. 3522–3529 (2018)
16.
Zurück zum Zitat Li, Y., Nie, F., Huang, H., Huang, J.: Large-scale multi-view spectral clustering via bipartite graph. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence, pp. 2750–2756 (2015) Li, Y., Nie, F., Huang, H., Huang, J.: Large-scale multi-view spectral clustering via bipartite graph. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence, pp. 2750–2756 (2015)
17.
18.
Zurück zum Zitat Luo, S.R., Zhang, C.Q., Zhang, W., Cao, X.C.: Consistent and specific multi-view subspace clustering. In: Proceedings of the 32th AAAI Conference on Artificial Intelligence, pp. 3730–3737 (2018) Luo, S.R., Zhang, C.Q., Zhang, W., Cao, X.C.: Consistent and specific multi-view subspace clustering. In: Proceedings of the 32th AAAI Conference on Artificial Intelligence, pp. 3730–3737 (2018)
20.
Zurück zum Zitat Ng, A.Y., Jordan, M.I., Weiss, Y.: On spectral clustering: analysis and an algorithm. In: Advances in Neural Information Processing Systems, pp. 849–856 (2001) Ng, A.Y., Jordan, M.I., Weiss, Y.: On spectral clustering: analysis and an algorithm. In: Advances in Neural Information Processing Systems, pp. 849–856 (2001)
21.
Zurück zum Zitat Ren, P.Z., et al.: Robust auto-weighted multi-view clustering. In: 27th International Joint Conference on Artificial Intelligence (IJCAI), pp. 2644–2650 (2018) Ren, P.Z., et al.: Robust auto-weighted multi-view clustering. In: 27th International Joint Conference on Artificial Intelligence (IJCAI), pp. 2644–2650 (2018)
22.
Zurück zum Zitat Steinley, D.: Properties of the hubert-arable adjusted rand index. Psychol. Methods 9(3), 386 (2004)CrossRef Steinley, D.: Properties of the hubert-arable adjusted rand index. Psychol. Methods 9(3), 386 (2004)CrossRef
23.
Zurück zum Zitat Sun, S.: A survey of multi-view machine learning. Neural Comput. Appl. 23(7–8), 2031–2038 (2013)CrossRef Sun, S.: A survey of multi-view machine learning. Neural Comput. Appl. 23(7–8), 2031–2038 (2013)CrossRef
24.
Zurück zum Zitat Wang, H., Nie, F., Huang, H.: Multi-view clustering and feature learning via structured sparsity, In: Proceedings of the 30th International Conference on Machine Learning (ICML 2013), pp. 352–360 (2013) Wang, H., Nie, F., Huang, H.: Multi-view clustering and feature learning via structured sparsity, In: Proceedings of the 30th International Conference on Machine Learning (ICML 2013), pp. 352–360 (2013)
25.
Zurück zum Zitat Wang, X., Zhang, T., Gao, X.: Multiview clustering based on non-negative matrix factorization and pairwise measurements. IEEE Trans. Cybern. 99, 1–14 (2018) Wang, X., Zhang, T., Gao, X.: Multiview clustering based on non-negative matrix factorization and pairwise measurements. IEEE Trans. Cybern. 99, 1–14 (2018)
26.
Zurück zum Zitat Wang, Y., Chen, L.: Multi-view fuzzy clustering with minimax optimization for effective clustering of data from multiple sources. Expert Syst. Appl. 72, 457–466 (2017)CrossRef Wang, Y., Chen, L.: Multi-view fuzzy clustering with minimax optimization for effective clustering of data from multiple sources. Expert Syst. Appl. 72, 457–466 (2017)CrossRef
27.
Zurück zum Zitat Wen, J., Xu, Y., Liu, H.: Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans. Cybern. 1–12 (2018) Wen, J., Xu, Y., Liu, H.: Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans. Cybern. 1–12 (2018)
28.
Zurück zum Zitat Xia, R., Pan, Y., Du, L., Jin, Y.: Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp. 2149–2155 (2014) Xia, R., Pan, Y., Du, L., Jin, Y.: Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp. 2149–2155 (2014)
29.
Zurück zum Zitat Xu, R., Wunsch, D.: Survey of clustering algorithms. IEEE Trans. Neural Netw. 16(3), 645–678 (2005)CrossRef Xu, R., Wunsch, D.: Survey of clustering algorithms. IEEE Trans. Neural Netw. 16(3), 645–678 (2005)CrossRef
33.
Zurück zum Zitat Yu, H., Wang, X.C., Wang, G.Y., Zeng, X.H.: An active three-way clustering method via low-rank matrices for multi-view data. Inf. Sci. 000, 1–17 (2018)CrossRef Yu, H., Wang, X.C., Wang, G.Y., Zeng, X.H.: An active three-way clustering method via low-rank matrices for multi-view data. Inf. Sci. 000, 1–17 (2018)CrossRef
34.
Zurück zum Zitat Zhang, G.Y., Wang, C.D., Huang, D., Zheng, W.X., Zhou, Y.R.: TW-Co-k-means: two-level weighted collaborative k-means for multi-view clustering. Knowl.-Based Syst. 150, 127–138 (2018)CrossRef Zhang, G.Y., Wang, C.D., Huang, D., Zheng, W.X., Zhou, Y.R.: TW-Co-k-means: two-level weighted collaborative k-means for multi-view clustering. Knowl.-Based Syst. 150, 127–138 (2018)CrossRef
Metadaten
Titel
A Three-Way Clustering Algorithm via Decomposing Similarity Matrices for Multi-view Data with Noise
verfasst von
Jing Xiong
Hong Yu
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-22815-6_15

Premium Partner