Skip to main content
Erschienen in: Soft Computing 8/2017

28.03.2016 | Foundations

Multi-view spectral clustering via robust local subspace learning

verfasst von: Lin Feng, Lei Cai, Yang Liu, Shenglan Liu

Erschienen in: Soft Computing | Ausgabe 8/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Because of the existence of multiple sources of datasets, multi-view clustering has a wide range of applications in data mining and pattern recognition. Multi-view could utilize complementary information that existed in multiple views to improve the performance of clustering. Recently, there have been multi-view clustering methods which improved the performance of clustering to some extent. However, they do not take local representation relationship into consideration and local representation relationship is a crucial technology in subspace learning. To solve this problem, we proposed a novel multi-view clustering algorithm via robust local representation. We consider that all the views are derived from a robust unified subspace and noisy. To get the robust similarity matrix we simultaneously take all the local reconstruction relationships into consideration and use L1-norm to guarantee the sparsity. We give an iteration solution for this problem and give the proof of correctness. We compare our method with a number of classical methods on real-world and synthetic datasets to show the efficacy of the proposed algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Banerjee A, Dhillon I, Ghosh J et al (2003) Generative model-based clustering of directional data. In: Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 19–28 Banerjee A, Dhillon I, Ghosh J et al (2003) Generative model-based clustering of directional data. In: Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 19–28
Zurück zum Zitat Bickel S, Scheffer T (2004) Multi-view clustering. ICDM 4:19–26 Bickel S, Scheffer T (2004) Multi-view clustering. ICDM 4:19–26
Zurück zum Zitat Blaschko MB, Lampert CH (2008) Correlational spectral clustering. Computer Vision and Pattern Recognition CVPR 2008. IEEE Conference on. IEEE, pp 1–8 Blaschko MB, Lampert CH (2008) Correlational spectral clustering. Computer Vision and Pattern Recognition CVPR 2008. IEEE Conference on. IEEE, pp 1–8
Zurück zum Zitat Blum A, Mitchell T (1998) Combining labeled and unlabeled data with co-training. In: Proceedings of the eleventh annual conference on Computational learning theory. ACM, pp 92–100 Blum A, Mitchell T (1998) Combining labeled and unlabeled data with co-training. In: Proceedings of the eleventh annual conference on Computational learning theory. ACM, pp 92–100
Zurück zum Zitat Cai D, He X, Han J (2005) Document clustering using locality preserving indexing. IEEE Trans Knowl Data Eng 17(12):1624–1637CrossRef Cai D, He X, Han J (2005) Document clustering using locality preserving indexing. IEEE Trans Knowl Data Eng 17(12):1624–1637CrossRef
Zurück zum Zitat Chaudhuri K, Kakade SM, Livescu K et al (2009) Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th annual international conference on machine learning. ACM, pp 129-136 Chaudhuri K, Kakade SM, Livescu K et al (2009) Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th annual international conference on machine learning. ACM, pp 129-136
Zurück zum Zitat Cortes C, Mohri M, Rostamizadeh A (2009) Learning non-linear combinations of kernels. Adv Neural Inform Process Syst:396–404 Cortes C, Mohri M, Rostamizadeh A (2009) Learning non-linear combinations of kernels. Adv Neural Inform Process Syst:396–404
Zurück zum Zitat de Sa VR (2005) Spectral clustering with two views. ICML workshop on learning with multiple views, pp 20–27 de Sa VR (2005) Spectral clustering with two views. ICML workshop on learning with multiple views, pp 20–27
Zurück zum Zitat Deng C, Lv Z, Liu W et al (2015) Multi-view matrix decomposition: a new scheme for exploring discriminative information. In: Proceedings of the 24th International Conference on Artificial Intelligence. AAAI Press, pp 3438–3444 Deng C, Lv Z, Liu W et al (2015) Multi-view matrix decomposition: a new scheme for exploring discriminative information. In: Proceedings of the 24th International Conference on Artificial Intelligence. AAAI Press, pp 3438–3444
Zurück zum Zitat Ding C, Li T, Jordan M (2010) Convex and semi-nonnegative matrix factorizations. IEEE Trans Pattern Anal Mach Intell 32(1):45–55CrossRef Ding C, Li T, Jordan M (2010) Convex and semi-nonnegative matrix factorizations. IEEE Trans Pattern Anal Mach Intell 32(1):45–55CrossRef
Zurück zum Zitat Gui J, Tao D, Sun Z et al (2014) Group sparse multiview patch alignment framework with view consistency for image classification. IEEE Trans Image Process 23(7):3126–3137MathSciNetCrossRef Gui J, Tao D, Sun Z et al (2014) Group sparse multiview patch alignment framework with view consistency for image classification. IEEE Trans Image Process 23(7):3126–3137MathSciNetCrossRef
Zurück zum Zitat Karasuyama M, Mamitsuka H (2013) Manifold-based similarity adaptation for label propagation. Adv Neural Inform Process Syst:1547–1555 Karasuyama M, Mamitsuka H (2013) Manifold-based similarity adaptation for label propagation. Adv Neural Inform Process Syst:1547–1555
Zurück zum Zitat Kumar A, Rai P, Daume H (2011) Co-regularized multi-view spectral clustering. Adv Neural Inform Process Syst 2011:1413–1421 Kumar A, Rai P, Daume H (2011) Co-regularized multi-view spectral clustering. Adv Neural Inform Process Syst 2011:1413–1421
Zurück zum Zitat Kumar A, Daum H (2011) A co-training approach for multi-view spectral clustering. Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp 393–400 Kumar A, Daum H (2011) A co-training approach for multi-view spectral clustering. Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp 393–400
Zurück zum Zitat Lee DD, Seung HS (2001) Algorithms for non-negative matrix factorization. Adv Neural Inform Process Syst:556–562 Lee DD, Seung HS (2001) Algorithms for non-negative matrix factorization. Adv Neural Inform Process Syst:556–562
Zurück zum Zitat Liu J, Wang C, Gao J et al (2013) Multi-view clustering via joint nonnegative matrix factorization. In: Proc. of SDM. vol 13, pp 252–260 Liu J, Wang C, Gao J et al (2013) Multi-view clustering via joint nonnegative matrix factorization. In: Proc. of SDM. vol 13, pp 252–260
Zurück zum Zitat Long B, Philip SY, Zhongfei (Mark) Z (2008) A general model for multiple view unsupervised learning. SDM:822–833 Long B, Philip SY, Zhongfei (Mark) Z (2008) A general model for multiple view unsupervised learning. SDM:822–833
Zurück zum Zitat Lovsz L, Plummer MD (2009) Matching theory. In: American Mathematical Society Lovsz L, Plummer MD (2009) Matching theory. In: American Mathematical Society
Zurück zum Zitat Luo Y, Liu T, Tao D et al (2015) Multi-view matrix completion for multi-label image classification. IEEE Trans Image Process 24(8):2355–2368 Luo Y, Liu T, Tao D et al (2015) Multi-view matrix completion for multi-label image classification. IEEE Trans Image Process 24(8):2355–2368
Zurück zum Zitat Manning CD, Raghavan P, Schtze H (2008) Introduction to information retrieval. Cambridge University Press, CambridgeCrossRefMATH Manning CD, Raghavan P, Schtze H (2008) Introduction to information retrieval. Cambridge University Press, CambridgeCrossRefMATH
Zurück zum Zitat Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
Zurück zum Zitat Sun S (2013) A survey of multi-view machine learning. Neural Comput Appl 23(7–8):2031–2038CrossRef Sun S (2013) A survey of multi-view machine learning. Neural Comput Appl 23(7–8):2031–2038CrossRef
Zurück zum Zitat Tang W, Lu Z, Dhillon IS (2009) Clustering with multiple graphs, Data Mining. ICDM’09. Ninth IEEE International Conference on. IEEE, pp 1016–1021 Tang W, Lu Z, Dhillon IS (2009) Clustering with multiple graphs, Data Mining. ICDM’09. Ninth IEEE International Conference on. IEEE, pp 1016–1021
Zurück zum Zitat Tzortzis G, Likas A (2012) Kernel-based weighted multi-view clustering. Data Mining (ICDM), 2012 IEEE 12th International Conference on IEEE, pp 675–684 Tzortzis G, Likas A (2012) Kernel-based weighted multi-view clustering. Data Mining (ICDM), 2012 IEEE 12th International Conference on IEEE, pp 675–684
Zurück zum Zitat Tzortzis GF, Likas AC (2010) Multiple view clustering using a weighted combination of exemplar-based mixture models. IEEE Trans Neural Netw 21(12):1925–1938CrossRef Tzortzis GF, Likas AC (2010) Multiple view clustering using a weighted combination of exemplar-based mixture models. IEEE Trans Neural Netw 21(12):1925–1938CrossRef
Zurück zum Zitat Wang W, Zhou ZH (2007) Analyzing co-training style algorithms. Machine Learning: ECML. Springer, Berlin Heidelberg, pp 454–465 Wang W, Zhou ZH (2007) Analyzing co-training style algorithms. Machine Learning: ECML. Springer, Berlin Heidelberg, pp 454–465
Zurück zum Zitat Wang W, Zhou ZH (2010) A new analysis of co-training. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp 1135–1142 Wang W, Zhou ZH (2010) A new analysis of co-training. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp 1135–1142
Zurück zum Zitat Xia T, Tao D, Mei T et al (2010) Multiview spectral embedding. IEEE Trans Syst Man Cybern Part B: Cybern 40(6):1438–1446CrossRef Xia T, Tao D, Mei T et al (2010) Multiview spectral embedding. IEEE Trans Syst Man Cybern Part B: Cybern 40(6):1438–1446CrossRef
Zurück zum Zitat Xia R, Pan Y, Du L et al (2014) Robust multi-view spectral clustering via low-rank and sparse decomposition. In: AAAI Conference on Artificial Intelligence, pp 2149–2155 Xia R, Pan Y, Du L et al (2014) Robust multi-view spectral clustering via low-rank and sparse decomposition. In: AAAI Conference on Artificial Intelligence, pp 2149–2155
Zurück zum Zitat Xu C, Tao D, Xu C (2015a) Multi-view learning with incomplete views. IEEE Trans Image Process 24(12):5812–5824MathSciNetCrossRef Xu C, Tao D, Xu C (2015a) Multi-view learning with incomplete views. IEEE Trans Image Process 24(12):5812–5824MathSciNetCrossRef
Zurück zum Zitat Xu C, Tao D, Xu C (2015b) Multi-view intact space learning. IEEE Trans Pattern Anal Mach Intell 37(12):2531–2544CrossRef Xu C, Tao D, Xu C (2015b) Multi-view intact space learning. IEEE Trans Pattern Anal Mach Intell 37(12):2531–2544CrossRef
Zurück zum Zitat Xu W, Liu X, Gong Y (2003) Document clustering based on non-negative matrix factorization. In: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval. ACM, pp 267–273 Xu W, Liu X, Gong Y (2003) Document clustering based on non-negative matrix factorization. In: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval. ACM, pp 267–273
Zurück zum Zitat Xu C, Tao D, Xu C (2015c) Multi-view self-paced learning for clustering. In: Proceedings of the 24th International Conference on Artificial Intelligence. AAAI Press, pp 3974–3980 Xu C, Tao D, Xu C (2015c) Multi-view self-paced learning for clustering. In: Proceedings of the 24th International Conference on Artificial Intelligence. AAAI Press, pp 3974–3980
Zurück zum Zitat Zhang Q, Zhang L, Zhang L et al (2015) Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding. Pattern Recogn 48(10):3102–3112CrossRef Zhang Q, Zhang L, Zhang L et al (2015) Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding. Pattern Recogn 48(10):3102–3112CrossRef
Zurück zum Zitat Zhang X, Zhao L, Zong L et al (2014) Multi-view clustering via multi-manifold regularized nonnegative matrix factorization. Data Mining (ICDM), 2014 IEEE International Conference on IEEE, pp 1103–1108 Zhang X, Zhao L, Zong L et al (2014) Multi-view clustering via multi-manifold regularized nonnegative matrix factorization. Data Mining (ICDM), 2014 IEEE International Conference on IEEE, pp 1103–1108
Zurück zum Zitat Zhuang J, Wang J, HOI CH et al (2011) Unsupervised multiple kernel learning. J Mach Learn Res (JMLR) 20:129–144 Zhuang J, Wang J, HOI CH et al (2011) Unsupervised multiple kernel learning. J Mach Learn Res (JMLR) 20:129–144
Metadaten
Titel
Multi-view spectral clustering via robust local subspace learning
verfasst von
Lin Feng
Lei Cai
Yang Liu
Shenglan Liu
Publikationsdatum
28.03.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 8/2017
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-016-2120-3

Weitere Artikel der Ausgabe 8/2017

Soft Computing 8/2017 Zur Ausgabe

Premium Partner