Skip to main content
Top
Published in: Soft Computing 1/2019

30-04-2018 | Methodologies and Application

Multi-view clustering via spectral embedding fusion

Authors: Hongwei Yin, Fanzhang Li, Li Zhang, Zhao Zhang

Published in: Soft Computing | Issue 1/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multi-view learning, such as multi-view feature learning and multi-view clustering, has a wide range of applications in machine learning and pattern recognition. Most previous studies employ the multiple data information from various views to improve the performance of learning. The key problem is to integrate the symbiotic part of the different views or datasets. In practical clustering task, the symbiotic part includes two levels: global structure information and local structure information. However, traditional multi-view clustering methods usually ignore the energy of the local structure information. This paper proposes a novel multi-view clustering model to solve this problem, which simultaneously integrates the global structure information and local structure information of all the views. By integrating the fusion of global spectral embedding and the fusion of spectral manifold embedding from multi-view data, we construct an objective function to find the final fusional embedding and give an iteration method to solve it by using the \(L_{2,1}\) norm. Finally, the K-means clustering method is applied to the obtained final fusional embedding. Extensive experimental results on several real multi-view data sets demonstrate the superior performance of our model.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Belkin M, Niyogi P (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Advances in neural information processing systems 14 [Neural information processing systems: natural and synthetic, NIPS 2001, December 3–8, 2001, Vancouver, British Columbia, Canada], pp 585–591 Belkin M, Niyogi P (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Advances in neural information processing systems 14 [Neural information processing systems: natural and synthetic, NIPS 2001, December 3–8, 2001, Vancouver, British Columbia, Canada], pp 585–591
go back to reference Cai X, Nie F, Huang H, Kamangar F (2011) Heterogeneous image feature integration via multi-modal spectral clustering. In: The 24th IEEE conference on computer vision and pattern recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, pp 1977–1984. https://doi.org/10.1109/CVPR.2011.5995740 Cai X, Nie F, Huang H, Kamangar F (2011) Heterogeneous image feature integration via multi-modal spectral clustering. In: The 24th IEEE conference on computer vision and pattern recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, pp 1977–1984. https://​doi.​org/​10.​1109/​CVPR.​2011.​5995740
go back to reference Chang X, Nie F, Ma Z, Yang Y, Zhou X (2015) A convex formulation for spectral shrunk clustering. In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, January 25–30, 2015, Austin, Texas, USA, pp 2532–2538 Chang X, Nie F, Ma Z, Yang Y, Zhou X (2015) A convex formulation for spectral shrunk clustering. In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, January 25–30, 2015, Austin, Texas, USA, pp 2532–2538
go back to reference Dhillon PS, Foster DP, Ungar LH (2011) Multi-view learning of word embeddings via CCA. In: Advances in neural information processing systems 24: 25th annual conference on neural information processing systems 2011. Proceedings of a meeting held 12–14 December 2011, Granada, Spain, pp 199–207 Dhillon PS, Foster DP, Ungar LH (2011) Multi-view learning of word embeddings via CCA. In: Advances in neural information processing systems 24: 25th annual conference on neural information processing systems 2011. Proceedings of a meeting held 12–14 December 2011, Granada, Spain, pp 199–207
go back to reference Kumar A, Daume III H (2011) A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th international conference on machine learning, ICML 2011, Bellevue, Washington, USA, June 28–July 2, 2011, pp 393–400 Kumar A, Daume III H (2011) A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th international conference on machine learning, ICML 2011, Bellevue, Washington, USA, June 28–July 2, 2011, pp 393–400
go back to reference Kumar A, Rai P, Daume III H (2011) Co-regularized multi-view spectral clustering. In: Advances in neural information processing systems 24: 25th annual conference on neural information processing systems 2011. Proceedings of a meeting held 12–14 December 2011, Granada, Spain, pp 1413–1421 Kumar A, Rai P, Daume III H (2011) Co-regularized multi-view spectral clustering. In: Advances in neural information processing systems 24: 25th annual conference on neural information processing systems 2011. Proceedings of a meeting held 12–14 December 2011, Granada, Spain, pp 1413–1421
go back to reference Li Y, Nie F, Huang H, Huang J (2015) Large-scale multi-view spectral clustering via bipartite graph. In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, January 25–30, 2015, Austin, Texas, USA, pp 2750–2756 Li Y, Nie F, Huang H, Huang J (2015) Large-scale multi-view spectral clustering via bipartite graph. In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, January 25–30, 2015, Austin, Texas, USA, pp 2750–2756
go back to reference Memisevic R (2012) On multi-view feature learning. In: Proceedings of the 29th international conference on machine learning, ICML 2012, Edinburgh, Scotland, UK, June 26–July 1, 2012 Memisevic R (2012) On multi-view feature learning. In: Proceedings of the 29th international conference on machine learning, ICML 2012, Edinburgh, Scotland, UK, June 26–July 1, 2012
go back to reference Ng AY, Jordan MI, Weiss Y (2001) On spectral clustering: analysis and an algorithm. In: Advances in neural information processing systems 14 [Neural information processing systems: natural and synthetic, NIPS 2001, December 3–8, 2001, Vancouver, British Columbia, Canada], pp 849–856 Ng AY, Jordan MI, Weiss Y (2001) On spectral clustering: analysis and an algorithm. In: Advances in neural information processing systems 14 [Neural information processing systems: natural and synthetic, NIPS 2001, December 3–8, 2001, Vancouver, British Columbia, Canada], pp 849–856
go back to reference Nie F, Huang H, Cai X, Ding CHQ (2010) Efficient and robust feature selection via joint \(l_{2,1}\)-norms minimization. In: Advances in neural information processing systems 23: 24th annual conference on neural information processing systems 2010. Proceedings of a meeting held 6–9 December 2010, Vancouver, British Columbia, Canada, pp 1813–1821 Nie F, Huang H, Cai X, Ding CHQ (2010) Efficient and robust feature selection via joint \(l_{2,1}\)-norms minimization. In: Advances in neural information processing systems 23: 24th annual conference on neural information processing systems 2010. Proceedings of a meeting held 6–9 December 2010, Vancouver, British Columbia, Canada, pp 1813–1821
go back to reference Nie F, Wang X, Huang H (2014) Clustering and projected clustering with adaptive neighbors. In: The 20th ACM SIGKDD international conference on knowledge discovery and data mining, KDD ’14, New York, NY, USA, August 24–27, pp 977–986 Nie F, Wang X, Huang H (2014) Clustering and projected clustering with adaptive neighbors. In: The 20th ACM SIGKDD international conference on knowledge discovery and data mining, KDD ’14, New York, NY, USA, August 24–27, pp 977–986
go back to reference Polito M, Perona P (2001) Grouping and dimensionality reduction by locally linear embedding. In: Advances in neural information processing systems 14 [Neural information processing systems: natural and synthetic, NIPS 2001, December 3–8, 2001, Vancouver, British Columbia, Canada], pp 1255–1262 Polito M, Perona P (2001) Grouping and dimensionality reduction by locally linear embedding. In: Advances in neural information processing systems 14 [Neural information processing systems: natural and synthetic, NIPS 2001, December 3–8, 2001, Vancouver, British Columbia, Canada], pp 1255–1262
go back to reference Xia R, Pan Y, Du L, Yin J (2014) Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, July 27–31, 2014, Québec City, Québec, Canada, pp 2149–2155 Xia R, Pan Y, Du L, Yin J (2014) Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, July 27–31, 2014, Québec City, Québec, Canada, pp 2149–2155
go back to reference Yin Q, Wu S, Wang L (2015) Incomplete multi-view clustering via subspace learning. In: Proceedings of the 24th ACM international conference on information and knowledge management, CIKM 2015, Melbourne, VIC, Australia, October 19–23, 2015, pp 383–392. https://doi.org/10.1145/2806416.2806526 Yin Q, Wu S, Wang L (2015) Incomplete multi-view clustering via subspace learning. In: Proceedings of the 24th ACM international conference on information and knowledge management, CIKM 2015, Melbourne, VIC, Australia, October 19–23, 2015, pp 383–392. https://​doi.​org/​10.​1145/​2806416.​2806526
go back to reference Zhou D, Burges CJC (2007) Spectral clustering and transductive learning with multiple views. In: Proceedings of the twenty-fourth international conference on machine learning (ICML 2007), Corvallis, Oregon, USA, June 20–24, 2007, pp 1159–1166. https://doi.org/10.1145/1273496.1273642 Zhou D, Burges CJC (2007) Spectral clustering and transductive learning with multiple views. In: Proceedings of the twenty-fourth international conference on machine learning (ICML 2007), Corvallis, Oregon, USA, June 20–24, 2007, pp 1159–1166. https://​doi.​org/​10.​1145/​1273496.​1273642
Metadata
Title
Multi-view clustering via spectral embedding fusion
Authors
Hongwei Yin
Fanzhang Li
Li Zhang
Zhao Zhang
Publication date
30-04-2018
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 1/2019
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-018-3184-z

Other articles of this Issue 1/2019

Soft Computing 1/2019 Go to the issue

Premium Partner