Skip to main content
Top
Published in: Neural Computing and Applications 1/2014

01-01-2014 | Original Article

Research of semi-supervised spectral clustering algorithm based on pairwise constraints

Authors: Shifei Ding, Hongjie Jia, Liwen Zhang, Fengxiang Jin

Published in: Neural Computing and Applications | Issue 1/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Clustering is often considered as an unsupervised data analysis method, but making full use of the prior information in the process of clustering will significantly improve the performance of the clustering algorithm. Spectral clustering algorithm can well use the prior pairwise constraint information to cluster and has become a new hot spot of machine learning research in recent years. In this paper, we propose an effective clustering algorithm, called a semi-supervised spectral clustering algorithm based on pairwise constraints, in which the similarity matrix of data points is adjusted and optimized by pairwise constraints. The experiments on real-world data sets demonstrate the effectiveness of this algorithm.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Jain A, Murty M, Flynn P (1999) Data clustering: a review. ACM Comput Surv 31(3):264–323CrossRef Jain A, Murty M, Flynn P (1999) Data clustering: a review. ACM Comput Surv 31(3):264–323CrossRef
2.
go back to reference Ding SF, Zhang LW, Zhang Y (2010) Research on spectral clustering algorithms and prospects. In: The 2nd international conference on computer engineering and technology (ICCET 2010), vol 6, April 16–18, 2010. Chengdu, pp 149–153 Ding SF, Zhang LW, Zhang Y (2010) Research on spectral clustering algorithms and prospects. In: The 2nd international conference on computer engineering and technology (ICCET 2010), vol 6, April 16–18, 2010. Chengdu, pp 149–153
3.
4.
go back to reference Gao Y, Gu SW, Tang J (2007) Research on spectral clustering in machine learning. Comput Sci 34(2):201–203 Gao Y, Gu SW, Tang J (2007) Research on spectral clustering in machine learning. Comput Sci 34(2):201–203
5.
go back to reference Malik J, Belongie S, Leung T, et al (2000) Contour and texture analysis for image segmentation. In: Perceptual organization for artificial vision systems, Kluwer, Dordrecht Malik J, Belongie S, Leung T, et al (2000) Contour and texture analysis for image segmentation. In: Perceptual organization for artificial vision systems, Kluwer, Dordrecht
6.
go back to reference Weiss Y (1999) Segmentation using eigenvectors: a unified view. In: International conference on computer vision Weiss Y (1999) Segmentation using eigenvectors: a unified view. In: International conference on computer vision
7.
go back to reference Shi J, Malik J (2000) Normalized cut s and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905CrossRef Shi J, Malik J (2000) Normalized cut s and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905CrossRef
8.
go back to reference Celikyilmaz A (2009) Soft-link spectral clustering for information extraction. In: IEEE third international conference on semantic computing (ICSC 2009), pp 434–441 Celikyilmaz A (2009) Soft-link spectral clustering for information extraction. In: IEEE third international conference on semantic computing (ICSC 2009), pp 434–441
9.
10.
11.
go back to reference Liu XY, Yong X, Lin HF (2011) An improved spectral clustering algorithm based on local neighbors in kernel space. Comput Sci Inf Syst 8(4):1143–1157CrossRef Liu XY, Yong X, Lin HF (2011) An improved spectral clustering algorithm based on local neighbors in kernel space. Comput Sci Inf Syst 8(4):1143–1157CrossRef
12.
go back to reference Wang Y, Jiang Y, Wu Y, Zhou ZH (2011) Spectral clustering on multiple manifolds. IEEE Trans Neural Netw 22(7):1149–1161CrossRef Wang Y, Jiang Y, Wu Y, Zhou ZH (2011) Spectral clustering on multiple manifolds. IEEE Trans Neural Netw 22(7):1149–1161CrossRef
13.
go back to reference Nie FP, Zeng ZN, Tsang IW, Xu D, Zhang CS (2011) Spectral embedded clustering: a framework for in-sample and out-of-sample spectral clustering. IEEE Trans Neural Netw 22(11):1796–1808CrossRef Nie FP, Zeng ZN, Tsang IW, Xu D, Zhang CS (2011) Spectral embedded clustering: a framework for in-sample and out-of-sample spectral clustering. IEEE Trans Neural Netw 22(11):1796–1808CrossRef
14.
go back to reference Zhao F, Liu HQ, Jiao LC (2011) Spectral clustering with fuzzy similarity measure. Digit Signal Process 21(6):701–709CrossRef Zhao F, Liu HQ, Jiao LC (2011) Spectral clustering with fuzzy similarity measure. Digit Signal Process 21(6):701–709CrossRef
15.
go back to reference Chen WY, Song YQ, Bai HJ et al (2011) Parallel spectral clustering in distributed systems. IEEE Trans Pattern Anal Mach Intell 33(3):568–586CrossRef Chen WY, Song YQ, Bai HJ et al (2011) Parallel spectral clustering in distributed systems. IEEE Trans Pattern Anal Mach Intell 33(3):568–586CrossRef
16.
go back to reference Xiao Y, Yu J (2008) Semi-supervised clustering based on affinity propagation algorithm. J Softw 19(11):2803–2813CrossRefMATH Xiao Y, Yu J (2008) Semi-supervised clustering based on affinity propagation algorithm. J Softw 19(11):2803–2813CrossRefMATH
17.
go back to reference Wang L, Bo LF, Jiao LC (2007) Density-sensitive semi-supervised spectral clustering. J Softw 18(10):2412–2422CrossRef Wang L, Bo LF, Jiao LC (2007) Density-sensitive semi-supervised spectral clustering. J Softw 18(10):2412–2422CrossRef
18.
go back to reference Wang N, Li X (2010) Active semi-supervised spectral clustering based on pairwise constraints. Acta Electronica Sinica 38(1):172–176 Wang N, Li X (2010) Active semi-supervised spectral clustering based on pairwise constraints. Acta Electronica Sinica 38(1):172–176
19.
go back to reference Cai XY, Dai GZ, Yang LB (2008) Survey on spectral clustering algorithms. Comput Sci 35(7):14–18 Cai XY, Dai GZ, Yang LB (2008) Survey on spectral clustering algorithms. Comput Sci 35(7):14–18
20.
go back to reference Ng AY, Jordan MI, Weiss Y (2002) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst 14: 849–856 Ng AY, Jordan MI, Weiss Y (2002) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst 14: 849–856
21.
go back to reference Li CL, Cao Z, Cao LP et al (2009) Some developments on semi-supervised clustering. Recognit Artif Intell 22(5):735–742 Li CL, Cao Z, Cao LP et al (2009) Some developments on semi-supervised clustering. Recognit Artif Intell 22(5):735–742
22.
go back to reference Zhong Shi (2006) Semi-supervised model-based document clustering: a comparative study. Mach Learn 65(1):3–29CrossRef Zhong Shi (2006) Semi-supervised model-based document clustering: a comparative study. Mach Learn 65(1):3–29CrossRef
23.
go back to reference Wagstaff K, Cardie C (2000) Clustering with instance-level constraints. In: Proceedings of the 17th international conference on machine learning, San Francisco, pp 1103–1110 Wagstaff K, Cardie C (2000) Clustering with instance-level constraints. In: Proceedings of the 17th international conference on machine learning, San Francisco, pp 1103–1110
24.
go back to reference Si WW, Qian YT (2005) Semi-supervised clustering based on spectral clustering. Comput Appl 25(6):1347–1349 Si WW, Qian YT (2005) Semi-supervised clustering based on spectral clustering. Comput Appl 25(6):1347–1349
25.
go back to reference Yin XS, Hu EL, Chen SC (2008) Discriminative semi-supervised clustering analysis with pairwise constraints. J Softw 19(11):2791–2802MATH Yin XS, Hu EL, Chen SC (2008) Discriminative semi-supervised clustering analysis with pairwise constraints. J Softw 19(11):2791–2802MATH
26.
go back to reference Davidon I, Ravi S (2007) The complexity of non-hierarchical clustering with instance and cluster level constraints. Data Min Knowl Disc 14(1):25–61CrossRef Davidon I, Ravi S (2007) The complexity of non-hierarchical clustering with instance and cluster level constraints. Data Min Knowl Disc 14(1):25–61CrossRef
27.
go back to reference Xu QJ, Desjardins M, Wagstaff K (2005) Constrained spectral clustering under a local proximity structure assumption. In: Proceedings of the 18th international conference of the Florida artificial intelligence research society (FLAIRS-05), Clearwater Beach, FL Xu QJ, Desjardins M, Wagstaff K (2005) Constrained spectral clustering under a local proximity structure assumption. In: Proceedings of the 18th international conference of the Florida artificial intelligence research society (FLAIRS-05), Clearwater Beach, FL
28.
go back to reference Klein D, Kamvar SD, Manning C (2002) From instance-level constraints to space-level constraints: making the most of prior knowledge in data clustering. In: Proceedings of the 19th international conference on machine learning. Sydney, pp 307–314 Klein D, Kamvar SD, Manning C (2002) From instance-level constraints to space-level constraints: making the most of prior knowledge in data clustering. In: Proceedings of the 19th international conference on machine learning. Sydney, pp 307–314
29.
go back to reference Jiang XQ (2008) Semi supervised clustering algorithm and its application and research. Jiangnan University, Wuxi Jiang XQ (2008) Semi supervised clustering algorithm and its application and research. Jiangnan University, Wuxi
30.
go back to reference Lei XF, Xie KQ, Lin F et al (2008) An efficient clustering algorithm based on local optimality of k-means. J Softw 19(7):1683–1692CrossRefMATH Lei XF, Xie KQ, Lin F et al (2008) An efficient clustering algorithm based on local optimality of k-means. J Softw 19(7):1683–1692CrossRefMATH
Metadata
Title
Research of semi-supervised spectral clustering algorithm based on pairwise constraints
Authors
Shifei Ding
Hongjie Jia
Liwen Zhang
Fengxiang Jin
Publication date
01-01-2014
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 1/2014
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-012-1207-8

Other articles of this Issue 1/2014

Neural Computing and Applications 1/2014 Go to the issue

Premium Partner