Skip to main content
Erschienen in: Neural Computing and Applications 7-8/2014

01.12.2014 | Original Article

A density-adaptive affinity propagation clustering algorithm based on spectral dimension reduction

verfasst von: Hongjie Jia, Shifei Ding, Lingheng Meng, Shuyan Fan

Erschienen in: Neural Computing and Applications | Ausgabe 7-8/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

As a novel clustering method, affinity propagation (AP) clustering can identify high-quality cluster centers by passing messages between data points. But its ultimate cluster number is affected by a user-defined parameter called self-confidence. When aiming at a given number of clusters due to prior knowledge, AP has to be launched many times until an appropriate setting of self-confidence is found. K-AP algorithm overcomes this disadvantage by introducing a constraint in the process of message passing to exploit the immediate results of K clusters. The key to K-AP clustering is constructing a suitable similarity matrix, which can truly reflect the intrinsic structure of the dataset. In this paper, a density-adaptive similarity measure is designed to describe the relations between data points more reasonably. Meanwhile, in order to solve the difficulties faced by K-AP algorithm in high-dimensional data sets, we use the dimension reduction method based on spectral graph theory to map the original data points to a low-dimensional eigenspace and propose a density-adaptive AP clustering algorithm based on spectral dimension reduction. Experiments show that the proposed algorithm can effectively deal with the clustering problem of datasets with complex structure and multiple scales, avoiding the singularity problem caused by the high-dimensional eigenvectors. Its clustering performance is better than AP clustering algorithm and K-AP algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Jigui Sun, Jie Liu, Lianyu Zhao (2008) Clustering algorithms research. J Softw 19(1):48–61CrossRefMATH Jigui Sun, Jie Liu, Lianyu Zhao (2008) Clustering algorithms research. J Softw 19(1):48–61CrossRefMATH
3.
Zurück zum Zitat Zhang XL, Wang W, Nørvag K et al (2010) K-AP: generating specified K clusters by efficient affinity propagation. In: Proceedings 2010 10th IEEE international conference on data mining (ICDM 2010), pp 1187–1192 Zhang XL, Wang W, Nørvag K et al (2010) K-AP: generating specified K clusters by efficient affinity propagation. In: Proceedings 2010 10th IEEE international conference on data mining (ICDM 2010), pp 1187–1192
4.
Zurück zum Zitat Nascimento MCV, de Carvalho ACPLF (2011) Spectral methods for graph clustering-A survey. Eur J Oper Res 211(2):221–231CrossRefMATH Nascimento MCV, de Carvalho ACPLF (2011) Spectral methods for graph clustering-A survey. Eur J Oper Res 211(2):221–231CrossRefMATH
5.
Zurück zum Zitat Lu HT, Fu ZY, Shu X (2014) Non-negative and sparse spectral clustering. Pattern Recogn 47(1):418–426CrossRef Lu HT, Fu ZY, Shu X (2014) Non-negative and sparse spectral clustering. Pattern Recogn 47(1):418–426CrossRef
6.
Zurück zum Zitat Ding SF, Qi BJ, Jia HJ et al (2013) Research of semi-supervised spectral clustering based on constraints expansion. Neural Comput Appl 22(Suppl 1):405–410CrossRef Ding SF, Qi BJ, Jia HJ et al (2013) Research of semi-supervised spectral clustering based on constraints expansion. Neural Comput Appl 22(Suppl 1):405–410CrossRef
7.
Zurück zum Zitat Jun Dong, Suoping Wang, Fanlun Xiong (2010) Affinity propagation clustering based on variable-similarity measure. J Electron Inf Technol 32(3):509–514CrossRef Jun Dong, Suoping Wang, Fanlun Xiong (2010) Affinity propagation clustering based on variable-similarity measure. J Electron Inf Technol 32(3):509–514CrossRef
8.
Zurück zum Zitat Jiang XP, Hu XH, Xu WW et al (2013) Comparison of dimensional reduction methods for detecting and visualizing novel patterns in human and marine microbiome. IEEE Trans Nanobiosci 12(3):199–205CrossRef Jiang XP, Hu XH, Xu WW et al (2013) Comparison of dimensional reduction methods for detecting and visualizing novel patterns in human and marine microbiome. IEEE Trans Nanobiosci 12(3):199–205CrossRef
9.
Zurück zum Zitat Huang CC, Tu SH, Lien HH et al (2014) Estrogen receptor status prediction by gene component regression: a comparative study. Int J Data Min Bioinform 9(2):149–171CrossRef Huang CC, Tu SH, Lien HH et al (2014) Estrogen receptor status prediction by gene component regression: a comparative study. Int J Data Min Bioinform 9(2):149–171CrossRef
10.
Zurück zum Zitat Sun WW, Halevy A, Benedetto JJ et al (2014) Nonlinear dimensionality reduction via the ENH-LTSA method for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 7(2):375–388CrossRef Sun WW, Halevy A, Benedetto JJ et al (2014) Nonlinear dimensionality reduction via the ENH-LTSA method for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 7(2):375–388CrossRef
11.
Zurück zum Zitat Fan MY, Zhang XQ, Lin ZC et al (2014) A regularized approach for geodesic-based semisupervised multimanifold learning. IEEE Trans Image Process 23(5):2133–2147CrossRefMathSciNet Fan MY, Zhang XQ, Lin ZC et al (2014) A regularized approach for geodesic-based semisupervised multimanifold learning. IEEE Trans Image Process 23(5):2133–2147CrossRefMathSciNet
12.
Zurück zum Zitat Dhanjal C, Gaudel R, Clemencon S (2014) Efficient eigen-updating for spectral graph clustering. Neurocomputing 131:440–452CrossRef Dhanjal C, Gaudel R, Clemencon S (2014) Efficient eigen-updating for spectral graph clustering. Neurocomputing 131:440–452CrossRef
13.
Zurück zum Zitat Ding SF, Jia HJ, Zhang LW et al (2014) Research of semi-supervised spectral clustering algorithm based on pairwise constraints. Neural Comput Appl 24(1):211–219CrossRef Ding SF, Jia HJ, Zhang LW et al (2014) Research of semi-supervised spectral clustering algorithm based on pairwise constraints. Neural Comput Appl 24(1):211–219CrossRef
14.
Zurück zum Zitat Wacquet G, Caillault EP, Hamad D et al (2013) Constrained spectral embedding for K-way data clustering. Pattern Recogn Lett 34(9):1009–1017CrossRef Wacquet G, Caillault EP, Hamad D et al (2013) Constrained spectral embedding for K-way data clustering. Pattern Recogn Lett 34(9):1009–1017CrossRef
15.
Zurück zum Zitat Ng AY, Jordan MI, Weiss Y (2002) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst 14:849–856 Ng AY, Jordan MI, Weiss Y (2002) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst 14:849–856
16.
Zurück zum Zitat Zhou D, Bousquet O, Lal TN, Weston J (2004) Learning with local and global consistency. Adv Neural Inf Process Syst 16:321–328 Zhou D, Bousquet O, Lal TN, Weston J (2004) Learning with local and global consistency. Adv Neural Inf Process Syst 16:321–328
17.
Zurück zum Zitat Wang Y, Jiang Y, Wu Y, Zhou ZH (2011) Spectral clustering on multiple manifolds. IEEE Trans Neural Networks 22(7):1149–1161CrossRef Wang Y, Jiang Y, Wu Y, Zhou ZH (2011) Spectral clustering on multiple manifolds. IEEE Trans Neural Networks 22(7):1149–1161CrossRef
18.
Zurück zum Zitat Golub TR, Slonim DK, Tamayo P et al (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286(5439):531–537CrossRef Golub TR, Slonim DK, Tamayo P et al (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286(5439):531–537CrossRef
19.
Zurück zum Zitat Perou CM, Sørlie T, Eisen MB et al (2000) Molecular portraits of human breast tumours. Nature 406:747–752CrossRef Perou CM, Sørlie T, Eisen MB et al (2000) Molecular portraits of human breast tumours. Nature 406:747–752CrossRef
20.
Zurück zum Zitat Alizadeh AA, Eisen MB, Davis RE et al (2000) Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling. Nature 403:503–511CrossRef Alizadeh AA, Eisen MB, Davis RE et al (2000) Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling. Nature 403:503–511CrossRef
21.
Zurück zum Zitat Bach F, Jordan M (2003) Learning spectral clustering. In: Proceedings of neural information processing systems (NIPS 2003), pp 305–312 Bach F, Jordan M (2003) Learning spectral clustering. In: Proceedings of neural information processing systems (NIPS 2003), pp 305–312
22.
Zurück zum Zitat Xie JY, Jiang S, Xie WX et al (2011) An efficient global K-means clustering algorithm. J Comput 6(2):271–279CrossRef Xie JY, Jiang S, Xie WX et al (2011) An efficient global K-means clustering algorithm. J Comput 6(2):271–279CrossRef
Metadaten
Titel
A density-adaptive affinity propagation clustering algorithm based on spectral dimension reduction
verfasst von
Hongjie Jia
Shifei Ding
Lingheng Meng
Shuyan Fan
Publikationsdatum
01.12.2014
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 7-8/2014
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-014-1628-7

Weitere Artikel der Ausgabe 7-8/2014

Neural Computing and Applications 7-8/2014 Zur Ausgabe

Premium Partner