Skip to main content
Erschienen in: Neural Computing and Applications 7-8/2014

01.12.2014 | Original Article

Stability-based preference selection in affinity propagation

verfasst von: Dong-Wei Chen, Jian-Qiang Sheng, Jun-Jie Chen, Chang-Dong Wang

Erschienen in: Neural Computing and Applications | Ausgabe 7-8/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recently, as one of the most popular exemplar-based clustering algorithms, affinity propagation has attracted a great amount of attention in various fields. The advantages of affinity propagation include the efficiency, insensitivity to cluster initialization and capability of finding clusters with less error. However, one shortcoming of the affinity propagation algorithm is that, the clustering results generated by affinity propagation strongly depend on the selection of exemplar preferences, which is a challenging model selection task. To tackle this problem, this paper investigates the clustering stability of affinity propagation for automatically selecting appropriate exemplar preferences. The basic idea is to define a novel stability measure for affinity propagation, based on which we can select exemplar preferences that generate the most stable clustering results. Consequently, the proposed approach is termed stability-based affinity propagation (SAP). Experimental results conducted on extensive real-world datasets have validated the effectiveness of the proposed SAP algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Fußnoten
1
Exemplar is a data point that best represents a cluster. It is also termed cluster center or prototype in the literature of data clustering.
 
Literatur
1.
Zurück zum Zitat Akaik H (1974) A new look at statistical model identification. IEEE Trans Autom Cont 19:716–723CrossRef Akaik H (1974) A new look at statistical model identification. IEEE Trans Autom Cont 19:716–723CrossRef
3.
Zurück zum Zitat Bandyopadhyay S (2011) Multiobjective simulated annealing for fuzzy clustering with stability and validity. IEEE Trans Syst Man Cybern Part C Appl Rev 41(5):682–691CrossRef Bandyopadhyay S (2011) Multiobjective simulated annealing for fuzzy clustering with stability and validity. IEEE Trans Syst Man Cybern Part C Appl Rev 41(5):682–691CrossRef
4.
Zurück zum Zitat Ben-David S, von Luxburg U (2008) Relating clustering stability to properties of cluster boundaries. In: COLT 2008, pp. 379–390 Ben-David S, von Luxburg U (2008) Relating clustering stability to properties of cluster boundaries. In: COLT 2008, pp. 379–390
5.
Zurück zum Zitat Ben-David S, Pal D, Simon HU (2007) Stability of \(k\)-means clustering. In: Learning Theory, Lecture Notes in Computer Science 2007, vol 4539, pp 20–34 Ben-David S, Pal D, Simon HU (2007) Stability of \(k\)-means clustering. In: Learning Theory, Lecture Notes in Computer Science 2007, vol 4539, pp 20–34
6.
Zurück zum Zitat Bozdogan H (1987) Model selection and Akaike’s information criterion (AIC): the general theory and its analytical extensions. Psychometrika 52:345–370CrossRefMATHMathSciNet Bozdogan H (1987) Model selection and Akaike’s information criterion (AIC): the general theory and its analytical extensions. Psychometrika 52:345–370CrossRefMATHMathSciNet
7.
Zurück zum Zitat Ding S, Ma G, Shi Z (2013) A novel self-adaptive extreme learning machine based on affinity propagation for radial basis function neural network. Neural Computing and Applications (in press) Ding S, Ma G, Shi Z (2013) A novel self-adaptive extreme learning machine based on affinity propagation for radial basis function neural network. Neural Computing and Applications (in press)
8.
Zurück zum Zitat Dueck D, Frey BJ, Jojic N, Jojic V, Giaever G, Emili A, Musso G, Hegele R (2008) Constructing treatment portfolios using affinity propagation. In: RECOMB, pp. 360–371 Dueck D, Frey BJ, Jojic N, Jojic V, Giaever G, Emili A, Musso G, Hegele R (2008) Constructing treatment portfolios using affinity propagation. In: RECOMB, pp. 360–371
10.
Zurück zum Zitat Givoni IE, Chung C, Frey BJ (2011) Hierarchical affinity propagation. In: UAI, pp 238–246 Givoni IE, Chung C, Frey BJ (2011) Hierarchical affinity propagation. In: UAI, pp 238–246
12.
Zurück zum Zitat Givoni IE, Frey BJ (2009) Semi-supervised affinity propagation with instance-level constraints. In: AISTATS, pp. 161–168 Givoni IE, Frey BJ (2009) Semi-supervised affinity propagation with instance-level constraints. In: AISTATS, pp. 161–168
13.
Zurück zum Zitat Guo P, Jiang Z, Lin S, Yao Y (2012) Combining LVQ with SVM technique for image semantic annotation. Neural Comput Appl 21:735–746CrossRef Guo P, Jiang Z, Lin S, Yao Y (2012) Combining LVQ with SVM technique for image semantic annotation. Neural Comput Appl 21:735–746CrossRef
14.
15.
Zurück zum Zitat Hu X, Xu L (2003) A comparative study of several cluster number selection criteria. In: Intelligent data engineering and automated learning 2003, pp 195–202 Hu X, Xu L (2003) A comparative study of several cluster number selection criteria. In: Intelligent data engineering and automated learning 2003, pp 195–202
16.
Zurück zum Zitat Huang TH, Cheng KY, Chuang YY (2009) A collaborative benchmark for region of interest detection algorithms. In: CVPR, pp 296–303 Huang TH, Cheng KY, Chuang YY (2009) A collaborative benchmark for region of interest detection algorithms. In: CVPR, pp 296–303
17.
Zurück zum Zitat Hull JJ (1994) A database for handwritten text recognition research. IEEE Trans Pattern Anal Mach Intell 16(5):550–554CrossRef Hull JJ (1994) A database for handwritten text recognition research. IEEE Trans Pattern Anal Mach Intell 16(5):550–554CrossRef
18.
Zurück zum Zitat Kschischang FR, Frey BJ, Loeliger HA (2001) Factor graphs and the sum-product algorithm. IEEE Trans Inf Theory 47(2):498–519CrossRefMATHMathSciNet Kschischang FR, Frey BJ, Loeliger HA (2001) Factor graphs and the sum-product algorithm. IEEE Trans Inf Theory 47(2):498–519CrossRefMATHMathSciNet
19.
Zurück zum Zitat Kuncheva LI, Vetrov DP (2006) Evaluation of stability of k-means cluster ensembles with respect to random initialization. IEEE Trans Pattern Anal Mach Intell 28(11):1798–1808CrossRef Kuncheva LI, Vetrov DP (2006) Evaluation of stability of k-means cluster ensembles with respect to random initialization. IEEE Trans Pattern Anal Mach Intell 28(11):1798–1808CrossRef
20.
Zurück zum Zitat Lange T, Braun ML, Roth V, Buhmann JM (2002) Stability-based model selection. In: NIPS 2002, pp 617–624 Lange T, Braun ML, Roth V, Buhmann JM (2002) Stability-based model selection. In: NIPS 2002, pp 617–624
21.
Zurück zum Zitat Lange T, Roth V, Braun ML, Buhmann JM (2004) Stability-based validation of clustering solutions. Neural Comput 16:1299–1323CrossRefMATH Lange T, Roth V, Braun ML, Buhmann JM (2004) Stability-based validation of clustering solutions. Neural Comput 16:1299–1323CrossRefMATH
23.
Zurück zum Zitat von Luxburg U (2009) Clustering stability: an overview. Found Trends Mach Learn 2(3):235–274CrossRefMATH von Luxburg U (2009) Clustering stability: an overview. Found Trends Mach Learn 2(3):235–274CrossRefMATH
24.
Zurück zum Zitat MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings. of the Fifth Berkeley symposium on mathematical statistics and probability, University of California Press, California, vol 1, pp 281–297 MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings. of the Fifth Berkeley symposium on mathematical statistics and probability, University of California Press, California, vol 1, pp 281–297
25.
Zurück zum Zitat Rakhlin A, Caponnetto A (2006) Stability of \(k\)-means clustering. In: NIPS 2006, pp 1121–1128 Rakhlin A, Caponnetto A (2006) Stability of \(k\)-means clustering. In: NIPS 2006, pp 1121–1128
26.
Zurück zum Zitat Rinaldo A, Singh A, Nugent R, Wasserman L (2012) Stability of density-based clustering. J Mach Learn Res 13:905–948MATHMathSciNet Rinaldo A, Singh A, Nugent R, Wasserman L (2012) Stability of density-based clustering. J Mach Learn Res 13:905–948MATHMathSciNet
27.
Zurück zum Zitat Roth V, Braun ML, Lange T, Buhmann JM (2002) Stability-based model order selection in clustering with applications to gene expression data. In: Proceedings of ICANN 2002, pp 607–612 Roth V, Braun ML, Lange T, Buhmann JM (2002) Stability-based model order selection in clustering with applications to gene expression data. In: Proceedings of ICANN 2002, pp 607–612
28.
Zurück zum Zitat Shang F, Jiao L, Shi J, Wang F, Gong M (2012) Fast affinity propagation clustering: a multilevel approach. Pattern Recogn 45:474–486CrossRef Shang F, Jiao L, Shi J, Wang F, Gong M (2012) Fast affinity propagation clustering: a multilevel approach. Pattern Recogn 45:474–486CrossRef
29.
Zurück zum Zitat Strehl A, Ghosh J (2002) Cluster ensembles—a knowledge reuse framework for combining multiple partitions. J Mach Learn Res 3:583–617MathSciNet Strehl A, Ghosh J (2002) Cluster ensembles—a knowledge reuse framework for combining multiple partitions. J Mach Learn Res 3:583–617MathSciNet
30.
Zurück zum Zitat Sumedha ML, Weigt M (2008) Unsupervised and semi-supervised clustering by message passing: soft-constraint affinity propagation. Eur Phys J B 66:125–135CrossRef Sumedha ML, Weigt M (2008) Unsupervised and semi-supervised clustering by message passing: soft-constraint affinity propagation. Eur Phys J B 66:125–135CrossRef
31.
Zurück zum Zitat Tarlow D, Zemel RS, Frey BJ (2008) Flexible priors for exemplar-based clustering. In: UAI, pp 537–545 Tarlow D, Zemel RS, Frey BJ (2008) Flexible priors for exemplar-based clustering. In: UAI, pp 537–545
32.
Zurück zum Zitat Verma R, Wang P (2007) On detecting subtle pathology via tissue clustering of multi-parametric data using affinity propagation. In: ICCV, pp 1–8 Verma R, Wang P (2007) On detecting subtle pathology via tissue clustering of multi-parametric data using affinity propagation. In: ICCV, pp 1–8
33.
Zurück zum Zitat Vinh NX, Epps J, Bailey J (2009) Information theoretic measures for clusterings comparison: Is a correction for chance necessary? In: ICML 2009, pp 1073–1080 Vinh NX, Epps J, Bailey J (2009) Information theoretic measures for clusterings comparison: Is a correction for chance necessary? In: ICML 2009, pp 1073–1080
35.
Zurück zum Zitat Wang CD, Lai JH, Huang D (2011) Kernel-based clustering with automatic cluster number selection. In: ICDM Workshops 2011, pp 293–299 Wang CD, Lai JH, Huang D (2011) Kernel-based clustering with automatic cluster number selection. In: ICDM Workshops 2011, pp 293–299
36.
Zurück zum Zitat Wang CD, Lai JH, Suen CY, Zhu JY (2013) Multi-exemplar affinity propagation. IEEE Trans Pattern Anal Mach Intell 35(9):2223–2237CrossRef Wang CD, Lai JH, Suen CY, Zhu JY (2013) Multi-exemplar affinity propagation. IEEE Trans Pattern Anal Mach Intell 35(9):2223–2237CrossRef
37.
Zurück zum Zitat Wang CD, Lai JH, Zhu JY (2012) Graph-based multiprototype competitive learning and its applications. IEEE Trans Syst Man Cybern C Appl Rev 42(6):934–946CrossRef Wang CD, Lai JH, Zhu JY (2012) Graph-based multiprototype competitive learning and its applications. IEEE Trans Syst Man Cybern C Appl Rev 42(6):934–946CrossRef
38.
Zurück zum Zitat Xiao J, Wang J, Tan P, Quan L (2007) Joint affinity propagation for multiple view segmentation. In: ICCV, pp 1–7 Xiao J, Wang J, Tan P, Quan L (2007) Joint affinity propagation for multiple view segmentation. In: ICCV, pp 1–7
39.
Zurück zum Zitat Xu B, Hu R, Guo P (2013) Combining affinity propagation with supervised dictionary learning for image classification. Neural Comput Appl 22:1301–1308CrossRef Xu B, Hu R, Guo P (2013) Combining affinity propagation with supervised dictionary learning for image classification. Neural Comput Appl 22:1301–1308CrossRef
40.
Zurück zum Zitat Xu L, Krzyzak A, Oja E (1993) Rival penalized competitive learning for clustering analysis, RBF net, and curve detection. IEEE Trans Neural Netw 4(4):636–649. doi:10.1109/72.238318 CrossRef Xu L, Krzyzak A, Oja E (1993) Rival penalized competitive learning for clustering analysis, RBF net, and curve detection. IEEE Trans Neural Netw 4(4):636–649. doi:10.​1109/​72.​238318 CrossRef
41.
Zurück zum Zitat Yang D, Guo P (2011) Image modeling with combined optimization techniques for image semantic annotation. Neural Comput Appl 20:1001–1015CrossRef Yang D, Guo P (2011) Image modeling with combined optimization techniques for image semantic annotation. Neural Comput Appl 20:1001–1015CrossRef
42.
Zurück zum Zitat Zhang X, Furtlehner C, Sebag M (2008) Data streaming with affinity propagation. In: ECML, pp 628–643 Zhang X, Furtlehner C, Sebag M (2008) Data streaming with affinity propagation. In: ECML, pp 628–643
43.
Zurück zum Zitat Zhao ZQ, Gao J, Glotin H, Wu X (2010) A matrix modular neural network based on task decomposition with subspace division by adaptive affinity propagation clustering. Appl Math Model 34:3884–3895CrossRefMATHMathSciNet Zhao ZQ, Gao J, Glotin H, Wu X (2010) A matrix modular neural network based on task decomposition with subspace division by adaptive affinity propagation clustering. Appl Math Model 34:3884–3895CrossRefMATHMathSciNet
44.
Zurück zum Zitat Zhou P, Li D, Wu H, Cheng F (2011) The automatic model selection and variable kernel width for RBF neural networks. Neurocomputing 74:3628–3637CrossRef Zhou P, Li D, Wu H, Cheng F (2011) The automatic model selection and variable kernel width for RBF neural networks. Neurocomputing 74:3628–3637CrossRef
Metadaten
Titel
Stability-based preference selection in affinity propagation
verfasst von
Dong-Wei Chen
Jian-Qiang Sheng
Jun-Jie Chen
Chang-Dong Wang
Publikationsdatum
01.12.2014
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 7-8/2014
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-014-1671-4

Weitere Artikel der Ausgabe 7-8/2014

Neural Computing and Applications 7-8/2014 Zur Ausgabe

Premium Partner