Skip to main content
Erschienen in: Neural Processing Letters 2/2019

22.09.2018

Discriminative Graph Based Similarity Boosting

verfasst von: Qianying Wang, Ming Lu

Erschienen in: Neural Processing Letters | Ausgabe 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Similarity measurement is crucial for unsupervised learning and semi-supervised learning. Unsupervised methods need a similarity to do clustering. Semi-supervised algorithms need a similarity to take advantage of unlabeled data. In this paper, we develop a boosted similarity learning algorithm. The ensemble similarity is the weighted sum of a few component similarities. Each component similarity is learned form a graph G(VE), where \(V=\{x_1, x_2,\ldots ,x_n\}\) represent the data and the edges E represent the distance (or similarity) between them. For a given graph, we propose “within graph-cluster scatter \(S_{w}\)” and “between graph-cluster scatter \(S_{b}\)” to analyze the discrimination of the graph. So the contributions of this paper are: (i) we develop a boosting similarity learning strategy based on a few graphs, so the proposed strategy can take advantage of a few graphs rather than only one; (ii) we propose “within graph-cluster scatter \(S_{w}\)” and “between graph-cluster scatter \(S_{b}\)” to measure the discrimination of a graph. Experimental results on both synthetic and public available data sets show that the proposed method outperforms the sate-of-the-arts.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chapelle O, Schölkopf B, Zien A (2006) Semi-supervised learning. MIT Press, CambridgeCrossRef Chapelle O, Schölkopf B, Zien A (2006) Semi-supervised learning. MIT Press, CambridgeCrossRef
2.
Zurück zum Zitat Zhang Z, Zhao M, Chow TWS (2015) Graph based constrained semi-supervised learning framework via label propagation over adaptive neighborhood. IEEE Trans Knowl Data Eng 27(9):2362–2376CrossRef Zhang Z, Zhao M, Chow TWS (2015) Graph based constrained semi-supervised learning framework via label propagation over adaptive neighborhood. IEEE Trans Knowl Data Eng 27(9):2362–2376CrossRef
3.
Zurück zum Zitat Bellet A, Habrard A, Sebban M (2012) Similarity learning for provably accurate sparse linear classification. In: International conference on machine learning Bellet A, Habrard A, Sebban M (2012) Similarity learning for provably accurate sparse linear classification. In: International conference on machine learning
4.
Zurück zum Zitat Guo ZC, Ying Y (2014) Guaranteed classification via regularized similarity learning. Neural Comput 26(3):497–522MathSciNetCrossRef Guo ZC, Ying Y (2014) Guaranteed classification via regularized similarity learning. Neural Comput 26(3):497–522MathSciNetCrossRef
5.
Zurück zum Zitat Chechik G, Sharma V, Shalit U, Bengio S (2010) Large scale online learning of image similarity through ranking. J Mach Learn Res 11(2):1109–1135MathSciNetMATH Chechik G, Sharma V, Shalit U, Bengio S (2010) Large scale online learning of image similarity through ranking. J Mach Learn Res 11(2):1109–1135MathSciNetMATH
6.
Zurück zum Zitat Lim D, Lanckriet GRG (2014) Efficient learning of mahalanobis metrics for ranking. In: International conference on machine learning, pp 1980–1988 Lim D, Lanckriet GRG (2014) Efficient learning of mahalanobis metrics for ranking. In: International conference on machine learning, pp 1980–1988
7.
Zurück zum Zitat Qin X, Liu D, Wang D (2017) Heterogeneous similarity learning for more practical kinship verification. Neural Process Lett 12:1–17 Qin X, Liu D, Wang D (2017) Heterogeneous similarity learning for more practical kinship verification. Neural Process Lett 12:1–17
8.
Zurück zum Zitat Yi J, Jin R, Jain AK, Jain S, Yang T (2012) Semi-crowdsourced clustering: generalizing crowd labeling by robust distance metric learning. In: Advances in neural information processing systems, pp 1772–1780 Yi J, Jin R, Jain AK, Jain S, Yang T (2012) Semi-crowdsourced clustering: generalizing crowd labeling by robust distance metric learning. In: Advances in neural information processing systems, pp 1772–1780
9.
Zurück zum Zitat Xing EP, Ng AY, Jordan MI, Russell S (2002) Distance metric learning, with application to clustering with side-information. Adv Neural Inf Process Syst 15:505–512 Xing EP, Ng AY, Jordan MI, Russell S (2002) Distance metric learning, with application to clustering with side-information. Adv Neural Inf Process Syst 15:505–512
10.
Zurück zum Zitat Ng AY, Jordan MI, Weiss Y (2002) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst 2:849–856 Ng AY, Jordan MI, Weiss Y (2002) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst 2:849–856
11.
Zurück zum Zitat Jordan MI, Bach FR (2004) Learning spectral clustering. Adv Neural Inf Process Syst 7(2):2006 Jordan MI, Bach FR (2004) Learning spectral clustering. Adv Neural Inf Process Syst 7(2):2006
12.
Zurück zum Zitat Wu Z, Yin M, Zhou Y, Fang X, Xie S (2017) Robust spectral subspace clustering based on least square regression. Neural Process Lett 3:1–14 Wu Z, Yin M, Zhou Y, Fang X, Xie S (2017) Robust spectral subspace clustering based on least square regression. Neural Process Lett 3:1–14
13.
Zurück zum Zitat Bellet A, Habrard A, Sebban M (2013) A survey on metric learning for feature vectors and structured data. CoRR. arXiv:1306.6709 Bellet A, Habrard A, Sebban M (2013) A survey on metric learning for feature vectors and structured data. CoRR. arXiv:​1306.​6709
15.
Zurück zum Zitat Cai D, He X, Han J (2007) Semi-supervised discriminant analysis. In: IEEE 11th international conference on computer vision, pp 1–7 Cai D, He X, Han J (2007) Semi-supervised discriminant analysis. In: IEEE 11th international conference on computer vision, pp 1–7
16.
Zurück zum Zitat Hoi SCH, Liu W, Chang S-F (2010) Semi-supervised distance metric learning for collaborative image retrieval and clustering. ACM Trans Multimed Comput Commun Appl (TOMCCAP) 6(3):18 Hoi SCH, Liu W, Chang S-F (2010) Semi-supervised distance metric learning for collaborative image retrieval and clustering. ACM Trans Multimed Comput Commun Appl (TOMCCAP) 6(3):18
17.
Zurück zum Zitat Xiang S, Nie F, Zhang C (2008) Learning a Mahalanobis distance metric for data clustering and classification. Pattern Recognit 41(12):3600–3612CrossRef Xiang S, Nie F, Zhang C (2008) Learning a Mahalanobis distance metric for data clustering and classification. Pattern Recognit 41(12):3600–3612CrossRef
18.
Zurück zum Zitat Wang Q, Yuen PC, Feng G (2013) Semi-supervised metric learning via topology preserving multiple semi-supervised assumptions. Pattern Recognit 46(9):2576C2587CrossRef Wang Q, Yuen PC, Feng G (2013) Semi-supervised metric learning via topology preserving multiple semi-supervised assumptions. Pattern Recognit 46(9):2576C2587CrossRef
19.
Zurück zum Zitat Chechik G, Sharma V, Shalit U, Bengio S (2009) Large scale online learning of image similarity through ranking. Springer, Berlin, pp 11–14MATH Chechik G, Sharma V, Shalit U, Bengio S (2009) Large scale online learning of image similarity through ranking. Springer, Berlin, pp 11–14MATH
20.
Zurück zum Zitat Wang Q, Lu M, Li J (2018) Similarity learning based on sparse representation for semi-supervised boosting. Int J Comput Intell Appl 17(2):1850011CrossRef Wang Q, Lu M, Li J (2018) Similarity learning based on sparse representation for semi-supervised boosting. Int J Comput Intell Appl 17(2):1850011CrossRef
21.
Zurück zum Zitat Chen SB, Ding CH, Luo B (2014) Similarity learning of manifold data. IEEE Trans Cybern 45(9):1744–1756CrossRef Chen SB, Ding CH, Luo B (2014) Similarity learning of manifold data. IEEE Trans Cybern 45(9):1744–1756CrossRef
22.
Zurück zum Zitat Liu K, Bellet A, Sha F (2014) Similarity learning for high-dimensional sparse data. Eprint Arxiv, pp 653–662 Liu K, Bellet A, Sha F (2014) Similarity learning for high-dimensional sparse data. Eprint Arxiv, pp 653–662
23.
Zurück zum Zitat Li J-H, Wang C-D, Li P-Z, Lai J-H (2018) Discriminative metric learning for multi-view graph partitioning. Pattern Recognit 75:199–213CrossRef Li J-H, Wang C-D, Li P-Z, Lai J-H (2018) Discriminative metric learning for multi-view graph partitioning. Pattern Recognit 75:199–213CrossRef
24.
Zurück zum Zitat Wang Q, Yuen PC, Feng G, Wang PS (2012) Similarity learning based on semi-supervised graph for classification. Int J Pattern Recognit Artif Intell 26(4):1250009MathSciNetCrossRef Wang Q, Yuen PC, Feng G, Wang PS (2012) Similarity learning based on semi-supervised graph for classification. Int J Pattern Recognit Artif Intell 26(4):1250009MathSciNetCrossRef
25.
Zurück zum Zitat Carreira-Perpinán MA, Zemel RS (2005) Proximity graphs for clustering and manifold learning. Adv Neural Inf Process Syst 17:225–232 Carreira-Perpinán MA, Zemel RS (2005) Proximity graphs for clustering and manifold learning. Adv Neural Inf Process Syst 17:225–232
26.
Zurück zum Zitat Zelnik-Manor L, Perona P (2004) Self-tuning spectral clustering. Adv Neural Inf Process Syst 17:1601–1608 Zelnik-Manor L, Perona P (2004) Self-tuning spectral clustering. Adv Neural Inf Process Syst 17:1601–1608
27.
Zurück zum Zitat Zhang X, Li J, Yu H (2011) Local density adaptive similarity measurement for spectral clustering. Pattern Recognit Lett 32(2):352–358CrossRef Zhang X, Li J, Yu H (2011) Local density adaptive similarity measurement for spectral clustering. Pattern Recognit Lett 32(2):352–358CrossRef
28.
Zurück zum Zitat Xia T, Cao J, Zhang YD, Li JT (2009) On defining affinity graph for spectral clustering through ranking on manifolds. Neurocomputing 72(1315):3203–3211CrossRef Xia T, Cao J, Zhang YD, Li JT (2009) On defining affinity graph for spectral clustering through ranking on manifolds. Neurocomputing 72(1315):3203–3211CrossRef
29.
Zurück zum Zitat Wang QY, Yuen PC, Feng GC (2011) Similarity learning for semi-supervised multi-class boosting. In: Acoustics, 2011 IEEE international conference on speech and signal processing (ICASSP), pp 2164–2167 Wang QY, Yuen PC, Feng GC (2011) Similarity learning for semi-supervised multi-class boosting. In: Acoustics, 2011 IEEE international conference on speech and signal processing (ICASSP), pp 2164–2167
30.
Zurück zum Zitat Valizadegan H, Jin R, Jain AK (2008) Semi-supervised boosting for multi-class classification. Mach Learn Knowl Discov Databases 522–537 Valizadegan H, Jin R, Jain AK (2008) Semi-supervised boosting for multi-class classification. Mach Learn Knowl Discov Databases 522–537
31.
Zurück zum Zitat Tanha J, Someren MV, Afsarmanesh H (2014) Boosting for multiclass semi-supervised learning. Pattern Recognit Lett 37(1):63–C77CrossRef Tanha J, Someren MV, Afsarmanesh H (2014) Boosting for multiclass semi-supervised learning. Pattern Recognit Lett 37(1):63–C77CrossRef
32.
Zurück zum Zitat Song E, Huang D, Ma G, Hung CC (2011) Semi-supervised multi-class Adaboost by exploiting unlabeled data. Expert Syst Appl 38(6):6720–6726CrossRef Song E, Huang D, Ma G, Hung CC (2011) Semi-supervised multi-class Adaboost by exploiting unlabeled data. Expert Syst Appl 38(6):6720–6726CrossRef
33.
Zurück zum Zitat Huang D, Lai JH, Wang CD (2015) Combining multiple clusterings via crowd agreement estimation and multi-granularity link analysis. Neurocomputing 170:240–250CrossRef Huang D, Lai JH, Wang CD (2015) Combining multiple clusterings via crowd agreement estimation and multi-granularity link analysis. Neurocomputing 170:240–250CrossRef
34.
Zurück zum Zitat Huang D, Wang CD, Lai JH (2016) Locally weighted ensemble clustering. IEEE Trans Cybern 48(5):1460–1473CrossRef Huang D, Wang CD, Lai JH (2016) Locally weighted ensemble clustering. IEEE Trans Cybern 48(5):1460–1473CrossRef
35.
Zurück zum Zitat Huang D, Lai JH, Wang CD (2016) Ensemble clustering using factor graph. Pattern Recognit 50(C):131–142CrossRef Huang D, Lai JH, Wang CD (2016) Ensemble clustering using factor graph. Pattern Recognit 50(C):131–142CrossRef
36.
Zurück zum Zitat Huang D, Lai JH, Wang CD (2016) Robust ensemble clustering using probability trajectories. IEEE Trans Knowl Data Eng 28(5):1312–1326CrossRef Huang D, Lai JH, Wang CD (2016) Robust ensemble clustering using probability trajectories. IEEE Trans Knowl Data Eng 28(5):1312–1326CrossRef
37.
Zurück zum Zitat Wang Q, Lu M, Zhou B (2015) Boosted similarity learning based on discriminative graphs. In: Proceedings of 2015 IEEE international conference on progress in informatics and computing, pp 61–64 Wang Q, Lu M, Zhou B (2015) Boosted similarity learning based on discriminative graphs. In: Proceedings of 2015 IEEE international conference on progress in informatics and computing, pp 61–64
38.
Zurück zum Zitat Duda RO, Hart PE, Stork DG (2012) Pattern classification. Wiley-Interscience, HobokenMATH Duda RO, Hart PE, Stork DG (2012) Pattern classification. Wiley-Interscience, HobokenMATH
39.
Zurück zum Zitat Fukunaga K (1990) Introduction to statistical pattern recognition. Academic Press, CambridgeMATH Fukunaga K (1990) Introduction to statistical pattern recognition. Academic Press, CambridgeMATH
40.
Zurück zum Zitat Baudat G, Anouar F (2006) Generalized discriminant analysis using a kernel approach. Neural Comput 12(10):2385–2404CrossRef Baudat G, Anouar F (2006) Generalized discriminant analysis using a kernel approach. Neural Comput 12(10):2385–2404CrossRef
41.
Zurück zum Zitat Mallapragada PK, Jin R, Jain AK, Liu Y (2009) Semiboost: boosting for semi-supervised learning. IEEE Trans Pattern Anal Mach Intell 31(11):2000–2014CrossRef Mallapragada PK, Jin R, Jain AK, Liu Y (2009) Semiboost: boosting for semi-supervised learning. IEEE Trans Pattern Anal Mach Intell 31(11):2000–2014CrossRef
42.
Zurück zum Zitat Chen K, Wang S (2011) Semi-supervised learning via regularized boosting working on multiple semi-supervised assumptions. IEEE Trans Pattern Anal Mach Intell 33(1):129–143CrossRef Chen K, Wang S (2011) Semi-supervised learning via regularized boosting working on multiple semi-supervised assumptions. IEEE Trans Pattern Anal Mach Intell 33(1):129–143CrossRef
43.
Zurück zum Zitat Fischer B, Buhmann JM (2003) Path-based clustering for grouping of smooth curves and texture segmentation. IEEE Trans Pattern Anal Mach Intell J 25(4):513–518 Fischer B, Buhmann JM (2003) Path-based clustering for grouping of smooth curves and texture segmentation. IEEE Trans Pattern Anal Mach Intell J 25(4):513–518
44.
Zurück zum Zitat Dit-Yan Y, Hong C (2007) A kernel approach for semisupervised metric learning. IEEE Trans Neural Netw 18(1):141–149CrossRef Dit-Yan Y, Hong C (2007) A kernel approach for semisupervised metric learning. IEEE Trans Neural Netw 18(1):141–149CrossRef
46.
Zurück zum Zitat Yeung D-Y, Chang H (2007) A kernel approach for semisupervised metric learning. IEEE Trans Neural Netw 18(1):141–149CrossRef Yeung D-Y, Chang H (2007) A kernel approach for semisupervised metric learning. IEEE Trans Neural Netw 18(1):141–149CrossRef
Metadaten
Titel
Discriminative Graph Based Similarity Boosting
verfasst von
Qianying Wang
Ming Lu
Publikationsdatum
22.09.2018
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2019
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-018-9918-1

Weitere Artikel der Ausgabe 2/2019

Neural Processing Letters 2/2019 Zur Ausgabe

Neuer Inhalt