Skip to main content
Erschienen in: Neural Computing and Applications 7/2021

09.07.2020 | Original Article

Node influence-based label propagation algorithm for semi-supervised learning

verfasst von: Zhiwen Hua, Youlong Yang, Haiquan Qiu

Erschienen in: Neural Computing and Applications | Ausgabe 7/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Graph-based semi-supervised learning (GSSL) has received more and more attention due to its efficiency and accuracy. Label propagation is a critical step in GSSL that propagates label information to unlabeled data through the structure of graph. However, the traditional label propagation algorithms treat all unlabeled samples as equivalent and blindly propagate label information to all neighbors without considering their reliabilities. In this case, some unreliable samples may mislead the process of label propagation, thus greatly reducing the accuracy of classification. In order to solve this problem, this paper proposes a novel label propagation algorithm called node influence-based label propagation (NILP). Based on the structure of graph, the NILP algorithm measures the influences of nodes by calculating their degrees and local densities. In the process of label propagation, the label information is preferentially transmitted to the influential neighbors to control the propagation sequence and prevent wrong propagation. Moreover, our algorithm improves the transition matrix by integrating label information and feature information. The experimental results on both synthetic and real-world benchmark datasets show that the proposed method is superior to some existing label propagation algorithms. Especially when the number of labeled samples is very small, the advantage of NILP algorithm is more obvious.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Appice A, Guccione P, Malerba D (2017) A novel spectral-spatial co-training algorithm for the transductive classification of hyperspectral imagery data. Pattern Recognition 63:229–245CrossRef Appice A, Guccione P, Malerba D (2017) A novel spectral-spatial co-training algorithm for the transductive classification of hyperspectral imagery data. Pattern Recognition 63:229–245CrossRef
2.
Zurück zum Zitat Bahrami S, Bosaghzadeh A, Dornaika F (2018) Graph fusion with correlation graph in semisupervised learning. In: 2018 4th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS), pp. 125–130. IEEE Bahrami S, Bosaghzadeh A, Dornaika F (2018) Graph fusion with correlation graph in semisupervised learning. In: 2018 4th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS), pp. 125–130. IEEE
3.
Zurück zum Zitat Berton L, de Andrade Lopes A (2014) Graph construction based on labeled instances for semi-supervised learning. In: 2014 22nd International Conference on Pattern Recognition, pp. 2477–2482. IEEE Berton L, de Andrade Lopes A (2014) Graph construction based on labeled instances for semi-supervised learning. In: 2014 22nd International Conference on Pattern Recognition, pp. 2477–2482. IEEE
4.
Zurück zum Zitat Bhatia V, Rani R (2017) An efficient influence based label propagation algorithm for clustering large graphs. In: 2017 International Conference on Infocom Technologies and Unmanned Systems (Trends and Future Directions)(ICTUS), pp. 1–7. IEEE Bhatia V, Rani R (2017) An efficient influence based label propagation algorithm for clustering large graphs. In: 2017 International Conference on Infocom Technologies and Unmanned Systems (Trends and Future Directions)(ICTUS), pp. 1–7. IEEE
5.
Zurück zum Zitat Dong W, Moses C, Li K (2011) Efficient k-nearest neighbor graph construction for generic similarity measures. In: Proceedings of the 20th international conference on World wide web, pp. 577–586 Dong W, Moses C, Li K (2011) Efficient k-nearest neighbor graph construction for generic similarity measures. In: Proceedings of the 20th international conference on World wide web, pp. 577–586
6.
Zurück zum Zitat Dornaika F, Dahbi R, Bosaghzadeh A, Ruichek Y (2017) Efficient dynamic graph construction for inductive semi-supervised learning. Neural Networks 94:192–203CrossRef Dornaika F, Dahbi R, Bosaghzadeh A, Ruichek Y (2017) Efficient dynamic graph construction for inductive semi-supervised learning. Neural Networks 94:192–203CrossRef
7.
Zurück zum Zitat Dornaika F, El Traboulsi Y (2019) Joint sparse graph and flexible embedding for graph-based semi-supervised learning. Neural Networks 114:91–95CrossRef Dornaika F, El Traboulsi Y (2019) Joint sparse graph and flexible embedding for graph-based semi-supervised learning. Neural Networks 114:91–95CrossRef
8.
Zurück zum Zitat Druck G, McCallum A (2010) High-performance semi-supervised learning using discriminatively constrained generative models. In: ICML Druck G, McCallum A (2010) High-performance semi-supervised learning using discriminatively constrained generative models. In: ICML
9.
Zurück zum Zitat Du B, Xinyao T, Wang Z, Zhang L, Tao D (2018) Robust graph-based semisupervised learning for noisy labeled data via maximum correntropy criterion. IEEE transactions on cybernetics 49(4):1440–1453CrossRef Du B, Xinyao T, Wang Z, Zhang L, Tao D (2018) Robust graph-based semisupervised learning for noisy labeled data via maximum correntropy criterion. IEEE transactions on cybernetics 49(4):1440–1453CrossRef
10.
Zurück zum Zitat El Kouni IB, Karoui W, Romdhane LB (2019) Node importance based label propagation algorithm for overlapping community detection in networks. Expert Systems with Applications p. 113020 El Kouni IB, Karoui W, Romdhane LB (2019) Node importance based label propagation algorithm for overlapping community detection in networks. Expert Systems with Applications p. 113020
12.
Zurück zum Zitat Kingma DP, Mohamed S, Rezende DJ, Welling M (2014) Semi-supervised learning with deep generative models. In: Advances in neural information processing systems, pp. 3581–3589 Kingma DP, Mohamed S, Rezende DJ, Welling M (2014) Semi-supervised learning with deep generative models. In: Advances in neural information processing systems, pp. 3581–3589
13.
Zurück zum Zitat Li M, Zhou ZH (2005) Setred: Self-training with editing. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining Li M, Zhou ZH (2005) Setred: Self-training with editing. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining
14.
Zurück zum Zitat Li Y, Guo M (2012) A new relational tri-training system with adaptive data editing for inductive logic programming. Knowledge-Based Systems 35:173–185CrossRef Li Y, Guo M (2012) A new relational tri-training system with adaptive data editing for inductive logic programming. Knowledge-Based Systems 35:173–185CrossRef
19.
Zurück zum Zitat Nie F, Xiang S, Liu Y, Zhang C (2010) A general graph-based semi-supervised learning with novel class discovery. Neural Computing and Applications 19(4):549–555CrossRef Nie F, Xiang S, Liu Y, Zhang C (2010) A general graph-based semi-supervised learning with novel class discovery. Neural Computing and Applications 19(4):549–555CrossRef
20.
Zurück zum Zitat Nie F, Xu D, Tsang IWH, Zhang C (2010) Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction. IEEE Transactions on Image Processing 19(7):1921–1932MathSciNetCrossRef Nie F, Xu D, Tsang IWH, Zhang C (2010) Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction. IEEE Transactions on Image Processing 19(7):1921–1932MathSciNetCrossRef
21.
Zurück zum Zitat Nigam K, McCallum AK, Thrun S, Mitchell T (2000) Text classification from labeled and unlabeled documents using em. Machine learning 39(2–3):103–134CrossRef Nigam K, McCallum AK, Thrun S, Mitchell T (2000) Text classification from labeled and unlabeled documents using em. Machine learning 39(2–3):103–134CrossRef
22.
Zurück zum Zitat Prakash VJ, Nithya LM (2014) A survey on semi-supervised learning techniques. International Journal of Computer Trends and Technology 8(1):25–29CrossRef Prakash VJ, Nithya LM (2014) A survey on semi-supervised learning techniques. International Journal of Computer Trends and Technology 8(1):25–29CrossRef
23.
Zurück zum Zitat Saul LK, Roweis ST (2003) Think globally, fit locally: unsupervised learning of low dimensional manifolds. Journal of Machine Learning Research 4:119–155MathSciNetMATH Saul LK, Roweis ST (2003) Think globally, fit locally: unsupervised learning of low dimensional manifolds. Journal of Machine Learning Research 4:119–155MathSciNetMATH
24.
Zurück zum Zitat Seyedi SA, Lotfi A, Moradi P, Qader NN (2019) Dynamic graph-based label propagation for density peaks clustering. Expert Systems with Applications 115:314–328CrossRef Seyedi SA, Lotfi A, Moradi P, Qader NN (2019) Dynamic graph-based label propagation for density peaks clustering. Expert Systems with Applications 115:314–328CrossRef
25.
Zurück zum Zitat de Sousa CA (2015) An overview on the gaussian fields and harmonic functions method for semi-supervised learning. In: 2015 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE de Sousa CA (2015) An overview on the gaussian fields and harmonic functions method for semi-supervised learning. In: 2015 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE
26.
Zurück zum Zitat Triguero I, Sáez JA, Luengo J, García S, Herrera F (2014) On the characterization of noise filters for self-training semi-supervised in nearest neighbor classification. Neurocomputing 132:30–41CrossRef Triguero I, Sáez JA, Luengo J, García S, Herrera F (2014) On the characterization of noise filters for self-training semi-supervised in nearest neighbor classification. Neurocomputing 132:30–41CrossRef
31.
Zurück zum Zitat Wu D, Shang M, Wang G, Li L (2018) A self-training semi-supervised classification algorithm based on density peaks of data and differential evolution. In: 2018 IEEE 15th International Conference on Networking, Sensing and Control (ICNSC), pp. 1–6. IEEE Wu D, Shang M, Wang G, Li L (2018) A self-training semi-supervised classification algorithm based on density peaks of data and differential evolution. In: 2018 IEEE 15th International Conference on Networking, Sensing and Control (ICNSC), pp. 1–6. IEEE
32.
Zurück zum Zitat Yu J, Kim SB (2018) Consensus rate-based label propagation for semi-supervised classification. Information Sciences 465:265–284MathSciNetCrossRef Yu J, Kim SB (2018) Consensus rate-based label propagation for semi-supervised classification. Information Sciences 465:265–284MathSciNetCrossRef
33.
Zurück zum Zitat Zhang H, Zhang Z, Li S, Ye Q, Zhao M, Wang M (2018) Robust adaptive label propagation by double matrix decomposition. In: 2018 24th International Conference on Pattern Recognition (ICPR), pp. 2160–2165 Zhang H, Zhang Z, Li S, Ye Q, Zhao M, Wang M (2018) Robust adaptive label propagation by double matrix decomposition. In: 2018 24th International Conference on Pattern Recognition (ICPR), pp. 2160–2165
34.
Zurück zum Zitat Zhang Z, Li F, Jia L, Qin J, Zhang L, Yan S (2017) Robust adaptive embedded label propagation with weight learning for inductive classification. IEEE transactions on neural networks and learning systems 29(8):3388–3403MathSciNetCrossRef Zhang Z, Li F, Jia L, Qin J, Zhang L, Yan S (2017) Robust adaptive embedded label propagation with weight learning for inductive classification. IEEE transactions on neural networks and learning systems 29(8):3388–3403MathSciNetCrossRef
35.
Zurück zum Zitat Zhang Z, Zhao M, Chow TW (2014) Graph based constrained semi-supervised learning framework via label propagation over adaptive neighborhood. IEEE Transactions on Knowledge and Data Engineering Zhang Z, Zhao M, Chow TW (2014) Graph based constrained semi-supervised learning framework via label propagation over adaptive neighborhood. IEEE Transactions on Knowledge and Data Engineering
36.
Zurück zum Zitat Zhou D, Bousquet O, Lal TN, Weston J, Olkopf BS (2004) Learning with local and global consistency. Advances in neural information processing systems 16(3): Zhou D, Bousquet O, Lal TN, Weston J, Olkopf BS (2004) Learning with local and global consistency. Advances in neural information processing systems 16(3):
37.
Zurück zum Zitat Zhou ZH, Li M (2010) Semi-supervised learning by disagreement. Knowledge and Information Systems 24(3):415–439MathSciNetCrossRef Zhou ZH, Li M (2010) Semi-supervised learning by disagreement. Knowledge and Information Systems 24(3):415–439MathSciNetCrossRef
38.
Zurück zum Zitat Zhu X (2005) Semi-supervised learning literature survey Zhu X (2005) Semi-supervised learning literature survey
39.
Zurück zum Zitat Zhu X, Ghahramani Z (2002) Learning from labeled and unlabeled data with label propagation Zhu X, Ghahramani Z (2002) Learning from labeled and unlabeled data with label propagation
40.
Zurück zum Zitat Zhu X, Ghahramani Z, Lafferty JD (2003) Semi-supervised learning using gaussian fields and harmonic functions. In: Proceedings of the 20th International conference on Machine learning (ICML-03), pp. 912–919 Zhu X, Ghahramani Z, Lafferty JD (2003) Semi-supervised learning using gaussian fields and harmonic functions. In: Proceedings of the 20th International conference on Machine learning (ICML-03), pp. 912–919
41.
Zurück zum Zitat Zhu X, Lafferty J, Rosenfeld R (2005) Semi-supervised learning with graphs Zhu X, Lafferty J, Rosenfeld R (2005) Semi-supervised learning with graphs
42.
Zurück zum Zitat Zhuang L, Zhou Z, Gao S, Yin J, Lin Z, Ma Y (2017) Label information guided graph construction for semi-supervised learning. IEEE Transactions on Image Processing 26(9):4182–4192MathSciNetCrossRef Zhuang L, Zhou Z, Gao S, Yin J, Lin Z, Ma Y (2017) Label information guided graph construction for semi-supervised learning. IEEE Transactions on Image Processing 26(9):4182–4192MathSciNetCrossRef
Metadaten
Titel
Node influence-based label propagation algorithm for semi-supervised learning
verfasst von
Zhiwen Hua
Youlong Yang
Haiquan Qiu
Publikationsdatum
09.07.2020
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 7/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05078-0

Weitere Artikel der Ausgabe 7/2021

Neural Computing and Applications 7/2021 Zur Ausgabe