Skip to main content
Erschienen in: Neural Processing Letters 4/2022

27.02.2021

Adaptive Graph Learning for Semi-supervised Self-paced Classification

verfasst von: Long Chen, Jianbo Lu

Erschienen in: Neural Processing Letters | Ausgabe 4/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Semi-supervised learning techniques have been attracting increasing interests in many machine learning fields for its effectiveness in using labeled and unlabeled samples. however, the ultimate performance tend to be inaccurate or misleading due to the presence of heavy noise and outliers. This problem raises the need to develop the methods that can exploit data structure and also be robust to the noisy points. In this paper, a novel semi-supervised classification method, named adaptive graph learning for semi-supervised self-paced classification (AGLSSC in short), is proposed by integrating self-paced learning (SSL) regime and adaptive graph learning (AGL) strategy into a joint framework and experimentally evaluated. Specifically, AGLSSC automatically select import samples by adding a parameter that can measure the importance of samples in each iteration optimization process. In addition, in order to learn the internal relationship of samples from corrupt data, the proposed method adaptively learns an optimal sample similarity matrix while maintaining the local structure of the samples. In this case, the proposed model has strong robustness to noise points. Extensive experiments conducted on diverse benchmarks demonstrate that AGLSSC achieves the most outstanding performance compared to some state-of-the-art semi-supervised classification methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Xiao M, Guo Y (2013) Semi-supervised representation learning for cross-lingual text classification, proceedings of the 2013 conference on empirical methods in natural language processing, 1465–1475 Xiao M, Guo Y (2013) Semi-supervised representation learning for cross-lingual text classification, proceedings of the 2013 conference on empirical methods in natural language processing, 1465–1475
3.
Zurück zum Zitat Li W, Sun M (2006) Semi-supervised learning for image annotation based on conditional random fields. Image Video Retr 4071:463–472CrossRef Li W, Sun M (2006) Semi-supervised learning for image annotation based on conditional random fields. Image Video Retr 4071:463–472CrossRef
4.
Zurück zum Zitat Zhang C, Cheng J, Tian Q (2019) Unsupervised and semi-supervised image classification with weak semantic consistency. IEEE Trans Multimed 21(10):2482–2491CrossRef Zhang C, Cheng J, Tian Q (2019) Unsupervised and semi-supervised image classification with weak semantic consistency. IEEE Trans Multimed 21(10):2482–2491CrossRef
5.
Zurück zum Zitat Fei W, Jing XY, Zhou J, Ji YM, Lan C, Huang Q, Wang R (2019) Semi-supervised multi-view individual and sharable feature learning for webpage classification. The World Wide Web Conference 3349–3355 Fei W, Jing XY, Zhou J, Ji YM, Lan C, Huang Q, Wang R (2019) Semi-supervised multi-view individual and sharable feature learning for webpage classification. The World Wide Web Conference 3349–3355
6.
Zurück zum Zitat Wang Z, Wang Z, Young LY, Sun F, Zhu S (2019) SolidBin improving metagenome binning with semi-supervised normalized cut. Bioinform 35(21):4229–4238CrossRef Wang Z, Wang Z, Young LY, Sun F, Zhu S (2019) SolidBin improving metagenome binning with semi-supervised normalized cut. Bioinform 35(21):4229–4238CrossRef
7.
Zurück zum Zitat Guangbo R, Jie Z, Yi MA, Zheng R (2010) Generative model based semi-supervised learning method of remote sensing image classification. J Remote Sens 14(6):1090–1104 Guangbo R, Jie Z, Yi MA, Zheng R (2010) Generative model based semi-supervised learning method of remote sensing image classification. J Remote Sens 14(6):1090–1104
8.
Zurück zum Zitat Nigam K, Mccallum AK, Thrun S (2000) Text classification from labeled and unlabeled documents using EM. Mach Learn 39:103–134CrossRef Nigam K, Mccallum AK, Thrun S (2000) Text classification from labeled and unlabeled documents using EM. Mach Learn 39:103–134CrossRef
9.
Zurück zum Zitat Kingma DP, Rezende DJ, Mohamed S, Welling M (2014) Semi-supervised learning with deep generative models. Adv Neural Inf Process Syst 4:3581–3589 Kingma DP, Rezende DJ, Mohamed S, Welling M (2014) Semi-supervised learning with deep generative models. Adv Neural Inf Process Syst 4:3581–3589
10.
Zurück zum Zitat Chu Z, Li P, Xuegang H (2019) Co-training based on semi-supervised ensemble classification approach for multi-label data stream. International conference on big knowledge 58–65 Chu Z, Li P, Xuegang H (2019) Co-training based on semi-supervised ensemble classification approach for multi-label data stream. International conference on big knowledge 58–65
11.
Zurück zum Zitat Lan D, Wang Y, Xie W (2019) a semi-supervised method for sar target discrimination based on co-training. International Geoscience and Remote Sensing Symposium 9482–9485 Lan D, Wang Y, Xie W (2019) a semi-supervised method for sar target discrimination based on co-training. International Geoscience and Remote Sensing Symposium 9482–9485
12.
Zurück zum Zitat Siyuan Q, Wei S, Zhishuai Z, Bo W, Alan LY (2018) Deep co-training for semi-supervised image recognition, computer vision—ECCV 2018 - 15th European Conference, 11219, 142–159 Siyuan Q, Wei S, Zhishuai Z, Bo W, Alan LY (2018) Deep co-training for semi-supervised image recognition, computer vision—ECCV 2018 - 15th European Conference, 11219, 142–159
13.
Zurück zum Zitat Chuck R, Martial H, Henry S (2005) Semi-supervised self-training of object detection models, 7th IEEE workshop on applications of computer vision, 29–36 Chuck R, Martial H, Henry S (2005) Semi-supervised self-training of object detection models, 7th IEEE workshop on applications of computer vision, 29–36
14.
Zurück zum Zitat Wu D, Shang M, Luo X, Xu J, Yan H, Deng W, Wang G (2018) Self-training semi-supervised classification based on density peaks of data. Neurocomputing 275:180–191CrossRef Wu D, Shang M, Luo X, Xu J, Yan H, Deng W, Wang G (2018) Self-training semi-supervised classification based on density peaks of data. Neurocomputing 275:180–191CrossRef
15.
Zurück zum Zitat Collobert R, Sinz FH, Weston J, Bottou L (2006) Large scale transductive SVMs. J Mach Learn Res 7:1687–1712MathSciNetMATH Collobert R, Sinz FH, Weston J, Bottou L (2006) Large scale transductive SVMs. J Mach Learn Res 7:1687–1712MathSciNetMATH
16.
Zurück zum Zitat Nie F, Xiang S, Jia Y, Zhang C (2009) Semi-supervised orthogonal discriminant analysis via label propagation. Pattern Recognit 42(11):2615–2627CrossRef Nie F, Xiang S, Jia Y, Zhang C (2009) Semi-supervised orthogonal discriminant analysis via label propagation. Pattern Recognit 42(11):2615–2627CrossRef
17.
Zurück zum Zitat Meng J, Cheolkon J (2015) Semi-supervised Bi-dictionary learning using smooth representation-based label propagation, 2015 International conference on cyber-enabled distributed computing and knowledge discovery, 239–242 Meng J, Cheolkon J (2015) Semi-supervised Bi-dictionary learning using smooth representation-based label propagation, 2015 International conference on cyber-enabled distributed computing and knowledge discovery, 239–242
18.
Zurück zum Zitat Junliang MA, Bing XAC, Cheng D (2020) Graph based semi-supervised classification with probabilistic nearest neighbors. Pattern Recognit Lett 133:94–101CrossRef Junliang MA, Bing XAC, Cheng D (2020) Graph based semi-supervised classification with probabilistic nearest neighbors. Pattern Recognit Lett 133:94–101CrossRef
19.
Zurück zum Zitat Zhu X, Ghahramani Z, Lafferty JD (2003) Semi-supervised learning using gaussian fields and harmonic functions, machine learning. Proceedings of the twentieth international conference 912–919 Zhu X, Ghahramani Z, Lafferty JD (2003) Semi-supervised learning using gaussian fields and harmonic functions, machine learning. Proceedings of the twentieth international conference 912–919
20.
Zurück zum Zitat Dengyong Z, Olivier B, Thomas NL, Jason W, Bernhard S (2003) Learning with local and global consistency. Adv Neural Inf Process Syst 16(16):321–328 Dengyong Z, Olivier B, Thomas NL, Jason W, Bernhard S (2003) Learning with local and global consistency. Adv Neural Inf Process Syst 16(16):321–328
21.
Zurück zum Zitat Wang M, Fu W, Hao S, Tao D, Wu X (2016) Scalable semi-supervised learning by efficient anchor graph regularization. IEEE Trans Knowl Data Eng 28(7):1864–1877CrossRef Wang M, Fu W, Hao S, Tao D, Wu X (2016) Scalable semi-supervised learning by efficient anchor graph regularization. IEEE Trans Knowl Data Eng 28(7):1864–1877CrossRef
22.
Zurück zum Zitat Yan S, Wang H (2009) Semi-supervised learning by sparse representation. Proceedings of the SIAM international conference on data mining 792–801 Yan S, Wang H (2009) Semi-supervised learning by sparse representation. Proceedings of the SIAM international conference on data mining 792–801
23.
Zurück zum Zitat Gideon S, Mann AM (2007). Simple, robust, scalable semi-supervised learning via expectation regularization, machine learning, Proceedings of the twenty-fourth international conference 227:593–600 Gideon S, Mann AM (2007). Simple, robust, scalable semi-supervised learning via expectation regularization, machine learning, Proceedings of the twenty-fourth international conference 227:593–600
24.
Zurück zum Zitat Philip S, Angelica IAR, Nicolas P, David C, Anita F, Carola-Bibiane S (2019) Semi-supervised learning with graphs: covariance based superpixels for hyperspectral image classification, IEEE international geoscience and remote sensing symposium, 592–595 Philip S, Angelica IAR, Nicolas P, David C, Anita F, Carola-Bibiane S (2019) Semi-supervised learning with graphs: covariance based superpixels for hyperspectral image classification, IEEE international geoscience and remote sensing symposium, 592–595
25.
Zurück zum Zitat de Sousa CAR, Solange OR, Gustavo EAPAB (2013) Influence of graph construction on semi-supervised learning, machine learning and knowledge discovery in databases—European Conference , 8190, 160–175 de Sousa CAR, Solange OR, Gustavo EAPAB (2013) Influence of graph construction on semi-supervised learning, machine learning and knowledge discovery in databases—European Conference , 8190, 160–175
26.
Zurück zum Zitat Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7(1):2399–2434MathSciNetMATH Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7(1):2399–2434MathSciNetMATH
27.
Zurück zum Zitat Girosi F, Jones M, Poggio T (1995) Regularization theory and neural networks architectures. Neural Comp 7(2):219–269CrossRef Girosi F, Jones M, Poggio T (1995) Regularization theory and neural networks architectures. Neural Comp 7(2):219–269CrossRef
28.
Zurück zum Zitat Yoshua B, Jerome L, Ronan C, Jason W (2009) Curriculum learning, Proceedings of the 26th annual international conference on machine learning, 382, 41–48 Yoshua B, Jerome L, Ronan C, Jason W (2009) Curriculum learning, Proceedings of the 26th annual international conference on machine learning, 382, 41–48
29.
Zurück zum Zitat Pawan Kumar M, Benjamin P, Daphne K (2020) Self-paced learning for latent variable models, advances in neural information processing systems 23: 24th Annual conference on neural information processing systems 2010, 1189–1197 Pawan Kumar M, Benjamin P, Daphne K (2020) Self-paced learning for latent variable models, advances in neural information processing systems 23: 24th Annual conference on neural information processing systems 2010, 1189–1197
30.
Zurück zum Zitat Fan Y, He R, Liang J, Bao-Gang H (2017) Learning self-paced (2017) an implicit regularization perspective, Proceedings of the thirty-first aaai conference on. artificial intelligence 1877–1883 Fan Y, He R, Liang J, Bao-Gang H (2017) Learning self-paced (2017) an implicit regularization perspective, Proceedings of the thirty-first aaai conference on. artificial intelligence 1877–1883
31.
Zurück zum Zitat Chang X, Tao D, Chao X (2015) Multi-view self-paced learning for clustering, Proceedings of the twenty-fourth international joint conference on. artificial intelligence 3974–3980 Chang X, Tao D, Chao X (2015) Multi-view self-paced learning for clustering, Proceedings of the twenty-fourth international joint conference on. artificial intelligence 3974–3980
32.
Zurück zum Zitat Feiping N, Xiaoqian W, Heng H (2014) Clustering and projected clustering with adaptive neighbors, The 20th ACM SIGKDD international conference on knowledge discovery and data mining, 977–986 Feiping N, Xiaoqian W, Heng H (2014) Clustering and projected clustering with adaptive neighbors, The 20th ACM SIGKDD international conference on knowledge discovery and data mining, 977–986
33.
Zurück zum Zitat James Steven Supancic III and Deva Ramanan, Self-Paced Learning for Long-Term Tracking, 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2379–2386, (2013) James Steven Supancic III and Deva Ramanan, Self-Paced Learning for Long-Term Tracking, 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2379–2386, (2013)
34.
Zurück zum Zitat Gabriel H, Maria LS (2011) On approximate kkt condition and its extension to continuous variational inequalities. J Optim Theory Appl 149(3):528–539MathSciNetCrossRef Gabriel H, Maria LS (2011) On approximate kkt condition and its extension to continuous variational inequalities. J Optim Theory Appl 149(3):528–539MathSciNetCrossRef
35.
Zurück zum Zitat Nie F, Li J, Li X (2016) Parameter-free auto-weighted multiple graph learning: a framework for multiview clustering and semi-supervised classification. Proceedings of the twenty-fifth international joint conference on artificial intelligence 1881–1887 Nie F, Li J, Li X (2016) Parameter-free auto-weighted multiple graph learning: a framework for multiview clustering and semi-supervised classification. Proceedings of the twenty-fifth international joint conference on artificial intelligence 1881–1887
36.
Zurück zum Zitat Cai X, Nie F, Cai W, Huang H (2013) Heterogeneous image features integration via multi-modal semi-supervised learning model. IEEE international conference on computer vision 1737–1744 Cai X, Nie F, Cai W, Huang H (2013) Heterogeneous image features integration via multi-modal semi-supervised learning model. IEEE international conference on computer vision 1737–1744
37.
Zurück zum Zitat Nie F, Cai G, Li X (2017) Multi-view clustering and semi-supervised classification with adaptive neighbours. Proceedings of the thirty-first AAAI conference on artificial intelligence 2408–2414 Nie F, Cai G, Li X (2017) Multi-view clustering and semi-supervised classification with adaptive neighbours. Proceedings of the thirty-first AAAI conference on artificial intelligence 2408–2414
38.
Zurück zum Zitat Chen L, Zhong Z (2019) Progressive graph-based subspace transductive learning for semi-supervised classification. IET Image Process 13(14):2753–2762CrossRef Chen L, Zhong Z (2019) Progressive graph-based subspace transductive learning for semi-supervised classification. IET Image Process 13(14):2753–2762CrossRef
39.
Zurück zum Zitat Xiaofeng Z, Bin S, Feng S, Yanbo C, Rongyao H, Jiangzhang G, Wenhai Z, Man L, Liye W, Yaozong G, Fei S, Dinggang S (2020) Joint prediction and time estimation of COVID-19 developing severe symptoms using chest ct scan, CoRR, abs/2005.03405, https://arxiv.org/abs/2005.03405 Xiaofeng Z, Bin S, Feng S, Yanbo C, Rongyao H, Jiangzhang G, Wenhai Z, Man L, Liye W, Yaozong G, Fei S, Dinggang S (2020) Joint prediction and time estimation of COVID-19 developing severe symptoms using chest ct scan, CoRR, abs/2005.03405, https://​arxiv.​org/​abs/​2005.​03405
41.
Zurück zum Zitat Hu R, Zhu X, Zhu Y, Gan J (2020) Robust SVM with adaptive graph learning. World Wide Web 23:1945–1968CrossRef Hu R, Zhu X, Zhu Y, Gan J (2020) Robust SVM with adaptive graph learning. World Wide Web 23:1945–1968CrossRef
45.
Zurück zum Zitat Shen HT, Zhu X, Zhang Z, Wang S, Chen Y, Xu X, Shao J (2021) Heterogeneous data fusion for predicting mild cognitive impairment conversion. Inf Fus 66:54–63CrossRef Shen HT, Zhu X, Zhang Z, Wang S, Chen Y, Xu X, Shao J (2021) Heterogeneous data fusion for predicting mild cognitive impairment conversion. Inf Fus 66:54–63CrossRef
46.
Zurück zum Zitat Zhu X, Gan J, Lu G, Li J, Zhang S (2020) Spectral clustering via half-quadratic optimization. World Wide Web 23:1969–1988CrossRef Zhu X, Gan J, Lu G, Li J, Zhang S (2020) Spectral clustering via half-quadratic optimization. World Wide Web 23:1969–1988CrossRef
47.
Zurück zum Zitat Zhu X, Suk H-I, Wang L, Lee S-W, Shen D (2017) A novel relational regularization feature selection method for joint regression and classification in AD diagnosis. Med Image Anal 38:205–214CrossRef Zhu X, Suk H-I, Wang L, Lee S-W, Shen D (2017) A novel relational regularization feature selection method for joint regression and classification in AD diagnosis. Med Image Anal 38:205–214CrossRef
Metadaten
Titel
Adaptive Graph Learning for Semi-supervised Self-paced Classification
verfasst von
Long Chen
Jianbo Lu
Publikationsdatum
27.02.2021
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 4/2022
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10453-6

Weitere Artikel der Ausgabe 4/2022

Neural Processing Letters 4/2022 Zur Ausgabe

Neuer Inhalt