Skip to main content
Top
Published in: Neural Processing Letters 4/2022

27-02-2021

Adaptive Graph Learning for Semi-supervised Self-paced Classification

Authors: Long Chen, Jianbo Lu

Published in: Neural Processing Letters | Issue 4/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Semi-supervised learning techniques have been attracting increasing interests in many machine learning fields for its effectiveness in using labeled and unlabeled samples. however, the ultimate performance tend to be inaccurate or misleading due to the presence of heavy noise and outliers. This problem raises the need to develop the methods that can exploit data structure and also be robust to the noisy points. In this paper, a novel semi-supervised classification method, named adaptive graph learning for semi-supervised self-paced classification (AGLSSC in short), is proposed by integrating self-paced learning (SSL) regime and adaptive graph learning (AGL) strategy into a joint framework and experimentally evaluated. Specifically, AGLSSC automatically select import samples by adding a parameter that can measure the importance of samples in each iteration optimization process. In addition, in order to learn the internal relationship of samples from corrupt data, the proposed method adaptively learns an optimal sample similarity matrix while maintaining the local structure of the samples. In this case, the proposed model has strong robustness to noise points. Extensive experiments conducted on diverse benchmarks demonstrate that AGLSSC achieves the most outstanding performance compared to some state-of-the-art semi-supervised classification methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Xiao M, Guo Y (2013) Semi-supervised representation learning for cross-lingual text classification, proceedings of the 2013 conference on empirical methods in natural language processing, 1465–1475 Xiao M, Guo Y (2013) Semi-supervised representation learning for cross-lingual text classification, proceedings of the 2013 conference on empirical methods in natural language processing, 1465–1475
3.
go back to reference Li W, Sun M (2006) Semi-supervised learning for image annotation based on conditional random fields. Image Video Retr 4071:463–472CrossRef Li W, Sun M (2006) Semi-supervised learning for image annotation based on conditional random fields. Image Video Retr 4071:463–472CrossRef
4.
go back to reference Zhang C, Cheng J, Tian Q (2019) Unsupervised and semi-supervised image classification with weak semantic consistency. IEEE Trans Multimed 21(10):2482–2491CrossRef Zhang C, Cheng J, Tian Q (2019) Unsupervised and semi-supervised image classification with weak semantic consistency. IEEE Trans Multimed 21(10):2482–2491CrossRef
5.
go back to reference Fei W, Jing XY, Zhou J, Ji YM, Lan C, Huang Q, Wang R (2019) Semi-supervised multi-view individual and sharable feature learning for webpage classification. The World Wide Web Conference 3349–3355 Fei W, Jing XY, Zhou J, Ji YM, Lan C, Huang Q, Wang R (2019) Semi-supervised multi-view individual and sharable feature learning for webpage classification. The World Wide Web Conference 3349–3355
6.
go back to reference Wang Z, Wang Z, Young LY, Sun F, Zhu S (2019) SolidBin improving metagenome binning with semi-supervised normalized cut. Bioinform 35(21):4229–4238CrossRef Wang Z, Wang Z, Young LY, Sun F, Zhu S (2019) SolidBin improving metagenome binning with semi-supervised normalized cut. Bioinform 35(21):4229–4238CrossRef
7.
go back to reference Guangbo R, Jie Z, Yi MA, Zheng R (2010) Generative model based semi-supervised learning method of remote sensing image classification. J Remote Sens 14(6):1090–1104 Guangbo R, Jie Z, Yi MA, Zheng R (2010) Generative model based semi-supervised learning method of remote sensing image classification. J Remote Sens 14(6):1090–1104
8.
go back to reference Nigam K, Mccallum AK, Thrun S (2000) Text classification from labeled and unlabeled documents using EM. Mach Learn 39:103–134CrossRef Nigam K, Mccallum AK, Thrun S (2000) Text classification from labeled and unlabeled documents using EM. Mach Learn 39:103–134CrossRef
9.
go back to reference Kingma DP, Rezende DJ, Mohamed S, Welling M (2014) Semi-supervised learning with deep generative models. Adv Neural Inf Process Syst 4:3581–3589 Kingma DP, Rezende DJ, Mohamed S, Welling M (2014) Semi-supervised learning with deep generative models. Adv Neural Inf Process Syst 4:3581–3589
10.
go back to reference Chu Z, Li P, Xuegang H (2019) Co-training based on semi-supervised ensemble classification approach for multi-label data stream. International conference on big knowledge 58–65 Chu Z, Li P, Xuegang H (2019) Co-training based on semi-supervised ensemble classification approach for multi-label data stream. International conference on big knowledge 58–65
11.
go back to reference Lan D, Wang Y, Xie W (2019) a semi-supervised method for sar target discrimination based on co-training. International Geoscience and Remote Sensing Symposium 9482–9485 Lan D, Wang Y, Xie W (2019) a semi-supervised method for sar target discrimination based on co-training. International Geoscience and Remote Sensing Symposium 9482–9485
12.
go back to reference Siyuan Q, Wei S, Zhishuai Z, Bo W, Alan LY (2018) Deep co-training for semi-supervised image recognition, computer vision—ECCV 2018 - 15th European Conference, 11219, 142–159 Siyuan Q, Wei S, Zhishuai Z, Bo W, Alan LY (2018) Deep co-training for semi-supervised image recognition, computer vision—ECCV 2018 - 15th European Conference, 11219, 142–159
13.
go back to reference Chuck R, Martial H, Henry S (2005) Semi-supervised self-training of object detection models, 7th IEEE workshop on applications of computer vision, 29–36 Chuck R, Martial H, Henry S (2005) Semi-supervised self-training of object detection models, 7th IEEE workshop on applications of computer vision, 29–36
14.
go back to reference Wu D, Shang M, Luo X, Xu J, Yan H, Deng W, Wang G (2018) Self-training semi-supervised classification based on density peaks of data. Neurocomputing 275:180–191CrossRef Wu D, Shang M, Luo X, Xu J, Yan H, Deng W, Wang G (2018) Self-training semi-supervised classification based on density peaks of data. Neurocomputing 275:180–191CrossRef
15.
go back to reference Collobert R, Sinz FH, Weston J, Bottou L (2006) Large scale transductive SVMs. J Mach Learn Res 7:1687–1712MathSciNetMATH Collobert R, Sinz FH, Weston J, Bottou L (2006) Large scale transductive SVMs. J Mach Learn Res 7:1687–1712MathSciNetMATH
16.
go back to reference Nie F, Xiang S, Jia Y, Zhang C (2009) Semi-supervised orthogonal discriminant analysis via label propagation. Pattern Recognit 42(11):2615–2627CrossRef Nie F, Xiang S, Jia Y, Zhang C (2009) Semi-supervised orthogonal discriminant analysis via label propagation. Pattern Recognit 42(11):2615–2627CrossRef
17.
go back to reference Meng J, Cheolkon J (2015) Semi-supervised Bi-dictionary learning using smooth representation-based label propagation, 2015 International conference on cyber-enabled distributed computing and knowledge discovery, 239–242 Meng J, Cheolkon J (2015) Semi-supervised Bi-dictionary learning using smooth representation-based label propagation, 2015 International conference on cyber-enabled distributed computing and knowledge discovery, 239–242
18.
go back to reference Junliang MA, Bing XAC, Cheng D (2020) Graph based semi-supervised classification with probabilistic nearest neighbors. Pattern Recognit Lett 133:94–101CrossRef Junliang MA, Bing XAC, Cheng D (2020) Graph based semi-supervised classification with probabilistic nearest neighbors. Pattern Recognit Lett 133:94–101CrossRef
19.
go back to reference Zhu X, Ghahramani Z, Lafferty JD (2003) Semi-supervised learning using gaussian fields and harmonic functions, machine learning. Proceedings of the twentieth international conference 912–919 Zhu X, Ghahramani Z, Lafferty JD (2003) Semi-supervised learning using gaussian fields and harmonic functions, machine learning. Proceedings of the twentieth international conference 912–919
20.
go back to reference Dengyong Z, Olivier B, Thomas NL, Jason W, Bernhard S (2003) Learning with local and global consistency. Adv Neural Inf Process Syst 16(16):321–328 Dengyong Z, Olivier B, Thomas NL, Jason W, Bernhard S (2003) Learning with local and global consistency. Adv Neural Inf Process Syst 16(16):321–328
21.
go back to reference Wang M, Fu W, Hao S, Tao D, Wu X (2016) Scalable semi-supervised learning by efficient anchor graph regularization. IEEE Trans Knowl Data Eng 28(7):1864–1877CrossRef Wang M, Fu W, Hao S, Tao D, Wu X (2016) Scalable semi-supervised learning by efficient anchor graph regularization. IEEE Trans Knowl Data Eng 28(7):1864–1877CrossRef
22.
go back to reference Yan S, Wang H (2009) Semi-supervised learning by sparse representation. Proceedings of the SIAM international conference on data mining 792–801 Yan S, Wang H (2009) Semi-supervised learning by sparse representation. Proceedings of the SIAM international conference on data mining 792–801
23.
go back to reference Gideon S, Mann AM (2007). Simple, robust, scalable semi-supervised learning via expectation regularization, machine learning, Proceedings of the twenty-fourth international conference 227:593–600 Gideon S, Mann AM (2007). Simple, robust, scalable semi-supervised learning via expectation regularization, machine learning, Proceedings of the twenty-fourth international conference 227:593–600
24.
go back to reference Philip S, Angelica IAR, Nicolas P, David C, Anita F, Carola-Bibiane S (2019) Semi-supervised learning with graphs: covariance based superpixels for hyperspectral image classification, IEEE international geoscience and remote sensing symposium, 592–595 Philip S, Angelica IAR, Nicolas P, David C, Anita F, Carola-Bibiane S (2019) Semi-supervised learning with graphs: covariance based superpixels for hyperspectral image classification, IEEE international geoscience and remote sensing symposium, 592–595
25.
go back to reference de Sousa CAR, Solange OR, Gustavo EAPAB (2013) Influence of graph construction on semi-supervised learning, machine learning and knowledge discovery in databases—European Conference , 8190, 160–175 de Sousa CAR, Solange OR, Gustavo EAPAB (2013) Influence of graph construction on semi-supervised learning, machine learning and knowledge discovery in databases—European Conference , 8190, 160–175
26.
go back to reference Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7(1):2399–2434MathSciNetMATH Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7(1):2399–2434MathSciNetMATH
27.
go back to reference Girosi F, Jones M, Poggio T (1995) Regularization theory and neural networks architectures. Neural Comp 7(2):219–269CrossRef Girosi F, Jones M, Poggio T (1995) Regularization theory and neural networks architectures. Neural Comp 7(2):219–269CrossRef
28.
go back to reference Yoshua B, Jerome L, Ronan C, Jason W (2009) Curriculum learning, Proceedings of the 26th annual international conference on machine learning, 382, 41–48 Yoshua B, Jerome L, Ronan C, Jason W (2009) Curriculum learning, Proceedings of the 26th annual international conference on machine learning, 382, 41–48
29.
go back to reference Pawan Kumar M, Benjamin P, Daphne K (2020) Self-paced learning for latent variable models, advances in neural information processing systems 23: 24th Annual conference on neural information processing systems 2010, 1189–1197 Pawan Kumar M, Benjamin P, Daphne K (2020) Self-paced learning for latent variable models, advances in neural information processing systems 23: 24th Annual conference on neural information processing systems 2010, 1189–1197
30.
go back to reference Fan Y, He R, Liang J, Bao-Gang H (2017) Learning self-paced (2017) an implicit regularization perspective, Proceedings of the thirty-first aaai conference on. artificial intelligence 1877–1883 Fan Y, He R, Liang J, Bao-Gang H (2017) Learning self-paced (2017) an implicit regularization perspective, Proceedings of the thirty-first aaai conference on. artificial intelligence 1877–1883
31.
go back to reference Chang X, Tao D, Chao X (2015) Multi-view self-paced learning for clustering, Proceedings of the twenty-fourth international joint conference on. artificial intelligence 3974–3980 Chang X, Tao D, Chao X (2015) Multi-view self-paced learning for clustering, Proceedings of the twenty-fourth international joint conference on. artificial intelligence 3974–3980
32.
go back to reference Feiping N, Xiaoqian W, Heng H (2014) Clustering and projected clustering with adaptive neighbors, The 20th ACM SIGKDD international conference on knowledge discovery and data mining, 977–986 Feiping N, Xiaoqian W, Heng H (2014) Clustering and projected clustering with adaptive neighbors, The 20th ACM SIGKDD international conference on knowledge discovery and data mining, 977–986
33.
go back to reference James Steven Supancic III and Deva Ramanan, Self-Paced Learning for Long-Term Tracking, 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2379–2386, (2013) James Steven Supancic III and Deva Ramanan, Self-Paced Learning for Long-Term Tracking, 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2379–2386, (2013)
34.
go back to reference Gabriel H, Maria LS (2011) On approximate kkt condition and its extension to continuous variational inequalities. J Optim Theory Appl 149(3):528–539MathSciNetCrossRef Gabriel H, Maria LS (2011) On approximate kkt condition and its extension to continuous variational inequalities. J Optim Theory Appl 149(3):528–539MathSciNetCrossRef
35.
go back to reference Nie F, Li J, Li X (2016) Parameter-free auto-weighted multiple graph learning: a framework for multiview clustering and semi-supervised classification. Proceedings of the twenty-fifth international joint conference on artificial intelligence 1881–1887 Nie F, Li J, Li X (2016) Parameter-free auto-weighted multiple graph learning: a framework for multiview clustering and semi-supervised classification. Proceedings of the twenty-fifth international joint conference on artificial intelligence 1881–1887
36.
go back to reference Cai X, Nie F, Cai W, Huang H (2013) Heterogeneous image features integration via multi-modal semi-supervised learning model. IEEE international conference on computer vision 1737–1744 Cai X, Nie F, Cai W, Huang H (2013) Heterogeneous image features integration via multi-modal semi-supervised learning model. IEEE international conference on computer vision 1737–1744
37.
go back to reference Nie F, Cai G, Li X (2017) Multi-view clustering and semi-supervised classification with adaptive neighbours. Proceedings of the thirty-first AAAI conference on artificial intelligence 2408–2414 Nie F, Cai G, Li X (2017) Multi-view clustering and semi-supervised classification with adaptive neighbours. Proceedings of the thirty-first AAAI conference on artificial intelligence 2408–2414
38.
go back to reference Chen L, Zhong Z (2019) Progressive graph-based subspace transductive learning for semi-supervised classification. IET Image Process 13(14):2753–2762CrossRef Chen L, Zhong Z (2019) Progressive graph-based subspace transductive learning for semi-supervised classification. IET Image Process 13(14):2753–2762CrossRef
39.
go back to reference Xiaofeng Z, Bin S, Feng S, Yanbo C, Rongyao H, Jiangzhang G, Wenhai Z, Man L, Liye W, Yaozong G, Fei S, Dinggang S (2020) Joint prediction and time estimation of COVID-19 developing severe symptoms using chest ct scan, CoRR, abs/2005.03405, https://arxiv.org/abs/2005.03405 Xiaofeng Z, Bin S, Feng S, Yanbo C, Rongyao H, Jiangzhang G, Wenhai Z, Man L, Liye W, Yaozong G, Fei S, Dinggang S (2020) Joint prediction and time estimation of COVID-19 developing severe symptoms using chest ct scan, CoRR, abs/2005.03405, https://​arxiv.​org/​abs/​2005.​03405
41.
go back to reference Hu R, Zhu X, Zhu Y, Gan J (2020) Robust SVM with adaptive graph learning. World Wide Web 23:1945–1968CrossRef Hu R, Zhu X, Zhu Y, Gan J (2020) Robust SVM with adaptive graph learning. World Wide Web 23:1945–1968CrossRef
45.
go back to reference Shen HT, Zhu X, Zhang Z, Wang S, Chen Y, Xu X, Shao J (2021) Heterogeneous data fusion for predicting mild cognitive impairment conversion. Inf Fus 66:54–63CrossRef Shen HT, Zhu X, Zhang Z, Wang S, Chen Y, Xu X, Shao J (2021) Heterogeneous data fusion for predicting mild cognitive impairment conversion. Inf Fus 66:54–63CrossRef
46.
go back to reference Zhu X, Gan J, Lu G, Li J, Zhang S (2020) Spectral clustering via half-quadratic optimization. World Wide Web 23:1969–1988CrossRef Zhu X, Gan J, Lu G, Li J, Zhang S (2020) Spectral clustering via half-quadratic optimization. World Wide Web 23:1969–1988CrossRef
47.
go back to reference Zhu X, Suk H-I, Wang L, Lee S-W, Shen D (2017) A novel relational regularization feature selection method for joint regression and classification in AD diagnosis. Med Image Anal 38:205–214CrossRef Zhu X, Suk H-I, Wang L, Lee S-W, Shen D (2017) A novel relational regularization feature selection method for joint regression and classification in AD diagnosis. Med Image Anal 38:205–214CrossRef
Metadata
Title
Adaptive Graph Learning for Semi-supervised Self-paced Classification
Authors
Long Chen
Jianbo Lu
Publication date
27-02-2021
Publisher
Springer US
Published in
Neural Processing Letters / Issue 4/2022
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10453-6

Other articles of this Issue 4/2022

Neural Processing Letters 4/2022 Go to the issue