Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 5/2019

24-01-2018 | Original Article

Adaptive safety degree-based safe semi-supervised learning

Authors: Nong Sang, Haitao Gan, Yingle Fan, Wei Wu, Zhi Yang

Published in: International Journal of Machine Learning and Cybernetics | Issue 5/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recently, safe semi-supervised learning has attracted more and more attention in the machine learning field. Many methods are introduced to safely exploit unlabeled data by designing different safe mechanisms. However, they assume that the risk or safety degrees are equal for all unlabeled data. In this paper, we propose an adaptive safe semi-supervised learning framework where the safety degrees of different unlabeled data are different and adaptively computed. In this framework, a safety degree-based tradeoff term between supervised learning (SL) and semi-supervised learning (SSL) is incorporated into the objective function of SSL. Then the optimal problem is solved by using an alternating iterative strategy. In particular, we utilize Regularized Least Squares (RLS) and Laplacian RLS (LapRLS) for SL and SSL, respectively. Our experimental results on several datasets demonstrate that the performance of our algorithm is never significantly inferior to that of RLS and LapRLS and show the effectiveness of our proposed safety mechanism.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Adankon MM, Cheriet M (2010) Genetic algorithm-based training for semi-supervised svm. Neural Comput Appl 19(8):1197–1206CrossRef Adankon MM, Cheriet M (2010) Genetic algorithm-based training for semi-supervised svm. Neural Comput Appl 19(8):1197–1206CrossRef
2.
go back to reference Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7:2399–2434MathSciNetMATH Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7:2399–2434MathSciNetMATH
3.
go back to reference Cao Y, He H, Huang H (2011) Lift: a new framework of learning from testing data for face recognition. Neurocomputing 74(6):916–929CrossRef Cao Y, He H, Huang H (2011) Lift: a new framework of learning from testing data for face recognition. Neurocomputing 74(6):916–929CrossRef
4.
go back to reference Chapelle O, Scholkopf B, Zien A (eds) (2006) Semi-supervised learning. MIT Press, Cambridge Chapelle O, Scholkopf B, Zien A (eds) (2006) Semi-supervised learning. MIT Press, Cambridge
5.
go back to reference Chen S, Li S, Su S, Cao D, Ji R (2014) Online semi-supervised compressive coding for robust visual tracking. J Vis Commun Image Represent 25(5):793–804CrossRef Chen S, Li S, Su S, Cao D, Ji R (2014) Online semi-supervised compressive coding for robust visual tracking. J Vis Commun Image Represent 25(5):793–804CrossRef
6.
go back to reference Cozman FG, Cohen I, Cirelo MC, Politecnica E (2003) Semi-supervised learning of mixture models. In: Proceedings of the 20th International Conference on Machine Learning. Omnipress, Madison, pp 99–106 Cozman FG, Cohen I, Cirelo MC, Politecnica E (2003) Semi-supervised learning of mixture models. In: Proceedings of the 20th International Conference on Machine Learning. Omnipress, Madison, pp 99–106
7.
go back to reference Gan H, Sang N, Huang R (2014) Self-training-based face recognition using semi-supervised linear discriminant analysis and affinity propagation. J Opt Soc Am A Optics, Image Sci Vis 31(1):1–6CrossRef Gan H, Sang N, Huang R (2014) Self-training-based face recognition using semi-supervised linear discriminant analysis and affinity propagation. J Opt Soc Am A Optics, Image Sci Vis 31(1):1–6CrossRef
8.
go back to reference Gan H, Sang N, Huang R, Tong X, Dan Z (2013) Using clustering analysis to improve semi-supervised classification. Neurocomputing 101:290–298CrossRef Gan H, Sang N, Huang R, Tong X, Dan Z (2013) Using clustering analysis to improve semi-supervised classification. Neurocomputing 101:290–298CrossRef
9.
go back to reference Gorski J, Pfeuffer F, Klamroth K (2007) Biconvex sets and optimization with biconvex functions: a survey and extensions. Math Methods Oper Res 66(3):373–407MathSciNetCrossRefMATH Gorski J, Pfeuffer F, Klamroth K (2007) Biconvex sets and optimization with biconvex functions: a survey and extensions. Math Methods Oper Res 66(3):373–407MathSciNetCrossRefMATH
10.
go back to reference Grabner Helmut LC, Horst B (2008) Semi-supervised on-line boosting for robust tracking. In: Proceedings of the 10th European Conference on Computer Vision: Part I. Springer-Verlag, Berlin, Heidelberg, pp 234–247 Grabner Helmut LC, Horst B (2008) Semi-supervised on-line boosting for robust tracking. In: Proceedings of the 10th European Conference on Computer Vision: Part I. Springer-Verlag, Berlin, Heidelberg, pp 234–247
11.
go back to reference Joachims T (1999) Transductive inference for text classification using support vector machines. In: Proceedings of the Sixteenth International Conference on Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp 200–209 Joachims T (1999) Transductive inference for text classification using support vector machines. In: Proceedings of the Sixteenth International Conference on Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp 200–209
12.
go back to reference Li YF, Zhou ZH (2011) Improving semi-supervised support vector machines through unlabeled instances selection. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence. AAAI Press, San Francisco, pp 500–505 Li YF, Zhou ZH (2011) Improving semi-supervised support vector machines through unlabeled instances selection. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence. AAAI Press, San Francisco, pp 500–505
13.
go back to reference Li YF, Zhou ZH (2011) Towards making unlabeled data never hurt. In: Proceedings of the 28th International Conference on Machine Learning, Omnipress, Madison, pp 1081–1088 Li YF, Zhou ZH (2011) Towards making unlabeled data never hurt. In: Proceedings of the 28th International Conference on Machine Learning, Omnipress, Madison, pp 1081–1088
14.
go back to reference Liu B, Xia SX, Meng FR, Zhou Y (2016) Manifold regularized extreme learning machine. Neural Comput Appl 27(2):255–269CrossRef Liu B, Xia SX, Meng FR, Zhou Y (2016) Manifold regularized extreme learning machine. Neural Comput Appl 27(2):255–269CrossRef
15.
go back to reference Lu Z, Wang L (2015) Noise-robust semi-supervised learning via fast sparse coding. Pattern Recogn 48(2):605–612CrossRefMATH Lu Z, Wang L (2015) Noise-robust semi-supervised learning via fast sparse coding. Pattern Recogn 48(2):605–612CrossRefMATH
16.
go back to reference Qi Z, Xu Y, Wang L, Song Y (2011) Online multiple instance boosting for object detection. Neurocomputing 74(10):1769–1775CrossRef Qi Z, Xu Y, Wang L, Song Y (2011) Online multiple instance boosting for object detection. Neurocomputing 74(10):1769–1775CrossRef
17.
go back to reference Reddy IS, Shevade S, Murty M (2011) A fast quasi-newton method for semi-supervised SVM. Pattern Recogn 44(10–11):2305–2313CrossRefMATH Reddy IS, Shevade S, Murty M (2011) A fast quasi-newton method for semi-supervised SVM. Pattern Recogn 44(10–11):2305–2313CrossRefMATH
18.
go back to reference Richarz J, Vajda S, Grzeszick R, Fink GA (2014) Semi-supervised learning for character recognition in historical archive documents. Pattern Recogn 47(3):1011–1020CrossRef Richarz J, Vajda S, Grzeszick R, Fink GA (2014) Semi-supervised learning for character recognition in historical archive documents. Pattern Recogn 47(3):1011–1020CrossRef
19.
go back to reference Singh A, Nowak R, Zhu X (2009) Unlabeled data: Now it helps, now it doesn’t. In: Koller D, Schuurmans D, Bengio Y, Bottou L (eds) Advances in neural information processing systems, vol 21. Curran Associates Inc, Red Hook, pp 1513–1520 Singh A, Nowak R, Zhu X (2009) Unlabeled data: Now it helps, now it doesn’t. In: Koller D, Schuurmans D, Bengio Y, Bottou L (eds) Advances in neural information processing systems, vol 21. Curran Associates Inc, Red Hook, pp 1513–1520
20.
go back to reference Tan B, Zhang J, Wang L (2011) Semi-supervised elastic net for pedestrian counting. Pattern Recogn 44(10–11):2297–2304CrossRef Tan B, Zhang J, Wang L (2011) Semi-supervised elastic net for pedestrian counting. Pattern Recogn 44(10–11):2297–2304CrossRef
21.
go back to reference Wang R, Wang XZ, Kwong S, Xu C (2017) Incorporating diversity and informativeness in multiple-instance active learning. IEEE Trans Fuzzy Syst 25(6):1460–1475CrossRef Wang R, Wang XZ, Kwong S, Xu C (2017) Incorporating diversity and informativeness in multiple-instance active learning. IEEE Trans Fuzzy Syst 25(6):1460–1475CrossRef
22.
go back to reference Wang XZ, Wang R, Feng HM, Wang HC (2014) A new approach to classifier fusion based on upper integral. IEEE Trans Cybern 44(5):620–635MathSciNetCrossRef Wang XZ, Wang R, Feng HM, Wang HC (2014) A new approach to classifier fusion based on upper integral. IEEE Trans Cybern 44(5):620–635MathSciNetCrossRef
23.
go back to reference Wang Y, Chen S (2013) Safety-aware semi-supervised classification. IEEE Trans Neural Netw Learn Syst 24(11):1763–1772CrossRef Wang Y, Chen S (2013) Safety-aware semi-supervised classification. IEEE Trans Neural Netw Learn Syst 24(11):1763–1772CrossRef
24.
go back to reference Zhang Z, Zhen L, Deng N, Tan J (2015) Manifold proximal support vector machine with mixed-norm for semi-supervised classification. Neural Comput Appl 26(2):399–407CrossRef Zhang Z, Zhen L, Deng N, Tan J (2015) Manifold proximal support vector machine with mixed-norm for semi-supervised classification. Neural Comput Appl 26(2):399–407CrossRef
25.
go back to reference Zhou ZH, Li M (2005) Tri-training: exploiting unlabeled data using three classifiers. IEEE Trans Knowl Data Eng 17(11):1529–1541CrossRef Zhou ZH, Li M (2005) Tri-training: exploiting unlabeled data using three classifiers. IEEE Trans Knowl Data Eng 17(11):1529–1541CrossRef
26.
go back to reference Zhu H, Wang X (2017) A cost-sensitive semi-supervised learning model based on uncertainty. Neurocomputing 251(Supplement C):106–114 Zhu H, Wang X (2017) A cost-sensitive semi-supervised learning model based on uncertainty. Neurocomputing 251(Supplement C):106–114
27.
go back to reference Zhu X, Goldberg AB (2009) Introduction to semi-supervised learning. Synth Lectures Artif Intell Mach Learn 3(1):1–130CrossRefMATH Zhu X, Goldberg AB (2009) Introduction to semi-supervised learning. Synth Lectures Artif Intell Mach Learn 3(1):1–130CrossRefMATH
Metadata
Title
Adaptive safety degree-based safe semi-supervised learning
Authors
Nong Sang
Haitao Gan
Yingle Fan
Wei Wu
Zhi Yang
Publication date
24-01-2018
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 5/2019
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-018-0788-7

Other articles of this Issue 5/2019

International Journal of Machine Learning and Cybernetics 5/2019 Go to the issue