Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 5/2019

24.01.2018 | Original Article

Adaptive safety degree-based safe semi-supervised learning

verfasst von: Nong Sang, Haitao Gan, Yingle Fan, Wei Wu, Zhi Yang

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 5/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recently, safe semi-supervised learning has attracted more and more attention in the machine learning field. Many methods are introduced to safely exploit unlabeled data by designing different safe mechanisms. However, they assume that the risk or safety degrees are equal for all unlabeled data. In this paper, we propose an adaptive safe semi-supervised learning framework where the safety degrees of different unlabeled data are different and adaptively computed. In this framework, a safety degree-based tradeoff term between supervised learning (SL) and semi-supervised learning (SSL) is incorporated into the objective function of SSL. Then the optimal problem is solved by using an alternating iterative strategy. In particular, we utilize Regularized Least Squares (RLS) and Laplacian RLS (LapRLS) for SL and SSL, respectively. Our experimental results on several datasets demonstrate that the performance of our algorithm is never significantly inferior to that of RLS and LapRLS and show the effectiveness of our proposed safety mechanism.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Adankon MM, Cheriet M (2010) Genetic algorithm-based training for semi-supervised svm. Neural Comput Appl 19(8):1197–1206CrossRef Adankon MM, Cheriet M (2010) Genetic algorithm-based training for semi-supervised svm. Neural Comput Appl 19(8):1197–1206CrossRef
2.
Zurück zum Zitat Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7:2399–2434MathSciNetMATH Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7:2399–2434MathSciNetMATH
3.
Zurück zum Zitat Cao Y, He H, Huang H (2011) Lift: a new framework of learning from testing data for face recognition. Neurocomputing 74(6):916–929CrossRef Cao Y, He H, Huang H (2011) Lift: a new framework of learning from testing data for face recognition. Neurocomputing 74(6):916–929CrossRef
4.
Zurück zum Zitat Chapelle O, Scholkopf B, Zien A (eds) (2006) Semi-supervised learning. MIT Press, Cambridge Chapelle O, Scholkopf B, Zien A (eds) (2006) Semi-supervised learning. MIT Press, Cambridge
5.
Zurück zum Zitat Chen S, Li S, Su S, Cao D, Ji R (2014) Online semi-supervised compressive coding for robust visual tracking. J Vis Commun Image Represent 25(5):793–804CrossRef Chen S, Li S, Su S, Cao D, Ji R (2014) Online semi-supervised compressive coding for robust visual tracking. J Vis Commun Image Represent 25(5):793–804CrossRef
6.
Zurück zum Zitat Cozman FG, Cohen I, Cirelo MC, Politecnica E (2003) Semi-supervised learning of mixture models. In: Proceedings of the 20th International Conference on Machine Learning. Omnipress, Madison, pp 99–106 Cozman FG, Cohen I, Cirelo MC, Politecnica E (2003) Semi-supervised learning of mixture models. In: Proceedings of the 20th International Conference on Machine Learning. Omnipress, Madison, pp 99–106
7.
Zurück zum Zitat Gan H, Sang N, Huang R (2014) Self-training-based face recognition using semi-supervised linear discriminant analysis and affinity propagation. J Opt Soc Am A Optics, Image Sci Vis 31(1):1–6CrossRef Gan H, Sang N, Huang R (2014) Self-training-based face recognition using semi-supervised linear discriminant analysis and affinity propagation. J Opt Soc Am A Optics, Image Sci Vis 31(1):1–6CrossRef
8.
Zurück zum Zitat Gan H, Sang N, Huang R, Tong X, Dan Z (2013) Using clustering analysis to improve semi-supervised classification. Neurocomputing 101:290–298CrossRef Gan H, Sang N, Huang R, Tong X, Dan Z (2013) Using clustering analysis to improve semi-supervised classification. Neurocomputing 101:290–298CrossRef
9.
Zurück zum Zitat Gorski J, Pfeuffer F, Klamroth K (2007) Biconvex sets and optimization with biconvex functions: a survey and extensions. Math Methods Oper Res 66(3):373–407MathSciNetCrossRefMATH Gorski J, Pfeuffer F, Klamroth K (2007) Biconvex sets and optimization with biconvex functions: a survey and extensions. Math Methods Oper Res 66(3):373–407MathSciNetCrossRefMATH
10.
Zurück zum Zitat Grabner Helmut LC, Horst B (2008) Semi-supervised on-line boosting for robust tracking. In: Proceedings of the 10th European Conference on Computer Vision: Part I. Springer-Verlag, Berlin, Heidelberg, pp 234–247 Grabner Helmut LC, Horst B (2008) Semi-supervised on-line boosting for robust tracking. In: Proceedings of the 10th European Conference on Computer Vision: Part I. Springer-Verlag, Berlin, Heidelberg, pp 234–247
11.
Zurück zum Zitat Joachims T (1999) Transductive inference for text classification using support vector machines. In: Proceedings of the Sixteenth International Conference on Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp 200–209 Joachims T (1999) Transductive inference for text classification using support vector machines. In: Proceedings of the Sixteenth International Conference on Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp 200–209
12.
Zurück zum Zitat Li YF, Zhou ZH (2011) Improving semi-supervised support vector machines through unlabeled instances selection. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence. AAAI Press, San Francisco, pp 500–505 Li YF, Zhou ZH (2011) Improving semi-supervised support vector machines through unlabeled instances selection. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence. AAAI Press, San Francisco, pp 500–505
13.
Zurück zum Zitat Li YF, Zhou ZH (2011) Towards making unlabeled data never hurt. In: Proceedings of the 28th International Conference on Machine Learning, Omnipress, Madison, pp 1081–1088 Li YF, Zhou ZH (2011) Towards making unlabeled data never hurt. In: Proceedings of the 28th International Conference on Machine Learning, Omnipress, Madison, pp 1081–1088
14.
Zurück zum Zitat Liu B, Xia SX, Meng FR, Zhou Y (2016) Manifold regularized extreme learning machine. Neural Comput Appl 27(2):255–269CrossRef Liu B, Xia SX, Meng FR, Zhou Y (2016) Manifold regularized extreme learning machine. Neural Comput Appl 27(2):255–269CrossRef
15.
Zurück zum Zitat Lu Z, Wang L (2015) Noise-robust semi-supervised learning via fast sparse coding. Pattern Recogn 48(2):605–612CrossRefMATH Lu Z, Wang L (2015) Noise-robust semi-supervised learning via fast sparse coding. Pattern Recogn 48(2):605–612CrossRefMATH
16.
Zurück zum Zitat Qi Z, Xu Y, Wang L, Song Y (2011) Online multiple instance boosting for object detection. Neurocomputing 74(10):1769–1775CrossRef Qi Z, Xu Y, Wang L, Song Y (2011) Online multiple instance boosting for object detection. Neurocomputing 74(10):1769–1775CrossRef
17.
Zurück zum Zitat Reddy IS, Shevade S, Murty M (2011) A fast quasi-newton method for semi-supervised SVM. Pattern Recogn 44(10–11):2305–2313CrossRefMATH Reddy IS, Shevade S, Murty M (2011) A fast quasi-newton method for semi-supervised SVM. Pattern Recogn 44(10–11):2305–2313CrossRefMATH
18.
Zurück zum Zitat Richarz J, Vajda S, Grzeszick R, Fink GA (2014) Semi-supervised learning for character recognition in historical archive documents. Pattern Recogn 47(3):1011–1020CrossRef Richarz J, Vajda S, Grzeszick R, Fink GA (2014) Semi-supervised learning for character recognition in historical archive documents. Pattern Recogn 47(3):1011–1020CrossRef
19.
Zurück zum Zitat Singh A, Nowak R, Zhu X (2009) Unlabeled data: Now it helps, now it doesn’t. In: Koller D, Schuurmans D, Bengio Y, Bottou L (eds) Advances in neural information processing systems, vol 21. Curran Associates Inc, Red Hook, pp 1513–1520 Singh A, Nowak R, Zhu X (2009) Unlabeled data: Now it helps, now it doesn’t. In: Koller D, Schuurmans D, Bengio Y, Bottou L (eds) Advances in neural information processing systems, vol 21. Curran Associates Inc, Red Hook, pp 1513–1520
20.
Zurück zum Zitat Tan B, Zhang J, Wang L (2011) Semi-supervised elastic net for pedestrian counting. Pattern Recogn 44(10–11):2297–2304CrossRef Tan B, Zhang J, Wang L (2011) Semi-supervised elastic net for pedestrian counting. Pattern Recogn 44(10–11):2297–2304CrossRef
21.
Zurück zum Zitat Wang R, Wang XZ, Kwong S, Xu C (2017) Incorporating diversity and informativeness in multiple-instance active learning. IEEE Trans Fuzzy Syst 25(6):1460–1475CrossRef Wang R, Wang XZ, Kwong S, Xu C (2017) Incorporating diversity and informativeness in multiple-instance active learning. IEEE Trans Fuzzy Syst 25(6):1460–1475CrossRef
22.
Zurück zum Zitat Wang XZ, Wang R, Feng HM, Wang HC (2014) A new approach to classifier fusion based on upper integral. IEEE Trans Cybern 44(5):620–635MathSciNetCrossRef Wang XZ, Wang R, Feng HM, Wang HC (2014) A new approach to classifier fusion based on upper integral. IEEE Trans Cybern 44(5):620–635MathSciNetCrossRef
23.
Zurück zum Zitat Wang Y, Chen S (2013) Safety-aware semi-supervised classification. IEEE Trans Neural Netw Learn Syst 24(11):1763–1772CrossRef Wang Y, Chen S (2013) Safety-aware semi-supervised classification. IEEE Trans Neural Netw Learn Syst 24(11):1763–1772CrossRef
24.
Zurück zum Zitat Zhang Z, Zhen L, Deng N, Tan J (2015) Manifold proximal support vector machine with mixed-norm for semi-supervised classification. Neural Comput Appl 26(2):399–407CrossRef Zhang Z, Zhen L, Deng N, Tan J (2015) Manifold proximal support vector machine with mixed-norm for semi-supervised classification. Neural Comput Appl 26(2):399–407CrossRef
25.
Zurück zum Zitat Zhou ZH, Li M (2005) Tri-training: exploiting unlabeled data using three classifiers. IEEE Trans Knowl Data Eng 17(11):1529–1541CrossRef Zhou ZH, Li M (2005) Tri-training: exploiting unlabeled data using three classifiers. IEEE Trans Knowl Data Eng 17(11):1529–1541CrossRef
26.
Zurück zum Zitat Zhu H, Wang X (2017) A cost-sensitive semi-supervised learning model based on uncertainty. Neurocomputing 251(Supplement C):106–114 Zhu H, Wang X (2017) A cost-sensitive semi-supervised learning model based on uncertainty. Neurocomputing 251(Supplement C):106–114
27.
Zurück zum Zitat Zhu X, Goldberg AB (2009) Introduction to semi-supervised learning. Synth Lectures Artif Intell Mach Learn 3(1):1–130CrossRefMATH Zhu X, Goldberg AB (2009) Introduction to semi-supervised learning. Synth Lectures Artif Intell Mach Learn 3(1):1–130CrossRefMATH
Metadaten
Titel
Adaptive safety degree-based safe semi-supervised learning
verfasst von
Nong Sang
Haitao Gan
Yingle Fan
Wei Wu
Zhi Yang
Publikationsdatum
24.01.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 5/2019
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-018-0788-7

Weitere Artikel der Ausgabe 5/2019

International Journal of Machine Learning and Cybernetics 5/2019 Zur Ausgabe

Neuer Inhalt