Skip to main content
Top
Published in: Neural Processing Letters 4/2021

11-01-2020

A Safe Semi-supervised Classification Algorithm Using Multiple Classifiers Ensemble

Authors: Jianhua Zhao, Ning Liu

Published in: Neural Processing Letters | Issue 4/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In order to improve the performance of semi-supervised learning, a safe semi-supervised classification algorithm using multiple classifiers ensemble (S3C-MC) is proposed. First, unlabeled samples are filtered and unlabeled samples with small ambiguity are selected for semi-supervised learning. Next, the labeled training set is sampled to multiple subsets and they generate multiple classifiers to predict the filtered unlabeled sample respectively. The predicted label is formed by multiple classifiers with weighted voting mechanism, and the weight of classifier is changing constantly according to the correctness of the prediction for unlabeled samples by classifier. Then, security verification is carried out to ensure that the classifier evolves in the direction of error reduction when the new sample is added. Only the label making classifiers error lower and having the same predictive value with the three classifiers in security verification is added into the labeled set to expand the number of labeled sets. Finally, the algorithm iterates until the unlabeled sample set is empty. The experiment is carried out on the UCI data set and the result shows that the proposed S3C-MC has good safety and has a higher classification rate.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Li M, Li H, Zhou ZH (2009) Semi-supervised document retrieval. Inf Process Manage 45(3):341–355CrossRef Li M, Li H, Zhou ZH (2009) Semi-supervised document retrieval. Inf Process Manage 45(3):341–355CrossRef
2.
go back to reference Silva NFFD, Coletta LFS, Hruschka ER (2016) A Survey and comparative study of tweet sentiment analysis via semi-supervised learning. ACM Comput Surv 49(1):1–26 Silva NFFD, Coletta LFS, Hruschka ER (2016) A Survey and comparative study of tweet sentiment analysis via semi-supervised learning. ACM Comput Surv 49(1):1–26
3.
go back to reference Camps-Valls G, Munoz-Mari J, Gomez-Chova L et al (2009) Biophysical parameter estimation with a semisupervised support vector machine. IEEE Geosci Remote Sens Lett 6(2):248–252CrossRef Camps-Valls G, Munoz-Mari J, Gomez-Chova L et al (2009) Biophysical parameter estimation with a semisupervised support vector machine. IEEE Geosci Remote Sens Lett 6(2):248–252CrossRef
4.
go back to reference Dornaika F, El Traboulsi Y, Dornaika F, El TY (2015) Learning flexible graph-based semi-supervised embedding. IEEE Trans Cybern 46(1):206–218MATHCrossRef Dornaika F, El Traboulsi Y, Dornaika F, El TY (2015) Learning flexible graph-based semi-supervised embedding. IEEE Trans Cybern 46(1):206–218MATHCrossRef
5.
go back to reference Peng Y, Zhai X, Zhao Y et al (2016) Semi-supervised cross-media feature learning with unified patch graph regularization. IEEE Trans Circuits Syst Video Technol 26(3):583–596CrossRef Peng Y, Zhai X, Zhao Y et al (2016) Semi-supervised cross-media feature learning with unified patch graph regularization. IEEE Trans Circuits Syst Video Technol 26(3):583–596CrossRef
6.
go back to reference Abdelgayed TS, Morsi WG, Sidhu TS (2018) Fault detection and classification based on co-training of semi-supervised machine learning. IEEE Trans Ind Electron 65(2):1595–1605CrossRef Abdelgayed TS, Morsi WG, Sidhu TS (2018) Fault detection and classification based on co-training of semi-supervised machine learning. IEEE Trans Ind Electron 65(2):1595–1605CrossRef
7.
go back to reference Zhou ZH, Li M (2010) Semi-supervised learning by disagreement. Knowl Inf Syst 24(3):415–439CrossRef Zhou ZH, Li M (2010) Semi-supervised learning by disagreement. Knowl Inf Syst 24(3):415–439CrossRef
8.
go back to reference Blum A, Mitchell T (1998) Combining labeled and unlabeled data with co-training. In: Proceedings of the 11th annual conference on computational learning theory (COLT’98), pp 92–100. ACM, Wisconsin Blum A, Mitchell T (1998) Combining labeled and unlabeled data with co-training. In: Proceedings of the 11th annual conference on computational learning theory (COLT’98), pp 92–100. ACM, Wisconsin
9.
go back to reference Yu ZW, Zhang YD, You JN et al (2019) Adaptive semi-supervised classifier ensemble for high dimensional data classification. IEEE Trans Cybern 49(2):366–379CrossRef Yu ZW, Zhang YD, You JN et al (2019) Adaptive semi-supervised classifier ensemble for high dimensional data classification. IEEE Trans Cybern 49(2):366–379CrossRef
10.
go back to reference Keyvanpour MR, Imani MB (2013) Semi-supervised text categorization: exploiting unlabeled data using ensemble learning algorithms. Intell Data Anal 17(3):367–385CrossRef Keyvanpour MR, Imani MB (2013) Semi-supervised text categorization: exploiting unlabeled data using ensemble learning algorithms. Intell Data Anal 17(3):367–385CrossRef
11.
go back to reference Yu GX, Zhang GJ, Yu ZW et al (2012) Semi-supervised ensemble classification in subspaces. Appl Soft Comput 12(5):1511–1522CrossRef Yu GX, Zhang GJ, Yu ZW et al (2012) Semi-supervised ensemble classification in subspaces. Appl Soft Comput 12(5):1511–1522CrossRef
12.
go back to reference Zhou ZH, Li M (2005) Tri-training: exploiting unlabeled data using three classifiers. IEEE Trans Knowl Data Eng 17(11):1529–1541CrossRef Zhou ZH, Li M (2005) Tri-training: exploiting unlabeled data using three classifiers. IEEE Trans Knowl Data Eng 17(11):1529–1541CrossRef
13.
go back to reference Li Y, Guo M (2012) A new relational Tri-training system with adaptive data editing for inductive logic programming. Knowl-Based Syst 35:73–185 Li Y, Guo M (2012) A new relational Tri-training system with adaptive data editing for inductive logic programming. Knowl-Based Syst 35:73–185
14.
go back to reference Li YF, Liang DM (2019) Safe semi-supervised learning: a brief introduction. Front Comput Sci 4:669–676CrossRef Li YF, Liang DM (2019) Safe semi-supervised learning: a brief introduction. Front Comput Sci 4:669–676CrossRef
15.
go back to reference Li YF, Zhou ZH (2015) Towards making unlabeled data never hurt. IEEE Trans Pattern Anal Mach Intell 37(1):175–188CrossRef Li YF, Zhou ZH (2015) Towards making unlabeled data never hurt. IEEE Trans Pattern Anal Mach Intell 37(1):175–188CrossRef
16.
go back to reference Li YF, Zhou ZH (2011) Improving semi-supervised support vector machines through unlabeled instances selection. In: Proceedings of the 25th AAAI conference on artificial intelligence, pp 386–391 Li YF, Zhou ZH (2011) Improving semi-supervised support vector machines through unlabeled instances selection. In: Proceedings of the 25th AAAI conference on artificial intelligence, pp 386–391
17.
go back to reference Sang N, Gan H, Fan Y et al (2019) Adaptive safety degree-based safe semi-supervised learning. Int J Mach Learn Cybernet 10:1101–1108CrossRef Sang N, Gan H, Fan Y et al (2019) Adaptive safety degree-based safe semi-supervised learning. Int J Mach Learn Cybernet 10:1101–1108CrossRef
18.
go back to reference Goldman S, Zhou Y (2000) Enhancing supervised learning with unlabeled data. In: Proceedings of the 17th international conference on machine learning, pp 327–334 Goldman S, Zhou Y (2000) Enhancing supervised learning with unlabeled data. In: Proceedings of the 17th international conference on machine learning, pp 327–334
19.
go back to reference Soonthornphisaj N, Kijsirikul B (2004) Interative cross-training: an algorithm for learning from unlabeled Web pages. Int J Intell Syst 19(1–2):131–147MATHCrossRef Soonthornphisaj N, Kijsirikul B (2004) Interative cross-training: an algorithm for learning from unlabeled Web pages. Int J Intell Syst 19(1–2):131–147MATHCrossRef
20.
go back to reference Mallapragada PK, Jin R, Jain AK et al (2009) SemiBoost: boosting for semi-supervised learning. IEEE Trans Pattern Anal Mach Intell 31(11):2000–2014CrossRef Mallapragada PK, Jin R, Jain AK et al (2009) SemiBoost: boosting for semi-supervised learning. IEEE Trans Pattern Anal Mach Intell 31(11):2000–2014CrossRef
21.
go back to reference Peng J, Aved AJ, Seetharaman G et al (2018) Multiview boosting with information propagation for classification. IEEE Trans Neural Netw Learn Syst 29(3):657–669MathSciNetCrossRef Peng J, Aved AJ, Seetharaman G et al (2018) Multiview boosting with information propagation for classification. IEEE Trans Neural Netw Learn Syst 29(3):657–669MathSciNetCrossRef
22.
go back to reference Schwenk H, Bengio Y (2000) Boosting neural networks. Neural Comput 12(8):1869–1887CrossRef Schwenk H, Bengio Y (2000) Boosting neural networks. Neural Comput 12(8):1869–1887CrossRef
23.
go back to reference Shen C, Li H (2009) On the dual formulation of boosting algorithms. IEEE Trans Pattern Anal Mach Intell 32(12):2216–2231CrossRef Shen C, Li H (2009) On the dual formulation of boosting algorithms. IEEE Trans Pattern Anal Mach Intell 32(12):2216–2231CrossRef
24.
go back to reference Rashedi E, Mirzaei A (2013) A hierarchical cluster ensemble method based on boosting theory. Knowl-Based Syst 45(3):83–93CrossRef Rashedi E, Mirzaei A (2013) A hierarchical cluster ensemble method based on boosting theory. Knowl-Based Syst 45(3):83–93CrossRef
25.
go back to reference Li J, Zhang L, Feng X, Jia K, Kong F (2019) Feature extraction and area identification of wireless channel in mobile communication. J Int Technol 20:544–553 Li J, Zhang L, Feng X, Jia K, Kong F (2019) Feature extraction and area identification of wireless channel in mobile communication. J Int Technol 20:544–553
26.
go back to reference Mi C, Shen Y, Mi WJ, Huang YF (2015) Ship identification algorithm based on 3D point cloud for automated ship loaders. J Coast Res 73:28–34CrossRef Mi C, Shen Y, Mi WJ, Huang YF (2015) Ship identification algorithm based on 3D point cloud for automated ship loaders. J Coast Res 73:28–34CrossRef
27.
go back to reference Yang A, Li S, Ren C, Liu H, Han Y, Liu L (2018) Situational awareness system in the smart campus. IEEE Access 6:63976–63986CrossRef Yang A, Li S, Ren C, Liu H, Han Y, Liu L (2018) Situational awareness system in the smart campus. IEEE Access 6:63976–63986CrossRef
28.
go back to reference Yang A, Li Y, Kong F, Wang G, Chen E (2018) security control redundancy allocation technology and security keys based on internet of things. IEEE Access. 6:50187–50196CrossRef Yang A, Li Y, Kong F, Wang G, Chen E (2018) security control redundancy allocation technology and security keys based on internet of things. IEEE Access. 6:50187–50196CrossRef
29.
go back to reference Yang Y, Zhong M, Yao H, Yu F, Fu X, Postolache O (2018) Internet of things for smart ports: technologies and challenges. IEEE Instrum Meas Mag 21:34–43CrossRef Yang Y, Zhong M, Yao H, Yu F, Fu X, Postolache O (2018) Internet of things for smart ports: technologies and challenges. IEEE Instrum Meas Mag 21:34–43CrossRef
Metadata
Title
A Safe Semi-supervised Classification Algorithm Using Multiple Classifiers Ensemble
Authors
Jianhua Zhao
Ning Liu
Publication date
11-01-2020
Publisher
Springer US
Published in
Neural Processing Letters / Issue 4/2021
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-020-10191-1

Other articles of this Issue 4/2021

Neural Processing Letters 4/2021 Go to the issue