Skip to main content

2018 | OriginalPaper | Buchkapitel

Active Evidential Calibration of Binary SVM Classifiers

verfasst von : Sébastien Ramel, Frédéric Pichon, François Delmotte

Erschienen in: Belief Functions: Theory and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Evidential calibration methods of binary classifiers improve upon probabilistic calibration methods by representing explicitly the calibration uncertainty due to the amount of training (labelled) data. This justified yet undesirable uncertainty can be reduced by adding training data, which are in general costly. Hence the need for strategies that, given a pool of unlabelled data, will point to interesting data to be labelled, i.e., to data inducing a drop in uncertainty greater than a random selection. Two such strategies are considered in this paper and applied to an ensemble of binary SVM classifiers on some classical binary classification datasets. Experimental results show the interest of the approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
\(Bel^\varTheta _x\) must be induced by a source [7]. It may be obtained by a number of evidential methods to statistical inference, and in particular the likelihood-based evidential method [8] in which case \(Bel^\varTheta _x\) is the consonant belief function whose contour function is the normalized likelihood function given the observed data x.
 
2
Equation (2) corresponds to a degenerate binning approach with only two bins. It can be derived rigorously without referring to the evidential binning calibration, by following a similar reasoning to the one used in [3] to obtain this latter calibration.
 
Literatur
1.
Zurück zum Zitat Niculescu-Mizil, A., Caruana, R.: Predicting good probabilities with supervised learning. In: Proceedings of ICML, pp. 625–632 (2005) Niculescu-Mizil, A., Caruana, R.: Predicting good probabilities with supervised learning. In: Proceedings of ICML, pp. 625–632 (2005)
2.
Zurück zum Zitat Zhong, W., Kwok, J.T.: Accurate probability calibration for multiple classifiers. In: Proceedings of IJCAI, pp. 1939–1945 (2013) Zhong, W., Kwok, J.T.: Accurate probability calibration for multiple classifiers. In: Proceedings of IJCAI, pp. 1939–1945 (2013)
3.
Zurück zum Zitat Xu, P., Davoine, F., Zha, H., Denoeux, T.: Evidential calibration of binary SVM classifiers. Int. J. Approx. Reason. 72, 55–70 (2016)MathSciNetCrossRef Xu, P., Davoine, F., Zha, H., Denoeux, T.: Evidential calibration of binary SVM classifiers. Int. J. Approx. Reason. 72, 55–70 (2016)MathSciNetCrossRef
4.
Zurück zum Zitat Minary, P., Pichon, F., Mercier, D., Lefevre, E., Droit, B.: Evidential joint calibration of binary SVM classifiers using logistic regression. In: Proceedings of SUM, pp. 405–411 (2017) Minary, P., Pichon, F., Mercier, D., Lefevre, E., Droit, B.: Evidential joint calibration of binary SVM classifiers using logistic regression. In: Proceedings of SUM, pp. 405–411 (2017)
5.
Zurück zum Zitat Settles, B.: Active learning literature survey. Computer Sciences Technical report 1648, University of Wisconsin-Madison (2009) Settles, B.: Active learning literature survey. Computer Sciences Technical report 1648, University of Wisconsin-Madison (2009)
6.
Zurück zum Zitat Kanjanatarakul, O., Sriboonchitta, S., Denœux, T.: Forecasting using belief functions: an application to marketing econometrics. Int. J. Approx. Reason. 55(5), 1113–1128 (2014)MathSciNetCrossRef Kanjanatarakul, O., Sriboonchitta, S., Denœux, T.: Forecasting using belief functions: an application to marketing econometrics. Int. J. Approx. Reason. 55(5), 1113–1128 (2014)MathSciNetCrossRef
7.
Zurück zum Zitat Kanjanatarakul, O., Denœux, T., Sriboonchitta, S.: Prediction of future observations using belief functions: a likelihood-based approach. Int. J. Approx. Reason. 72, 71–94 (2016)MathSciNetCrossRef Kanjanatarakul, O., Denœux, T., Sriboonchitta, S.: Prediction of future observations using belief functions: a likelihood-based approach. Int. J. Approx. Reason. 72, 71–94 (2016)MathSciNetCrossRef
8.
Zurück zum Zitat Denoeux, T.: Likelihood-based belief function: Justification and some extensions to low-quality data. Int. J. Approx. Reason. 55(7), 1535–1547 (2014)MathSciNetCrossRef Denoeux, T.: Likelihood-based belief function: Justification and some extensions to low-quality data. Int. J. Approx. Reason. 55(7), 1535–1547 (2014)MathSciNetCrossRef
9.
Zurück zum Zitat Klir, G.J.: Uncertainty and Information: Foundations of Generalized Information Theory. Wiley, Hoboken (2005)CrossRef Klir, G.J.: Uncertainty and Information: Foundations of Generalized Information Theory. Wiley, Hoboken (2005)CrossRef
11.
Zurück zum Zitat Reineking, T.: Active classification using belief functions and information gain maximization. Int. J. Approx. Reason. 72, 43–54 (2016)MathSciNetCrossRef Reineking, T.: Active classification using belief functions and information gain maximization. Int. J. Approx. Reason. 72, 43–54 (2016)MathSciNetCrossRef
12.
Zurück zum Zitat Teugels, J.L.: Some representation of the multivariate Bernoulli and binomial distributions. J. Multivar. Anal. 32, 256–268 (1990)MathSciNetCrossRef Teugels, J.L.: Some representation of the multivariate Bernoulli and binomial distributions. J. Multivar. Anal. 32, 256–268 (1990)MathSciNetCrossRef
Metadaten
Titel
Active Evidential Calibration of Binary SVM Classifiers
verfasst von
Sébastien Ramel
Frédéric Pichon
François Delmotte
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-99383-6_26

Premium Partner