Skip to main content
Top

2017 | OriginalPaper | Chapter

Evaluation of Different Heuristics for Accommodating Asymmetric Loss Functions in Regression

Authors : Andrei Tolstikov, Frederik Janssen, Johannes Fürnkranz

Published in: Discovery Science

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Most machine learning methods used for regression explicitly or implicitly assume a symmetric loss function. However, recently an increasing number of problem domains require loss functions that are asymmetric in the sense that the costs for over- or under-predicting the target value may differ. This paper discusses theoretical foundations of handling asymmetric loss functions, and describes and evaluates simple methods which might be used to offset the effects of asymmetric losses. While these methods are applicable to any problem where an asymmetric loss is used, our work derives its motivation from the area of predictive maintenance, which is often characterized by a small number of training samples (in case of failure prediction) or monetary cost-based, mostly non-convex, loss functions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The datasets used are auto93.arff, autoMpg.arff, autoPrice.arff, cloud.arff, cpu.arff, echoMonths.arff, elevators.arff, housing.arff, meta.arff, pyrim.arff, strike.arff, triazines.arff, and veteran.arff.
 
Literature
1.
go back to reference Calvo, B., Santafe, G.: scmamp: Statistical comparison of multiple algorithms in multiple problems. R J. 8(1), 248–256 (2016) Calvo, B., Santafe, G.: scmamp: Statistical comparison of multiple algorithms in multiple problems. R J. 8(1), 248–256 (2016)
2.
3.
go back to reference Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetMATH Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetMATH
4.
go back to reference Elkan, C.: The foundations of cost-sensitive learning. In: Proceedings of the 17th International Joint Conference on Artificial Intelligence (IJCAI 2001), vol. 2. pp. 973–978. Morgan Kaufmann Publishers Inc, San Francisco, CA, USA (2001) Elkan, C.: The foundations of cost-sensitive learning. In: Proceedings of the 17th International Joint Conference on Artificial Intelligence (IJCAI 2001), vol. 2. pp. 973–978. Morgan Kaufmann Publishers Inc, San Francisco, CA, USA (2001)
5.
go back to reference Frank, E., Wang, Y., Inglis, S., Holmes, G., Witten, I.H.: Using model trees for classification. Mach. Learn. 32(1), 63–76 (1998)CrossRefMATH Frank, E., Wang, Y., Inglis, S., Holmes, G., Witten, I.H.: Using model trees for classification. Mach. Learn. 32(1), 63–76 (1998)CrossRefMATH
7.
go back to reference Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The Weka data mining software: An update. SIGKDD Explor. 11(1), 10–18 (2009)CrossRef Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The Weka data mining software: An update. SIGKDD Explor. 11(1), 10–18 (2009)CrossRef
8.
go back to reference Hernández-Orallo, J.: Probabilistic reframing for cost-sensitive regression. ACM Trans. Knowl. Discov. Data 8(4), 17.1–17.55 (2014) Hernández-Orallo, J.: Probabilistic reframing for cost-sensitive regression. ACM Trans. Knowl. Discov. Data 8(4), 17.1–17.55 (2014)
11.
go back to reference McCullough, B.: Optimal prediction with a general loss function. J. Comb. Inf. Syst. Sci. 25(14), 207–221 (2000) McCullough, B.: Optimal prediction with a general loss function. J. Comb. Inf. Syst. Sci. 25(14), 207–221 (2000)
12.
go back to reference Zhao, H., Sinha, A.P., Bansal, G.: An extended tuning method for cost-sensitive regression and forecasting. Decis. Support Syst. 51(3), 372–383 (2011)CrossRef Zhao, H., Sinha, A.P., Bansal, G.: An extended tuning method for cost-sensitive regression and forecasting. Decis. Support Syst. 51(3), 372–383 (2011)CrossRef
Metadata
Title
Evaluation of Different Heuristics for Accommodating Asymmetric Loss Functions in Regression
Authors
Andrei Tolstikov
Frederik Janssen
Johannes Fürnkranz
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-67786-6_5

Premium Partner