Skip to main content
Erschienen in: Neural Computing and Applications 21/2021

19.04.2021 | Review Article

Boosting algorithms in energy research: a systematic review

verfasst von: Hristos Tyralis, Georgia Papacharalampous

Erschienen in: Neural Computing and Applications | Ausgabe 21/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Machine learning algorithms have been extensively exploited in energy research, due to their flexibility, automation and ability to handle big data. Among the most prominent machine learning algorithms are the boosting ones, which are known to be “garnering wisdom from a council of fools”, thereby transforming weak learners to strong learners. Boosting algorithms are characterized by both high flexibility and high interpretability. The latter property is the result of recent developments by the statistical community. In this work, we provide understanding on the properties of boosting algorithms to facilitate a better exploitation of their strengths in energy research. In this respect, (a) we summarize recent advances on boosting algorithms, (b) we review relevant applications in energy research with those focusing on renewable energy (in particular those focusing on wind energy and solar energy) consisting a significant portion of the total ones, and (c) we describe how boosting algorithms are implemented and how their use is related to their properties. We show that boosting has been underexploited so far, while great advances in the energy field are possible both in terms of explanation and interpretation, and in terms of predictive performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
9.
Zurück zum Zitat Bickel PJ, Ritov Y, Zakai A (2006) Some theory for generalized boosting algorithms. J Mach Learn Res 7:705–732MathSciNetMATH Bickel PJ, Ritov Y, Zakai A (2006) Some theory for generalized boosting algorithms. J Mach Learn Res 7:705–732MathSciNetMATH
14.
Zurück zum Zitat Bühlmann P (2003) Boosting methods: why they can be useful for high-dimensional data. In: Proceedings of the 3rd International Workshop on Distributed Statistical Computing (DSC 2003) Bühlmann P (2003) Boosting methods: why they can be useful for high-dimensional data. In: Proceedings of the 3rd International Workshop on Distributed Statistical Computing (DSC 2003)
27.
28.
Zurück zum Zitat Efron B, Hastie T (2016) Computer age statistical inference. Cambridge University Press, New YorkCrossRef Efron B, Hastie T (2016) Computer age statistical inference. Cambridge University Press, New YorkCrossRef
33.
Zurück zum Zitat Freund Y, Schapire RE (1995) A desicion-theoretic generalization of on-line learning and an application to boosting. In: Vitányi P (ed) Computational Learning Theory EuroCOLT Lecture Notes in Computer Science Lecture Notes in Artificial Intelligence, vol 904. Springer, Berlin Heidelberg, pp 23–27 Freund Y, Schapire RE (1995) A desicion-theoretic generalization of on-line learning and an application to boosting. In: Vitányi P (ed) Computational Learning Theory EuroCOLT Lecture Notes in Computer Science Lecture Notes in Artificial Intelligence, vol 904. Springer, Berlin Heidelberg, pp 23–27
34.
Zurück zum Zitat Freund Y, Schapire RE (1996) Experiments with a new boosting algorithm. In: Proceedings of the Thirteenth International Conference on Machine Learning 148–156 Freund Y, Schapire RE (1996) Experiments with a new boosting algorithm. In: Proceedings of the Thirteenth International Conference on Machine Learning 148–156
40.
Zurück zum Zitat Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning. Springer, New York, NYCrossRef Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning. Springer, New York, NYCrossRef
45.
Zurück zum Zitat Hothorn T, Bühlmann P, Kneib T, Schmid M, Hofner B (2010) Model-based boosting 2.0. J Mach Learn Res 11:2109–2113MathSciNetMATH Hothorn T, Bühlmann P, Kneib T, Schmid M, Hofner B (2010) Model-based boosting 2.0. J Mach Learn Res 11:2109–2113MathSciNetMATH
46.
Zurück zum Zitat James G, Witten D, Hastie T, Tibshirani R (2013) An introduction to statistical learning. Springer, New York, NYCrossRef James G, Witten D, Hastie T, Tibshirani R (2013) An introduction to statistical learning. Springer, New York, NYCrossRef
51.
Zurück zum Zitat Ke G, Meng Q, Finkey T, Wang T, Chen W, Ma W, Ye Q, Liu TY (2017) LightGBM: a highly efficient gradient boosting decision tree. Adv Neural Inf Process Syst 30:3146–3154 Ke G, Meng Q, Finkey T, Wang T, Chen W, Ma W, Ye Q, Liu TY (2017) LightGBM: a highly efficient gradient boosting decision tree. Adv Neural Inf Process Syst 30:3146–3154
67.
Zurück zum Zitat Mease D, Wyner A (2008) Evidence contrary to the statistical view of boosting. J Mach Learn Res 9:131–156 Mease D, Wyner A (2008) Evidence contrary to the statistical view of boosting. J Mach Learn Res 9:131–156
74.
Zurück zum Zitat Papacharalampous G, Tyralis H, Langousis A, Jayawardena AW, Sivakumar B, Mamassis N, Montanari A, Koutsoyiannis D (2019) Probabilistic hydrological post-processing at scale: why and how to apply machine-learning quantile regression algorithms. Water 11(10):2126. https://doi.org/10.3390/w11102126CrossRef Papacharalampous G, Tyralis H, Langousis A, Jayawardena AW, Sivakumar B, Mamassis N, Montanari A, Koutsoyiannis D (2019) Probabilistic hydrological post-processing at scale: why and how to apply machine-learning quantile regression algorithms. Water 11(10):2126. https://​doi.​org/​10.​3390/​w11102126CrossRef
75.
Zurück zum Zitat Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A (2018) CatBoost: unbiased boosting with categorical features. Adv Neural Inf Process Syst 31:6638–6648 Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A (2018) CatBoost: unbiased boosting with categorical features. Adv Neural Inf Process Syst 31:6638–6648
78.
Zurück zum Zitat Ridgeway G (1999) The state of boosting. Comput Sci Stat 31:172–181 Ridgeway G (1999) The state of boosting. Comput Sci Stat 31:172–181
84.
Zurück zum Zitat Schapire RE, Freund Y (2012) Boosting. The MIT Press, Cambridge, MassachusettsMATH Schapire RE, Freund Y (2012) Boosting. The MIT Press, Cambridge, MassachusettsMATH
105.
Zurück zum Zitat Wyner AJ, Olson M, Bleich J, Mease D (2017) Explaining the success of AdaBoost and random forests as interpolating classifiers. J Mach Learn Res 18(48):1–33MathSciNetMATH Wyner AJ, Olson M, Bleich J, Mease D (2017) Explaining the success of AdaBoost and random forests as interpolating classifiers. J Mach Learn Res 18(48):1–33MathSciNetMATH
114.
Zurück zum Zitat Zhou ZH (2012) Ensemble methods: foundations and algorithms. Chapman and Hall/CRC, Boca Raton, FLCrossRef Zhou ZH (2012) Ensemble methods: foundations and algorithms. Chapman and Hall/CRC, Boca Raton, FLCrossRef
Metadaten
Titel
Boosting algorithms in energy research: a systematic review
verfasst von
Hristos Tyralis
Georgia Papacharalampous
Publikationsdatum
19.04.2021
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 21/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-021-05995-8

Weitere Artikel der Ausgabe 21/2021

Neural Computing and Applications 21/2021 Zur Ausgabe

Premium Partner