Skip to main content
Top
Published in: Neural Computing and Applications 20/2021

27-04-2021 | Original Article

Intelligent forecast engine for short-term wind speed prediction based on stacked long short-term memory

Authors: Farah Shahid, Aneela Zameer, Muhammad Javaid Iqbal

Published in: Neural Computing and Applications | Issue 20/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents machine learning techniques for short-term wind speed prediction by exploiting their computational intelligence capabilities such as random forest regression (RFR), support vector regression (SVR), radial basis function neural networks (RBFNN), and long short-term memory (LSTM) on various wind farm datasets located in Pakistan. Initially, predictions are obtained by employing baseline regressors, RFR and RBFNN in terms of error indices. Later, a stacked LSTM forecast engine (SLFE) has been proposed to improve the efficacy, accuracy, and prediction capability of the forecast engine by using leaky rectified linear units (Leaky ReLU) as kernel function. SLFE has been implemented and tested on the datasets acquired from four different wind farms having a temporal locality of 10 min for short-term wind speed prediction. Furthermore, an ensemble of stacked LSTM with RFR, SVR, and RBFNN has also been developed for the comparison. The strength of the SLFE has been evaluated in terms of various performance measures such as mean absolute error (MAE), root mean squared error (RMSE), R2Score, and explained variance score (EVS). The efficacy of the proposed models is evaluated in terms of performance metrics, MAE, RMSE, R2Score and EVS, 0.043, 0.065, 0.813, and 0.814, respectively, demonstrating the worth of the forecast engine. Additionally, statistical one-way ANOVA is also carried out with multiple independent executions of the proposed algorithm to demonstrate the robustness, efficiency, and reliability of the model.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Foley AM, Leahy PG, McKeogh EJ (2010) Wind power forecasting & prediction methods. In: 2010 9th International conference on environment and electrical engineering, pp 61-64. IEEE Foley AM, Leahy PG, McKeogh EJ (2010) Wind power forecasting & prediction methods. In: 2010 9th International conference on environment and electrical engineering, pp 61-64. IEEE
2.
go back to reference Sideratos G, Hatziargyriou N (2007) An advanced statistical method for wind power forecasting. IEEE Trans power syst 22:258–265CrossRef Sideratos G, Hatziargyriou N (2007) An advanced statistical method for wind power forecasting. IEEE Trans power syst 22:258–265CrossRef
3.
go back to reference Ghorbani M et al (2016) Short-term wind speed predictions with machine learning techniques. Meteorol Atmos Phys 128(1):57–72CrossRef Ghorbani M et al (2016) Short-term wind speed predictions with machine learning techniques. Meteorol Atmos Phys 128(1):57–72CrossRef
4.
go back to reference Yilmaz I, Erik NY, Kaynar O (2010) Different types of learning algorithms of artificial neural network (ANN) models for prediction of gross calorific value (GCV) of coals. Sci Res Essays 5(16):2242–2249 Yilmaz I, Erik NY, Kaynar O (2010) Different types of learning algorithms of artificial neural network (ANN) models for prediction of gross calorific value (GCV) of coals. Sci Res Essays 5(16):2242–2249
5.
go back to reference Carcangiu C et al (2014) Wind gust detection and load mitigation using artificial neural networks assisted control. Wind Energy 17(7):957–970CrossRef Carcangiu C et al (2014) Wind gust detection and load mitigation using artificial neural networks assisted control. Wind Energy 17(7):957–970CrossRef
6.
go back to reference Korprasertsak N, Leephakpreeda T (2019) Robust short-term prediction of wind power generation under uncertainty via statistical interpretation of multiple forecasting models. Energy 180:387–397CrossRef Korprasertsak N, Leephakpreeda T (2019) Robust short-term prediction of wind power generation under uncertainty via statistical interpretation of multiple forecasting models. Energy 180:387–397CrossRef
7.
go back to reference Ghorbani MA et al (2013) Relative importance of parameters affecting wind speed prediction using artificial neural networks. Theor Appl Climatol 114(1):107–114CrossRef Ghorbani MA et al (2013) Relative importance of parameters affecting wind speed prediction using artificial neural networks. Theor Appl Climatol 114(1):107–114CrossRef
8.
go back to reference Haque AU, Nehrir MH, Mandal P (2014) A hybrid intelligent model for deterministic and quantile regression approach for probabilistic wind power forecasting. IEEE Trans Power Syst 29(4):1663–1672CrossRef Haque AU, Nehrir MH, Mandal P (2014) A hybrid intelligent model for deterministic and quantile regression approach for probabilistic wind power forecasting. IEEE Trans Power Syst 29(4):1663–1672CrossRef
9.
go back to reference Chang W-Y (2015) Short-term load forecasting using radial basis function neural network. J Comput Commun 2015(3):40–45CrossRef Chang W-Y (2015) Short-term load forecasting using radial basis function neural network. J Comput Commun 2015(3):40–45CrossRef
10.
go back to reference Sideratos G, Hatziargyriou ND (2012) Probabilistic wind power forecasting using radial basis function neural networks. IEEE Trans Power Syst 27(4):1788–1796CrossRef Sideratos G, Hatziargyriou ND (2012) Probabilistic wind power forecasting using radial basis function neural networks. IEEE Trans Power Syst 27(4):1788–1796CrossRef
11.
go back to reference Senjyu T et al (2006) Application of recurrent neural network to long-term-ahead generating power forecasting for wind power generator. In: 2006 IEEE PES power systems conference and exposition. IEEE. Senjyu T et al (2006) Application of recurrent neural network to long-term-ahead generating power forecasting for wind power generator. In: 2006 IEEE PES power systems conference and exposition. IEEE.
12.
go back to reference Espinoza M, Suykens JAK, Moor BD (2006) Fixed-size least squares support vector machines: a large scale application in electrical load forecasting. Comput Manag Sci 3(2):113–129MathSciNetCrossRef Espinoza M, Suykens JAK, Moor BD (2006) Fixed-size least squares support vector machines: a large scale application in electrical load forecasting. Comput Manag Sci 3(2):113–129MathSciNetCrossRef
13.
go back to reference Hu Z, Bao Y, Xiong T (2013) Electricity load forecasting using support vector regression with memetic algorithms. Sci World J 2013:10 Hu Z, Bao Y, Xiong T (2013) Electricity load forecasting using support vector regression with memetic algorithms. Sci World J 2013:10
14.
go back to reference Duan P et al (2011) Short-term load forecasting for electric power systems using the PSO-SVR and FCM clustering techniques. Energies 4(1):173–184CrossRef Duan P et al (2011) Short-term load forecasting for electric power systems using the PSO-SVR and FCM clustering techniques. Energies 4(1):173–184CrossRef
15.
go back to reference Yuan X et al (2017) Wind power prediction using hybrid autoregressive fractionally integrated moving average and least square support vector machine. Energy 129:122–137CrossRef Yuan X et al (2017) Wind power prediction using hybrid autoregressive fractionally integrated moving average and least square support vector machine. Energy 129:122–137CrossRef
16.
go back to reference Alonso Á, Torres A, and Dorronsoro JR (2015) Random forests and gradient boosting for wind energy prediction. In: International conference on hybrid artificial intelligence systems. Springer. Alonso Á, Torres A, and Dorronsoro JR (2015) Random forests and gradient boosting for wind energy prediction. In: International conference on hybrid artificial intelligence systems. Springer.
17.
go back to reference Nagy GI et al (2016) GEFCom2014: Probabilistic solar and wind power forecasting using a generalized additive tree ensemble approach. Int J Forecast 32(3):1087–1093CrossRef Nagy GI et al (2016) GEFCom2014: Probabilistic solar and wind power forecasting using a generalized additive tree ensemble approach. Int J Forecast 32(3):1087–1093CrossRef
18.
go back to reference Qureshi AS et al (2017) Wind power prediction using deep neural network based meta regression and transfer learning. Appl Soft Comput 58:742–755CrossRef Qureshi AS et al (2017) Wind power prediction using deep neural network based meta regression and transfer learning. Appl Soft Comput 58:742–755CrossRef
19.
go back to reference Zameer A et al (2017) Intelligent and robust prediction of short term wind power using genetic programming based ensemble of neural networks. Energy Convers Manag 134:361–372CrossRef Zameer A et al (2017) Intelligent and robust prediction of short term wind power using genetic programming based ensemble of neural networks. Energy Convers Manag 134:361–372CrossRef
20.
go back to reference Zameer A, Khan A, Javed SG (2015) Machine learning based short term wind power prediction using a hybrid learning model. Comput Electr Eng 45:122–133CrossRef Zameer A, Khan A, Javed SG (2015) Machine learning based short term wind power prediction using a hybrid learning model. Comput Electr Eng 45:122–133CrossRef
21.
go back to reference Rani RHJ, Victoire AAT (2018) Training radial basis function networks for wind speed prediction using PSO enhanced differential search optimizer. PLOS ONE 13(5):e0196871CrossRef Rani RHJ, Victoire AAT (2018) Training radial basis function networks for wind speed prediction using PSO enhanced differential search optimizer. PLOS ONE 13(5):e0196871CrossRef
22.
go back to reference Deo RC et al (2018) Multi-layer perceptron hybrid model integrated with the firefly optimizer algorithm for windspeed prediction of target site using a limited set of neighboring reference station data. Renew Energy 116:309–323CrossRef Deo RC et al (2018) Multi-layer perceptron hybrid model integrated with the firefly optimizer algorithm for windspeed prediction of target site using a limited set of neighboring reference station data. Renew Energy 116:309–323CrossRef
23.
go back to reference Wang H et al (2016) Deep belief network based deterministic and probabilistic wind speed forecasting approach. Appl Energy 182:80–93CrossRef Wang H et al (2016) Deep belief network based deterministic and probabilistic wind speed forecasting approach. Appl Energy 182:80–93CrossRef
24.
go back to reference Zhang Y et al (2018) Long short-term memory recurrent neural network for remaining useful life prediction of lithium-ion batteries. IEEE Trans Veh Technol 67(7):5695–5705CrossRef Zhang Y et al (2018) Long short-term memory recurrent neural network for remaining useful life prediction of lithium-ion batteries. IEEE Trans Veh Technol 67(7):5695–5705CrossRef
25.
go back to reference Xu L et al (2018) Long-short-term memory network based hybrid model for short-term electrical load forecasting. Information 9(7):165CrossRef Xu L et al (2018) Long-short-term memory network based hybrid model for short-term electrical load forecasting. Information 9(7):165CrossRef
26.
go back to reference India Massana MÀ, Rodríguez Fonollosa JA, and Hernando Pericás FJ (2017) LSTM neural network-based speaker segmentation using acoustic and language modelling. In: INTERSPEECH 2017: 20–24 August 2017—Stockholm. 2017. International Speech Communication Association (ISCA) India Massana MÀ, Rodríguez Fonollosa JA, and Hernando Pericás FJ (2017) LSTM neural network-based speaker segmentation using acoustic and language modelling. In: INTERSPEECH 2017: 20–24 August 2017—Stockholm. 2017. International Speech Communication Association (ISCA)
27.
go back to reference Meshram SG et al (2020) Long-term temperature trend analysis associated with agriculture crops. Theoret Appl Climatol 140(3):1139–1159CrossRef Meshram SG et al (2020) Long-term temperature trend analysis associated with agriculture crops. Theoret Appl Climatol 140(3):1139–1159CrossRef
28.
go back to reference Yang T et al (2018) A novel method of wind speed prediction by peephole LSTM. In: 2018 International conference on power system technology (POWERCON) Yang T et al (2018) A novel method of wind speed prediction by peephole LSTM. In: 2018 International conference on power system technology (POWERCON)
29.
go back to reference Barbounis T, Theocharis JB (2007) Locally recurrent neural networks for wind speed prediction using spatial correlation. Inf Sci 177(24):5775–5797CrossRef Barbounis T, Theocharis JB (2007) Locally recurrent neural networks for wind speed prediction using spatial correlation. Inf Sci 177(24):5775–5797CrossRef
30.
go back to reference Barbounis TG et al (2006) Long-term wind speed and power forecasting using local recurrent neural network models. IEEE Trans Energy Convers 21(1):273–284CrossRef Barbounis TG et al (2006) Long-term wind speed and power forecasting using local recurrent neural network models. IEEE Trans Energy Convers 21(1):273–284CrossRef
31.
go back to reference Yu R et al (2019) LSTM-EFG for wind power forecasting based on sequential correlation features. Futur Gener Comput Syst 93:33–42CrossRef Yu R et al (2019) LSTM-EFG for wind power forecasting based on sequential correlation features. Futur Gener Comput Syst 93:33–42CrossRef
34.
go back to reference Ho TK (1995) Random decision forests. In: Proceedings of the third international conference on document analysis and recognition (Volume 1). IEEE Computer Society. pp. 278. Ho TK (1995) Random decision forests. In: Proceedings of the third international conference on document analysis and recognition (Volume 1). IEEE Computer Society. pp. 278.
35.
go back to reference Torres-Barrán A, Alonso Á, Dorronsoro JR (2019) Regression tree ensembles for wind energy and solar radiation prediction. Neurocomputing 326:151–160CrossRef Torres-Barrán A, Alonso Á, Dorronsoro JR (2019) Regression tree ensembles for wind energy and solar radiation prediction. Neurocomputing 326:151–160CrossRef
36.
37.
go back to reference Zhao X, Wang SX, and Li T (2011) Review of evaluation criteria and main methods of wind power forecasting. In: Proceedings of international conference on smart grid and clean energy technologies (Icsgce 2011), p. 12 Zhao X, Wang SX, and Li T (2011) Review of evaluation criteria and main methods of wind power forecasting. In: Proceedings of international conference on smart grid and clean energy technologies (Icsgce 2011), p. 12
38.
go back to reference Musavi MT et al (1992) On the training of radial basis function classifiers. Neural Netw 5(4):595–603CrossRef Musavi MT et al (1992) On the training of radial basis function classifiers. Neural Netw 5(4):595–603CrossRef
39.
go back to reference Zeng J (2011) and W. Short-term solar power prediction using an RBF neural network, Qiao, pp 1–8 Zeng J (2011) and W. Short-term solar power prediction using an RBF neural network, Qiao, pp 1–8
40.
go back to reference Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural comput 9(8):1735–1780CrossRef Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural comput 9(8):1735–1780CrossRef
41.
go back to reference Barbounis TG, Theocharis JB (2006) Locally recurrent neural networks for long-term wind speed and power prediction. Neurocomputing 69(4–6):466–496CrossRef Barbounis TG, Theocharis JB (2006) Locally recurrent neural networks for long-term wind speed and power prediction. Neurocomputing 69(4–6):466–496CrossRef
42.
go back to reference Pascanu R, Bengio Y (1986) Learning to deal with long-term dependencies. Neural Comput 9:1735–1780 Pascanu R, Bengio Y (1986) Learning to deal with long-term dependencies. Neural Comput 9:1735–1780
43.
go back to reference Zhang L et al (2018) Two-Stage short-term wind speed prediction based on LSTM-LSSVM-CFA. In: 2018 2nd IEEE conference on energy internet and energy system integration (EI2) Zhang L et al (2018) Two-Stage short-term wind speed prediction based on LSTM-LSSVM-CFA. In: 2018 2nd IEEE conference on energy internet and energy system integration (EI2)
44.
go back to reference Graves A, Jaitly N, Mohamed A-R (2013) Hybrid speech recognition with deep bidirectional LSTM. In: 2013 IEEE workshop on automatic speech recognition and understanding. IEEE Graves A, Jaitly N, Mohamed A-R (2013) Hybrid speech recognition with deep bidirectional LSTM. In: 2013 IEEE workshop on automatic speech recognition and understanding. IEEE
45.
go back to reference Gao M et al (2019) Day-ahead power forecasting in a large-scale photovoltaic plant based on weather classification using LSTM. Energy 187:115838CrossRef Gao M et al (2019) Day-ahead power forecasting in a large-scale photovoltaic plant based on weather classification using LSTM. Energy 187:115838CrossRef
46.
go back to reference Kim T-Y, Cho S-B (2019) Predicting residential energy consumption using CNN-LSTM neural networks. Energy 182:72–81CrossRef Kim T-Y, Cho S-B (2019) Predicting residential energy consumption using CNN-LSTM neural networks. Energy 182:72–81CrossRef
47.
go back to reference Xu B, Wang N, Chen T, Li M (2015) Empirical evaluation of rectified activations in convolutional network. arXiv preprint arXiv:1505.00853 Xu B, Wang N, Chen T, Li M (2015) Empirical evaluation of rectified activations in convolutional network. arXiv preprint arXiv:​1505.​00853
Metadata
Title
Intelligent forecast engine for short-term wind speed prediction based on stacked long short-term memory
Authors
Farah Shahid
Aneela Zameer
Muhammad Javaid Iqbal
Publication date
27-04-2021
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 20/2021
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-021-06016-4

Other articles of this Issue 20/2021

Neural Computing and Applications 20/2021 Go to the issue

Premium Partner