Skip to main content
Top
Published in: Electrical Engineering 2/2021

18-11-2020 | Original Paper

Long short-term memory-singular spectrum analysis-based model for electric load forecasting

Authors: Neeraj Neeraj, Jimson Mathew, Mayank Agarwal, Ranjan Kumar Behera

Published in: Electrical Engineering | Issue 2/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Electrical load forecasting is a key player in building sustainable power systems and helps in efficient system planning. However, the irregular and noisy behavior in the observed data makes it difficult to achieve better forecasting accuracy. To handle this, we propose a new model, named singular spectrum analysis-long short- term memory (SSA-LSTM). SSA is a signal processing technique used to eliminate the noisy components of a skewed load series. LSTM model uses the outcome of SSA to forecast the final load. We have used five publicly available datasets from the Australian Energy Market Operator (AEMO) repository to assess the performance of the proposed model. The proposed model has superior forecasting accuracy compared to other existing state-of-the-art methods [persistence, autoregressive (AR), AR-exogenous, ARMA-exogenous (ARMAX), support vector regression (SVR), random forest (RF), artificial neural network (ANN), deep belief network (DBN), empirical mode decomposition (EMD-SVR), EMD-ANN, ensemble DBN, and dynamic mode decomposition (DMD)] for half-hourly and one day ahead load forecasting using RMSE and MAPE error metrics.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Hippert HS, Pedreira CE, Souza RC (2001) Neural networks for short-term load forecasting: a review and evaluation. IEEE Trans Power Syst 16(1):44–55 Hippert HS, Pedreira CE, Souza RC (2001) Neural networks for short-term load forecasting: a review and evaluation. IEEE Trans Power Syst 16(1):44–55
2.
go back to reference Zhang G, Patuwo BE, Hu MY (1998) Forecasting with artificial neural networks: the state of the art. Int J Forecast 14(1):35–62 Zhang G, Patuwo BE, Hu MY (1998) Forecasting with artificial neural networks: the state of the art. Int J Forecast 14(1):35–62
3.
go back to reference Jain AK, Mao J, Mohiuddin KM (1996) Artificial neural networks: a tutorial. Computer 29(3):31–44 Jain AK, Mao J, Mohiuddin KM (1996) Artificial neural networks: a tutorial. Computer 29(3):31–44
4.
go back to reference Hinton GE, Osindero S, Teh Y-W (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527–1554MathSciNetMATH Hinton GE, Osindero S, Teh Y-W (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527–1554MathSciNetMATH
5.
go back to reference Laptev N, Yosinski J, Li LE, Smyl S (2017) Time-series extreme event forecasting with neural networks at uber. Int Conf Mach Learn 34:1–5 Laptev N, Yosinski J, Li LE, Smyl S (2017) Time-series extreme event forecasting with neural networks at uber. Int Conf Mach Learn 34:1–5
6.
go back to reference Salkuti SR (2018) Short-term electrical load forecasting using radial basis function neural networks considering weather factors. Electr Eng 100(3):1985–1995 Salkuti SR (2018) Short-term electrical load forecasting using radial basis function neural networks considering weather factors. Electr Eng 100(3):1985–1995
7.
go back to reference Liu K, Subbarayan S, Shoults R, Manry M, Kwan C, Lewis F, Naccarino J (1996) Comparison of very short-term load forecasting techniques. IEEE Trans Power Syst 11(2):877–882 Liu K, Subbarayan S, Shoults R, Manry M, Kwan C, Lewis F, Naccarino J (1996) Comparison of very short-term load forecasting techniques. IEEE Trans Power Syst 11(2):877–882
8.
go back to reference Chen D, York M (2008) Neural network based very short term load prediction. In: IEEE/PES transmission and distribution conference and exposition. IEEE 2008, pp 1–9 Chen D, York M (2008) Neural network based very short term load prediction. In: IEEE/PES transmission and distribution conference and exposition. IEEE 2008, pp 1–9
9.
go back to reference Qiu X, Zhang L, Ren Y, Suganthan PN, Amaratunga G (2014) Ensemble deep learning for regression and time series forecasting. In: 2014 IEEE symposium on computational intelligence in ensemble learning (CIEL), IEEE, pp 1–6 Qiu X, Zhang L, Ren Y, Suganthan PN, Amaratunga G (2014) Ensemble deep learning for regression and time series forecasting. In: 2014 IEEE symposium on computational intelligence in ensemble learning (CIEL), IEEE, pp 1–6
10.
go back to reference Qiu X, Ren Y, Suganthan PN, Amaratunga GA (2017) Empirical mode decomposition based ensemble deep learning for load demand time series forecasting. Appl Soft Comput 54:246–255 Qiu X, Ren Y, Suganthan PN, Amaratunga GA (2017) Empirical mode decomposition based ensemble deep learning for load demand time series forecasting. Appl Soft Comput 54:246–255
11.
go back to reference Lin Y, Luo H, Wang D, Guo H, Zhu K (2017) An ensemble model based on machine learning methods and data preprocessing for short-term electric load forecasting. Energies 10(8):1186 Lin Y, Luo H, Wang D, Guo H, Zhu K (2017) An ensemble model based on machine learning methods and data preprocessing for short-term electric load forecasting. Energies 10(8):1186
12.
go back to reference Soliman SA-H, Al-Kandari AM (2010) Electrical load forecasting: modeling and model construction. Elsevier, London Soliman SA-H, Al-Kandari AM (2010) Electrical load forecasting: modeling and model construction. Elsevier, London
13.
go back to reference Brockwell PJ, Davis RA (2013) Time series: theory and methods. Springer, BerlinMATH Brockwell PJ, Davis RA (2013) Time series: theory and methods. Springer, BerlinMATH
14.
go back to reference Huang S-J, Shih K-R (2003) Short-term load forecasting via arma model identification including non-gaussian process considerations. IEEE Trans Power Syst 18(2):673–679 Huang S-J, Shih K-R (2003) Short-term load forecasting via arma model identification including non-gaussian process considerations. IEEE Trans Power Syst 18(2):673–679
15.
go back to reference Chen J-F, Wang W-M, Huang C-M (1995) Analysis of an adaptive time-series autoregressive moving-average (arma) model for short-term load forecasting. Electr Power Syst Res 34(3):187–196 Chen J-F, Wang W-M, Huang C-M (1995) Analysis of an adaptive time-series autoregressive moving-average (arma) model for short-term load forecasting. Electr Power Syst Res 34(3):187–196
16.
go back to reference Zhang GP (2003) Time series forecasting using a hybrid arima and neural network model. Neurocomputing 50:159–175MATH Zhang GP (2003) Time series forecasting using a hybrid arima and neural network model. Neurocomputing 50:159–175MATH
17.
go back to reference Hagan MT, Behr SM (1987) The time series approach to short term load forecasting. IEEE Trans Power Syst 2(3):785–791 Hagan MT, Behr SM (1987) The time series approach to short term load forecasting. IEEE Trans Power Syst 2(3):785–791
18.
go back to reference De Felice M, Alessandri A, Catalano F (2015) Seasonal climate forecasts for medium-term electricity demand forecasting. Appl Energy 137:435–444 De Felice M, Alessandri A, Catalano F (2015) Seasonal climate forecasts for medium-term electricity demand forecasting. Appl Energy 137:435–444
19.
go back to reference Chen K-Y, Wang C-H (2007) A hybrid sarima and support vector machines in forecasting the production values of the machinery industry in taiwan. Expert Syst Appl 32(1):254–264MathSciNet Chen K-Y, Wang C-H (2007) A hybrid sarima and support vector machines in forecasting the production values of the machinery industry in taiwan. Expert Syst Appl 32(1):254–264MathSciNet
20.
go back to reference Lütkepohl H (2006) Forecasting with varma models. Handbook Econ Forecast 1:287–325 Lütkepohl H (2006) Forecasting with varma models. Handbook Econ Forecast 1:287–325
21.
go back to reference Ceperic E, Ceperic V, Baric A (2013) A strategy for short-term load forecasting by support vector regression machines. IEEE Trans Power Syst 28(4):4356–4364 Ceperic E, Ceperic V, Baric A (2013) A strategy for short-term load forecasting by support vector regression machines. IEEE Trans Power Syst 28(4):4356–4364
22.
go back to reference Pai P-F, Hong W-C (2005) Forecasting regional electricity load based on recurrent support vector machines with genetic algorithms. Electr Power Syst Res 74(3):417–425 Pai P-F, Hong W-C (2005) Forecasting regional electricity load based on recurrent support vector machines with genetic algorithms. Electr Power Syst Res 74(3):417–425
23.
go back to reference Kouhi S, Keynia F (2013) A new cascade nn based method to short-term load forecast in deregulated electricity market. Energy Convers Manag 71:76–83 Kouhi S, Keynia F (2013) A new cascade nn based method to short-term load forecast in deregulated electricity market. Energy Convers Manag 71:76–83
24.
go back to reference Li H-Z, Guo S, Li C-J, Sun J-Q (2013) A hybrid annual power load forecasting model based on generalized regression neural network with fruit fly optimization algorithm. Knowl-Based Syst 37:378–387 Li H-Z, Guo S, Li C-J, Sun J-Q (2013) A hybrid annual power load forecasting model based on generalized regression neural network with fruit fly optimization algorithm. Knowl-Based Syst 37:378–387
25.
go back to reference Kyriakides E, Polycarpou M (2007) Short term electric load forecasting: a tutorial. In: Trends in neural computation, Springer, pp 391–418 Kyriakides E, Polycarpou M (2007) Short term electric load forecasting: a tutorial. In: Trends in neural computation, Springer, pp 391–418
26.
go back to reference Ranaweera D, Hubele N, Papalexopoulos A (1995) Application of radial basis function neural network model for short-term load forecasting. IEE Proc Gener Transm Distrib 142(1):45–50 Ranaweera D, Hubele N, Papalexopoulos A (1995) Application of radial basis function neural network model for short-term load forecasting. IEE Proc Gener Transm Distrib 142(1):45–50
27.
go back to reference El-Telbany M, El-Karmi F (2008) Short-term forecasting of jordanian electricity demand using particle swarm optimization. Electr Power Syst Res 78(3):425–433 El-Telbany M, El-Karmi F (2008) Short-term forecasting of jordanian electricity demand using particle swarm optimization. Electr Power Syst Res 78(3):425–433
28.
go back to reference Cecati C, Kolbusz J, Różycki P, Siano P, Wilamowski BM (2015) A novel rbf training algorithm for short-term electric load forecasting and comparative studies. IEEE Trans Industr Electron 62(10):6519–6529 Cecati C, Kolbusz J, Różycki P, Siano P, Wilamowski BM (2015) A novel rbf training algorithm for short-term electric load forecasting and comparative studies. IEEE Trans Industr Electron 62(10):6519–6529
29.
go back to reference Çevik HH, Çunkaş M (2015) Short-term load forecasting using fuzzy logic and anfis. Neural Comput Appl 26(6):1355–1367 Çevik HH, Çunkaş M (2015) Short-term load forecasting using fuzzy logic and anfis. Neural Comput Appl 26(6):1355–1367
30.
go back to reference Fan G-F, Peng L-L, Hong W-C, Sun F (2016) Electric load forecasting by the svr model with differential empirical mode decomposition and auto regression. Neurocomputing 173:958–970 Fan G-F, Peng L-L, Hong W-C, Sun F (2016) Electric load forecasting by the svr model with differential empirical mode decomposition and auto regression. Neurocomputing 173:958–970
31.
go back to reference Zhang X, Wang J (2018) A novel decomposition-ensemble model for forecasting short-term load-time series with multiple seasonal patterns. Appl Soft Comput 65:478–494 Zhang X, Wang J (2018) A novel decomposition-ensemble model for forecasting short-term load-time series with multiple seasonal patterns. Appl Soft Comput 65:478–494
32.
go back to reference Fan G-F, Peng L-L, Zhao X, Hong W-C (2017) Applications of hybrid emd with pso and ga for an svr-based load forecasting model. Energies 10(11):1713 Fan G-F, Peng L-L, Zhao X, Hong W-C (2017) Applications of hybrid emd with pso and ga for an svr-based load forecasting model. Energies 10(11):1713
33.
go back to reference Singh P, Dwivedi P (2018) Integration of new evolutionary approach with artificial neural network for solving short term load forecast problem. Appl Energy 217:537–549 Singh P, Dwivedi P (2018) Integration of new evolutionary approach with artificial neural network for solving short term load forecast problem. Appl Energy 217:537–549
34.
go back to reference Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780 Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
36.
go back to reference Elsner JB, Tsonis AA (2013) Singular spectrum analysis: a new tool in time series analysis. Springer, Berlin Elsner JB, Tsonis AA (2013) Singular spectrum analysis: a new tool in time series analysis. Springer, Berlin
37.
go back to reference Vautard R, Yiou P, Ghil M (1992) Singular-spectrum analysis: a toolkit for short, noisy chaotic signals. Physica D 58(1–4):95–126 Vautard R, Yiou P, Ghil M (1992) Singular-spectrum analysis: a toolkit for short, noisy chaotic signals. Physica D 58(1–4):95–126
39.
go back to reference Golyandina N, Nekrutkin V, Zhigljavsky AA (2001) Analysis of time series structure: SSA and related techniques. Chapman and Hall/CRC, New YorkMATH Golyandina N, Nekrutkin V, Zhigljavsky AA (2001) Analysis of time series structure: SSA and related techniques. Chapman and Hall/CRC, New YorkMATH
41.
go back to reference Zhang C, Wei H, Zhao J, Liu T, Zhu T, Zhang K (2016) Short-term wind speed forecasting using empirical mode decomposition and feature selection. Renew Energy 96:727–737 Zhang C, Wei H, Zhao J, Liu T, Zhu T, Zhang K (2016) Short-term wind speed forecasting using empirical mode decomposition and feature selection. Renew Energy 96:727–737
42.
go back to reference Su C-H, Cheng C-H (2016) A hybrid fuzzy time series model based on anfis and integrated nonlinear feature selection method for forecasting stock. Neurocomputing 205:264–273 Su C-H, Cheng C-H (2016) A hybrid fuzzy time series model based on anfis and integrated nonlinear feature selection method for forecasting stock. Neurocomputing 205:264–273
43.
go back to reference Huang C-L, Tsai C-Y (2009) A hybrid sofm-svr with a filter-based feature selection for stock market forecasting. Expert Syst Appl 36(2):1529–1539MathSciNet Huang C-L, Tsai C-Y (2009) A hybrid sofm-svr with a filter-based feature selection for stock market forecasting. Expert Syst Appl 36(2):1529–1539MathSciNet
44.
go back to reference Hu Z, Bao Y, Xiong T, Chiong R (2015) Hybrid filter-wrapper feature selection for short-term load forecasting. Eng Appl Artif Intell 40:17–27 Hu Z, Bao Y, Xiong T, Chiong R (2015) Hybrid filter-wrapper feature selection for short-term load forecasting. Eng Appl Artif Intell 40:17–27
45.
go back to reference Koprinska I, Rana M, Agelidis VG (2015) Correlation and instance based feature selection for electricity load forecasting. Knowl-Based Syst 82:29–40 Koprinska I, Rana M, Agelidis VG (2015) Correlation and instance based feature selection for electricity load forecasting. Knowl-Based Syst 82:29–40
46.
go back to reference Jiménez F, Palma J, Sánchez G, Marín D, Palacios F, López L (2020) Feature selection based multivariate time series forecasting: an application to antibiotic resistance outbreaks prediction. In: Artificial Intelligence in Medicine 101818 Jiménez F, Palma J, Sánchez G, Marín D, Palacios F, López L (2020) Feature selection based multivariate time series forecasting: an application to antibiotic resistance outbreaks prediction. In: Artificial Intelligence in Medicine 101818
48.
go back to reference Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M, Ghemawat S, Goodfellow I, Moore S, Murray D, Olah C, Schuster M, Shlens J, Steiner B, Sutskever I, TensorFlow KT (2015) Large-scale machine learning on heterogeneous systems, software available from tensorflow.org. https://www.tensorflow.org/ Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M, Ghemawat S, Goodfellow I, Moore S, Murray D, Olah C, Schuster M, Shlens J, Steiner B, Sutskever I, TensorFlow KT (2015) Large-scale machine learning on heterogeneous systems, software available from tensorflow.org. https://​www.​tensorflow.​org/​
49.
go back to reference Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
50.
go back to reference Haykin S, Network N (2004) A comprehensive foundation. Neural Netw 2(2004):41 Haykin S, Network N (2004) A comprehensive foundation. Neural Netw 2(2004):41
51.
52.
go back to reference Lin Y, Peng L (2011) Combined model based on emd-svm for short-term wind power prediction. Proc CSEE 31(31):102–108 Lin Y, Peng L (2011) Combined model based on emd-svm for short-term wind power prediction. Proc CSEE 31(31):102–108
53.
go back to reference Liu H, Chen C, Tian H-Q, Li Y-F (2012) A hybrid model for wind speed prediction using empirical mode decomposition and artificial neural networks. Renew Energy 48:545–556 Liu H, Chen C, Tian H-Q, Li Y-F (2012) A hybrid model for wind speed prediction using empirical mode decomposition and artificial neural networks. Renew Energy 48:545–556
54.
go back to reference Mohan N, Soman K, Kumar SS (2018) A data-driven strategy for short-term electric load forecasting using dynamic mode decomposition model. Appl Energy 232:229–244 Mohan N, Soman K, Kumar SS (2018) A data-driven strategy for short-term electric load forecasting using dynamic mode decomposition model. Appl Energy 232:229–244
55.
go back to reference Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(Jan):1–30MathSciNetMATH Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(Jan):1–30MathSciNetMATH
Metadata
Title
Long short-term memory-singular spectrum analysis-based model for electric load forecasting
Authors
Neeraj Neeraj
Jimson Mathew
Mayank Agarwal
Ranjan Kumar Behera
Publication date
18-11-2020
Publisher
Springer Berlin Heidelberg
Published in
Electrical Engineering / Issue 2/2021
Print ISSN: 0948-7921
Electronic ISSN: 1432-0487
DOI
https://doi.org/10.1007/s00202-020-01135-y

Other articles of this Issue 2/2021

Electrical Engineering 2/2021 Go to the issue