Skip to main content
Top

2021 | OriginalPaper | Chapter

Short-Term Load Forecasting Based on CNN-BiLSTM with Bayesian Optimization and Attention Mechanism

Authors : Kai Miao, Qiang Hua, Huifeng Shi

Published in: Parallel and Distributed Computing, Applications and Technologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Short-term power load forecasting is quite vital in maintaining the balance between power production and power consumption of the power grid. Prediction accuracy not only affects the power grid construction, but also influences the economic development of the power grid. This paper proposes a short-term load forecasting based on Convolutional Neural Networks and Bidirectional Long Short-Term Memory (CNN-BiLSTM) with Bayesian Optimization (BO) and Attention Mechanism (AM). The BiLSTM is good at time series forecasting, and the Attention Mechanism can help the model to focus on the important part of the BiLSTM output. In order to make the forecasting performance of the model as good as possible, the Bayesian Optimization is used to tune the hyperparameters of the model. The input of the model is history load, time slot, and meteorological factors. In order to eliminate the seasonal influence, the data set is divided into four subsets with respect to four seasons. The performance of the proposed model is compared with other forecasting models by MAE, RMSE, MAPE, and \(R^2\) score. The experiment results show that the proposed model fits the actual values best and has the best forecasting performance among the contrast models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference He, F., Zhou, J., Feng, Z., Liu, G., Yang, Y.: A hybrid short-term load forecasting model based on variational mode decomposition and long short-term memory networks considering relevant factors with Bayesian optimization algorithm. Appl. Energy 237, 103–116 (2019)CrossRef He, F., Zhou, J., Feng, Z., Liu, G., Yang, Y.: A hybrid short-term load forecasting model based on variational mode decomposition and long short-term memory networks considering relevant factors with Bayesian optimization algorithm. Appl. Energy 237, 103–116 (2019)CrossRef
2.
go back to reference Torkzadeh, R., Mirzaei, A., Mirjalili, M.M., Anaraki, A.S., Sehhati, M.R., Behdad, F.: Medium term load forecasting in distribution systems based on multi linear regression and principal component analysis: a novel approach. In: 19th Conference on Electrical Power Distribution Networks (EPDC), pp. 66–70. IEEE, Tehran (2014) Torkzadeh, R., Mirzaei, A., Mirjalili, M.M., Anaraki, A.S., Sehhati, M.R., Behdad, F.: Medium term load forecasting in distribution systems based on multi linear regression and principal component analysis: a novel approach. In: 19th Conference on Electrical Power Distribution Networks (EPDC), pp. 66–70. IEEE, Tehran (2014)
3.
go back to reference Hagan, M.T., Behr, S.M.: The time series approach to short term load forecasting. IEEE Trans. Power Syst. 2(3), 785–791 (1987)CrossRef Hagan, M.T., Behr, S.M.: The time series approach to short term load forecasting. IEEE Trans. Power Syst. 2(3), 785–791 (1987)CrossRef
4.
go back to reference Huang, S.-J., Shih, K.-R.: Short-term load forecasting via ARMA model identification including non-Gaussian process considerations. IEEE Trans. Power Syst. 18(2), 673–679 (2003)CrossRef Huang, S.-J., Shih, K.-R.: Short-term load forecasting via ARMA model identification including non-Gaussian process considerations. IEEE Trans. Power Syst. 18(2), 673–679 (2003)CrossRef
5.
go back to reference Vermaak, J., Botha, E.C.: Recurrent neural networks for short-term load forecasting. IEEE Trans. Power Syst. 13(1), 126–132 (1998)CrossRef Vermaak, J., Botha, E.C.: Recurrent neural networks for short-term load forecasting. IEEE Trans. Power Syst. 13(1), 126–132 (1998)CrossRef
6.
go back to reference Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef
7.
go back to reference Kong, W., Dong, Z.Y., Jia, Y., Hill, D.J., Xu, Y., Zhang, Y.: Short-term residential load forecasting based on LSTM recurrent neural network. IEEE Trans. Smart Grid 10(1), 841–851 (2019)CrossRef Kong, W., Dong, Z.Y., Jia, Y., Hill, D.J., Xu, Y., Zhang, Y.: Short-term residential load forecasting based on LSTM recurrent neural network. IEEE Trans. Smart Grid 10(1), 841–851 (2019)CrossRef
8.
go back to reference Hu, P., Tong, J., Wang, J., et al.: A hybrid model based on CNN and Bi-LSTM for urban water demand prediction. In: Congress on Evolutionary Computation (CEC), Wellington, New Zealand, pp. 1088–1094. IEEE (2019) Hu, P., Tong, J., Wang, J., et al.: A hybrid model based on CNN and Bi-LSTM for urban water demand prediction. In: Congress on Evolutionary Computation (CEC), Wellington, New Zealand, pp. 1088–1094. IEEE (2019)
9.
go back to reference Alhussein, M., Aurangzeb, K., Haider, S.I.: Hybrid CNN-LSTM model for short-term individual household load forecasting. IEEE Access 8, 180544–180557 (2020)CrossRef Alhussein, M., Aurangzeb, K., Haider, S.I.: Hybrid CNN-LSTM model for short-term individual household load forecasting. IEEE Access 8, 180544–180557 (2020)CrossRef
10.
go back to reference Pan, C., Tan, J., Feng, D., Li, Y.: Very short-term solar generation forecasting based on LSTM with temporal attention mechanism. In: 5th International Conference on Computer and Communications (ICCC), Chengdu, China, pp. 267–271. IEEE (2019) Pan, C., Tan, J., Feng, D., Li, Y.: Very short-term solar generation forecasting based on LSTM with temporal attention mechanism. In: 5th International Conference on Computer and Communications (ICCC), Chengdu, China, pp. 267–271. IEEE (2019)
11.
go back to reference Wang, M., Cheng, J., Zhai, H.: Life prediction for machinery components based on CNN-BiLSTM network and attention model. In: 5th Information Technology and Mechatronics Engineering Conference (ITOEC), Chongqing, China, pp. 851–855. IEEE (2020) Wang, M., Cheng, J., Zhai, H.: Life prediction for machinery components based on CNN-BiLSTM network and attention model. In: 5th Information Technology and Mechatronics Engineering Conference (ITOEC), Chongqing, China, pp. 851–855. IEEE (2020)
12.
go back to reference Kim, T., Cho, S.: Particle swarm optimization-based CNN-LSTM networks for forecasting energy consumption. In: Congress on Evolutionary Computation (CEC), Wellington, New Zealand, pp. 1510–1516. IEEE (2019) Kim, T., Cho, S.: Particle swarm optimization-based CNN-LSTM networks for forecasting energy consumption. In: Congress on Evolutionary Computation (CEC), Wellington, New Zealand, pp. 1510–1516. IEEE (2019)
13.
go back to reference Lu, J., Zhang, Q., Yang, Z., et al.: A hybrid model based on convolutional neural network and long short-term memory for short-term load forecasting. In: Power and Energy Society General Meeting (PESGM), Atlanta, GA, USA, pp. 1–5. IEEE (2019) Lu, J., Zhang, Q., Yang, Z., et al.: A hybrid model based on convolutional neural network and long short-term memory for short-term load forecasting. In: Power and Energy Society General Meeting (PESGM), Atlanta, GA, USA, pp. 1–5. IEEE (2019)
14.
go back to reference Niu, D.X., Shi, H.F., Wu, D.D.: Short-term load forecasting using Bayesian neural networks learned by Hybrid Monte Carlo algorithm. Appl. Soft Comput. 12(6), 1822–1827 (2012)CrossRef Niu, D.X., Shi, H.F., Wu, D.D.: Short-term load forecasting using Bayesian neural networks learned by Hybrid Monte Carlo algorithm. Appl. Soft Comput. 12(6), 1822–1827 (2012)CrossRef
15.
go back to reference He, Y.J., Zhu, Y.C., Gu, J.C., et al.: Similar day selecting based neural network model and its application in short-term load forecasting. In: International Conference on Machine Learning and Cybernetics, Guangzhou, China, pp. 4760–4763, IEEE (2005) He, Y.J., Zhu, Y.C., Gu, J.C., et al.: Similar day selecting based neural network model and its application in short-term load forecasting. In: International Conference on Machine Learning and Cybernetics, Guangzhou, China, pp. 4760–4763, IEEE (2005)
16.
go back to reference Pelikan, M., Goldberg, D.E., Cantu-Paz, E.: BOA: The Bayesian optimization algorithm. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 1999), pp. 525–532 (1999) Pelikan, M., Goldberg, D.E., Cantu-Paz, E.: BOA: The Bayesian optimization algorithm. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 1999), pp. 525–532 (1999)
Metadata
Title
Short-Term Load Forecasting Based on CNN-BiLSTM with Bayesian Optimization and Attention Mechanism
Authors
Kai Miao
Qiang Hua
Huifeng Shi
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-69244-5_10

Premium Partner