Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 4/2024

11-09-2023 | Original Article

A k-nearest neighbor attentive deep autoregressive network for electricity consumption prediction

Authors: Xihe Qiu, Yajun Ru, Xiaoyu Tan, Jue Chen, Bin Chen, Yun Guo

Published in: International Journal of Machine Learning and Cybernetics | Issue 4/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Electricity is vital in daily life and crucial for sustainable economic development. Accurate forecasting of energy consumption ensures efficient electricity system operation and supports strategic decision-making for energy distribution. Current time-series methods neglect the influence of neighboring regions’ electricity consumption and the varying impact levels caused by multiple factors on the target area. Therefore, we propose the k-nearest neighbor attentive deep autoregressive network (KNNA-DeepAR) model, which combines a k-nearest neighbor approach with an attentive deep autoregressive network, to achieve precise short-term electricity consumption predictions. By extracting informative features from historical time-series data, we incorporate electricity consumption data from the k regions closest to the target area as additional variables. Leveraging the attention mechanism, we assign varying weights to each variable to capture their interdependencies. Experimental results on a public dataset of electricity loads in fourteen U.S. regions demonstrate the superiority of our model. Compared to state-of-the-art time-series models, our model achieves higher predictive accuracy and exhibits significant potential as an effective approach for accurately predicting electricity consumption and other time-series tasks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Paudel A, Khorasany M, Gooi HB (2020) Decentralized local energy trading in microgrids with voltage management. IEEE Trans Ind Inform 17(2):1111–1121CrossRef Paudel A, Khorasany M, Gooi HB (2020) Decentralized local energy trading in microgrids with voltage management. IEEE Trans Ind Inform 17(2):1111–1121CrossRef
2.
go back to reference Friedrich L, Afshari A (2015) Short-term forecasting of the Abu Dhabi electricity load using multiple weather variables. Energy Proc 75:3014–3026CrossRef Friedrich L, Afshari A (2015) Short-term forecasting of the Abu Dhabi electricity load using multiple weather variables. Energy Proc 75:3014–3026CrossRef
3.
go back to reference Luo J, Hong T, Yue M (2018) Real-time anomaly detection for very short-term load forecasting. J Mod Power Syst Clean Energy 6(2):235–243CrossRef Luo J, Hong T, Yue M (2018) Real-time anomaly detection for very short-term load forecasting. J Mod Power Syst Clean Energy 6(2):235–243CrossRef
4.
go back to reference Zor K, Timur O, Teke A (2017) A state-of-the-art review of artificial intelligence techniques for short-term electric load forecasting. In: 2017 6th International Youth Conference on Energy (IYCE), pp 1–7. IEEE Zor K, Timur O, Teke A (2017) A state-of-the-art review of artificial intelligence techniques for short-term electric load forecasting. In: 2017 6th International Youth Conference on Energy (IYCE), pp 1–7. IEEE
5.
go back to reference Desportes L, Andry P, Fijalkow I, David J (2019) Short-term temperature forecasting on a several hours horizon. In: Artificial neural networks and machine learning–ICANN 2019: Text and Time Series: 28th International Conference on Artificial Neural Networks, Munich, Germany, September 17–19, 2019, Proceedings, Part IV 28, pp 525–536. Springer Desportes L, Andry P, Fijalkow I, David J (2019) Short-term temperature forecasting on a several hours horizon. In: Artificial neural networks and machine learning–ICANN 2019: Text and Time Series: 28th International Conference on Artificial Neural Networks, Munich, Germany, September 17–19, 2019, Proceedings, Part IV 28, pp 525–536. Springer
6.
go back to reference Zhu Q, Zhang F, Liu S, Wu Y, Wang L (2019) A hybrid vmd-bigru model for rubber futures time series forecasting. Appl Soft Comput 84:105739CrossRef Zhu Q, Zhang F, Liu S, Wu Y, Wang L (2019) A hybrid vmd-bigru model for rubber futures time series forecasting. Appl Soft Comput 84:105739CrossRef
7.
go back to reference Juberias G, Yunta R, Moreno JG, Mendivil C (1999) A new arima model for hourly load forecasting. In: 1999 IEEE Transmission and Distribution Conference (Cat. No. 99CH36333), vol. 1, pp 314–319. IEEE Juberias G, Yunta R, Moreno JG, Mendivil C (1999) A new arima model for hourly load forecasting. In: 1999 IEEE Transmission and Distribution Conference (Cat. No. 99CH36333), vol. 1, pp 314–319. IEEE
8.
go back to reference Bercu S, Proïa F (2013) A sarimax coupled modelling applied to individual load curves intraday forecasting. J Appl Stat 40(6):1333–1348MathSciNetCrossRef Bercu S, Proïa F (2013) A sarimax coupled modelling applied to individual load curves intraday forecasting. J Appl Stat 40(6):1333–1348MathSciNetCrossRef
9.
go back to reference Taylor JW (2011) Short-term load forecasting with exponentially weighted methods. IEEE Trans Power Syst 27(1):458–464CrossRefADS Taylor JW (2011) Short-term load forecasting with exponentially weighted methods. IEEE Trans Power Syst 27(1):458–464CrossRefADS
11.
go back to reference Ke K, Hongbin S, Chengkang Z, Brown C (2019) Short-term electrical load forecasting method based on stacked auto-encoding and gru neural network. Evol Intel 12(3):385–394CrossRef Ke K, Hongbin S, Chengkang Z, Brown C (2019) Short-term electrical load forecasting method based on stacked auto-encoding and gru neural network. Evol Intel 12(3):385–394CrossRef
12.
go back to reference Salinas D, Flunkert V, Gasthaus J, Januschowski T (2020) Deepar: probabilistic forecasting with autoregressive recurrent networks. Int J Forecast 36(3):1181–1191CrossRef Salinas D, Flunkert V, Gasthaus J, Januschowski T (2020) Deepar: probabilistic forecasting with autoregressive recurrent networks. Int J Forecast 36(3):1181–1191CrossRef
14.
go back to reference Yu Y, Si X, Hu C, Zhang J (2019) A review of recurrent neural networks: Lstm cells and network architectures. Neural Comput 31(7):1235–1270MathSciNetCrossRefPubMed Yu Y, Si X, Hu C, Zhang J (2019) A review of recurrent neural networks: Lstm cells and network architectures. Neural Comput 31(7):1235–1270MathSciNetCrossRefPubMed
15.
go back to reference Shilpa G, Sheshadri G (2017) Short-term load forecasting using arima model for Karnataka state electrical load. Int J Eng Res Dev 13(7):75–79 Shilpa G, Sheshadri G (2017) Short-term load forecasting using arima model for Karnataka state electrical load. Int J Eng Res Dev 13(7):75–79
16.
go back to reference Barak S, Sadegh SS (2016) Forecasting energy consumption using ensemble arima-anfis hybrid algorithm. Int J Electric Power Energy Syst 82:92–104CrossRef Barak S, Sadegh SS (2016) Forecasting energy consumption using ensemble arima-anfis hybrid algorithm. Int J Electric Power Energy Syst 82:92–104CrossRef
17.
go back to reference Bianco V, Manca O, Nardini S (2009) Electricity consumption forecasting in Italy using linear regression models. Energy 34(9):1413–1421CrossRef Bianco V, Manca O, Nardini S (2009) Electricity consumption forecasting in Italy using linear regression models. Energy 34(9):1413–1421CrossRef
18.
go back to reference Ceperic E, Ceperic V, Baric A (2013) A strategy for short-term load forecasting by support vector regression machines. IEEE Trans Power Syst 28(4):4356–4364CrossRefADS Ceperic E, Ceperic V, Baric A (2013) A strategy for short-term load forecasting by support vector regression machines. IEEE Trans Power Syst 28(4):4356–4364CrossRefADS
19.
go back to reference Xu W, Peng H, Zeng X, Zhou F, Tian X, Peng X (2019) A hybrid modelling method for time series forecasting based on a linear regression model and deep learning. Appl Intell 49(8):3002–3015CrossRef Xu W, Peng H, Zeng X, Zhou F, Tian X, Peng X (2019) A hybrid modelling method for time series forecasting based on a linear regression model and deep learning. Appl Intell 49(8):3002–3015CrossRef
20.
go back to reference Ahmad AS, Hassan MY, Abdullah MP, Rahman HA, Hussin F, Abdullah H, Saidur R (2014) A review on applications of ann and svm for building electrical energy consumption forecasting. Renew Sustain Energy Rev 33:102–109CrossRef Ahmad AS, Hassan MY, Abdullah MP, Rahman HA, Hussin F, Abdullah H, Saidur R (2014) A review on applications of ann and svm for building electrical energy consumption forecasting. Renew Sustain Energy Rev 33:102–109CrossRef
21.
go back to reference Yang Y, Tao Z, Qian C, Gao Y, Zhou H, Ding Z, Wu J (2022) A hybrid robust system considering outliers for electric load series forecasting. Appl Intell 52(2):1630–1652CrossRef Yang Y, Tao Z, Qian C, Gao Y, Zhou H, Ding Z, Wu J (2022) A hybrid robust system considering outliers for electric load series forecasting. Appl Intell 52(2):1630–1652CrossRef
22.
go back to reference Kalogirou SA (2006) Artificial neural networks in energy applications in buildings. Int J Low-Carbon Technol 1(3):201–216CrossRef Kalogirou SA (2006) Artificial neural networks in energy applications in buildings. Int J Low-Carbon Technol 1(3):201–216CrossRef
23.
go back to reference Rahman A, Srikumar V, Smith AD (2018) Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks. Appl Energy 212:372–385CrossRefADS Rahman A, Srikumar V, Smith AD (2018) Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks. Appl Energy 212:372–385CrossRefADS
24.
25.
go back to reference Kim N, Kim M, Choi JK (2018) Lstm based short-term electricity consumption forecast with daily load profile sequences. In: 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE), pp 136–137. IEEE Kim N, Kim M, Choi JK (2018) Lstm based short-term electricity consumption forecast with daily load profile sequences. In: 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE), pp 136–137. IEEE
26.
go back to reference Marino DL, Amarasinghe K, Manic M (2016) Building energy load forecasting using deep neural networks. In: IECON 2016-42nd Annual Conference of the IEEE Industrial Electronics Society, pp 7046–7051. IEEE Marino DL, Amarasinghe K, Manic M (2016) Building energy load forecasting using deep neural networks. In: IECON 2016-42nd Annual Conference of the IEEE Industrial Electronics Society, pp 7046–7051. IEEE
28.
go back to reference Naz A, Javaid N, Asif M, Javed MU, Ahmed A, Gulfam SM, Shafiq M, Choi J-G (2021) Electricity consumption forecasting using gated-fcn with ensemble strategy. IEEE Access 9:131365–131381CrossRef Naz A, Javaid N, Asif M, Javed MU, Ahmed A, Gulfam SM, Shafiq M, Choi J-G (2021) Electricity consumption forecasting using gated-fcn with ensemble strategy. IEEE Access 9:131365–131381CrossRef
29.
go back to reference Li W, Logenthiran T, Woo WL (2019) Multi-gru prediction system for electricity generation’s planning and operation. IET Gener Transm Distrib 13(9):1630–1637CrossRef Li W, Logenthiran T, Woo WL (2019) Multi-gru prediction system for electricity generation’s planning and operation. IET Gener Transm Distrib 13(9):1630–1637CrossRef
30.
go back to reference Arora P, Jalali SMJ, Ahmadian S, Panigrahi B, Suganthan P, Khosravi A (2022) Probabilistic wind power forecasting using optimized deep auto-regressive recurrent neural networks. IEEE Trans Ind Inf 19(3):2814–2825CrossRef Arora P, Jalali SMJ, Ahmadian S, Panigrahi B, Suganthan P, Khosravi A (2022) Probabilistic wind power forecasting using optimized deep auto-regressive recurrent neural networks. IEEE Trans Ind Inf 19(3):2814–2825CrossRef
31.
go back to reference Chen Y, Kang Y, Chen Y, Wang Z (2020) Probabilistic forecasting with temporal convolutional neural network. Neurocomputing 399:491–501CrossRef Chen Y, Kang Y, Chen Y, Wang Z (2020) Probabilistic forecasting with temporal convolutional neural network. Neurocomputing 399:491–501CrossRef
32.
go back to reference Niu Z, Zhong G, Yu H (2021) A review on the attention mechanism of deep learning. Neurocomputing 452:48–62CrossRef Niu Z, Zhong G, Yu H (2021) A review on the attention mechanism of deep learning. Neurocomputing 452:48–62CrossRef
33.
go back to reference Huang P-Y, Liu F, Shiang S-R, Oh J, Dyer C (2016) Attention-based multimodal neural machine translation. In: Proceedings of the First Conference on machine translation: volume 2, Shared Task Papers, pp 639–645 Huang P-Y, Liu F, Shiang S-R, Oh J, Dyer C (2016) Attention-based multimodal neural machine translation. In: Proceedings of the First Conference on machine translation: volume 2, Shared Task Papers, pp 639–645
34.
go back to reference Zhang B, Xiong D, Su J (2018) Neural machine translation with deep attention. IEEE Trans Pattern Anal Mach Intell 42(1):154–163CrossRefPubMed Zhang B, Xiong D, Su J (2018) Neural machine translation with deep attention. IEEE Trans Pattern Anal Mach Intell 42(1):154–163CrossRefPubMed
35.
go back to reference Ru Y, Qiu X, Tan X, Chen B, Gao Y, Jin Y (2022) Sparse-attentive meta temporal point process for clinical decision support. Neurocomputing 485:114–123CrossRef Ru Y, Qiu X, Tan X, Chen B, Gao Y, Jin Y (2022) Sparse-attentive meta temporal point process for clinical decision support. Neurocomputing 485:114–123CrossRef
36.
go back to reference Ma F, Chitta R, Zhou J, You Q, Sun T, Gao J (2017) Dipole: Diagnosis prediction in healthcare via attention-based bidirectional recurrent neural networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on knowledge discovery and data mining, pp 1903–1911 Ma F, Chitta R, Zhou J, You Q, Sun T, Gao J (2017) Dipole: Diagnosis prediction in healthcare via attention-based bidirectional recurrent neural networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on knowledge discovery and data mining, pp 1903–1911
37.
go back to reference Wang S, Hu L, Cao L, Huang X, Lian D, Liu W (2018) Attention-based transactional context embedding for next-item recommendation. In: Proceedings of the AAAI Conference on artificial intelligence, vol. 32 Wang S, Hu L, Cao L, Huang X, Lian D, Liu W (2018) Attention-based transactional context embedding for next-item recommendation. In: Proceedings of the AAAI Conference on artificial intelligence, vol. 32
38.
go back to reference Qian J, Qiu X, Tan X, Li Q, Chen J, Jiang X (2023) An attentive lstm based approach for adverse drug reactions prediction. Appl Intell 53(5):4875–4889 Qian J, Qiu X, Tan X, Li Q, Chen J, Jiang X (2023) An attentive lstm based approach for adverse drug reactions prediction. Appl Intell 53(5):4875–4889
39.
go back to reference Luong M-T, Pham H, Manning CD (2015) Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:1508.04025 Luong M-T, Pham H, Manning CD (2015) Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:​1508.​04025
40.
go back to reference Zhang G, Bai X, Wang Y (2021) Short-time multi-energy load forecasting method based on cnn-seq2seq model with attention mechanism. Mach Learn Appl 5:100064 Zhang G, Bai X, Wang Y (2021) Short-time multi-energy load forecasting method based on cnn-seq2seq model with attention mechanism. Mach Learn Appl 5:100064
41.
go back to reference Sundermeyer M, Schlüter R, Ney H (2012) Lstm neural networks for language modeling. In: Thirteenth Annual Conference of the International Speech Communication Association Sundermeyer M, Schlüter R, Ney H (2012) Lstm neural networks for language modeling. In: Thirteenth Annual Conference of the International Speech Communication Association
42.
go back to reference Sivaramakrishnan S, Fernandez TF, Babukarthik R, Premalatha S (2022) Forecasting time series data using arima and facebook prophet models. In: Big Data Management in Sensing, pp 47–59. River Publishers Sivaramakrishnan S, Fernandez TF, Babukarthik R, Premalatha S (2022) Forecasting time series data using arima and facebook prophet models. In: Big Data Management in Sensing, pp 47–59. River Publishers
43.
go back to reference Yifan D, Jialin L, Boxi F (2021) Forecast model of breast cancer diagnosis based on rf-adaboost. In: 2021 International Conference on communications, information system and computer engineering (CISCE), pp 716–719. IEEE Yifan D, Jialin L, Boxi F (2021) Forecast model of breast cancer diagnosis based on rf-adaboost. In: 2021 International Conference on communications, information system and computer engineering (CISCE), pp 716–719. IEEE
44.
go back to reference Amjady N (2001) Short-term hourly load forecasting using time-series modeling with peak load estimation capability. IEEE Trans Power Syst 16(3):498–505CrossRefADS Amjady N (2001) Short-term hourly load forecasting using time-series modeling with peak load estimation capability. IEEE Trans Power Syst 16(3):498–505CrossRefADS
45.
go back to reference Bae D-J, Kwon B-S, Song K-B (2021) Xgboost-based day-ahead load forecasting algorithm considering behind-the-meter solar pv generation. Energies 15(1):128CrossRef Bae D-J, Kwon B-S, Song K-B (2021) Xgboost-based day-ahead load forecasting algorithm considering behind-the-meter solar pv generation. Energies 15(1):128CrossRef
Metadata
Title
A k-nearest neighbor attentive deep autoregressive network for electricity consumption prediction
Authors
Xihe Qiu
Yajun Ru
Xiaoyu Tan
Jue Chen
Bin Chen
Yun Guo
Publication date
11-09-2023
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 4/2024
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-023-01963-x

Other articles of this Issue 4/2024

International Journal of Machine Learning and Cybernetics 4/2024 Go to the issue