Skip to main content
Erschienen in: Neural Computing and Applications 12/2019

06.08.2019 | Original Article

Dilated residual attention network for load disaggregation

verfasst von: Min Xia, Wan’an Liu, Yiqing Xu, Ke Wang, Xu Zhang

Erschienen in: Neural Computing and Applications | Ausgabe 12/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Load disaggregation technology is a key technology to realize real-time nonintrusive load monitoring (NILM), and deep learning method has shown great promise for NILM. However, current load disaggregation models based on deep learning are prone to the problems of gradient disappearance and model degradation, and it is difficult to extract effective features from load time series. In order to solve these problems, a new dilated residual attention deep network is proposed for load disaggregation. The proposed model adopts residual learning to extract high-level load features, reduces the difficulty of network optimization and solves the problem of network gradient disappearance. Dilated convolution is introduced to increase the receptive field of convolution kernels, which solves the problem that long-load time-series data are difficult to be learned. Most important of all, the proposed bottom-up and top-down attention mechanism can effectively extract the features of the abrupt points in mains power, improve the accuracy of judging the on/off state of electrical appliances and at the same time improve the learning ability of electrical appliances with low usage. Experiments on WikiEnergy dataset and UK-DALE dataset show that the proposed method achieves more accurate load disaggregation tasks than existing studies, which is of great significance for realizing practical NILM.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wan Z, Li J, Gao Y (2018) Monitoring and diagnosis process of abnormal consumption on smart power grid. Neural Comput Appl 30(1):21–28CrossRef Wan Z, Li J, Gao Y (2018) Monitoring and diagnosis process of abnormal consumption on smart power grid. Neural Comput Appl 30(1):21–28CrossRef
2.
Zurück zum Zitat Ridi A, Gisler C, Hennebert J (2014) A survey on intrusive load monitoring for appliance recognition. In: 2014 22nd international conference on pattern recognition, pp 3702–3707 Ridi A, Gisler C, Hennebert J (2014) A survey on intrusive load monitoring for appliance recognition. In: 2014 22nd international conference on pattern recognition, pp 3702–3707
3.
Zurück zum Zitat Hart GW (1992) Nonintrusive appliance load monitoring. Proc IEEE 80(12):1870–1891CrossRef Hart GW (1992) Nonintrusive appliance load monitoring. Proc IEEE 80(12):1870–1891CrossRef
4.
Zurück zum Zitat Miyasawa A, Fujimoto Y, Hayashi Y (2019) Energy disaggregation based on smart metering data via semi-binary nonnegative matrix factorization. Energy Build 183:547–558CrossRef Miyasawa A, Fujimoto Y, Hayashi Y (2019) Energy disaggregation based on smart metering data via semi-binary nonnegative matrix factorization. Energy Build 183:547–558CrossRef
6.
Zurück zum Zitat Paterakis NG, Erdinc O, Bakirtzis AG, Catalão JPS (2015) Optimal household appliances scheduling under day-ahead pricing and load-shaping demand response strategies. IEEE Trans Ind Inf 11(6):1509–1519CrossRef Paterakis NG, Erdinc O, Bakirtzis AG, Catalão JPS (2015) Optimal household appliances scheduling under day-ahead pricing and load-shaping demand response strategies. IEEE Trans Ind Inf 11(6):1509–1519CrossRef
7.
Zurück zum Zitat Islam B, Baharudin Z, Nallagownden P (2017) Development of chaotically improved meta-heuristics and modified bp neural network-based model for electrical energy demand prediction in smart grid. Neural Comput Appl 28(s1):877–891CrossRef Islam B, Baharudin Z, Nallagownden P (2017) Development of chaotically improved meta-heuristics and modified bp neural network-based model for electrical energy demand prediction in smart grid. Neural Comput Appl 28(s1):877–891CrossRef
8.
Zurück zum Zitat Lee WK, Fung GSK, Lam HY, Chan FHY, Lucente Mark (2004) Exploration on load signatures. In: International conference on electrical engineering (ICEE), vol 152 Lee WK, Fung GSK, Lam HY, Chan FHY, Lucente Mark (2004) Exploration on load signatures. In: International conference on electrical engineering (ICEE), vol 152
9.
Zurück zum Zitat Amara F, Agbossou K, Dubé Y, Kelouwani S, Cardenas A, Hosseini SS (2019) A residual load modeling approach for household short-term load forecasting application. Energy Build 187(15):132–143CrossRef Amara F, Agbossou K, Dubé Y, Kelouwani S, Cardenas A, Hosseini SS (2019) A residual load modeling approach for household short-term load forecasting application. Energy Build 187(15):132–143CrossRef
10.
Zurück zum Zitat Lin Y-H, Tsai M-S (2014) Development of an improved time-frequency analysis-based nonintrusive load monitor for load demand identification. IEEE Trans Instrum Meas 63(6):1470–1483MathSciNetCrossRef Lin Y-H, Tsai M-S (2014) Development of an improved time-frequency analysis-based nonintrusive load monitor for load demand identification. IEEE Trans Instrum Meas 63(6):1470–1483MathSciNetCrossRef
11.
Zurück zum Zitat Chang H-H, Lin L-S, Chen N, Lee W-J (2013) Particle-swarm-optimization-based nonintrusive demand monitoring and load identification in smart meters. IEEE Trans Ind Appl 49(5):2229–2236CrossRef Chang H-H, Lin L-S, Chen N, Lee W-J (2013) Particle-swarm-optimization-based nonintrusive demand monitoring and load identification in smart meters. IEEE Trans Ind Appl 49(5):2229–2236CrossRef
12.
Zurück zum Zitat Gou J, Guo WP, Wang C, Luo W (2017) A multi-strategy improved particle swarm optimization algorithm and its application to identifying uncorrelated multi-source load in the frequency domain. Neural Comput Appl 28(7):1635–1656CrossRef Gou J, Guo WP, Wang C, Luo W (2017) A multi-strategy improved particle swarm optimization algorithm and its application to identifying uncorrelated multi-source load in the frequency domain. Neural Comput Appl 28(7):1635–1656CrossRef
13.
Zurück zum Zitat Piga D, Cominola A, Giuliani M, Castelletti A, Rizzoli AE et al (2016) Sparse optimization for automated energy end use disaggregation. IEEE Trans Control Syst Technol 24(3):1044–1051CrossRef Piga D, Cominola A, Giuliani M, Castelletti A, Rizzoli AE et al (2016) Sparse optimization for automated energy end use disaggregation. IEEE Trans Control Syst Technol 24(3):1044–1051CrossRef
14.
Zurück zum Zitat Ahmadi H, Martı JR (2015) Load decomposition at smart meters level using eigenloads approach. IEEE Trans Power Syst 30(6):3425–3436CrossRef Ahmadi H, Martı JR (2015) Load decomposition at smart meters level using eigenloads approach. IEEE Trans Power Syst 30(6):3425–3436CrossRef
15.
Zurück zum Zitat Kim H, Marwah M, Arlitt M, Lyon G, Han J (2011) Unsupervised disaggregation of low frequency power measurements. In: Proceedings of the 2011 SIAM international conference on data mining, pp 747–758. SIAM Kim H, Marwah M, Arlitt M, Lyon G, Han J (2011) Unsupervised disaggregation of low frequency power measurements. In: Proceedings of the 2011 SIAM international conference on data mining, pp 747–758. SIAM
16.
Zurück zum Zitat Zoha A, Gluhak A, Nati M, Imran MA (2013) Low-power appliance monitoring using factorial hidden Markov models. In: IEEE eighth international conference on intelligent sensors, sensor networks and information processing, pp. 527–532. IEEE Zoha A, Gluhak A, Nati M, Imran MA (2013) Low-power appliance monitoring using factorial hidden Markov models. In: IEEE eighth international conference on intelligent sensors, sensor networks and information processing, pp. 527–532. IEEE
17.
Zurück zum Zitat Kolter JZ, Batra S, Ng AY (2010) Energy disaggregation via discriminative sparse coding. In: Advances in neural information processing systems, pp 1153–1161 Kolter JZ, Batra S, Ng AY (2010) Energy disaggregation via discriminative sparse coding. In: Advances in neural information processing systems, pp 1153–1161
18.
Zurück zum Zitat Deb C, Frei M, Hofer J, Schlueter A (2019) Automated load disaggregation for residences with electrical resistance heating. Energy Build 182:61–74CrossRef Deb C, Frei M, Hofer J, Schlueter A (2019) Automated load disaggregation for residences with electrical resistance heating. Energy Build 182:61–74CrossRef
19.
Zurück zum Zitat Hassan T, Javed F, Arshad N (2014) An empirical investigation of VI trajectory based load signatures for non-intrusive load monitoring. IEEE Trans Smart Grid 5(2):870–878CrossRef Hassan T, Javed F, Arshad N (2014) An empirical investigation of VI trajectory based load signatures for non-intrusive load monitoring. IEEE Trans Smart Grid 5(2):870–878CrossRef
20.
Zurück zum Zitat Tsai M-S, Lin Y-H (2012) Modern development of an adaptive non-intrusive appliance load monitoring system in electricity energy conservation. Appl Energy 96:55–73CrossRef Tsai M-S, Lin Y-H (2012) Modern development of an adaptive non-intrusive appliance load monitoring system in electricity energy conservation. Appl Energy 96:55–73CrossRef
21.
Zurück zum Zitat Saitoh T, Osaki T, Konishi R, Sugahara K (2010) Current sensor based home appliance and state of appliance recognition. SICE J Control Meas Syst Integr 3(2):86–93CrossRef Saitoh T, Osaki T, Konishi R, Sugahara K (2010) Current sensor based home appliance and state of appliance recognition. SICE J Control Meas Syst Integr 3(2):86–93CrossRef
22.
Zurück zum Zitat Lin Y-H, Tsai M-S (2014) Non-intrusive load monitoring by novel neuro-fuzzy classification considering uncertainties. IEEE Trans Smart Grid 5(5):2376–2384CrossRef Lin Y-H, Tsai M-S (2014) Non-intrusive load monitoring by novel neuro-fuzzy classification considering uncertainties. IEEE Trans Smart Grid 5(5):2376–2384CrossRef
23.
Zurück zum Zitat Smith DV, Shahriar MS (2013) A context aware sound classifier applied to prawn feed monitoring and energy disaggregation. Knowl-Based Syst 52:21–31CrossRef Smith DV, Shahriar MS (2013) A context aware sound classifier applied to prawn feed monitoring and energy disaggregation. Knowl-Based Syst 52:21–31CrossRef
24.
Zurück zum Zitat Chang H-H, Lian K-L, Su Y-C, Lee W-J (2014) Power-spectrum-based wavelet transform for nonintrusive demand monitoring and load identification. IEEE Trans Ind Appl 50(3):2081–2089CrossRef Chang H-H, Lian K-L, Su Y-C, Lee W-J (2014) Power-spectrum-based wavelet transform for nonintrusive demand monitoring and load identification. IEEE Trans Ind Appl 50(3):2081–2089CrossRef
25.
Zurück zum Zitat Guo Z, Wang ZJ, Kashani A (2015) Home appliance load modeling from aggregated smart meter data. IEEE Trans Power Syst 30(1):254–262CrossRef Guo Z, Wang ZJ, Kashani A (2015) Home appliance load modeling from aggregated smart meter data. IEEE Trans Power Syst 30(1):254–262CrossRef
26.
Zurück zum Zitat Bouhouras AS, Gkaidatzis PA, Panagiotou E, Poulakis N, Christoforidis GC (2019) A NILM algorithm with enhanced disaggregation scheme under harmonic current vectors. Energy Build 183:392–407CrossRef Bouhouras AS, Gkaidatzis PA, Panagiotou E, Poulakis N, Christoforidis GC (2019) A NILM algorithm with enhanced disaggregation scheme under harmonic current vectors. Energy Build 183:392–407CrossRef
27.
Zurück zum Zitat Perez KX, Cole WJ, Rhodes JD, Ondeck A, Webber M, Baldea M, Edgar TF (2014) Nonintrusive disaggregation of residential air-conditioning loads from sub-hourly smart meter data. Energy Build 81:316–325CrossRef Perez KX, Cole WJ, Rhodes JD, Ondeck A, Webber M, Baldea M, Edgar TF (2014) Nonintrusive disaggregation of residential air-conditioning loads from sub-hourly smart meter data. Energy Build 81:316–325CrossRef
29.
Zurück zum Zitat Ji Y, Zhang H, Wu QMJ (2018) Salient object detection via multi-scale attention CNN. Neurocomputing 322:130–140CrossRef Ji Y, Zhang H, Wu QMJ (2018) Salient object detection via multi-scale attention CNN. Neurocomputing 322:130–140CrossRef
30.
Zurück zum Zitat Chang H-H, Yang H-T, Lin C-L (2007) Load identification in neural networks for a non-intrusive monitoring of industrial electrical loads. In: International conference on computer supported cooperative work in design, Springer, Berlin, pp 664–674 Chang H-H, Yang H-T, Lin C-L (2007) Load identification in neural networks for a non-intrusive monitoring of industrial electrical loads. In: International conference on computer supported cooperative work in design, Springer, Berlin, pp 664–674
31.
Zurück zum Zitat Kelly J, Knottenbelt W (2015) Neural NILM: deep neural networks applied to energy disaggregation. In: Proceedings of the 2nd ACM international conference on embedded systems for energy-efficient built environments, ACM, Cambridge, pp 55–64 Kelly J, Knottenbelt W (2015) Neural NILM: deep neural networks applied to energy disaggregation. In: Proceedings of the 2nd ACM international conference on embedded systems for energy-efficient built environments, ACM, Cambridge, pp 55–64
32.
Zurück zum Zitat Bonfigli R, Felicetti A, Principi E, Fagiani M, Squartini S, Piazza F (2018) Denoising autoencoders for non-intrusive load monitoring: improvements and comparative evaluation. Energy Build 158:1461–1474CrossRef Bonfigli R, Felicetti A, Principi E, Fagiani M, Squartini S, Piazza F (2018) Denoising autoencoders for non-intrusive load monitoring: improvements and comparative evaluation. Energy Build 158:1461–1474CrossRef
33.
Zurück zum Zitat Zhang C, Zhong M, Wang Z, Goddard N, Sutton C (2016) Sequence-to-point learning with neural networks for nonintrusive load monitoring. arXiv preprint arXiv:1612.09106 Zhang C, Zhong M, Wang Z, Goddard N, Sutton C (2016) Sequence-to-point learning with neural networks for nonintrusive load monitoring. arXiv preprint arXiv:​1612.​09106
34.
Zurück zum Zitat Zhang H, Li J, Ji Y, Yue H (2016) Understanding subtitles by character-level sequence-to-sequence learning. IEEE Trans Ind Inf 13(2):616–624CrossRef Zhang H, Li J, Ji Y, Yue H (2016) Understanding subtitles by character-level sequence-to-sequence learning. IEEE Trans Ind Inf 13(2):616–624CrossRef
35.
Zurück zum Zitat Liu B, Liu Q, Zhu Z, Zhang T, Yang Y (2019) MSST-ResNet: deep multi-scale spatiotemporal features for robust visual object tracking. Knowl-Based Syst 164:235–252CrossRef Liu B, Liu Q, Zhu Z, Zhang T, Yang Y (2019) MSST-ResNet: deep multi-scale spatiotemporal features for robust visual object tracking. Knowl-Based Syst 164:235–252CrossRef
37.
Zurück zum Zitat Kelly J, Knottenbelt W (2015) The UK-DALE dataset, domestic appliance-level electricity demand and whole-house demand from five UK homes. Sci Data 2:150007CrossRef Kelly J, Knottenbelt W (2015) The UK-DALE dataset, domestic appliance-level electricity demand and whole-house demand from five UK homes. Sci Data 2:150007CrossRef
38.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
39.
Zurück zum Zitat Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:​1502.​03167
41.
Zurück zum Zitat Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: CVPR, vol 1, p 3 Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: CVPR, vol 1, p 3
42.
Zurück zum Zitat LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436CrossRef LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436CrossRef
43.
Zurück zum Zitat Katsuki F, Constantinidis C (2014) Bottom-up and top-down attention: different processes and overlapping neural systems. The Neurosci 20(5):509–521 Katsuki F, Constantinidis C (2014) Bottom-up and top-down attention: different processes and overlapping neural systems. The Neurosci 20(5):509–521
44.
Zurück zum Zitat Buschman TJ, Miller EK (2007) Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science 315(5820):1860–1862CrossRef Buschman TJ, Miller EK (2007) Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science 315(5820):1860–1862CrossRef
45.
Zurück zum Zitat Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H, Wang X, Tang X (2017) Residual attention network for image classification. arXiv preprint arXiv:1704.06904 Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H, Wang X, Tang X (2017) Residual attention network for image classification. arXiv preprint arXiv:​1704.​06904
47.
Zurück zum Zitat Yu F, Koltun V, Funkhouser TA (2017) Dilated residual networks. In: CVPR, vol 2, p 3 Yu F, Koltun V, Funkhouser TA (2017) Dilated residual networks. In: CVPR, vol 2, p 3
Metadaten
Titel
Dilated residual attention network for load disaggregation
verfasst von
Min Xia
Wan’an Liu
Yiqing Xu
Ke Wang
Xu Zhang
Publikationsdatum
06.08.2019
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 12/2019
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04414-3

Weitere Artikel der Ausgabe 12/2019

Neural Computing and Applications 12/2019 Zur Ausgabe

Machine Learning - Applications & Techniques in Cyber Intelligence

A collaborative filtering algorithm based on correlation coefficient

Machine Learning - Applications & Techniques in Cyber Intelligence

A non-intrusive load decomposition algorithm for residents

S.I.: Machine Learning - Applications & Techniques in Cyber Intelligence

Three-dimensional dynamic monitoring of environmental cost based on state-space model

Premium Partner