Skip to main content
Top
Published in: Neural Computing and Applications 14/2022

08-03-2022 | Original Article

An interpretable CNN model for classification of partial discharge waveforms in 3D-printed dielectric samples with different void sizes

Authors: Sara Mantach, Puneet Gill, Derek R. Oliver, Ahmed Ashraf, Behzad Kordi

Published in: Neural Computing and Applications | Issue 14/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Regular maintenance of power equipment in high voltage power systems is essential for avoiding outages. An effective way to maintain such systems is the measurement of partial discharges in the insulation material. Voids in solid dielectrics may result from many causes including defects taking place during the manufacturing of the dielectric. These voids induce PDs. Classifying different void sizes is challenging since traditional classification tools used for partial discharge (PD) classification do not work properly. For instance, phase resolved partial discharge (PRPD) patterns resulting from different void sizes will be roughly the same since the source of the partial discharge is the same. Using existing clustering techniques such as Time–Frequency (TF) map or analysis of statistical features extracted from the PRPD patterns presents their own limitations. TF map restricts the use of Fast Fourier Transform, while working with PRPDs is only applicable for AC measurements. In this paper, a convolutional neural network (CNN) attention-based model has shown superior capability over traditional classification technique (TF map) to classify partial discharge (PD) waveforms resulting from different voids in PLA 3D-printed samples. 1D-CNN has classification accuracy of 98.7% with an increase of 21.42% compared to the TF map technique. Extensive investigation of the learned model has been conducted in order to interpret the decisions made by the proposed neural network. In particular, adding an interpretable attention model such as GRAD-CAM to our CNN shows that while making the decision the neural network learns to focus more on the regions of the waveform corresponding to the rise of the pulse.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Satish L, Zaengl WS (1994) Artificial neural networks for recognition of 3-d partial discharge patterns. IEEE Trans Dielectr Electr Insul 1(2):265–275CrossRef Satish L, Zaengl WS (1994) Artificial neural networks for recognition of 3-d partial discharge patterns. IEEE Trans Dielectr Electr Insul 1(2):265–275CrossRef
2.
go back to reference Whitehead S (1951) Dielectric breakdown of solids. Clarendon Press, LondonMATH Whitehead S (1951) Dielectric breakdown of solids. Clarendon Press, LondonMATH
3.
go back to reference Crichton GC, Karlsson P, Pedersen A (1989) Partial discharges in ellipsoidal and spheroidal voids. IEEE Trans Electr Insul 24(2):335–342CrossRef Crichton GC, Karlsson P, Pedersen A (1989) Partial discharges in ellipsoidal and spheroidal voids. IEEE Trans Electr Insul 24(2):335–342CrossRef
4.
go back to reference Fothergill JC (2007) Ageing, space charge and nanodielectrics: ten things we don’t know about dielectrics. In: 2007 IEEE international conference on solid dielectrics. IEEE, pp 1–10 Fothergill JC (2007) Ageing, space charge and nanodielectrics: ten things we don’t know about dielectrics. In: 2007 IEEE international conference on solid dielectrics. IEEE, pp 1–10
5.
go back to reference Zhang Y, He L, Zhu H (2017) Influencing factors of partial discharge of needle-plate based on acoustic emission detection. In: World conference on acoustic emission. Springer, pp 389–397 Zhang Y, He L, Zhu H (2017) Influencing factors of partial discharge of needle-plate based on acoustic emission detection. In: World conference on acoustic emission. Springer, pp 389–397
6.
go back to reference Krivda A (1995) Automated recognition of partial discharges. IEEE Trans Dielectr Electr Insul 2(5):796–821CrossRef Krivda A (1995) Automated recognition of partial discharges. IEEE Trans Dielectr Electr Insul 2(5):796–821CrossRef
7.
go back to reference Sahoo N, Salama M, Bartnikas R (2005) Trends in partial discharge pattern classification: a survey. IEEE Trans Dielectr Electr Insul 12(2):248–264CrossRef Sahoo N, Salama M, Bartnikas R (2005) Trends in partial discharge pattern classification: a survey. IEEE Trans Dielectr Electr Insul 12(2):248–264CrossRef
8.
go back to reference Lin C-F, Wang S-D (2002) Fuzzy support vector machines. IEEE Trans Neural Netw 13(2):464–471CrossRef Lin C-F, Wang S-D (2002) Fuzzy support vector machines. IEEE Trans Neural Netw 13(2):464–471CrossRef
9.
go back to reference Duda RO, Hart PE, Stork DG (2001) Pattern classification, vol 58, 2nd edn. Wiley, New York, p 16MATH Duda RO, Hart PE, Stork DG (2001) Pattern classification, vol 58, 2nd edn. Wiley, New York, p 16MATH
10.
11.
go back to reference Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119–139MathSciNetCrossRef Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119–139MathSciNetCrossRef
12.
go back to reference Wu M, Cao H, Cao J, Nguyen H-L, Gomes JB, Krishnaswamy SP (2015) An overview of state-of-the-art partial discharge analysis techniques for condition monitoring. IEEE Electr Insul Mag 31(6):22–35CrossRef Wu M, Cao H, Cao J, Nguyen H-L, Gomes JB, Krishnaswamy SP (2015) An overview of state-of-the-art partial discharge analysis techniques for condition monitoring. IEEE Electr Insul Mag 31(6):22–35CrossRef
13.
go back to reference Catterson V, Sheng B (2015) Deep neural networks for understanding and diagnosing partial discharge data. In: 2015 IEEE electrical insulation conference (EIC). IEEE, pp 218–221 Catterson V, Sheng B (2015) Deep neural networks for understanding and diagnosing partial discharge data. In: 2015 IEEE electrical insulation conference (EIC). IEEE, pp 218–221
14.
go back to reference Lu S, Chai H, Sahoo A, Phung B (2020) Condition monitoring based on partial discharge diagnostics using machine learning methods: a comprehensive state-of-the-art review. IEEE Trans Dielectr Electr Insul 27(6):1861–1888CrossRef Lu S, Chai H, Sahoo A, Phung B (2020) Condition monitoring based on partial discharge diagnostics using machine learning methods: a comprehensive state-of-the-art review. IEEE Trans Dielectr Electr Insul 27(6):1861–1888CrossRef
15.
go back to reference Wang Y, Yan J, Yang Z, Liu T, Zhao Y, Li J (2019) Partial discharge pattern recognition of gas-insulated switchgear via a light-scale convolutional neural network. Energies 12(24):4674CrossRef Wang Y, Yan J, Yang Z, Liu T, Zhao Y, Li J (2019) Partial discharge pattern recognition of gas-insulated switchgear via a light-scale convolutional neural network. Energies 12(24):4674CrossRef
16.
go back to reference Barrios S, Buldain D, Comech MP, Gilbert I, Orue I (2019) Partial discharge classification using deep learning methods-survey of recent progress. Energies 12(13):2485CrossRef Barrios S, Buldain D, Comech MP, Gilbert I, Orue I (2019) Partial discharge classification using deep learning methods-survey of recent progress. Energies 12(13):2485CrossRef
17.
go back to reference Fawaz HI, Forestier G, Weber J, Idoumghar L, Muller P-A (2019) Deep learning for time series classification: a review. Data Min Knowl Discov 33(4):917–963MathSciNetCrossRef Fawaz HI, Forestier G, Weber J, Idoumghar L, Muller P-A (2019) Deep learning for time series classification: a review. Data Min Knowl Discov 33(4):917–963MathSciNetCrossRef
18.
go back to reference Ibrahim A, Zhou Y, Jenkins ME, Trejos AL, Naish MD (2020) The design of a parkinson’s tremor predictor and estimator using a hybrid convolutional-multilayer perceptron neural network. In: 2020 42nd annual international conference of the ieee engineering in medicine & biology society (EMBC). IEEE, pp 5996–6000 Ibrahim A, Zhou Y, Jenkins ME, Trejos AL, Naish MD (2020) The design of a parkinson’s tremor predictor and estimator using a hybrid convolutional-multilayer perceptron neural network. In: 2020 42nd annual international conference of the ieee engineering in medicine & biology society (EMBC). IEEE, pp 5996–6000
19.
go back to reference Khan MA, Choo J, Kim Y-H (2019) End-to-end partial discharge detection in power cables via time-domain convolutional neural networks. J Electr Eng Technol 14(3):1299–1309CrossRef Khan MA, Choo J, Kim Y-H (2019) End-to-end partial discharge detection in power cables via time-domain convolutional neural networks. J Electr Eng Technol 14(3):1299–1309CrossRef
20.
go back to reference Wang W, Yu N (2020) Partial discharge detection with convolutional neural networks. In: 2020 international conference on probabilistic methods applied to power systems (PMAPS). IEEE, pp 1–6 Wang W, Yu N (2020) Partial discharge detection with convolutional neural networks. In: 2020 international conference on probabilistic methods applied to power systems (PMAPS). IEEE, pp 1–6
21.
go back to reference Peng X, Yang F, Wang G, Wu Y, Li L, Li Z, Bhatti AA, Zhou C, Hepburn DM, Reid AJ et al (2019) A convolutional neural network-based deep learning methodology for recognition of partial discharge patterns from high-voltage cables. IEEE Trans Power Deliv 34(4):1460–1469CrossRef Peng X, Yang F, Wang G, Wu Y, Li L, Li Z, Bhatti AA, Zhou C, Hepburn DM, Reid AJ et al (2019) A convolutional neural network-based deep learning methodology for recognition of partial discharge patterns from high-voltage cables. IEEE Trans Power Deliv 34(4):1460–1469CrossRef
22.
go back to reference Borghei M, Ghassemi M, Kordi B, Gill P, Oliver D (2021) A finite element analysis model for internal partial discharges in an air-filled cylindrical cavity inside solid dielectric. In: IEEE electrical insulation conference (EIC), pp 7–21 Borghei M, Ghassemi M, Kordi B, Gill P, Oliver D (2021) A finite element analysis model for internal partial discharges in an air-filled cylindrical cavity inside solid dielectric. In: IEEE electrical insulation conference (EIC), pp 7–21
23.
go back to reference Contin A, Cavallini A, Montanari G, Pasini G, Puletti F (2002) Digital detection and fuzzy classification of partial discharge signals. IEEE Trans Dielectr Electr Insul 9(3):335–348CrossRef Contin A, Cavallini A, Montanari G, Pasini G, Puletti F (2002) Digital detection and fuzzy classification of partial discharge signals. IEEE Trans Dielectr Electr Insul 9(3):335–348CrossRef
24.
go back to reference Cavallini A, Montanari G, Contin A, Pulletti F (2003) A new approach to the diagnosis of solid insulation systems based on pd signal inference. IEEE Electr Insul Mag 19(2):23–30CrossRef Cavallini A, Montanari G, Contin A, Pulletti F (2003) A new approach to the diagnosis of solid insulation systems based on pd signal inference. IEEE Electr Insul Mag 19(2):23–30CrossRef
25.
go back to reference Cavallini A, Montanari G, Puletti F, Contin A (2005) A new methodology for the identification of pd in electrical apparatus: properties and applications. IEEE Trans Dielectr Electr Insul 12(2):203–215CrossRef Cavallini A, Montanari G, Puletti F, Contin A (2005) A new methodology for the identification of pd in electrical apparatus: properties and applications. IEEE Trans Dielectr Electr Insul 12(2):203–215CrossRef
26.
go back to reference Janani H (2016) Partial discharge source classification using pattern recognition algorithms. PhD thesis, University of Manitoba Janani H (2016) Partial discharge source classification using pattern recognition algorithms. PhD thesis, University of Manitoba
27.
go back to reference Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105 Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105
28.
go back to reference Shen X, Ni Z, Liu L, Yang J, Ahmed K (2021) Wipass: 1d-cnn-based smartphone keystroke recognition using wifi signals. Pervasive Mob Comput 73:101393CrossRef Shen X, Ni Z, Liu L, Yang J, Ahmed K (2021) Wipass: 1d-cnn-based smartphone keystroke recognition using wifi signals. Pervasive Mob Comput 73:101393CrossRef
29.
go back to reference Chen W, Shi K (2019) A deep learning framework for time series classification using relative position matrix and convolutional neural network. Neurocomputing 359:384–394CrossRef Chen W, Shi K (2019) A deep learning framework for time series classification using relative position matrix and convolutional neural network. Neurocomputing 359:384–394CrossRef
30.
go back to reference Nair V, Hinton GE (2010) Rectified linear units improve restricted boltzmann machines. In: Icml Nair V, Hinton GE (2010) Rectified linear units improve restricted boltzmann machines. In: Icml
31.
go back to reference Goodfellow I, Lee H, Le Q, Saxe A, Ng A (2009) Measuring invariances in deep networks. Adv Neural Inf Process Syst 22:646–654 Goodfellow I, Lee H, Le Q, Saxe A, Ng A (2009) Measuring invariances in deep networks. Adv Neural Inf Process Syst 22:646–654
32.
go back to reference Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2014) Semantic image segmentation with deep convolutional nets and fully connected crfs. Preprint arXiv:1412.7062 Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2014) Semantic image segmentation with deep convolutional nets and fully connected crfs. Preprint arXiv:​1412.​7062
33.
go back to reference Yi-de M, Qing L, Zhi-Bai Q (2004) Automated image segmentation using improved pcnn model based on cross-entropy. In: Proceedings of 2004 international symposium on intelligent multimedia, video and speech processing. IEEE, pp 743–746 Yi-de M, Qing L, Zhi-Bai Q (2004) Automated image segmentation using improved pcnn model based on cross-entropy. In: Proceedings of 2004 international symposium on intelligent multimedia, video and speech processing. IEEE, pp 743–746
34.
go back to reference Zhang Z (2018) Improved adam optimizer for deep neural networks. In: 2018 IEEE/ACM 26th international symposium on quality of service (IWQoS). IEEE, pp 1–2 Zhang Z (2018) Improved adam optimizer for deep neural networks. In: 2018 IEEE/ACM 26th international symposium on quality of service (IWQoS). IEEE, pp 1–2
35.
go back to reference Burman P (1989) A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods. Biometrika 76(3):503–514MathSciNetCrossRef Burman P (1989) A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods. Biometrika 76(3):503–514MathSciNetCrossRef
36.
go back to reference Bengio Y, Courville A, Vincent P (2013) Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798–1828CrossRef Bengio Y, Courville A, Vincent P (2013) Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798–1828CrossRef
38.
go back to reference Du M, Liu N, Hu X (2019) Techniques for interpretable machine learning. Commun ACM 63(1):68–77CrossRef Du M, Liu N, Hu X (2019) Techniques for interpretable machine learning. Commun ACM 63(1):68–77CrossRef
39.
go back to reference Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision, pp 618–626 Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision, pp 618–626
40.
go back to reference He T, Guo J, Chen N, Xu X, Wang Z, Fu K, Liu L, Yi Z (2019) Medimlp: using grad-cam to extract crucial variables for lung cancer postoperative complication prediction. IEEE J Biomed Health Inform 24(6):1762–1771CrossRef He T, Guo J, Chen N, Xu X, Wang Z, Fu K, Liu L, Yi Z (2019) Medimlp: using grad-cam to extract crucial variables for lung cancer postoperative complication prediction. IEEE J Biomed Health Inform 24(6):1762–1771CrossRef
41.
go back to reference Panwar H, Gupta P, Siddiqui MK, Morales-Menendez R, Bhardwaj P, Singh V (2020) A deep learning and grad-cam based color visualization approach for fast detection of covid-19 cases using chest x-ray and ct-scan images. Chaos Solitons Fractals 140:110190MathSciNetCrossRef Panwar H, Gupta P, Siddiqui MK, Morales-Menendez R, Bhardwaj P, Singh V (2020) A deep learning and grad-cam based color visualization approach for fast detection of covid-19 cases using chest x-ray and ct-scan images. Chaos Solitons Fractals 140:110190MathSciNetCrossRef
42.
go back to reference Cian D, van Gemert J, Lengyel A (2020) Evaluating the performance of the lime and grad-cam explanation methods on a lego multi-label image classification task. Preprint arXiv:2008.01584 Cian D, van Gemert J, Lengyel A (2020) Evaluating the performance of the lime and grad-cam explanation methods on a lego multi-label image classification task. Preprint arXiv:​2008.​01584
43.
go back to reference Feng F, Wu C, Zhu J, Wu S, Tian Q, Jiang P (2020) Research on multitask fault diagnosis and weight visualization of rotating machinery based on convolutional neural network. J Braz Soc Mech Sci Eng 42(11):1–14CrossRef Feng F, Wu C, Zhu J, Wu S, Tian Q, Jiang P (2020) Research on multitask fault diagnosis and weight visualization of rotating machinery based on convolutional neural network. J Braz Soc Mech Sci Eng 42(11):1–14CrossRef
Metadata
Title
An interpretable CNN model for classification of partial discharge waveforms in 3D-printed dielectric samples with different void sizes
Authors
Sara Mantach
Puneet Gill
Derek R. Oliver
Ahmed Ashraf
Behzad Kordi
Publication date
08-03-2022
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 14/2022
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-022-07066-y

Other articles of this Issue 14/2022

Neural Computing and Applications 14/2022 Go to the issue

Premium Partner