Skip to main content
Top

2021 | OriginalPaper | Chapter

Corrosion Detection on Aircraft Fuselage with Multi-teacher Knowledge Distillation

Authors : K. Zuchniak, W. Dzwinel, E. Majerz, A. Pasternak, K. Dragan

Published in: Computational Science – ICCS 2021

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The procedures of non-destructive inspection (NDI) are employed by the aerospace industry to reduce operational costs and the risk of catastrophe. The success of deep learning (DL) in numerous engineering applications encouraged us to check the usefulness of autonomous DL models also in this field. Particularly, in the inspection of the fuselage surface and search for corrosion defects. Herein, we present the tests of employing convolutional neural network (CNN) architectures in detecting small spots of corrosion on the fuselage surface and rivets. We use a unique and difficult dataset consisting of \(1.3\times 10^4\) images (\(640\times 480\)) of various fuselage parts from several aircraft types, brands, and service life. The images come from the non-invasive DAIS (D-Sight Aircraft Inspection System) inspection system, which can be treated as an analog image enhancement device. We demonstrate that our novel DL ensembling scheme, i.e., multi-teacher/single-student knowledge distillation architecture, allows for 100% detection of the images representing the “moderate corrosion” class on the test set. Simultaneously, we show that the proposed ensemble classifier, when used for the whole dataset with images representing various stages of corrosion, yields significant improvement in the classification accuracy in comparison to the baseline single ResNet50 neural network. Our work is the contribution to a relatively new discussion of deep learning applications in the fast inspection of the full surface of an aircraft fuselage but not only its fragments.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Asif, U., Tang, J., Harrer, S.: Ensemble knowledge distillation for learning improved and efficient networks. arXiv preprint arXiv:1909.08097 (2019) Asif, U., Tang, J., Harrer, S.: Ensemble knowledge distillation for learning improved and efficient networks. arXiv preprint arXiv:​1909.​08097 (2019)
4.
go back to reference Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009) Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
5.
go back to reference Forsyth, D., Komorowski, J., Gould, R., Marincak, A.: Automation of enhanced visual NDT techniques. In: Proceedings 1st Pan-American Conference for NDT, Toronto, Canada, pp. 107–117 (1998) Forsyth, D., Komorowski, J., Gould, R., Marincak, A.: Automation of enhanced visual NDT techniques. In: Proceedings 1st Pan-American Conference for NDT, Toronto, Canada, pp. 107–117 (1998)
6.
go back to reference Garipov, T., Izmailov, P., Podoprikhin, D., Vetrov, D.P., Wilson, A.G.: Loss surfaces, mode connectivity, and fast ensembling of DNNs. In: Advances in Neural Information Processing Systems, pp. 8789–8798 (2018) Garipov, T., Izmailov, P., Podoprikhin, D., Vetrov, D.P., Wilson, A.G.: Loss surfaces, mode connectivity, and fast ensembling of DNNs. In: Advances in Neural Information Processing Systems, pp. 8789–8798 (2018)
8.
go back to reference He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
9.
go back to reference Heida, J., Bruinsma, A.: D-sight technique for rapid impact damage detection on composite aircraft structures (1997) Heida, J., Bruinsma, A.: D-sight technique for rapid impact damage detection on composite aircraft structures (1997)
11.
go back to reference Jerzy, P., Komorowski, R.W., Gould, D.L.S.: Application of diffracto sight to the nondestructive inspection of aircraft structures. Rev. Prog. Quant. Nondestr. Eval. 12, 449 (2012) Jerzy, P., Komorowski, R.W., Gould, D.L.S.: Application of diffracto sight to the nondestructive inspection of aircraft structures. Rev. Prog. Quant. Nondestr. Eval. 12, 449 (2012)
13.
go back to reference Komorowski, J.P., Gould, R.W., Simpson, D.L.: Synergy between advanced composites and new NDI methods. Adv. Perf. Mater. 5(1–2), 137–151 (1998)CrossRef Komorowski, J.P., Gould, R.W., Simpson, D.L.: Synergy between advanced composites and new NDI methods. Adv. Perf. Mater. 5(1–2), 137–151 (1998)CrossRef
14.
go back to reference Van der Maaten, L., Hinton, G.: Visualizing data using t-sne. J. Mach. Learn. Res. 9(11), 2579–2605 (2008)MATH Van der Maaten, L., Hinton, G.: Visualizing data using t-sne. J. Mach. Learn. Res. 9(11), 2579–2605 (2008)MATH
16.
go back to reference Malekzadeh, T., Abdollahzadeh, M., Nejati, H., Cheung, N.M.: Aircraft fuselage defect detection using deep neural networks. arXiv preprint arXiv:1712.09213 (2017) Malekzadeh, T., Abdollahzadeh, M., Nejati, H., Cheung, N.M.: Aircraft fuselage defect detection using deep neural networks. arXiv preprint arXiv:​1712.​09213 (2017)
17.
go back to reference Niepokólczycki, A., Leski, A., Dragan, K.: Review of aeronautical fatigue investigations in poland (2013–2014). Fatigue Aircraft Struct. 2016(8), 5–48 (2016)CrossRef Niepokólczycki, A., Leski, A., Dragan, K.: Review of aeronautical fatigue investigations in poland (2013–2014). Fatigue Aircraft Struct. 2016(8), 5–48 (2016)CrossRef
18.
go back to reference Ren, I.: An Ensemble Machine Vision System for Automated Detection of Surface Defects in Aircraft Propeller Blades. Ph.D. thesis, Georgia Institute of Technology (2020) Ren, I.: An Ensemble Machine Vision System for Automated Detection of Surface Defects in Aircraft Propeller Blades. Ph.D. thesis, Georgia Institute of Technology (2020)
19.
go back to reference Rousseeuw, P.J.: Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20, 53–65 (1987)CrossRef Rousseeuw, P.J.: Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20, 53–65 (1987)CrossRef
20.
go back to reference Sagi, O., Rokach, L.: Ensemble learning: a survey. Wiley Interdisc. Rev. Data Mining Knowl. Disc. 8(4), e1249 (2018) Sagi, O., Rokach, L.: Ensemble learning: a survey. Wiley Interdisc. Rev. Data Mining Knowl. Disc. 8(4), e1249 (2018)
21.
go back to reference Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017) Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)
23.
go back to reference Shen, Z., Wan, X., Ye, F., Guan, X., Liu, S.: Deep learning based framework for automatic damage detection in aircraft engine borescope inspection. In: 2019 International Conference on Computing, Networking and Communications (ICNC), pp. 1005–1010. IEEE (2019) Shen, Z., Wan, X., Ye, F., Guan, X., Liu, S.: Deep learning based framework for automatic damage detection in aircraft engine borescope inspection. In: 2019 International Conference on Computing, Networking and Communications (ICNC), pp. 1005–1010. IEEE (2019)
24.
go back to reference Wang, L., Yoon, K.J.: Knowledge distillation and student-teacher learning for visual intelligence: a review and new outlooks. arXiv preprint arXiv:2004.05937 (2020) Wang, L., Yoon, K.J.: Knowledge distillation and student-teacher learning for visual intelligence: a review and new outlooks. arXiv preprint arXiv:​2004.​05937 (2020)
25.
go back to reference Zhu, X., Gong, S., et al.: Knowledge distillation by on-the-fly native ensemble. In: Advances in Neural Information Processing Systems, pp. 7517–7527 (2018) Zhu, X., Gong, S., et al.: Knowledge distillation by on-the-fly native ensemble. In: Advances in Neural Information Processing Systems, pp. 7517–7527 (2018)
Metadata
Title
Corrosion Detection on Aircraft Fuselage with Multi-teacher Knowledge Distillation
Authors
K. Zuchniak
W. Dzwinel
E. Majerz
A. Pasternak
K. Dragan
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-77980-1_25

Premium Partner