Skip to main content
Top

2024 | OriginalPaper | Chapter

A Novel SegNet Model for Crack Image Semantic Segmentation in Bridge Inspection

Authors : Rong Pang, Hao Tan, Yan Yang, Xun Xu, Nanqing Liu, Peng Zhang

Published in: Advances in Knowledge Discovery and Data Mining

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Cracks on bridge surfaces represent a significant defect that demands accurate and efficient inspection methods. However, current approaches for segmenting cracks suffer from low accuracy and slow detection speed, particularly when dealing with fine and small cracks that occupy only a few pixels. In this work, we propose a novel crack image semantic segmentation method based on an enhanced SegNet. The proposed approach addresses these challenges through three key innovations. First, we reduce the network depth to improve computational efficiency while maintaining accuracy. Furthermore, we employ ConvNeXt-V2 to effectively extract and fuse crack features, thereby improving segmentation performance. To handle pixel imbalance during loss calculation, we integrate the Dice coefficient into the original cross-entropy loss function. Experimental results demonstrate that our enhanced SegNet achieves remarkable improvements in mIoU for non-steel and steel crack segmentation tasks, reaching 82.37% and 77.26%, respectively. Our approach outperforms state-of-the-art methods in both inference speed and accuracy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abdel-Qader, I., Abudayyeh, O., Kelly, M.E.: Analysis of edge-detection techniques for crack identification in bridges. J. Comput. Civil Eng. 17(4), 255–263 (2013)CrossRef Abdel-Qader, I., Abudayyeh, O., Kelly, M.E.: Analysis of edge-detection techniques for crack identification in bridges. J. Comput. Civil Eng. 17(4), 255–263 (2013)CrossRef
2.
go back to reference Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRef Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRef
4.
go back to reference Carr, T.A., Jenkins, M.D., Iglesias, M.I., Buggy, T., Morison, G.: Road crack detection using a single stage detector based deep neural network. In: 2018 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS), pp. 1–5. IEEE (2018) Carr, T.A., Jenkins, M.D., Iglesias, M.I., Buggy, T., Morison, G.: Road crack detection using a single stage detector based deep neural network. In: 2018 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS), pp. 1–5. IEEE (2018)
5.
go back to reference Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818 (2018) Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818 (2018)
6.
go back to reference Chen, T., et al.: Pavement crack detection and recognition using the architecture of SegNet. J. Ind. Inf. Integr. 18, 100144 (2020) Chen, T., et al.: Pavement crack detection and recognition using the architecture of SegNet. J. Ind. Inf. Integr. 18, 100144 (2020)
7.
go back to reference Chong, W.-K., Low, S.-P.: Assessment of defects at construction and occupancy stages. J. Perform. Constr. Facil. 19(4), 283–289 (2005)CrossRef Chong, W.-K., Low, S.-P.: Assessment of defects at construction and occupancy stages. J. Perform. Constr. Facil. 19(4), 283–289 (2005)CrossRef
8.
go back to reference Delagnes, P., Barba, D.: A markov random field for rectilinear structure extraction in pavement distress image analysis. In: Proceedings of International Conference on Image Processing, vol. 1, pp. 446–449. IEEE (1995) Delagnes, P., Barba, D.: A markov random field for rectilinear structure extraction in pavement distress image analysis. In: Proceedings of International Conference on Image Processing, vol. 1, pp. 446–449. IEEE (1995)
9.
go back to reference Jin, T., Li, Z., Ding, Y., Ma, S., Ou, Y.: Bridge crack library. In: Harvard Dataverse (2021) Jin, T., Li, Z., Ding, Y., Ma, S., Ou, Y.: Bridge crack library. In: Harvard Dataverse (2021)
10.
go back to reference Jin, X., et al.: Development of nanomodified self-healing mortar and a u-net model based on semantic segmentation for crack detection and evaluation. Construct. Build. Mater. 365, 129985 (2023) Jin, X., et al.: Development of nanomodified self-healing mortar and a u-net model based on semantic segmentation for crack detection and evaluation. Construct. Build. Mater. 365, 129985 (2023)
11.
go back to reference Lei, B., Wang, N., Pengcheng, X., Song, G.: New crack detection method for bridge inspection using UAV incorporating image processing. J. Aerosp. Eng. 31(5), 04018058 (2018)CrossRef Lei, B., Wang, N., Pengcheng, X., Song, G.: New crack detection method for bridge inspection using UAV incorporating image processing. J. Aerosp. Eng. 31(5), 04018058 (2018)CrossRef
12.
go back to reference Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015) Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
13.
go back to reference Munawar, H.S., Hammad, A.W.A., Haddad, A., Pereira Soares, C.A., Waller, S.T.: Image-based crack detection methods: a review. Infrastructures 6(8), 115 (2021) Munawar, H.S., Hammad, A.W.A., Haddad, A., Pereira Soares, C.A., Waller, S.T.: Image-based crack detection methods: a review. Infrastructures 6(8), 115 (2021)
14.
go back to reference Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)CrossRef Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)CrossRef
15.
go back to reference Qin, Y., Dong, S., Pang, R., Xia, Z., Zhou, Q., Yang, J.: Design and kinematic analysis of a wall-climbing robot for bridge appearance inspection. In: IOP Conference Series: Earth and Environmental Science, vol. 638, 012062. IOP Publishing (2021) Qin, Y., Dong, S., Pang, R., Xia, Z., Zhou, Q., Yang, J.: Design and kinematic analysis of a wall-climbing robot for bridge appearance inspection. In: IOP Conference Series: Earth and Environmental Science, vol. 638, 012062. IOP Publishing (2021)
18.
go back to reference Woo, S., et al.: ConvNeXt V2: co-designing and scaling convnets with masked autoencoders. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 16133–16142 (2023) Woo, S., et al.: ConvNeXt V2: co-designing and scaling convnets with masked autoencoders. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 16133–16142 (2023)
19.
go back to reference Xu, X., Nguyen, M.C., Yazici, Y., Lu, K., Min, H., Foo, C.-S.: Semi-supervised curvilinear structure segmentation. Semicurv. IEEE Trans. Image Process. 31, 5109–5120 (2022) Xu, X., Nguyen, M.C., Yazici, Y., Lu, K., Min, H., Foo, C.-S.: Semi-supervised curvilinear structure segmentation. Semicurv. IEEE Trans. Image Process. 31, 5109–5120 (2022)
20.
go back to reference Yamaguchi, T., Nakamura, S., Saegusa, R., Hashimoto, S.: Image-based crack detection for real concrete surfaces. IEEJ Trans. Electr. Electron. Eng. 3(1), 128–135 (2008)CrossRef Yamaguchi, T., Nakamura, S., Saegusa, R., Hashimoto, S.: Image-based crack detection for real concrete surfaces. IEEJ Trans. Electr. Electron. Eng. 3(1), 128–135 (2008)CrossRef
21.
go back to reference Yang, F., Zhang, L., Sijia, Yu., Prokhorov, D., Mei, X., Ling, H.: Feature pyramid and hierarchical boosting network for pavement crack detection. IEEE Trans. Intell. Transp. Syst. 21(4), 1525–1535 (2019)CrossRef Yang, F., Zhang, L., Sijia, Yu., Prokhorov, D., Mei, X., Ling, H.: Feature pyramid and hierarchical boosting network for pavement crack detection. IEEE Trans. Intell. Transp. Syst. 21(4), 1525–1535 (2019)CrossRef
22.
go back to reference Zhang, J., Qian, S., Tan, C.: Automated bridge crack detection method based on lightweight vision models. Complex Intell. Syst. 9(2), 1639–1652 (2023)CrossRef Zhang, J., Qian, S., Tan, C.: Automated bridge crack detection method based on lightweight vision models. Complex Intell. Syst. 9(2), 1639–1652 (2023)CrossRef
23.
go back to reference Zheng, Y., Gao, Y., Lu, S., Mosalam, K.M.: Multistage semisupervised active learning framework for crack identification, segmentation, and measurement of bridges. Comput.-Aided Civil Infrastruct. Eng. 37(9), 1089–1108 (2022) Zheng, Y., Gao, Y., Lu, S., Mosalam, K.M.: Multistage semisupervised active learning framework for crack identification, segmentation, and measurement of bridges. Comput.-Aided Civil Infrastruct. Eng. 37(9), 1089–1108 (2022)
Metadata
Title
A Novel SegNet Model for Crack Image Semantic Segmentation in Bridge Inspection
Authors
Rong Pang
Hao Tan
Yan Yang
Xun Xu
Nanqing Liu
Peng Zhang
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2259-4_26

Premium Partner