Skip to main content
Top
Published in: Pattern Analysis and Applications 2/2024

01-06-2024 | Original Paper

CABF-YOLO: a precise and efficient deep learning method for defect detection on strip steel surface

Authors: Qiqi Zhou, Haichao Wang

Published in: Pattern Analysis and Applications | Issue 2/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Deep learning algorithms have gained widespread usage in defect detection systems. However, existing methods are not satisfied for large-scale applications on surface defect detection of strip steel. In this paper, we propose a precise and efficient detection model, named CABF-YOLO, based on the YOLOX for strip steel surface defects. Firstly, we introduce the Triplet Convolutional Coordinate Attention (TCCA) module in the backbone of the YOLOX. By factorizing the pooling operation, the TCCA module can accurately capture cross-channel features to identify the location information of defects. Secondly, we design a novel Bidirectional Fusion (BF) strategy in the neck of the YOLOX. The BF strategy enhances the fusion of low-level and high-level semantic information to obtain fine-grained information. Lastly, the original bounding box loss function is replaced by the EIoU loss function. In the EIoU loss function, the penalty term is redefined to consider the overlap area, central point, and side length of the required regressions to accelerate the convergence rate and localization accuracy. On the benchmark NEU-DET dataset and GC10-DET dataset, the experimental results show that the CABF-YOLO achieves superior performance compared with other comparison models and satisfies the real-time detection requirement of industrial production.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Yu J, Cheng X, Li Q (2022) Surface defect detection of steel strips based on anchor-free network with channel attention and bidirectional feature fusion. IEEE Trans Instrum Meas 71:1–10 Yu J, Cheng X, Li Q (2022) Surface defect detection of steel strips based on anchor-free network with channel attention and bidirectional feature fusion. IEEE Trans Instrum Meas 71:1–10
2.
go back to reference Luo Q, Fang X, Sun Y, Liu L, Ai J, Yang C, Simpson O (2019) Surface defect classification for hot-rolled steel strips by selectively dominant local binary patterns. IEEE Access 7:23488–23499CrossRef Luo Q, Fang X, Sun Y, Liu L, Ai J, Yang C, Simpson O (2019) Surface defect classification for hot-rolled steel strips by selectively dominant local binary patterns. IEEE Access 7:23488–23499CrossRef
3.
go back to reference Hou Z, Parker JM (2005) Texture defect detection using support vector machines with adaptive Gabor wavelet features. In: 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION’05), vol 1, pp 275–280 Hou Z, Parker JM (2005) Texture defect detection using support vector machines with adaptive Gabor wavelet features. In: 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION’05), vol 1, pp 275–280
4.
go back to reference Ghorai S, Mukherjee A, Gangadaran M, Dutta PK (2012) Automatic defect detection on hot-rolled flat steel products. IEEE Trans Instrum Meas 62(3):612–621CrossRef Ghorai S, Mukherjee A, Gangadaran M, Dutta PK (2012) Automatic defect detection on hot-rolled flat steel products. IEEE Trans Instrum Meas 62(3):612–621CrossRef
5.
go back to reference Xu K, Ai Y-H, Wu X-Y (2013) Application of multi-scale feature extraction to surface defect classification of hot-rolled steels. Int J Miner Metall Mater 20:37–41CrossRef Xu K, Ai Y-H, Wu X-Y (2013) Application of multi-scale feature extraction to surface defect classification of hot-rolled steels. Int J Miner Metall Mater 20:37–41CrossRef
6.
go back to reference Pernkopf F (2004) Detection of surface defects on raw steel blocks using Bayesian network classifiers. Pattern Anal Appl 7:333–342MathSciNetCrossRef Pernkopf F (2004) Detection of surface defects on raw steel blocks using Bayesian network classifiers. Pattern Anal Appl 7:333–342MathSciNetCrossRef
7.
go back to reference Xue-Wu Z, Yan-Qiong D, Yan-Yun L, Ai-Ye S, Rui-Yu L (2011) A vision inspection system for the surface defects of strongly reflected metal based on multi-class SVM. Expert Syst Appl 38(5):5930–5939CrossRef Xue-Wu Z, Yan-Qiong D, Yan-Yun L, Ai-Ye S, Rui-Yu L (2011) A vision inspection system for the surface defects of strongly reflected metal based on multi-class SVM. Expert Syst Appl 38(5):5930–5939CrossRef
8.
go back to reference Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–587 Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–587
9.
go back to reference Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448 Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448
10.
go back to reference Ren S, He K, Girshick R, Sun J, Faster R-CNN: towards real-time object detection with region proposal networks. Adv Neural Inf Processing Syst 28 Ren S, He K, Girshick R, Sun J, Faster R-CNN: towards real-time object detection with region proposal networks. Adv Neural Inf Processing Syst 28
11.
go back to reference Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788 Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788
12.
go back to reference Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7263–7271 Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7263–7271
13.
go back to reference Lin T-Y, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980–2988 Lin T-Y, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980–2988
14.
go back to reference Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2117–2125 Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2117–2125
19.
go back to reference Li C, Li L, Jiang H, Weng K, Geng Y, Li L, Ke Z, Li Q, Cheng M, Nie W et al (2022) Yolov6: a single-stage object detection framework for industrial applications. arXiv:2209.02976 Li C, Li L, Jiang H, Weng K, Geng Y, Li L, Ke Z, Li Q, Cheng M, Nie W et al (2022) Yolov6: a single-stage object detection framework for industrial applications. arXiv:​2209.​02976
20.
go back to reference Ding X, Zhang X, Ma N, Han J, Ding G, Sun J (2021) RepVGG: making VGG-style convnets great again. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13733–13742 Ding X, Zhang X, Ma N, Han J, Ding G, Sun J (2021) RepVGG: making VGG-style convnets great again. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13733–13742
21.
go back to reference Wang C-Y, Bochkovskiy A, Liao H-YM (2023) Yolov7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 7464–7475 Wang C-Y, Bochkovskiy A, Liao H-YM (2023) Yolov7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 7464–7475
23.
go back to reference He Y, Song K, Meng Q, Yan Y (2019) An end-to-end steel surface defect detection approach via fusing multiple hierarchical features. IEEE Trans Instrum Meas 69(4):1493–1504CrossRef He Y, Song K, Meng Q, Yan Y (2019) An end-to-end steel surface defect detection approach via fusing multiple hierarchical features. IEEE Trans Instrum Meas 69(4):1493–1504CrossRef
24.
go back to reference Lv X, Duan F, Jiang J-J, Fu X, Gan L (2020) Deep metallic surface defect detection: the new benchmark and detection network. Sensors 20(6):1562CrossRef Lv X, Duan F, Jiang J-J, Fu X, Gan L (2020) Deep metallic surface defect detection: the new benchmark and detection network. Sensors 20(6):1562CrossRef
25.
go back to reference Kou X, Liu S, Cheng K, Qian Y (2021) Development of a YOLO-V3-based model for detecting defects on steel strip surface. Measurement 182:109454CrossRef Kou X, Liu S, Cheng K, Qian Y (2021) Development of a YOLO-V3-based model for detecting defects on steel strip surface. Measurement 182:109454CrossRef
26.
go back to reference Zhao W, Chen F, Huang H, Li D, Cheng W (2021) A new steel defect detection algorithm based on deep learning. Comput Intell Neurosci 2021:1–13 Zhao W, Chen F, Huang H, Li D, Cheng W (2021) A new steel defect detection algorithm based on deep learning. Comput Intell Neurosci 2021:1–13
27.
go back to reference Tian R, Jia M (2022) DCC-CenterNet: a rapid detection method for steel surface defects. Measurement 187:110211CrossRef Tian R, Jia M (2022) DCC-CenterNet: a rapid detection method for steel surface defects. Measurement 187:110211CrossRef
28.
go back to reference Yu X, Lyu W, Zhou D, Wang C, Xu W (2022) ES-Net: Efficient scale-aware network for tiny defect detection. IEEE Trans Instrum Meas 71:1–14 Yu X, Lyu W, Zhou D, Wang C, Xu W (2022) ES-Net: Efficient scale-aware network for tiny defect detection. IEEE Trans Instrum Meas 71:1–14
29.
go back to reference Wang W, Mi C, Wu Z, Lu K, Long H, Pan B, Li D, Zhang J, Chen P, Wang B (2022) A real-time steel surface defect detection approach with high accuracy. IEEE Trans Instrum Meas 71:1–10CrossRef Wang W, Mi C, Wu Z, Lu K, Long H, Pan B, Li D, Zhang J, Chen P, Wang B (2022) A real-time steel surface defect detection approach with high accuracy. IEEE Trans Instrum Meas 71:1–10CrossRef
30.
go back to reference Guo Z, Wang C, Yang G, Huang Z, Li G (2022) MSFT-YOLO: improved YOLOv5 based on transformer for detecting defects of steel surface. Sensors 22(9):3467CrossRef Guo Z, Wang C, Yang G, Huang Z, Li G (2022) MSFT-YOLO: improved YOLOv5 based on transformer for detecting defects of steel surface. Sensors 22(9):3467CrossRef
31.
go back to reference Wang Y, Wang H, Xin Z (2022) Efficient detection model of steel strip surface defects based on YOLO-V7. IEEE Access 10:133936–133944CrossRef Wang Y, Wang H, Xin Z (2022) Efficient detection model of steel strip surface defects based on YOLO-V7. IEEE Access 10:133936–133944CrossRef
32.
go back to reference Zhou X, Wei M, Li Q, Fu Y, Gan Y, Liu H, Ruan J, Liang J (2023) Surface defect detection of steel strip with double pyramid network. Appl Sci 13(2):1054CrossRef Zhou X, Wei M, Li Q, Fu Y, Gan Y, Liu H, Ruan J, Liang J (2023) Surface defect detection of steel strip with double pyramid network. Appl Sci 13(2):1054CrossRef
33.
go back to reference Liu R, Huang M, Gao Z, Cao Z, Cao P (2023) MSC-DNet: an efficient detector with multi-scale context for defect detection on strip steel surface. Measurement 209:112467CrossRef Liu R, Huang M, Gao Z, Cao Z, Cao P (2023) MSC-DNet: an efficient detector with multi-scale context for defect detection on strip steel surface. Measurement 209:112467CrossRef
34.
go back to reference Chen H, Du Y, Fu Y, Zhu J, Zeng H (2023) DCAM-Net: a rapid detection network for strip steel surface defects based on deformable convolution and attention mechanism. IEEE Trans Instrum Meas 72:1–12 Chen H, Du Y, Fu Y, Zhu J, Zeng H (2023) DCAM-Net: a rapid detection network for strip steel surface defects based on deformable convolution and attention mechanism. IEEE Trans Instrum Meas 72:1–12
35.
go back to reference Zhang Y, Zhang H, Huang Q, Han Y, Zhao M (2024) DsP-YOLO: an anchor-free network with DsPAN for small object detection of multiscale defects. Expert Syst Appl 241:122669CrossRef Zhang Y, Zhang H, Huang Q, Han Y, Zhao M (2024) DsP-YOLO: an anchor-free network with DsPAN for small object detection of multiscale defects. Expert Syst Appl 241:122669CrossRef
36.
go back to reference Zhang Y-F, Ren W, Zhang Z, Jia Z, Wang L, Tan T (2022) Focal and efficient IOU loss for accurate bounding box regression. Neurocomputing 506:146–157CrossRef Zhang Y-F, Ren W, Zhang Z, Jia Z, Wang L, Tan T (2022) Focal and efficient IOU loss for accurate bounding box regression. Neurocomputing 506:146–157CrossRef
37.
go back to reference Song K, Yan Y (2013) A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects. Appl Surf Sci 285:858–864CrossRef Song K, Yan Y (2013) A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects. Appl Surf Sci 285:858–864CrossRef
38.
go back to reference Hou Q, Zhou D, Feng J (2021) Coordinate attention for efficient mobile network design. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13713–13722 Hou Q, Zhou D, Feng J (2021) Coordinate attention for efficient mobile network design. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13713–13722
39.
go back to reference Li D, Hu J, Wang C, Li X, She Q, Zhu L, Zhang T, Chen Q (2021) Involution: inverting the inherence of convolution for visual recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 12321–12330 Li D, Hu J, Wang C, Li X, She Q, Zhu L, Zhang T, Chen Q (2021) Involution: inverting the inherence of convolution for visual recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 12321–12330
40.
go back to reference Sunkara R, Luo T (2022) No more strided convolutions or pooling: a new CNN building block for low-resolution images and small objects. arXiv:2208.03641 Sunkara R, Luo T (2022) No more strided convolutions or pooling: a new CNN building block for low-resolution images and small objects. arXiv:​2208.​03641
41.
go back to reference Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141 Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141
42.
go back to reference Woo S, Park J, Lee J-Y, Kweon IS (2018) CBAM: convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp 3–19 Woo S, Park J, Lee J-Y, Kweon IS (2018) CBAM: convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp 3–19
43.
go back to reference Wang Q, Wu B, Zhu P, Li P, Zuo W, Hu Q (2020) ECA-net: efficient channel attention for deep convolutional neural networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 11534–11542 Wang Q, Wu B, Zhu P, Li P, Zuo W, Hu Q (2020) ECA-net: efficient channel attention for deep convolutional neural networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 11534–11542
Metadata
Title
CABF-YOLO: a precise and efficient deep learning method for defect detection on strip steel surface
Authors
Qiqi Zhou
Haichao Wang
Publication date
01-06-2024
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 2/2024
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-024-01252-5

Other articles of this Issue 2/2024

Pattern Analysis and Applications 2/2024 Go to the issue

Premium Partner