Skip to main content
Erschienen in: Pattern Analysis and Applications 2/2024

01.06.2024 | Original Paper

CABF-YOLO: a precise and efficient deep learning method for defect detection on strip steel surface

verfasst von: Qiqi Zhou, Haichao Wang

Erschienen in: Pattern Analysis and Applications | Ausgabe 2/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Deep learning algorithms have gained widespread usage in defect detection systems. However, existing methods are not satisfied for large-scale applications on surface defect detection of strip steel. In this paper, we propose a precise and efficient detection model, named CABF-YOLO, based on the YOLOX for strip steel surface defects. Firstly, we introduce the Triplet Convolutional Coordinate Attention (TCCA) module in the backbone of the YOLOX. By factorizing the pooling operation, the TCCA module can accurately capture cross-channel features to identify the location information of defects. Secondly, we design a novel Bidirectional Fusion (BF) strategy in the neck of the YOLOX. The BF strategy enhances the fusion of low-level and high-level semantic information to obtain fine-grained information. Lastly, the original bounding box loss function is replaced by the EIoU loss function. In the EIoU loss function, the penalty term is redefined to consider the overlap area, central point, and side length of the required regressions to accelerate the convergence rate and localization accuracy. On the benchmark NEU-DET dataset and GC10-DET dataset, the experimental results show that the CABF-YOLO achieves superior performance compared with other comparison models and satisfies the real-time detection requirement of industrial production.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Yu J, Cheng X, Li Q (2022) Surface defect detection of steel strips based on anchor-free network with channel attention and bidirectional feature fusion. IEEE Trans Instrum Meas 71:1–10 Yu J, Cheng X, Li Q (2022) Surface defect detection of steel strips based on anchor-free network with channel attention and bidirectional feature fusion. IEEE Trans Instrum Meas 71:1–10
2.
Zurück zum Zitat Luo Q, Fang X, Sun Y, Liu L, Ai J, Yang C, Simpson O (2019) Surface defect classification for hot-rolled steel strips by selectively dominant local binary patterns. IEEE Access 7:23488–23499CrossRef Luo Q, Fang X, Sun Y, Liu L, Ai J, Yang C, Simpson O (2019) Surface defect classification for hot-rolled steel strips by selectively dominant local binary patterns. IEEE Access 7:23488–23499CrossRef
3.
Zurück zum Zitat Hou Z, Parker JM (2005) Texture defect detection using support vector machines with adaptive Gabor wavelet features. In: 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION’05), vol 1, pp 275–280 Hou Z, Parker JM (2005) Texture defect detection using support vector machines with adaptive Gabor wavelet features. In: 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION’05), vol 1, pp 275–280
4.
Zurück zum Zitat Ghorai S, Mukherjee A, Gangadaran M, Dutta PK (2012) Automatic defect detection on hot-rolled flat steel products. IEEE Trans Instrum Meas 62(3):612–621CrossRef Ghorai S, Mukherjee A, Gangadaran M, Dutta PK (2012) Automatic defect detection on hot-rolled flat steel products. IEEE Trans Instrum Meas 62(3):612–621CrossRef
5.
Zurück zum Zitat Xu K, Ai Y-H, Wu X-Y (2013) Application of multi-scale feature extraction to surface defect classification of hot-rolled steels. Int J Miner Metall Mater 20:37–41CrossRef Xu K, Ai Y-H, Wu X-Y (2013) Application of multi-scale feature extraction to surface defect classification of hot-rolled steels. Int J Miner Metall Mater 20:37–41CrossRef
6.
Zurück zum Zitat Pernkopf F (2004) Detection of surface defects on raw steel blocks using Bayesian network classifiers. Pattern Anal Appl 7:333–342MathSciNetCrossRef Pernkopf F (2004) Detection of surface defects on raw steel blocks using Bayesian network classifiers. Pattern Anal Appl 7:333–342MathSciNetCrossRef
7.
Zurück zum Zitat Xue-Wu Z, Yan-Qiong D, Yan-Yun L, Ai-Ye S, Rui-Yu L (2011) A vision inspection system for the surface defects of strongly reflected metal based on multi-class SVM. Expert Syst Appl 38(5):5930–5939CrossRef Xue-Wu Z, Yan-Qiong D, Yan-Yun L, Ai-Ye S, Rui-Yu L (2011) A vision inspection system for the surface defects of strongly reflected metal based on multi-class SVM. Expert Syst Appl 38(5):5930–5939CrossRef
8.
Zurück zum Zitat Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–587 Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–587
9.
Zurück zum Zitat Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448 Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448
10.
Zurück zum Zitat Ren S, He K, Girshick R, Sun J, Faster R-CNN: towards real-time object detection with region proposal networks. Adv Neural Inf Processing Syst 28 Ren S, He K, Girshick R, Sun J, Faster R-CNN: towards real-time object detection with region proposal networks. Adv Neural Inf Processing Syst 28
11.
Zurück zum Zitat Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788 Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788
12.
Zurück zum Zitat Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7263–7271 Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7263–7271
13.
Zurück zum Zitat Lin T-Y, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980–2988 Lin T-Y, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980–2988
14.
Zurück zum Zitat Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2117–2125 Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2117–2125
19.
Zurück zum Zitat Li C, Li L, Jiang H, Weng K, Geng Y, Li L, Ke Z, Li Q, Cheng M, Nie W et al (2022) Yolov6: a single-stage object detection framework for industrial applications. arXiv:2209.02976 Li C, Li L, Jiang H, Weng K, Geng Y, Li L, Ke Z, Li Q, Cheng M, Nie W et al (2022) Yolov6: a single-stage object detection framework for industrial applications. arXiv:​2209.​02976
20.
Zurück zum Zitat Ding X, Zhang X, Ma N, Han J, Ding G, Sun J (2021) RepVGG: making VGG-style convnets great again. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13733–13742 Ding X, Zhang X, Ma N, Han J, Ding G, Sun J (2021) RepVGG: making VGG-style convnets great again. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13733–13742
21.
Zurück zum Zitat Wang C-Y, Bochkovskiy A, Liao H-YM (2023) Yolov7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 7464–7475 Wang C-Y, Bochkovskiy A, Liao H-YM (2023) Yolov7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 7464–7475
23.
Zurück zum Zitat He Y, Song K, Meng Q, Yan Y (2019) An end-to-end steel surface defect detection approach via fusing multiple hierarchical features. IEEE Trans Instrum Meas 69(4):1493–1504CrossRef He Y, Song K, Meng Q, Yan Y (2019) An end-to-end steel surface defect detection approach via fusing multiple hierarchical features. IEEE Trans Instrum Meas 69(4):1493–1504CrossRef
24.
Zurück zum Zitat Lv X, Duan F, Jiang J-J, Fu X, Gan L (2020) Deep metallic surface defect detection: the new benchmark and detection network. Sensors 20(6):1562CrossRef Lv X, Duan F, Jiang J-J, Fu X, Gan L (2020) Deep metallic surface defect detection: the new benchmark and detection network. Sensors 20(6):1562CrossRef
25.
Zurück zum Zitat Kou X, Liu S, Cheng K, Qian Y (2021) Development of a YOLO-V3-based model for detecting defects on steel strip surface. Measurement 182:109454CrossRef Kou X, Liu S, Cheng K, Qian Y (2021) Development of a YOLO-V3-based model for detecting defects on steel strip surface. Measurement 182:109454CrossRef
26.
Zurück zum Zitat Zhao W, Chen F, Huang H, Li D, Cheng W (2021) A new steel defect detection algorithm based on deep learning. Comput Intell Neurosci 2021:1–13 Zhao W, Chen F, Huang H, Li D, Cheng W (2021) A new steel defect detection algorithm based on deep learning. Comput Intell Neurosci 2021:1–13
27.
Zurück zum Zitat Tian R, Jia M (2022) DCC-CenterNet: a rapid detection method for steel surface defects. Measurement 187:110211CrossRef Tian R, Jia M (2022) DCC-CenterNet: a rapid detection method for steel surface defects. Measurement 187:110211CrossRef
28.
Zurück zum Zitat Yu X, Lyu W, Zhou D, Wang C, Xu W (2022) ES-Net: Efficient scale-aware network for tiny defect detection. IEEE Trans Instrum Meas 71:1–14 Yu X, Lyu W, Zhou D, Wang C, Xu W (2022) ES-Net: Efficient scale-aware network for tiny defect detection. IEEE Trans Instrum Meas 71:1–14
29.
Zurück zum Zitat Wang W, Mi C, Wu Z, Lu K, Long H, Pan B, Li D, Zhang J, Chen P, Wang B (2022) A real-time steel surface defect detection approach with high accuracy. IEEE Trans Instrum Meas 71:1–10CrossRef Wang W, Mi C, Wu Z, Lu K, Long H, Pan B, Li D, Zhang J, Chen P, Wang B (2022) A real-time steel surface defect detection approach with high accuracy. IEEE Trans Instrum Meas 71:1–10CrossRef
30.
Zurück zum Zitat Guo Z, Wang C, Yang G, Huang Z, Li G (2022) MSFT-YOLO: improved YOLOv5 based on transformer for detecting defects of steel surface. Sensors 22(9):3467CrossRef Guo Z, Wang C, Yang G, Huang Z, Li G (2022) MSFT-YOLO: improved YOLOv5 based on transformer for detecting defects of steel surface. Sensors 22(9):3467CrossRef
31.
Zurück zum Zitat Wang Y, Wang H, Xin Z (2022) Efficient detection model of steel strip surface defects based on YOLO-V7. IEEE Access 10:133936–133944CrossRef Wang Y, Wang H, Xin Z (2022) Efficient detection model of steel strip surface defects based on YOLO-V7. IEEE Access 10:133936–133944CrossRef
32.
Zurück zum Zitat Zhou X, Wei M, Li Q, Fu Y, Gan Y, Liu H, Ruan J, Liang J (2023) Surface defect detection of steel strip with double pyramid network. Appl Sci 13(2):1054CrossRef Zhou X, Wei M, Li Q, Fu Y, Gan Y, Liu H, Ruan J, Liang J (2023) Surface defect detection of steel strip with double pyramid network. Appl Sci 13(2):1054CrossRef
33.
Zurück zum Zitat Liu R, Huang M, Gao Z, Cao Z, Cao P (2023) MSC-DNet: an efficient detector with multi-scale context for defect detection on strip steel surface. Measurement 209:112467CrossRef Liu R, Huang M, Gao Z, Cao Z, Cao P (2023) MSC-DNet: an efficient detector with multi-scale context for defect detection on strip steel surface. Measurement 209:112467CrossRef
34.
Zurück zum Zitat Chen H, Du Y, Fu Y, Zhu J, Zeng H (2023) DCAM-Net: a rapid detection network for strip steel surface defects based on deformable convolution and attention mechanism. IEEE Trans Instrum Meas 72:1–12 Chen H, Du Y, Fu Y, Zhu J, Zeng H (2023) DCAM-Net: a rapid detection network for strip steel surface defects based on deformable convolution and attention mechanism. IEEE Trans Instrum Meas 72:1–12
35.
Zurück zum Zitat Zhang Y, Zhang H, Huang Q, Han Y, Zhao M (2024) DsP-YOLO: an anchor-free network with DsPAN for small object detection of multiscale defects. Expert Syst Appl 241:122669CrossRef Zhang Y, Zhang H, Huang Q, Han Y, Zhao M (2024) DsP-YOLO: an anchor-free network with DsPAN for small object detection of multiscale defects. Expert Syst Appl 241:122669CrossRef
36.
Zurück zum Zitat Zhang Y-F, Ren W, Zhang Z, Jia Z, Wang L, Tan T (2022) Focal and efficient IOU loss for accurate bounding box regression. Neurocomputing 506:146–157CrossRef Zhang Y-F, Ren W, Zhang Z, Jia Z, Wang L, Tan T (2022) Focal and efficient IOU loss for accurate bounding box regression. Neurocomputing 506:146–157CrossRef
37.
Zurück zum Zitat Song K, Yan Y (2013) A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects. Appl Surf Sci 285:858–864CrossRef Song K, Yan Y (2013) A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects. Appl Surf Sci 285:858–864CrossRef
38.
Zurück zum Zitat Hou Q, Zhou D, Feng J (2021) Coordinate attention for efficient mobile network design. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13713–13722 Hou Q, Zhou D, Feng J (2021) Coordinate attention for efficient mobile network design. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13713–13722
39.
Zurück zum Zitat Li D, Hu J, Wang C, Li X, She Q, Zhu L, Zhang T, Chen Q (2021) Involution: inverting the inherence of convolution for visual recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 12321–12330 Li D, Hu J, Wang C, Li X, She Q, Zhu L, Zhang T, Chen Q (2021) Involution: inverting the inherence of convolution for visual recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 12321–12330
40.
Zurück zum Zitat Sunkara R, Luo T (2022) No more strided convolutions or pooling: a new CNN building block for low-resolution images and small objects. arXiv:2208.03641 Sunkara R, Luo T (2022) No more strided convolutions or pooling: a new CNN building block for low-resolution images and small objects. arXiv:​2208.​03641
41.
Zurück zum Zitat Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141 Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141
42.
Zurück zum Zitat Woo S, Park J, Lee J-Y, Kweon IS (2018) CBAM: convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp 3–19 Woo S, Park J, Lee J-Y, Kweon IS (2018) CBAM: convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp 3–19
43.
Zurück zum Zitat Wang Q, Wu B, Zhu P, Li P, Zuo W, Hu Q (2020) ECA-net: efficient channel attention for deep convolutional neural networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 11534–11542 Wang Q, Wu B, Zhu P, Li P, Zuo W, Hu Q (2020) ECA-net: efficient channel attention for deep convolutional neural networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 11534–11542
Metadaten
Titel
CABF-YOLO: a precise and efficient deep learning method for defect detection on strip steel surface
verfasst von
Qiqi Zhou
Haichao Wang
Publikationsdatum
01.06.2024
Verlag
Springer London
Erschienen in
Pattern Analysis and Applications / Ausgabe 2/2024
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-024-01252-5

Weitere Artikel der Ausgabe 2/2024

Pattern Analysis and Applications 2/2024 Zur Ausgabe

Premium Partner