Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 8/2023

11-03-2023 | Original Article

An adaptive focused target feature fusion network for detection of foreign bodies in coal flow

Authors: Tao Ye, Zhikang Zheng, Yunwang Li, Xi Zhang, Xiangpeng Deng, Yu Ouyang, Zongyang Zhao, Xiaozhi Gao

Published in: International Journal of Machine Learning and Cybernetics | Issue 8/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In the process of conveying raw coal to the surface on conveyor belts, the raw coal is generally blended with foreign bodies, such as large pieces of gangue and damaged bolts, which can affect the quality of mined coal, damage the transportation equipment and even jam the coal conduit, seriously reducing the coal conveying efficiency. To handle to the existing problems of underground complex environment, low detection accuracy and poor real-time performance in coal flow foreign bodies detection, we propose an adaptive focused target feature fusion network (AFFNet) based on YOLOX. The multi-transformer parallel (MTRP) module is used to expand the receptive field and fuse the features under different receptive fields with the transformer encoder to enhance the feature extraction ability. The cross stage partial transformer (CSPTR) with transformer encoder module is designed to capture the global context information of the feature maps in the network, and improve the location prediction in the detection. In the feature fusion channel of different scales, the learnable weight parameters are added to learn the spatial weight of feature map fusion adaptively, and the feature expression ability of different scales is optimized. SCYLLA-IoU (SIoU) loss and varifocal loss are used to obtain more accurate bounding boxes and deal with the sample category imbalance problem, respectively. The experimental results show that AFFNet can achieve a detection speed of 48 frame per second (FPS) and a mean average precision (mAP50) of 95.6%, 6.7% higher than YOLOX-s on the dataset of foreign body in coal flow. It can balance both the detection speed and detection accuracy, and can be used to improve the efficiency of detecting foreign bodies in the coal flow.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Sun Y-Q, Xiao K, Wang X-D, Lv Z-H, Mao M (2021) Evaluating the distribution and potential ecological risks of heavy metal in coal gangue. Environ Sci Pollut Res 28(15):18604–18615CrossRef Sun Y-Q, Xiao K, Wang X-D, Lv Z-H, Mao M (2021) Evaluating the distribution and potential ecological risks of heavy metal in coal gangue. Environ Sci Pollut Res 28(15):18604–18615CrossRef
2.
go back to reference Li D-Y, Wang G-F, Zhang Y, Wang S (2022) Coal gangue detection and recognition algorithm based on deformable convolution yolov3. IET Image Process 16(1):134–144CrossRef Li D-Y, Wang G-F, Zhang Y, Wang S (2022) Coal gangue detection and recognition algorithm based on deformable convolution yolov3. IET Image Process 16(1):134–144CrossRef
3.
go back to reference Shang D, Zhang L, Niu Y (2022) Design and key technology analysis of coal gangue sorting robot. Coal Sci Technol 50(3):7 Shang D, Zhang L, Niu Y (2022) Design and key technology analysis of coal gangue sorting robot. Coal Sci Technol 50(3):7
4.
go back to reference Zhao Y, Yang X, Luo Z, Duan C, Song S (2014) Progress in developments of dry coal beneficiation. Int J Coal Sci Technol 1(1):103–112CrossRef Zhao Y, Yang X, Luo Z, Duan C, Song S (2014) Progress in developments of dry coal beneficiation. Int J Coal Sci Technol 1(1):103–112CrossRef
5.
go back to reference Guofa W, Feng L, Xiangjun M, Jingdao F, Huaiwei R (2019) Research and practice on intelligent coal mine construction (primary stage). Coal Sci Technol 47(8):1–36 Guofa W, Feng L, Xiangjun M, Jingdao F, Huaiwei R (2019) Research and practice on intelligent coal mine construction (primary stage). Coal Sci Technol 47(8):1–36
6.
go back to reference Luo Y, Zhang B, Lang LL (2021) Technology and realization of coal gangue recognition based on deep learning. Coal Sci Technol 49(12):7 Luo Y, Zhang B, Lang LL (2021) Technology and realization of coal gangue recognition based on deep learning. Coal Sci Technol 49(12):7
9.
go back to reference Zhang H, Wang Y, Dayoub F, Sünderhauf N (2020) Varifocalnet: an iou-aware dense object detector. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Zhang H, Wang Y, Dayoub F, Sünderhauf N (2020) Varifocalnet: an iou-aware dense object detector. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
11.
go back to reference Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly SA (2021) An image is worth 16 \(\times\) 16 words: transformers for image recognition at scale. In: International conference on learning representations Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly SA (2021) An image is worth 16 \(\times\) 16 words: transformers for image recognition at scale. In: International conference on learning representations
12.
go back to reference Tao Y, Jun Z, Zhi-hao Z, Yi Z, Fu-qiang Z, Xiao-zhi G (2022) Fault detection of train mechanical parts using multi-mode aggregation feature enhanced convolution neural network. Int J Mach Learn Cybern 13(6):1781–1794CrossRef Tao Y, Jun Z, Zhi-hao Z, Yi Z, Fu-qiang Z, Xiao-zhi G (2022) Fault detection of train mechanical parts using multi-mode aggregation feature enhanced convolution neural network. Int J Mach Learn Cybern 13(6):1781–1794CrossRef
13.
go back to reference Cheng B, Wei Y, Shi H, Feris R, Xiong J, Huang T (2018) Revisiting rcnn: on awakening the classification power of faster rcnn. In: 2018 European conference on computer vision (ECCV) Cheng B, Wei Y, Shi H, Feris R, Xiong J, Huang T (2018) Revisiting rcnn: on awakening the classification power of faster rcnn. In: 2018 European conference on computer vision (ECCV)
14.
go back to reference Ren S, He K, Girshick R, Sun J (2016) Faster r-cnn: towards real-time object detection with region proposal networks. In: NIPS Ren S, He K, Girshick R, Sun J (2016) Faster r-cnn: towards real-time object detection with region proposal networks. In: NIPS
15.
go back to reference Lin TY, Dollar P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR) Lin TY, Dollar P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR)
16.
go back to reference Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2015) Ssd: single shot multibox detector Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2015) Ssd: single shot multibox detector
17.
go back to reference Jiang P, Ergu D, Liu F, Cai Y, Ma B (2022) A review of yolo algorithm developments. Procedia Comput Sci 199:1066–1073CrossRef Jiang P, Ergu D, Liu F, Cai Y, Ma B (2022) A review of yolo algorithm developments. Procedia Comput Sci 199:1066–1073CrossRef
18.
go back to reference Li C, Li L, Jiang H, Weng K, Geng Y, Li L, Ke Z, Li Q, Cheng M, Nie W et al (2022) Yolov6: a single-stage object detection framework for industrial applications. arXiv preprint arXiv:2209.02976 (2022) Li C, Li L, Jiang H, Weng K, Geng Y, Li L, Ke Z, Li Q, Cheng M, Nie W et al (2022) Yolov6: a single-stage object detection framework for industrial applications. arXiv preprint arXiv:​2209.​02976 (2022)
19.
go back to reference Wang C-Y, Bochkovskiy A, Liao H-YM (2022) Yolov7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv preprint arXiv:2207.02696 Wang C-Y, Bochkovskiy A, Liao H-YM (2022) Yolov7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv preprint arXiv:​2207.​02696
21.
go back to reference Guo Y, Zhongshan YU, Yichang LU (2019) Research on photoelectric intelligent separation technology of coal and gangue based on np-fsvm with the pso algorithm. Coal Sci Technol 47(4):13–19 Guo Y, Zhongshan YU, Yichang LU (2019) Research on photoelectric intelligent separation technology of coal and gangue based on np-fsvm with the pso algorithm. Coal Sci Technol 47(4):13–19
22.
go back to reference Shang D, Wang Y, Yang Z, Wang J, Liu Y (2020) Study on comprehensive calibration and image sieving for coal-gangue separation parallel robot. Appl Sci 10(20):7059CrossRef Shang D, Wang Y, Yang Z, Wang J, Liu Y (2020) Study on comprehensive calibration and image sieving for coal-gangue separation parallel robot. Appl Sci 10(20):7059CrossRef
23.
go back to reference Li M, Duan Y, He X, Yang M (2020) Image positioning and identification method and system for coal and gangue sorting robot. Int J Coal Prep Util 4:1–19 Li M, Duan Y, He X, Yang M (2020) Image positioning and identification method and system for coal and gangue sorting robot. Int J Coal Prep Util 4:1–19
24.
go back to reference Fan Z, Chen N, Huang Y, Zhang L, Li Y (2021) Coal gangue recognition based on support vector machine and multiple features. J Jinan Univ (Nat Sci Ed) 19(3):13–18 Fan Z, Chen N, Huang Y, Zhang L, Li Y (2021) Coal gangue recognition based on support vector machine and multiple features. J Jinan Univ (Nat Sci Ed) 19(3):13–18
25.
go back to reference Sun Z, Huang L, Jia R (2021) Coal and gangue separating robot system based on computer vision. Sensors 21(4):1349CrossRef Sun Z, Huang L, Jia R (2021) Coal and gangue separating robot system based on computer vision. Sensors 21(4):1349CrossRef
26.
go back to reference Han C, Zhu X, Fu L (2021) Improve the recognition of coal gangue based on the fusion of spatial channel attention and residual. J Xi’an Univ Sci Technol 6:1113–1121 Han C, Zhu X, Fu L (2021) Improve the recognition of coal gangue based on the fusion of spatial channel attention and residual. J Xi’an Univ Sci Technol 6:1113–1121
27.
go back to reference Lv Z, Wang W, Xu Z, Zhang K, Lv H (2020) Cascade network for detection of coal and gangue in the production context. Powder Technol 377:361–371CrossRef Lv Z, Wang W, Xu Z, Zhang K, Lv H (2020) Cascade network for detection of coal and gangue in the production context. Powder Technol 377:361–371CrossRef
28.
go back to reference Liu Q, Li J, Li Y, Gao M (2021) Recognition methods for coal and coal gangue based on deep learning. IEEE Access PP(99):1–1CrossRef Liu Q, Li J, Li Y, Gao M (2021) Recognition methods for coal and coal gangue based on deep learning. IEEE Access PP(99):1–1CrossRef
29.
go back to reference He K, Zhang X, Ren S, Sun J (2015) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916CrossRef He K, Zhang X, Ren S, Sun J (2015) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916CrossRef
30.
go back to reference Liu S, Qi L, Qin H, Shi J, Jia J (2018) Path aggregation network for instance segmentation. In: 2018 IEEE/CVF conference on computer vision and pattern recognition (CVPR) Liu S, Qi L, Qin H, Shi J, Jia J (2018) Path aggregation network for instance segmentation. In: 2018 IEEE/CVF conference on computer vision and pattern recognition (CVPR)
32.
go back to reference Lin TY, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell PP(99):2999–3007 Lin TY, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell PP(99):2999–3007
34.
go back to reference Zhu X, Lyu S, Wang X, Zhao Q (2021) Tph-yolov5: improved yolov5 based on transformer prediction head for object detection on drone-captured scenarios. In: 2021 IEEE/CVF international conference on computer vision (ICCV) Zhu X, Lyu S, Wang X, Zhao Q (2021) Tph-yolov5: improved yolov5 based on transformer prediction head for object detection on drone-captured scenarios. In: 2021 IEEE/CVF international conference on computer vision (ICCV)
35.
go back to reference Tian Z, Shen C, Chen H, He T (2020) Fcos: fully convolutional one-stage object detection. In: 2019 IEEE/CVF international conference on computer vision (ICCV) Tian Z, Shen C, Chen H, He T (2020) Fcos: fully convolutional one-stage object detection. In: 2019 IEEE/CVF international conference on computer vision (ICCV)
Metadata
Title
An adaptive focused target feature fusion network for detection of foreign bodies in coal flow
Authors
Tao Ye
Zhikang Zheng
Yunwang Li
Xi Zhang
Xiangpeng Deng
Yu Ouyang
Zongyang Zhao
Xiaozhi Gao
Publication date
11-03-2023
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 8/2023
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-023-01798-6

Other articles of this Issue 8/2023

International Journal of Machine Learning and Cybernetics 8/2023 Go to the issue