Top

The Journal of Supercomputing

Published in:

20-04-2024

SPD-YOLOv8: an small-size object detection model of UAV imagery in complex scene

Authors: Rui Zhong, Ende Peng, Ziqiang Li, Qing Ai, Tao Han, Yong Tang

Published in: The Journal of Supercomputing | Issue 12/2024

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Traditional camera sensors rely on human observation. However, in complex scenes, people often experience fatigue when observing objects of various sizes. Moreover, human cognitive abilities have inherent limitations, leading to potential judgment errors. To overcome these challenges, object recognition technology, a pivotal means of categorizing objects captured by camera sensors is introduced. This paper presents a specialized small-size object detection algorithm designed for unique scenarios. This algorithm offers distinct advantages, including enhanced accuracy in detecting small-size objects and improved detection performance for objects of various sizes. The main innovations in this paper include the following three points. Firstly, summarizing a small-size object detection layer and reconfiguring both the feature extraction network and the feature fusion network to enhance the effectiveness of capturing small-size objects. Secondly, SPD-Conv modules are introduced to replace stride convolutions and pooling layers to improve the detection accuracy of small objects. Finally, employing the MPDIoU loss function to enhance the precision of bounding box fitting. In our experiments. We utilized authoritative official datasets. The experimental results on the Visdrone dataset demonstrate a 10.9% increase in mAP0.5 and a 9.3% increase in mAP0.5:0.95 rates compared to the original YOLOv8s. This model not only meets the accuracy requirements but also accounts for the lightweight demands when deployed on embedded devices.

previous article Unilateral protection scheme for N-qubit GHZ states against decoherence: a resource-efficient approach

next article FCNet: a deep neural network based on multi-channel feature cascading for image denoising

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Lou H, Duan X, Guo J, Liu H, Guo J, Liu H et al (2023) DC-YOLOv8: small-size object detection algorithm based on camera sensor. Electronics 12(10):2323. https://doi.org/10.3390/electronics12102323CrossRef

Zou M, Yu J, Lv Y, Lu B, Chi W, Sun L (2023) A novel day-to-night obstacle detection method for excavators based on image enhancement and multisensor fusion. IEEE Sens J 23(10):10825–10835. https://doi.org/10.1109/JSEN.2023.3254588CrossRef

Liu H, Li L (2023) Anomaly detection of high-frequency sensing data in transportation infrastructure monitoring system based on fine-tuned model. IEEE Sens J 23(8):8630–8638. https://doi.org/10.1109/JSEN.2023.3254506CrossRef

Guo J, Liu X, Bi L, Liu H, Lou H (2023) UN-YOLOv5s: a UAV-based aerial photography detection algorithm. Sensors 23(13):5907. https://doi.org/10.3390/s23135907CrossRef

Liu H, Yu Y, Liu S, Wang W (2022) A military object detection model of UAV reconnaissance image and feature visualization. Appl Sci 12(23):12236. https://doi.org/10.3390/app122312236CrossRef

Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp 1440–1448

Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: toward real-time object detection with region proposal networks. IEEE T Pattern Anal 39(6):1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031CrossRef

He K, Gkioxari G, Dollar P, Girshick R (2017) Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp 2961–2969

Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 779–788 https://doi.org/10.1109/CVPR.2016.91

10.

Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 6517–6525. https://doi.org/10.1109/CVPR.2017.690

11.

Redmon J, Farhadi A (2018) YOLOv3: an incremental improvement. arXiv preprint arXiv:1804.02767https://doi.org/10.48550/arXiv.1804.02767

12.

Bochkovskiy A, Wang C-Y, Liao H-YM (2020) YOLOv4: optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934https://doi.org/10.48550/arXiv.2004.10934

13.

Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C-Y, Berg AC (2016) SSD: single shot multibox detector. In: Computer Vision-ECCV 2016 (ECCV), pp 21–37

14.

Liu H, Duan X, Chen H, Lou H, Deng L (2023) DBF-YOLO: UAV small targets detection based on shallow feature fusion. IEEJ T Electr Electr 18(4):605–612. https://doi.org/10.1002/tee.23758CrossRef

15.

Liu H, Sun F, Gu J, Deng L (2022) SF-YOLOv5: a lightweight small object detection algorithm based on improved feature fusion mode. Sensors 22(15):5817. https://doi.org/10.3390/s22155817CrossRef

16.

Wang F, Wang H, Qin Z, Tang J (2023) UAV target detection algorithm based on improved YOLOv8. IEEE Access 11:116534–116544. https://doi.org/10.1109/ACCESS.2023.3325677CrossRef

17.

Zhang Y, Zhang H, Huang Q, Han Y, Zhao M (2024) DsP-YOLO: an anchor-free network with DsPAN for small object detection of multiscale defects. Expert Syst Appl 241:122669. https://doi.org/10.1016/j.eswa.2023.122669CrossRef

18.

Li J, Yuan C, Wang X (2023) Real-time instance-level detection of asphalt pavement distress combining space-to-depth (SPD) YOLO and omni-scale network (OSNet). Automat Constr 155:105062. https://doi.org/10.1016/j.autcon.2023.105062CrossRef

19.

Ao Z, Wan F, Lei G, Ong Y, Xu L, Ye Z et al (2023) FL-YOLOv7: a lightweight small object detection algorithm in forest fire detection. Forests 14(9):1812. https://doi.org/10.3390/f14091812CrossRef

20.

Chen S, Cheng T, Fang J, Zhang Q, Li Y, Liu W, Wang X. (2023) TinyDet: accurate small object detection in lightweight generic detectors. arXiv preprint arXiv: 2304.03428 https://doi.org/10.48550/arXiv.2304.03428

21.

Ma M, Pang H (2023) SP-YOLOv8s: an improved YOLOv8s model for remote sensing image tiny object detection. Appl Sci 13(14):8161. https://doi.org/10.3390/app13148161CrossRef

22.

Li A, Sun S, Zhang Z, Feng M, Wu C, Li W (2023) A multi-scale traffic object detection algorithm for road scenes based on improved YOLOv5. Electronics 12(4):878. https://doi.org/10.3390/electronics12040878CrossRef

23.

Han Y, Wang F, Wang W, Li A, Zhang J (2024) YOLO-SG: small traffic signs detection method in complex scene. J Supercomput 80:2025–2046. https://doi.org/10.1007/s11227-023-05547-yCrossRef

24.

Zhang J, Wan G, Jiang M, Lu G, Tao X, Huang Z (2023) Small object detection in UAV image based on improved YOLOv5. Syst Sci Control Eng 11(1):2247082. https://doi.org/10.1080/21642583.2023.2247082CrossRef

25.

Zhai X, Huang Z, Li T, Liu H, Wang S (2023) YOLO-Drone: an optimized YOLOv8 network for tiny UAV object detection. Electronics 12(17):3664. https://doi.org/10.3390/electronics12173664CrossRef

26.

Siliang M, Yong X (2023) MPDIoU: a loss for efficient and accurate bounding box regression. arXiv preprint arXiv:2307.07662https://doi.org/10.48550/arXiv.2307.07662

27.

Wang C-Y, Bochkovskiy A, Liao H-YM (2023) YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 7464–7475

28.

Wang C-Y, Liao H-YM, Wu Y-H, Chen P-Y, Hsieh J-W, Yeh I-H (2020) CSPNet: a new backbone that can enhance learning capability of CNN. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 390–391

29.

Zhang S, Chi C, Yao Y, Lei Z, Li SZ (2020) Bridging the gap between anchor-based and anchor-free detection via adaptive training sample selection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 9759–9768

30.

Zheng Z, Wang P, Ren D, Liu W, Ye R, Hu Q, Zuo W (2022) Enhancing geometric factors in model learning and inference for object detection and instance segmentation. IEEE T Cybern 52(8):8574–8586. https://doi.org/10.1109/TCYB.2021.3095305CrossRef

31.

Li H, Xiong P, An J, Wang L (2018) Pyramid attention network for semantic segmentation. arXiv preprint arXiv:1805.10180https://doi.org/10.48550/arXiv.1805.10180

32.

Lin T-Y, Dollar P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 2117–2125

33.

Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T et al (2017) MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861https://doi.org/10.48550/arXiv.1704.04861

34.

Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC (2018) MobileNetV2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 4510–4520

35.

Howard A, Sandler M, Chu G, Chen L-C, Chen B, Tan M et al (2019) Searching for MobileNetV3. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp 1314–1324

36.

Wang L, Guo S, Huang W, Qiao Y (2015) Places205-VGGNet models for scene recognition. arXiv preprint arXiv:1508.01667https://doi.org/10.48550/arXiv.1508.01667

37.

Xu Y, Xie L, Xie C, Dai W, Mei J, Qiao S et al (2023) BNET: batch normalization with enhanced linear transformation. IEEE T Pattern Anal 45(7):9225–9232. https://doi.org/10.1109/TPAMI.2023.3235369CrossRef

38.

Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90. https://doi.org/10.1145/3065386CrossRef

39.

Du D, Zhu P, Wen L, Bian X, Lin H, Hu Q et al (2019) VisDrone-DET2019: the vision meets drone object detection in image challenge results. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp 0–0

40.

Zhu P, Wen L, Du D, Bian X, Ling H, Hu Q et al (2018) VisDrone-DET2018: the vision meets drone object detection in image challenge results. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 0–0

41.

Cao Y, He Z, Wang L, Wang W, Yuan Y, Zhang D et al (2021) VisDrone-DET2021: the vision meets drone object detection challenge results. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp 2847–2854

42.

Wen L, Du D, Cai Z, Lei Z, Chang M-C, Qi H et al (2020) UA-DETRAC: a new benchmark and protocol for multi-object detection and tracking. Comput Vis Image Und 193:102907. https://doi.org/10.1016/j.cviu.2020.102907CrossRef

43.

Lyu S, Chang M-C, Du D, Wen L, Qi H, Li Y et al (2017) UA-DETRAC 2017: report of AVSS2017 & IWT4S challenge on advanced traffic monitoring. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp 1–7. https://doi.org/10.1109/AVSS.2017.8078560

Title: SPD-YOLOv8: an small-size object detection model of UAV imagery in complex scene
Authors: Rui Zhong
Ende Peng
Ziqiang Li
Qing Ai
Tao Han
Yong Tang
Publication date: 20-04-2024
Publisher: Springer US
Published in: The Journal of Supercomputing / Issue 12/2024
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI: https://doi.org/10.1007/s11227-024-06121-w

Springer Professional

SPD-YOLOv8: an small-size object detection model of UAV imagery in complex scene

Abstract

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Other articles of this Issue 12/2024

A learning-based efficient query model for blockchain in internet of medical things

FGCF: fault-aware green computing framework in software-defined social internet of vehicle

TS-Finder: privacy enhanced web crawler detection model using temporal–spatial access behaviors

A supervised active learning method for identifying critical nodes in IoT networks

Qsmix: Q-learning-based task scheduling approach for mixed-critical applications on heterogeneous multi-cores

LGAFormer: transformer with local and global attention for action detection

Premium Partner

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

A learning-based efficient query model for blockchain in internet of medical things

FGCF: fault-aware green computing framework in software-defined social internet of vehicle

TS-Finder: privacy enhanced web crawler detection model using temporal–spatial access behaviors

A supervised active learning method for identifying critical nodes in IoT networks

Qsmix: Q-learning-based task scheduling approach for mixed-critical applications on heterogeneous multi-cores

LGAFormer: transformer with local and global attention for action detection