Top

Published in:

2021 | OriginalPaper | Chapter

Statistical Precision-Recall Curves for Object Detection Algorithms Performance Measurement

Author : Anna A. Kuznetsova

Published in: Cyber-Physical Systems: Modelling and Intelligent Control

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

A statistical approach to the construction of Precision-Recall curves is proposed for analyzing the quality of algorithms for detecting objects in images. Statistical Precision-Recall curves, unlike traditional ones, are guaranteed to be monotonously non-increasing. At the same time, the statistical average accuracy of object detection algorithms on small test data sets turns out to be less than the traditional average accuracy. On relatively large test image sets, these differences are smoothed out.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Functional Model for the Formation of Individual Metal Control Programs of Boiler Equipment

next chapter YOLOv5 versus YOLOv3 for Apple Detection

Kent, A., Berry, M.M., Luehrs Jr., F.U., Perry, J.W.: Machine literature searching VIII. Operational criteria for designing information retrieval systems. Am. Doc. 6(2), 93–101 (1955). https://doi.org/10.1002/asi.5090060209

COCO: Common Objects in Context Dataset. https://cocodataset.org/#overview (2017). Accessed 10 July 2020

Chen, Z., Huang, S., Tao, D.: Context refinement for object detection. Lect. Notes Comput. Sci. 11212, 74–89 (2018). https://doi.org/10.1007/978-3-030-01237-3_5CrossRef

Lu, X., Li, B., Yue, Y., Li, Q., Yan, J.: Grid R-CNN plus: Faster and better. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition—CVPR 2019, pp. 7355–7364. Long Beach, CA, USA, 16–20 June 2019. https://arxiv.org/abs/1906.05688

Cheng, B., Wei, Y., Shi, H., Feris, R., Xiong, J., Huang, T.: Revisiting RCNN: on awakening the classification power of faster RCNN. Lect. Notes Comput. Sci. 11219, 473–490 (2018). https://doi.org/10.1007/978-3-030-01267-0_28CrossRef

Singh, B., M. Najibi, M., Davis, L.S.: SNIPER: Efficient multi-scale training. In: Proceedings of the 32nd Conference on Neural Information Processing Systems—NeurIPS 2018, pp. 1–11. Montréal, Canada, 2–8 December 2018. https://arxiv.org/abs/1805.09300

Singh, B., Davis, L.S.: An analysis of scale invariance in object detection—SNIP. In: Proceedings of the 31st IEEE Conference on Computer Vision and Pattern Recognition—CVPR 2018, pp. 3578–3587. Salt Lake City, UT, USA, 18–22 June 2018. https://arxiv.org/abs/1711.08189

Li, Y., Chen, Y., Wang, N., and Zhang, Z.: Scale-aware trident networks for object detection. In: Proceedings of the IEEE International Conference on Computer Vision—ICCV2019, pp. 6053–6062. Seoul, South Korea, 27 October—2 November 2019. https://arxiv.org/abs/1901.01892

Zhou, X., Zhuo, J., Krähenbühl, P.: Bottom-up object detection by grouping extreme and center points. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition—CVPR 2019, pp. 850–859. Long Beach, CA, USA, 16–20 June 2019. https://arxiv.org/abs/1906.05688

10.

Redmon, J., Divvala, S., Girshick, R. Farhadi, A.: YOLOv3: an incremental improvement. In: Proceedings of the 31st IEEE Conference on Computer Vision and Pattern Recognition—CVPR 2018, pp. 1–6. Salt Lake City, UT, USA, 18–22 June 2018. https://arxiv.org/abs/1804.02767

11.

Lin Ts.-Y., Goyal P., Girshick R., He, K., Dollar P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision—ICCV 2017, pp. 2980–2988. Venice, Italy, 22–29 October 2017. https://arxiv.org/abs/1708.02002

12.

Zhou, X., Wang, D., Krähenbühl, P.: Objects as points. https://arxiv.org/abs/1904.07850 (2019)

13.

Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., Tian, Q.: CenterNet: keypoint triplets for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition—CVPR 2019, pp. 6569–6578. Long Beach, CA, USA, 16–20 June 2019. https://arxiv.org/abs/1904.08189

14.

Zhu, Ch., He, Y., Savvides, M.: Feature selective anchor-free module for single-shot object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition—CVPR 2019, pp. 840–849. Long Beach, CA, USA, 16–20 June 2019. https://arxiv.org/abs/1903.00621

15.

Bochkovskiy, A., Wang, Ch.-Y., Liao, H.-Yu.M.: YOLOv4: optimal speed and accuracy of object detection. https://arxiv.org/abs/2004.10934 (2020). Accessed 10 July 2020

16.

Jocher, G., Nishimura, K., Mineeva, T., Vilariño, R.: YOLOv5. https://github.com/ultralytics/yolov5 (2020). Accessed 10 July 2020

17.

Tan, M., Pang, R., Le, Q.V.: EfficientDet: Scalable and efficient object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition—CVPR 2020 pp. 10781–10790. Virtual, 14–19 June 2020. https://arxiv.org/abs/1901.08043

18.

Fawcett, T.: An introduction to ROC analysis. Pattern Recogn. Lett. 27(8), 861–874 (2006). https://doi.org/10.1016/j.patrec.2005.10.010MathSciNetCrossRef

19.

Kuznetsova, A., Maleva, T., Soloviev, V.: Using YOLOv3 algorithm with pre- and post-processing for apple detection in fruit-harvesting robot. Agronomy 10(7), 1016 (2020). https://doi.org/10.3390/agronomy10071016CrossRef

20.

Kuznetsova, A., Maleva, T., Soloviev, V.: Detecting apples in orchards using YOLOv3. In: Gervasi, O., et al. (eds.) ICCSA 2020. LNCS, vol. 12249, pp. 923–934. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58799-4_66

Title: Statistical Precision-Recall Curves for Object Detection Algorithms Performance Measurement
Author: Anna A. Kuznetsova
Publisher: Springer International Publishing
Book: Cyber-Physical Systems: Modelling and Intelligent Control
Print ISBN: 978-3-030-66076-5

Electronic ISBN: 978-3-030-66077-2

Copyright Year: 2021
DOI: https://doi.org/10.1007/978-3-030-66077-2_27

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner