Skip to main content
Top

2019 | OriginalPaper | Chapter

Pixel2Field: Single Image Transformation to Physical Field of Sports Videos

Author : Liang Peng

Published in: Advances in Visual Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Locating players on a 2D field plane for sports match is the first step towards developing many types of sports analytics applications. Most existing mechanisms of locating players require them to wear sensors during sports play. Sports games can be easily recorded by cameras with low cost. Current human detection and tracking techniques can be used to locate players in the video, which is typically distorted for panorama view. We propose an end-to-end system named Pixel2Field, which can transform every pixel location into their scaled 2d field image. This is done by first undistorting the image by estimating the distortion coefficients, followed by a homography recovery. Experiments using detected soccer players from a distorted video show the proposed transformation method works well. To the best of knowledge, this is the first end-to-end system that can transform frame pixel location to field location without any human intervention. This unlock a lot of opportunities for developing sports analytics applications.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Alonso, R.A.: Sports telemetry system for collecting performance metrics and data, US Patent 8,289,185, 16 October 2012 Alonso, R.A.: Sports telemetry system for collecting performance metrics and data, US Patent 8,289,185, 16 October 2012
2.
go back to reference Baysal, S., Duygulu, P.: Sentioscope: a soccer player tracking system using model field particles. IEEE Trans. Circuits Syst. for Video Technol. 26(7), 1350–1362 (2015)CrossRef Baysal, S., Duygulu, P.: Sentioscope: a soccer player tracking system using model field particles. IEEE Trans. Circuits Syst. for Video Technol. 26(7), 1350–1362 (2015)CrossRef
3.
go back to reference Carlock, C.R.: Apparatus for locating and positioning a football on a football playing field, US Patent 3,985,356, 12 October 1976 Carlock, C.R.: Apparatus for locating and positioning a football on a football playing field, US Patent 3,985,356, 12 October 1976
4.
go back to reference Fryer, J.G., Brown, D.C.: Lens distortion for close-range photogrammetry. Photogram. Eng. Remote Sens. 52(1), 51–58 (1986) Fryer, J.G., Brown, D.C.: Lens distortion for close-range photogrammetry. Photogram. Eng. Remote Sens. 52(1), 51–58 (1986)
5.
go back to reference Lopez, M., Mari, R., Gargallo, P., Kuang, Y., Gonzalez-Jimenez, J., Haro, G.: Deep single image camera calibration with radial distortion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 11817–11825 (2019) Lopez, M., Mari, R., Gargallo, P., Kuang, Y., Gonzalez-Jimenez, J., Haro, G.: Deep single image camera calibration with radial distortion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 11817–11825 (2019)
6.
go back to reference Pavić, D., Schönefeld, V., Kobbelt, L.: Interactive image completion with perspective correction. Vis. Comput. 22(9–11), 671–681 (2006)CrossRef Pavić, D., Schönefeld, V., Kobbelt, L.: Interactive image completion with perspective correction. Vis. Comput. 22(9–11), 671–681 (2006)CrossRef
7.
go back to reference Peng, L.: Enhanced camera capturing using object-detection-based autofocus on smartphones. In: 2016 4th Intl Conf on Applied Computing and Information Technology/3rd Intl Conf on Computational Science/Intelligence and Applied Informatics/1st Intl Conf on Big Data, Cloud Computing, Data Science & Engineering (ACIT-CSII-BCD), pp. 208–212. IEEE (2016) Peng, L.: Enhanced camera capturing using object-detection-based autofocus on smartphones. In: 2016 4th Intl Conf on Applied Computing and Information Technology/3rd Intl Conf on Computational Science/Intelligence and Applied Informatics/1st Intl Conf on Big Data, Cloud Computing, Data Science & Engineering (ACIT-CSII-BCD), pp. 208–212. IEEE (2016)
8.
go back to reference Peng, L.: Gscheduler: Reducing mobile device energy consumption. In: 2016 4th Intl Conf on Applied Computing and Information Technology/3rd Intl Conf on Computational Science/Intelligence and Applied Informatics/1st Intl Conf on Big Data, Cloud Computing, Data Science & Engineering (ACIT-CSII-BCD), pp. 1–6. IEEE (2016) Peng, L.: Gscheduler: Reducing mobile device energy consumption. In: 2016 4th Intl Conf on Applied Computing and Information Technology/3rd Intl Conf on Computational Science/Intelligence and Applied Informatics/1st Intl Conf on Big Data, Cloud Computing, Data Science & Engineering (ACIT-CSII-BCD), pp. 1–6. IEEE (2016)
9.
go back to reference Peng, L.: Object Recognition in Videos Utilizing Hierarchical and Temporal Objectness with Deep Neural Networks. Ph.D. dissertation, Utah State University (2017) Peng, L.: Object Recognition in Videos Utilizing Hierarchical and Temporal Objectness with Deep Neural Networks. Ph.D. dissertation, Utah State University (2017)
10.
go back to reference Peng, L., Qi, X.: A hierarchical model to learn object proposals and its applications. J. Intell. Fuzzy Syst. 31(5), 2543–2551 (2016)CrossRef Peng, L., Qi, X.: A hierarchical model to learn object proposals and its applications. J. Intell. Fuzzy Syst. 31(5), 2543–2551 (2016)CrossRef
11.
go back to reference Peng, L., Qi, X.: Temporal objectness: model-free learning of object proposals in video. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3663–3667. IEEE (2016) Peng, L., Qi, X.: Temporal objectness: model-free learning of object proposals in video. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3663–3667. IEEE (2016)
12.
go back to reference Peng, L., Qian, H.: Automatic red-eye detection in consumer photographs. In: International Conference on Computer Applications in Industry and Engineering (2018) Peng, L., Qian, H.: Automatic red-eye detection in consumer photographs. In: International Conference on Computer Applications in Industry and Engineering (2018)
13.
go back to reference Peng, L., Qian, H.: A three-stage object detection framework using compact features and deep CNN. In: International Conference on Computer Applications in Industry and Engineering (2018) Peng, L., Qian, H.: A three-stage object detection framework using compact features and deep CNN. In: International Conference on Computer Applications in Industry and Engineering (2018)
14.
go back to reference Peng, L., Wang, H.: Object identification system and method, US Patent 9,122,931, 1 September 2015 Peng, L., Wang, H.: Object identification system and method, US Patent 9,122,931, 1 September 2015
15.
go back to reference Peng, L., Yang, Y., Qi, X., Wang, H.: Highly accurate video object identification utilizing hint information. In: 2014 International Conference on Computing, Networking and Communications (ICNC), pp. 317–321. IEEE (2014) Peng, L., Yang, Y., Qi, X., Wang, H.: Highly accurate video object identification utilizing hint information. In: 2014 International Conference on Computing, Networking and Communications (ICNC), pp. 317–321. IEEE (2014)
16.
go back to reference Peng, L., Yang, Y., Wang, H.: Automatic face annotation method and system, US Patent 9,176,987, 3 November 2015 Peng, L., Yang, Y., Wang, H.: Automatic face annotation method and system, US Patent 9,176,987, 3 November 2015
17.
go back to reference Pettersen, S.A., et al.: Soccer video and player position dataset. In: Proceedings of the 5th ACM Multimedia Systems Conference, pp. 18–23. ACM (2014) Pettersen, S.A., et al.: Soccer video and player position dataset. In: Proceedings of the 5th ACM Multimedia Systems Conference, pp. 18–23. ACM (2014)
18.
go back to reference Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779–788 (2016) Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779–788 (2016)
19.
go back to reference Wang, Q., Zhang, Y.: High speed stereoscopic shadowgraph imaging and its digital 3D reconstruction. Meas. Sci. Technol. 22(6), 065302 (2011)CrossRef Wang, Q., Zhang, Y.: High speed stereoscopic shadowgraph imaging and its digital 3D reconstruction. Meas. Sci. Technol. 22(6), 065302 (2011)CrossRef
20.
go back to reference Yu, J., Skaff, S., Peng, L., Imai, F.: Leveraging knowledge-based inference for material classification. In: Proceedings of the 23rd ACM International Conference on Multimedia, pp. 1243–1246. ACM (2015) Yu, J., Skaff, S., Peng, L., Imai, F.: Leveraging knowledge-based inference for material classification. In: Proceedings of the 23rd ACM International Conference on Multimedia, pp. 1243–1246. ACM (2015)
21.
22.
Metadata
Title
Pixel2Field: Single Image Transformation to Physical Field of Sports Videos
Author
Liang Peng
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-33720-9_51

Premium Partner