Skip to main content

2019 | OriginalPaper | Buchkapitel

Pixel2Field: Single Image Transformation to Physical Field of Sports Videos

verfasst von : Liang Peng

Erschienen in: Advances in Visual Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Locating players on a 2D field plane for sports match is the first step towards developing many types of sports analytics applications. Most existing mechanisms of locating players require them to wear sensors during sports play. Sports games can be easily recorded by cameras with low cost. Current human detection and tracking techniques can be used to locate players in the video, which is typically distorted for panorama view. We propose an end-to-end system named Pixel2Field, which can transform every pixel location into their scaled 2d field image. This is done by first undistorting the image by estimating the distortion coefficients, followed by a homography recovery. Experiments using detected soccer players from a distorted video show the proposed transformation method works well. To the best of knowledge, this is the first end-to-end system that can transform frame pixel location to field location without any human intervention. This unlock a lot of opportunities for developing sports analytics applications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Alonso, R.A.: Sports telemetry system for collecting performance metrics and data, US Patent 8,289,185, 16 October 2012 Alonso, R.A.: Sports telemetry system for collecting performance metrics and data, US Patent 8,289,185, 16 October 2012
2.
Zurück zum Zitat Baysal, S., Duygulu, P.: Sentioscope: a soccer player tracking system using model field particles. IEEE Trans. Circuits Syst. for Video Technol. 26(7), 1350–1362 (2015)CrossRef Baysal, S., Duygulu, P.: Sentioscope: a soccer player tracking system using model field particles. IEEE Trans. Circuits Syst. for Video Technol. 26(7), 1350–1362 (2015)CrossRef
3.
Zurück zum Zitat Carlock, C.R.: Apparatus for locating and positioning a football on a football playing field, US Patent 3,985,356, 12 October 1976 Carlock, C.R.: Apparatus for locating and positioning a football on a football playing field, US Patent 3,985,356, 12 October 1976
4.
Zurück zum Zitat Fryer, J.G., Brown, D.C.: Lens distortion for close-range photogrammetry. Photogram. Eng. Remote Sens. 52(1), 51–58 (1986) Fryer, J.G., Brown, D.C.: Lens distortion for close-range photogrammetry. Photogram. Eng. Remote Sens. 52(1), 51–58 (1986)
5.
Zurück zum Zitat Lopez, M., Mari, R., Gargallo, P., Kuang, Y., Gonzalez-Jimenez, J., Haro, G.: Deep single image camera calibration with radial distortion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 11817–11825 (2019) Lopez, M., Mari, R., Gargallo, P., Kuang, Y., Gonzalez-Jimenez, J., Haro, G.: Deep single image camera calibration with radial distortion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 11817–11825 (2019)
6.
Zurück zum Zitat Pavić, D., Schönefeld, V., Kobbelt, L.: Interactive image completion with perspective correction. Vis. Comput. 22(9–11), 671–681 (2006)CrossRef Pavić, D., Schönefeld, V., Kobbelt, L.: Interactive image completion with perspective correction. Vis. Comput. 22(9–11), 671–681 (2006)CrossRef
7.
Zurück zum Zitat Peng, L.: Enhanced camera capturing using object-detection-based autofocus on smartphones. In: 2016 4th Intl Conf on Applied Computing and Information Technology/3rd Intl Conf on Computational Science/Intelligence and Applied Informatics/1st Intl Conf on Big Data, Cloud Computing, Data Science & Engineering (ACIT-CSII-BCD), pp. 208–212. IEEE (2016) Peng, L.: Enhanced camera capturing using object-detection-based autofocus on smartphones. In: 2016 4th Intl Conf on Applied Computing and Information Technology/3rd Intl Conf on Computational Science/Intelligence and Applied Informatics/1st Intl Conf on Big Data, Cloud Computing, Data Science & Engineering (ACIT-CSII-BCD), pp. 208–212. IEEE (2016)
8.
Zurück zum Zitat Peng, L.: Gscheduler: Reducing mobile device energy consumption. In: 2016 4th Intl Conf on Applied Computing and Information Technology/3rd Intl Conf on Computational Science/Intelligence and Applied Informatics/1st Intl Conf on Big Data, Cloud Computing, Data Science & Engineering (ACIT-CSII-BCD), pp. 1–6. IEEE (2016) Peng, L.: Gscheduler: Reducing mobile device energy consumption. In: 2016 4th Intl Conf on Applied Computing and Information Technology/3rd Intl Conf on Computational Science/Intelligence and Applied Informatics/1st Intl Conf on Big Data, Cloud Computing, Data Science & Engineering (ACIT-CSII-BCD), pp. 1–6. IEEE (2016)
9.
Zurück zum Zitat Peng, L.: Object Recognition in Videos Utilizing Hierarchical and Temporal Objectness with Deep Neural Networks. Ph.D. dissertation, Utah State University (2017) Peng, L.: Object Recognition in Videos Utilizing Hierarchical and Temporal Objectness with Deep Neural Networks. Ph.D. dissertation, Utah State University (2017)
10.
Zurück zum Zitat Peng, L., Qi, X.: A hierarchical model to learn object proposals and its applications. J. Intell. Fuzzy Syst. 31(5), 2543–2551 (2016)CrossRef Peng, L., Qi, X.: A hierarchical model to learn object proposals and its applications. J. Intell. Fuzzy Syst. 31(5), 2543–2551 (2016)CrossRef
11.
Zurück zum Zitat Peng, L., Qi, X.: Temporal objectness: model-free learning of object proposals in video. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3663–3667. IEEE (2016) Peng, L., Qi, X.: Temporal objectness: model-free learning of object proposals in video. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3663–3667. IEEE (2016)
12.
Zurück zum Zitat Peng, L., Qian, H.: Automatic red-eye detection in consumer photographs. In: International Conference on Computer Applications in Industry and Engineering (2018) Peng, L., Qian, H.: Automatic red-eye detection in consumer photographs. In: International Conference on Computer Applications in Industry and Engineering (2018)
13.
Zurück zum Zitat Peng, L., Qian, H.: A three-stage object detection framework using compact features and deep CNN. In: International Conference on Computer Applications in Industry and Engineering (2018) Peng, L., Qian, H.: A three-stage object detection framework using compact features and deep CNN. In: International Conference on Computer Applications in Industry and Engineering (2018)
14.
Zurück zum Zitat Peng, L., Wang, H.: Object identification system and method, US Patent 9,122,931, 1 September 2015 Peng, L., Wang, H.: Object identification system and method, US Patent 9,122,931, 1 September 2015
15.
Zurück zum Zitat Peng, L., Yang, Y., Qi, X., Wang, H.: Highly accurate video object identification utilizing hint information. In: 2014 International Conference on Computing, Networking and Communications (ICNC), pp. 317–321. IEEE (2014) Peng, L., Yang, Y., Qi, X., Wang, H.: Highly accurate video object identification utilizing hint information. In: 2014 International Conference on Computing, Networking and Communications (ICNC), pp. 317–321. IEEE (2014)
16.
Zurück zum Zitat Peng, L., Yang, Y., Wang, H.: Automatic face annotation method and system, US Patent 9,176,987, 3 November 2015 Peng, L., Yang, Y., Wang, H.: Automatic face annotation method and system, US Patent 9,176,987, 3 November 2015
17.
Zurück zum Zitat Pettersen, S.A., et al.: Soccer video and player position dataset. In: Proceedings of the 5th ACM Multimedia Systems Conference, pp. 18–23. ACM (2014) Pettersen, S.A., et al.: Soccer video and player position dataset. In: Proceedings of the 5th ACM Multimedia Systems Conference, pp. 18–23. ACM (2014)
18.
Zurück zum Zitat Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779–788 (2016) Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779–788 (2016)
19.
Zurück zum Zitat Wang, Q., Zhang, Y.: High speed stereoscopic shadowgraph imaging and its digital 3D reconstruction. Meas. Sci. Technol. 22(6), 065302 (2011)CrossRef Wang, Q., Zhang, Y.: High speed stereoscopic shadowgraph imaging and its digital 3D reconstruction. Meas. Sci. Technol. 22(6), 065302 (2011)CrossRef
20.
Zurück zum Zitat Yu, J., Skaff, S., Peng, L., Imai, F.: Leveraging knowledge-based inference for material classification. In: Proceedings of the 23rd ACM International Conference on Multimedia, pp. 1243–1246. ACM (2015) Yu, J., Skaff, S., Peng, L., Imai, F.: Leveraging knowledge-based inference for material classification. In: Proceedings of the 23rd ACM International Conference on Multimedia, pp. 1243–1246. ACM (2015)
21.
Zurück zum Zitat , cN Patent CN105100894A, 25 November 2015 https://static-content.springer.com/image/chp%3A10.1007%2F978-3-030-33720-9_51/MediaObjects/491108_1_En_51_Figa_HTML.gif , cN Patent CN105100894A, 25 November 2015
22.
Zurück zum Zitat , cN Patent CN104573706A, 29 April 2015 https://static-content.springer.com/image/chp%3A10.1007%2F978-3-030-33720-9_51/MediaObjects/491108_1_En_51_Figb_HTML.gif , cN Patent CN104573706A, 29 April 2015
Metadaten
Titel
Pixel2Field: Single Image Transformation to Physical Field of Sports Videos
verfasst von
Liang Peng
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-33720-9_51