Skip to main content

2017 | OriginalPaper | Buchkapitel

Highlights Extraction in Sports Videos Based on Automatic Posture and Gesture Recognition

verfasst von : Kazimierz Choroś

Erschienen in: Intelligent Information and Database Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Content-based indexing of sports videos is usually based on the automatic detection of video highlights. Highlights can be detected on the basis of players’ or referees’ gestures and postures. Some gestures and postures of players are very typical for special sports events. These special gestures and postures can be recognized mainly in close-up and medium close view shots. The effective view classification method should be first applied. In the paper sports video shots favorable to detect gesture and posture of players are characterized and then experimental results of the tests with video shot categorization based on gesture recognition are presented. Then important and interesting moments in soccer games are detected when referees hold the penalty card above the head and look towards the player that has committed a serious offense. This recognition process is based only on visual information of sports videos and does not use any sensors.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Truong, B.T., Venkatesh, S.: Video abstraction: a systematic review and classification. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 3(1), 1–37 (2007). Article 3CrossRef Truong, B.T., Venkatesh, S.: Video abstraction: a systematic review and classification. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 3(1), 1–37 (2007). Article 3CrossRef
2.
Zurück zum Zitat Choroś, K.: Video structure analysis for content-based indexing and categorisation of TV sports news. Int. J. Intell. Inf. Database Syst. 6(5), 451–465 (2012) Choroś, K.: Video structure analysis for content-based indexing and categorisation of TV sports news. Int. J. Intell. Inf. Database Syst. 6(5), 451–465 (2012)
3.
Zurück zum Zitat Choroś, K.: Automatic detection of headlines in temporally aggregated TV sports news videos. In: Proceedings of the 8th International Symposium on Image and Signal Processing and Analysis (ISPA 2013), pp. 147–152. IEEE (2013) Choroś, K.: Automatic detection of headlines in temporally aggregated TV sports news videos. In: Proceedings of the 8th International Symposium on Image and Signal Processing and Analysis (ISPA 2013), pp. 147–152. IEEE (2013)
4.
Zurück zum Zitat Rautaray, S.S., Agrawal, A.: Vision based hand gesture recognition for human computer interaction: a survey. Artif. Intell. Rev. 43(1), 1–54 (2015)CrossRef Rautaray, S.S., Agrawal, A.: Vision based hand gesture recognition for human computer interaction: a survey. Artif. Intell. Rev. 43(1), 1–54 (2015)CrossRef
5.
Zurück zum Zitat Fu, Y.: Human Activity Recognition and Prediction. Springer, Switzerland (2016)CrossRef Fu, Y.: Human Activity Recognition and Prediction. Springer, Switzerland (2016)CrossRef
6.
Zurück zum Zitat Naik, V., Rathod, G.: An algorithm for retrieval of significant events near goal post from soccer videos using fuzzy systems. Int. J. Emerg. Technol. Adv. Eng. 3(3), 808–814 (2013) Naik, V., Rathod, G.: An algorithm for retrieval of significant events near goal post from soccer videos using fuzzy systems. Int. J. Emerg. Technol. Adv. Eng. 3(3), 808–814 (2013)
7.
Zurück zum Zitat Choroś, K.: Improved video scene detection using player detection methods in temporally aggregated TV sports news. In: Hwang, D., Jung, J.J., Nguyen, N.-T. (eds.) ICCCI 2014. LNCS (LNAI), vol. 8733, pp. 633–643. Springer, Heidelberg (2014). doi:10.1007/978-3-319-11289-3_64 Choroś, K.: Improved video scene detection using player detection methods in temporally aggregated TV sports news. In: Hwang, D., Jung, J.J., Nguyen, N.-T. (eds.) ICCCI 2014. LNCS (LNAI), vol. 8733, pp. 633–643. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-11289-3_​64
8.
Zurück zum Zitat Roh, M.-C., Christmas, B., Kittler, J., Lee, S.-W.: Robust player gesture spotting and recognition in low-resolution sports video. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 347–358. Springer, Heidelberg (2006). doi:10.1007/11744085_27 CrossRef Roh, M.-C., Christmas, B., Kittler, J., Lee, S.-W.: Robust player gesture spotting and recognition in low-resolution sports video. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 347–358. Springer, Heidelberg (2006). doi:10.​1007/​11744085_​27 CrossRef
9.
Zurück zum Zitat Chambers, G.S., Venkatesh, S., West, G.A.: Automatic labeling of sports video using umpire gesture recognition. In: Fred, A., Caelli, T.M., Duin, R.P.W., Campilho, A.C., de Ridder, D. (eds.) SSPR/SPR 2004. LNCS, vol. 3138, pp. 859–867. Springer, Heidelberg (2004). doi:10.1007/978-3-540-27868-9_94 CrossRef Chambers, G.S., Venkatesh, S., West, G.A.: Automatic labeling of sports video using umpire gesture recognition. In: Fred, A., Caelli, T.M., Duin, R.P.W., Campilho, A.C., de Ridder, D. (eds.) SSPR/SPR 2004. LNCS, vol. 3138, pp. 859–867. Springer, Heidelberg (2004). doi:10.​1007/​978-3-540-27868-9_​94 CrossRef
10.
Zurück zum Zitat Hsieh, C.H., Huang, C.P., Jiang, Y.C.: Player detection, tracking and segmentation in broadcast tennis video. J. CCIT 43(1), 25–40 (2014) Hsieh, C.H., Huang, C.P., Jiang, Y.C.: Player detection, tracking and segmentation in broadcast tennis video. J. CCIT 43(1), 25–40 (2014)
11.
Zurück zum Zitat Archana, M., Geetha, M.K.: An efficient ball and player detection in broadcast tennis video. In: Berretti, S., Thampi, S.M., Srivastava, P.R. (eds.). AISC, vol. 384, pp. 427–436. Springer, Heidelberg (2016). doi:10.1007/978-3-319-23036-8_37 CrossRef Archana, M., Geetha, M.K.: An efficient ball and player detection in broadcast tennis video. In: Berretti, S., Thampi, S.M., Srivastava, P.R. (eds.). AISC, vol. 384, pp. 427–436. Springer, Heidelberg (2016). doi:10.​1007/​978-3-319-23036-8_​37 CrossRef
12.
Zurück zum Zitat Takahashi, M., Naemura, M., Fujii, M., Little, J.J.: Recognition of action in broadcast basketball videos on the basis of global and local pairwise representation. In: Proceedings of the IEEE International Symposium on Multimedia (ISM), pp. 147–154. IEEE (2013) Takahashi, M., Naemura, M., Fujii, M., Little, J.J.: Recognition of action in broadcast basketball videos on the basis of global and local pairwise representation. In: Proceedings of the IEEE International Symposium on Multimedia (ISM), pp. 147–154. IEEE (2013)
13.
Zurück zum Zitat Ivankovic, Z., Rackovic, M., Ivkovic, M.: Automatic player position detection in basketball games. Multimedia Tools Appl. 72(3), 2741–2767 (2014)CrossRef Ivankovic, Z., Rackovic, M., Ivkovic, M.: Automatic player position detection in basketball games. Multimedia Tools Appl. 72(3), 2741–2767 (2014)CrossRef
14.
Zurück zum Zitat Pecev, P., Racković, M., Ivković, M.: A system for deductive prediction and analysis of movement of basketball referees. Multimedia Tools Appl. 75(23), 16389–16416 (2016) Pecev, P., Racković, M., Ivković, M.: A system for deductive prediction and analysis of movement of basketball referees. Multimedia Tools Appl. 75(23), 16389–16416 (2016)
15.
Zurück zum Zitat Lu, W.L., Ting, J.A., Murphy, K.P., Little, J.J.: Identifying players in broadcast sports videos using conditional random fields. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3249–3256. IEEE (2011) Lu, W.L., Ting, J.A., Murphy, K.P., Little, J.J.: Identifying players in broadcast sports videos using conditional random fields. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3249–3256. IEEE (2011)
16.
Zurück zum Zitat Atmosukarto, I., Ghanem, B., Saadalla, M., Ahuja, N.: Recognizing team formation in American football. In: Computer Vision in Sports, pp. 271–291. Springer International Publishing, Switzerland (2014) Atmosukarto, I., Ghanem, B., Saadalla, M., Ahuja, N.: Recognizing team formation in American football. In: Computer Vision in Sports, pp. 271–291. Springer International Publishing, Switzerland (2014)
17.
Zurück zum Zitat Santiago, C.B., Sousa, A., Reis, L.P.: Vision system for tracking handball players using fuzzy color processing. Mach. Vis. Appl. 24(5), 1055–1074 (2013)CrossRef Santiago, C.B., Sousa, A., Reis, L.P.: Vision system for tracking handball players using fuzzy color processing. Mach. Vis. Appl. 24(5), 1055–1074 (2013)CrossRef
18.
Zurück zum Zitat Peng, Y., Ma, X., Gao, X., Zhou, F.: Background estimation and player detection in badminton video clips using histogram of pixel values along temporal dimension. In: Proceedings of the Sixth International Conference on Electronics and Information Engineering, p. 979409. International Society for Optics and Photonics (2015) Peng, Y., Ma, X., Gao, X., Zhou, F.: Background estimation and player detection in badminton video clips using histogram of pixel values along temporal dimension. In: Proceedings of the Sixth International Conference on Electronics and Information Engineering, p. 979409. International Society for Optics and Photonics (2015)
19.
Zurück zum Zitat Chakraborty, P.R., Tjondronegoro, D., Zhang, L., Chandran, V.: Automatic identification of sports video highlights using viewer interest features. In: Proceedings of the International Conference on Multimedia Retrieval, pp. 55–62. ACM (2016) Chakraborty, P.R., Tjondronegoro, D., Zhang, L., Chandran, V.: Automatic identification of sports video highlights using viewer interest features. In: Proceedings of the International Conference on Multimedia Retrieval, pp. 55–62. ACM (2016)
20.
Zurück zum Zitat Choroś, K.: Video structure analysis and content-based indexing in the automatic video indexer AVI. In: Nguyen, N.T., Zgrzywa, A., Czyżewski, A. (eds.) Advances in Multimedia and Network Information System Technologies. AISC, vol. 80, pp. 79–90. Springer, Heidelberg (2010). doi:10.1007/978-3-642-14989-4_8 CrossRef Choroś, K.: Video structure analysis and content-based indexing in the automatic video indexer AVI. In: Nguyen, N.T., Zgrzywa, A., Czyżewski, A. (eds.) Advances in Multimedia and Network Information System Technologies. AISC, vol. 80, pp. 79–90. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-14989-4_​8 CrossRef
21.
Zurück zum Zitat Ekin, A., Tekalp, A.M., Mehrotra, R.: Automatic soccer video analysis and summarization. IEEE Trans. Image Process. 12(7), 796–807 (2003)CrossRef Ekin, A., Tekalp, A.M., Mehrotra, R.: Automatic soccer video analysis and summarization. IEEE Trans. Image Process. 12(7), 796–807 (2003)CrossRef
22.
Zurück zum Zitat Li, L., Zhang, X., Hu, W., Li, W., Zhu, P.: soccer video shot classification based on color characterization using dominant sets clustering. In: Muneesawang, P., Wu, F., Kumazawa, I., Roeksabutr, A., Liao, M., Tang, X. (eds.) PCM 2009. LNCS, vol. 5879, pp. 923–929. Springer, Heidelberg (2009). doi:10.1007/978-3-642-10467-1_83 CrossRef Li, L., Zhang, X., Hu, W., Li, W., Zhu, P.: soccer video shot classification based on color characterization using dominant sets clustering. In: Muneesawang, P., Wu, F., Kumazawa, I., Roeksabutr, A., Liao, M., Tang, X. (eds.) PCM 2009. LNCS, vol. 5879, pp. 923–929. Springer, Heidelberg (2009). doi:10.​1007/​978-3-642-10467-1_​83 CrossRef
23.
Zurück zum Zitat Cholewa B.: Detection and categorization of objects on the basis of player gestures and postures in sports videos. Unpublished Master’s Thesis (in Polish), Wrocław University of Science and Technology (2015) Cholewa B.: Detection and categorization of objects on the basis of player gestures and postures in sports videos. Unpublished Master’s Thesis (in Polish), Wrocław University of Science and Technology (2015)
24.
Zurück zum Zitat Choroś, K.: Automatic playing field detection and dominant color extraction in sports video shots of different view types. In: Zgrzywa, A., Choroś, K., Siemiński, A. (eds.). AISC, vol. 506, pp. 39–48. Springer, Heidelberg (2017). doi:10.1007/978-3-319-43982-2_4 CrossRef Choroś, K.: Automatic playing field detection and dominant color extraction in sports video shots of different view types. In: Zgrzywa, A., Choroś, K., Siemiński, A. (eds.). AISC, vol. 506, pp. 39–48. Springer, Heidelberg (2017). doi:10.​1007/​978-3-319-43982-2_​4 CrossRef
Metadaten
Titel
Highlights Extraction in Sports Videos Based on Automatic Posture and Gesture Recognition
verfasst von
Kazimierz Choroś
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-54472-4_58

Premium Partner