Skip to main content

2018 | OriginalPaper | Buchkapitel

SmartTennisTV: Automatic Indexing of Tennis Videos

verfasst von : Anurag Ghosh, C. V. Jawahar

Erschienen in: Computer Vision, Pattern Recognition, Image Processing, and Graphics

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we demonstrate a score based indexing approach for tennis videos. Given a broadcast tennis video (btv), we index all the video segments with their scores to create a navigable and searchable match. Our approach temporally segments the rallies in the video and then recognizes the scores from each of the segments, before refining the scores using the knowledge of the tennis scoring system. We finally build an interface to effortlessly retrieve and view the relevant video segments by also automatically tagging the segmented rallies with human accessible tags such as ‘fault’ and ‘deuce’. The efficiency of our approach is demonstrated on btv’s from two major tennis tournaments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Huang, Y.P., Chiou, C.L., Sandnes, F.E.: An intelligent strategy for the automatic detection of highlights in tennis video recordings. Expert Syst. Appl. 36(6), 9907–9918 (2009)CrossRef Huang, Y.P., Chiou, C.L., Sandnes, F.E.: An intelligent strategy for the automatic detection of highlights in tennis video recordings. Expert Syst. Appl. 36(6), 9907–9918 (2009)CrossRef
2.
Zurück zum Zitat Ghanem, B., Kreidieh, M., Farra, M., Zhang, T.: Context-aware learning for automatic sports highlight recognition. In: 21st International Conference on Pattern Recognition (ICPR), pp. 1977–1980. IEEE (2012) Ghanem, B., Kreidieh, M., Farra, M., Zhang, T.: Context-aware learning for automatic sports highlight recognition. In: 21st International Conference on Pattern Recognition (ICPR), pp. 1977–1980. IEEE (2012)
3.
Zurück zum Zitat Hanjalic, A.: Generic approach to highlights extraction from a sport video. In: International Conference on Image Processing (ICIP), vol. 1, pp. I–1. IEEE (2003) Hanjalic, A.: Generic approach to highlights extraction from a sport video. In: International Conference on Image Processing (ICIP), vol. 1, pp. I–1. IEEE (2003)
4.
Zurück zum Zitat Mentzelopoulos, M., Psarrou, A., Angelopoulou, A., Garcıá-Rodrıáguez, J.: Active foreground region extraction and tracking for sports video annotation. Neural Process. Lett. 37(1), 33–46 (2013)CrossRef Mentzelopoulos, M., Psarrou, A., Angelopoulou, A., Garcıá-Rodrıáguez, J.: Active foreground region extraction and tracking for sports video annotation. Neural Process. Lett. 37(1), 33–46 (2013)CrossRef
5.
Zurück zum Zitat Zhang, Y., Zhang, X., Xu, C., Lu, H.: Personalized retrieval of sports video. In: Proceedings of the International Workshop on Workshop on Multimedia Information Retrieval, pp. 313–322 (2007) Zhang, Y., Zhang, X., Xu, C., Lu, H.: Personalized retrieval of sports video. In: Proceedings of the International Workshop on Workshop on Multimedia Information Retrieval, pp. 313–322 (2007)
6.
Zurück zum Zitat Kolekar, M.H., Sengupta, S.: Bayesian network-based customized highlight generation for broadcast soccer videos. IEEE Trans. Broadcast. 61(2), 195–209 (2015)CrossRef Kolekar, M.H., Sengupta, S.: Bayesian network-based customized highlight generation for broadcast soccer videos. IEEE Trans. Broadcast. 61(2), 195–209 (2015)CrossRef
7.
Zurück zum Zitat Liu, C., Huang, Q., Jiang, S., Xing, L., Ye, Q., Gao, W.: A framework for flexible summarization of racquet sports video using multiple modalities. Comput. Vis. Image Underst. 113(3), 415–424 (2009)CrossRef Liu, C., Huang, Q., Jiang, S., Xing, L., Ye, Q., Gao, W.: A framework for flexible summarization of racquet sports video using multiple modalities. Comput. Vis. Image Underst. 113(3), 415–424 (2009)CrossRef
8.
Zurück zum Zitat Connaghan, D., Kelly, P., O’Connor, N.E.: Game, shot and match: event-based indexing of tennis. In: 2011 9th International Workshop on Content-Based Multimedia Indexing (CBMI), pp. 97–102. IEEE (2011) Connaghan, D., Kelly, P., O’Connor, N.E.: Game, shot and match: event-based indexing of tennis. In: 2011 9th International Workshop on Content-Based Multimedia Indexing (CBMI), pp. 97–102. IEEE (2011)
9.
Zurück zum Zitat Miyamori, H., Iisaku, S.-I.: Video annotation for content based retrieval using human behavior analysis and domain knowledge. In: Fourth IEEE International Conference on Automatic Face and Gesture Recognition Proceedings, pp. 320–325. IEEE (2000) Miyamori, H., Iisaku, S.-I.: Video annotation for content based retrieval using human behavior analysis and domain knowledge. In: Fourth IEEE International Conference on Automatic Face and Gesture Recognition Proceedings, pp. 320–325. IEEE (2000)
10.
Zurück zum Zitat Sukhwani, M., Jawahar, C.: TennisVid2Text: fine-grained descriptions for domain specific videos. In: Proceedings of the British Machine Vision Conference (BMVC), pp. 117.1-117.12. BMVA Press, September 2015 Sukhwani, M., Jawahar, C.: TennisVid2Text: fine-grained descriptions for domain specific videos. In: Proceedings of the British Machine Vision Conference (BMVC), pp. 117.1-117.12. BMVA Press, September 2015
11.
Zurück zum Zitat Sukhwani, M., Jawahar, C.: Frame level annotations for tennis videos. In: International Conference on Pattern Recognition (2016) Sukhwani, M., Jawahar, C.: Frame level annotations for tennis videos. In: International Conference on Pattern Recognition (2016)
12.
Zurück zum Zitat Xu, C., Wang, J., Lu, H., Zhang, Y.: A novel framework for semantic annotation and personalized retrieval of sports video. IEEE Trans. Multimed. 10(3), 421–436 (2008)CrossRef Xu, C., Wang, J., Lu, H., Zhang, Y.: A novel framework for semantic annotation and personalized retrieval of sports video. IEEE Trans. Multimed. 10(3), 421–436 (2008)CrossRef
13.
Zurück zum Zitat Yan, F., Christmas, W., Kittler, J.: All pairs shortest path formulation for multiple object tracking with application to tennis video analysis. In: British Machine Vision Conference (2007) Yan, F., Christmas, W., Kittler, J.: All pairs shortest path formulation for multiple object tracking with application to tennis video analysis. In: British Machine Vision Conference (2007)
14.
Zurück zum Zitat Yan, F., Kittler, J., Windridge, D., Christmas, W., Mikolajczyk, K., Cox, S., Huang, Q.: Automatic annotation of tennis games: an integration of audio, vision, and learning. Image Vis. Comput. 32(11), 896–903 (2014)CrossRef Yan, F., Kittler, J., Windridge, D., Christmas, W., Mikolajczyk, K., Cox, S., Huang, Q.: Automatic annotation of tennis games: an integration of audio, vision, and learning. Image Vis. Comput. 32(11), 896–903 (2014)CrossRef
15.
Zurück zum Zitat Zhou, X., Xie, L., Huang, Q., Cox, S.J., Zhang, Y.: Tennis ball tracking using a two-layered data association approach. IEEE Trans. Multimed. 17(2), 145–156 (2015)CrossRef Zhou, X., Xie, L., Huang, Q., Cox, S.J., Zhang, Y.: Tennis ball tracking using a two-layered data association approach. IEEE Trans. Multimed. 17(2), 145–156 (2015)CrossRef
16.
Zurück zum Zitat Liao, S., Wang, Y., Xin, Y.: Research on scoreboard detection and localization in basketball video. Int. J. Multimed. Ubiquit. Eng. 10(11), 57–68 (2015)CrossRef Liao, S., Wang, Y., Xin, Y.: Research on scoreboard detection and localization in basketball video. Int. J. Multimed. Ubiquit. Eng. 10(11), 57–68 (2015)CrossRef
17.
Zurück zum Zitat Miao, G., Zhu, G., Jiang, S., Huang, Q., Xu, C., Gao, W.: A real-time score detection and recognition approach for broadcast basketball video. In: IEEE International Conference on Multimedia and Expo, pp. 1691–1694 (2007) Miao, G., Zhu, G., Jiang, S., Huang, Q., Xu, C., Gao, W.: A real-time score detection and recognition approach for broadcast basketball video. In: IEEE International Conference on Multimedia and Expo, pp. 1691–1694 (2007)
18.
Zurück zum Zitat Smith, R.: An overview of the Tesseract OCR engine. In: Ninth International Conference on Document Analysis and Recognition, vol. 2, pp. 629–633 (2007) Smith, R.: An overview of the Tesseract OCR engine. In: Ninth International Conference on Document Analysis and Recognition, vol. 2, pp. 629–633 (2007)
19.
Zurück zum Zitat Gupta, A., Vedaldi, A., Zisserman, A.: Synthetic data for text localisation in natural images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2315–2324 (2016) Gupta, A., Vedaldi, A., Zisserman, A.: Synthetic data for text localisation in natural images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2315–2324 (2016)
20.
Zurück zum Zitat Shi, B., Bai, X., Yao, C.: An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39, 2298–2304 (2016)CrossRef Shi, B., Bai, X., Yao, C.: An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39, 2298–2304 (2016)CrossRef
21.
Zurück zum Zitat Jaderberg, M., Simonyan, K., Vedaldi, A., Zisserman, A.: Synthetic data and artificial neural networks for natural scene text recognition. arXiv preprint arXiv:1406.2227 (2014) Jaderberg, M., Simonyan, K., Vedaldi, A., Zisserman, A.: Synthetic data and artificial neural networks for natural scene text recognition. arXiv preprint arXiv:​1406.​2227 (2014)
Metadaten
Titel
SmartTennisTV: Automatic Indexing of Tennis Videos
verfasst von
Anurag Ghosh
C. V. Jawahar
Copyright-Jahr
2018
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-0020-2_3