Skip to main content
Top
Published in: Multimedia Systems 6/2020

18-08-2020 | Regular Paper

Emperor Penguin optimized event recognition and summarization for cricket highlight generation

Authors: Hansa Shingrakhia, Hetal Patel

Published in: Multimedia Systems | Issue 6/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Cricket highlight generation is the process of summarizing a full-length video to a shortened form which should preserve the important moments present in the original video. In this paper, a new approach has been proposed for recognizing the key events and summarization. Audio features are initially used for extracting the excitement clips. Then, the important events like replay, players, umpires, spectators, and players gathering are extracted from each clip. Here, a hybrid deep neural network with Emperor Penguin optimization (HDNN-EPO) is proposed for labeling the excitement concepts presented in the cricket video based on the observed events automatically. These labeled concepts are then selected based on the importance degree and concatenated in temporal order to form highlights. The efficiency of the proposed method is proved through the experimental results and it outperforms the other existing approaches. Also, the extracted highlights have been compared with the manually-generated highlights by the sports television channel.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Shih, H.C.: A survey of content-aware video analysis for sports. IEEE Trans. Circuits Syst. Video Technol. 28(5), 1212–1231 (2018)CrossRef Shih, H.C.: A survey of content-aware video analysis for sports. IEEE Trans. Circuits Syst. Video Technol. 28(5), 1212–1231 (2018)CrossRef
2.
go back to reference Wang, L., Wang, Z., Qiao, Y., Van Gool, L.: Transferring deep object and scene representations for event recognition in still images. Int. J. Comput. Vision 126, 09 (2017)MathSciNetCrossRef Wang, L., Wang, Z., Qiao, Y., Van Gool, L.: Transferring deep object and scene representations for event recognition in still images. Int. J. Comput. Vision 126, 09 (2017)MathSciNetCrossRef
3.
go back to reference Renò, V., Mosca, N., Nitti, M., D’Orazio, T., Guaragnella, C., Campagnoli, D., Prati, A., Stella, E.: A technology platform for automatic high-level tennis game analysis. Comput. Vision Image Understand. 159, 01 (2017)CrossRef Renò, V., Mosca, N., Nitti, M., D’Orazio, T., Guaragnella, C., Campagnoli, D., Prati, A., Stella, E.: A technology platform for automatic high-level tennis game analysis. Comput. Vision Image Understand. 159, 01 (2017)CrossRef
4.
go back to reference Nguyen, D.T., Jung, J.E.: Real-time event detection for online behavioral analysis of big social data. Future Gener. Comput. Syst. 1(66), 137–145 (2017)CrossRef Nguyen, D.T., Jung, J.E.: Real-time event detection for online behavioral analysis of big social data. Future Gener. Comput. Syst. 1(66), 137–145 (2017)CrossRef
5.
go back to reference Ravi, A., Venugopal, H., Paul, S., Tizhoosh, H.R.: A dataset and preliminary results for umpire pose detection using SVM classification of deep features. In: 2018 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 1396–1402. IEEE (2018) Ravi, A., Venugopal, H., Paul, S., Tizhoosh, H.R.: A dataset and preliminary results for umpire pose detection using SVM classification of deep features. In:  2018 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 1396–1402. IEEE (2018)
6.
go back to reference Ellappan, V., Rajasekaran, R.: Event recognition and classification in sports video. In: 2017 Second International Conference on Recent Trends and Challenges in Computational Models (ICRTCCM), pp. 182–187. IEEE (2017) Ellappan, V., Rajasekaran, R.: Event recognition and classification in sports video. In:  2017 Second International Conference on Recent Trends and Challenges in Computational Models (ICRTCCM), pp. 182–187. IEEE (2017)
7.
go back to reference Shukla P., Sadana, H., Bansal, A., Verma, D., Elmadjian, C., Raman, B., Turk, M.: Automatic cricket highlight generation using event-driven and excitement-based features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1800–1808 (2018) Shukla P., Sadana, H., Bansal, A., Verma, D., Elmadjian, C., Raman, B., Turk, M.: Automatic cricket highlight generation using event-driven and excitement-based features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1800–1808 (2018)
8.
go back to reference Javed A.: Event driven video summarization for sports. PhD diss., University of Engineering and Technology, Taxila, Pakistan, (2016) Javed A.: Event driven video summarization for sports. PhD diss., University of Engineering and Technology, Taxila, Pakistan, (2016)
9.
go back to reference Kolekar, M.H., Sengupta, S.: Bayesian network-based customized highlight generation for broadcast soccer videos. IEEE Trans. Broadcast. 61(2), 195–209 (2015)CrossRef Kolekar, M.H., Sengupta, S.: Bayesian network-based customized highlight generation for broadcast soccer videos. IEEE Trans. Broadcast. 61(2), 195–209 (2015)CrossRef
10.
go back to reference Baijal, A., Cho, J., Lee, W., Ko, B.-S.: Sports highlights generation based on acoustic events detection: a rugby case study. In: 2015 IEEE International Conference on Consumer Electronics (ICCE), pp. 20–23. IEEE (2015) Baijal, A., Cho, J., Lee, W., Ko, B.-S.: Sports highlights generation based on acoustic events detection: a rugby case study. In: 2015 IEEE International Conference on Consumer Electronics (ICCE), pp. 20–23. IEEE (2015)
11.
go back to reference Zhang J, Yao, J., Wan, X.: Towards constructing sports news from live text commentary. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol. 1, pp. 1361–1371 (2016) Zhang J, Yao, J., Wan, X.: Towards constructing sports news from live text commentary. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol. 1, pp. 1361–1371 (2016)
12.
go back to reference Bhalla, A., Ahuja, A., Pant, P., Mittal, A.: A multimodal approach for automatic cricket video summarization. In: 2019 6th International Conference on Signal Processing and Integrated Networks (SPIN), pp. 146–150. IEEE (2019) Bhalla, A., Ahuja, A., Pant, P., Mittal, A.: A multimodal approach for automatic cricket video summarization. In: 2019 6th International Conference on Signal Processing and Integrated Networks (SPIN), pp. 146–150. IEEE (2019)
13.
go back to reference Baliarsingh, S.K., Vipsita, S., Muhammad, K., Bakshi, S.: Analysis of high-dimensional biomedical data using an evolutionary multi-objective emperor penguin optimizer. Swarm Evolut. Comput. 48, 262–273 (2019)CrossRef Baliarsingh, S.K., Vipsita, S., Muhammad, K., Bakshi, S.: Analysis of high-dimensional biomedical data using an evolutionary multi-objective emperor penguin optimizer. Swarm Evolut. Comput. 48, 262–273 (2019)CrossRef
14.
go back to reference Xing, Z.: An improved emperor penguin optimization based multilevel thresholding for color image segmentation. Knowl.-Based Syst 194, 105570 (2020)CrossRef Xing, Z.: An improved emperor penguin optimization based multilevel thresholding for color image segmentation. Knowl.-Based Syst 194, 105570 (2020)CrossRef
15.
go back to reference Javed, A., Irtaza, S.A., Malik, H., Mahmood, M., Adnan, S.M.: A multimodal framework based on audio-visual features for summarization of cricket videos. IET Image Proc. 13(4), 615–622 (2019)CrossRef Javed, A., Irtaza, S.A., Malik, H., Mahmood, M., Adnan, S.M.: A multimodal framework based on audio-visual features for summarization of cricket videos. IET Image Proc. 13(4), 615–622 (2019)CrossRef
16.
go back to reference Kolekar, M.H.: Bayesian belief network-based broadcast sports video indexing. Multimedia Tools Appl. 54(1), 27–54 (2011)CrossRef Kolekar, M.H.: Bayesian belief network-based broadcast sports video indexing. Multimedia Tools Appl. 54(1), 27–54 (2011)CrossRef
17.
go back to reference Nasir, M., Javed, A., Irtaza, A., Malik, H., Mahmood, M.: Event detection and summarization of cricket videos. J. Image Graphics 6, 27–32 (2018)CrossRef Nasir, M., Javed, A., Irtaza, A., Malik, H., Mahmood, M.: Event detection and summarization of cricket videos. J. Image Graphics 6, 27–32 (2018)CrossRef
18.
go back to reference Midhu, K., Padmanabhan, N.A.: Highlight the generation of cricket matches using deep learning. In: Computational Vision and Bio Inspired Computing, pp. 925–936. Springer, Cham (2018) Midhu, K., Padmanabhan, N.A.: Highlight the generation of cricket matches using deep learning. In: Computational Vision and Bio Inspired Computing, pp. 925–936. Springer, Cham (2018)
19.
go back to reference Chakraborty, S., Thounaojam, D.: A novel shot boundary detection system using hybrid optimization technique. Appl. Intell. 49, 03 (2019)CrossRef Chakraborty, S., Thounaojam, D.: A novel shot boundary detection system using hybrid optimization technique. Appl. Intell. 49, 03 (2019)CrossRef
20.
go back to reference Javed, A., Bajwa, K.B., Malik, H., Irtaza, A., Mahmood, M.T.: A hybrid approach for summarization of cricket videos. In: 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), pp. 1–4. IEEE (2016) Javed, A., Bajwa, K.B., Malik, H., Irtaza, A., Mahmood, M.T.: A hybrid approach for summarization of cricket videos. In: 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), pp. 1–4. IEEE (2016)
21.
go back to reference Kolekar, M.H., Sengupta, S.: Semantic concept mining in cricket videos for automated highlight generation. Multimedia Tools Appl. 47(3), 545–579 (2010)CrossRef Kolekar, M.H., Sengupta, S.: Semantic concept mining in cricket videos for automated highlight generation. Multimedia Tools Appl. 47(3), 545–579 (2010)CrossRef
22.
go back to reference Hari, R., Wilscy, M.: Event detection in cricket videos using intensity projection profile of Umpire gestures. In: 2014 Annual IEEE India Conference (INDICON), pp. 1–6. IEEE (2014) Hari, R., Wilscy, M.: Event detection in cricket videos using intensity projection profile of Umpire gestures. In: 2014 Annual IEEE India Conference (INDICON), pp. 1–6. IEEE (2014)
23.
go back to reference Merler, M., Mac, K.-N.C., Joshi, D., Nguyen, Q.-B., Hammer, S., Kent, J., Xiong, J., Do, M.N., Smith, J.R., Feris, R.S.: Automatic curation of sports highlights using multimodal excitement features.IEEE Trans. Multimedia 21, 1147–1160 (2019)CrossRef Merler, M., Mac, K.-N.C., Joshi, D., Nguyen, Q.-B., Hammer, S., Kent, J., Xiong, J., Do, M.N., Smith, J.R., Feris, R.S.: Automatic curation of sports highlights using multimodal excitement features.IEEE Trans. Multimedia 21, 1147–1160 (2019)CrossRef
24.
go back to reference F. Hajati and M. Tavakolian, Video Classification Using Deep Autoencoder Network, 01 2020, pp. 508–518 F. Hajati and M. Tavakolian, Video Classification Using Deep Autoencoder Network, 01 2020, pp. 508–518
25.
go back to reference Dhiman, G., Kumar, V.: Emperor penguin optimizer: a bio-inspired algorithm for engineering problems. Knowl.-Based Syst. 159, 20–50 (2018)CrossRef Dhiman, G., Kumar, V.: Emperor penguin optimizer: a bio-inspired algorithm for engineering problems. Knowl.-Based Syst. 159, 20–50 (2018)CrossRef
Metadata
Title
Emperor Penguin optimized event recognition and summarization for cricket highlight generation
Authors
Hansa Shingrakhia
Hetal Patel
Publication date
18-08-2020
Publisher
Springer Berlin Heidelberg
Published in
Multimedia Systems / Issue 6/2020
Print ISSN: 0942-4962
Electronic ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-020-00684-3

Other articles of this Issue 6/2020

Multimedia Systems 6/2020 Go to the issue