Skip to main content

2016 | OriginalPaper | Buchkapitel

Key Frame Extraction Based on Motion Vector

verfasst von : Ziqian Qiang, Qing Xu, Shihua Sun, Mateu Sbert

Erschienen in: Advances in Multimedia Information Processing - PCM 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Video key frame extraction is a video summarization technique which is used to recapitulate and describe the most important segments of video sequence. Video clips containing motion information are more likely to draw users’ attention. Accordingly, we propose a novel key frame extraction scheme based on motion vector. A video sequence is partitioned into shots by distance between consecutive video frames calculated by Relative Entropy (RE). Difference of magnitude of motion vector between neighboring video images within a shot is computed to localize video clips containing significant content changes. And such segments are defined as active sub-shots in this paper. The key frames are extracted from each active sub-shots and other inactive sub-shots by exploiting different algorithms. Experimental results show that our proposed method obtains exact and complete results in video key frame extraction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chang, H.S., Sull, S., Lee, S.U.: Efficient video indexing scheme for content-based retrieval. IEEE Trans. Circ. Syst. Video Technol. 9, 1269–1279 (1999)CrossRef Chang, H.S., Sull, S., Lee, S.U.: Efficient video indexing scheme for content-based retrieval. IEEE Trans. Circ. Syst. Video Technol. 9, 1269–1279 (1999)CrossRef
2.
Zurück zum Zitat Escolano, F., Suau, P., Bonev, B.: Information Theory in Computer Vision and Pattern Recognition. Springer, London (2009)CrossRefMATH Escolano, F., Suau, P., Bonev, B.: Information Theory in Computer Vision and Pattern Recognition. Springer, London (2009)CrossRefMATH
3.
Zurück zum Zitat Feixas, M., Bardera, A., Rigau, J., Xu, Q., Sbert, M.: Information Theory Tools for Image Processing. Morgan & Claypool, San Rafael (2014)MATH Feixas, M., Bardera, A., Rigau, J., Xu, Q., Sbert, M.: Information Theory Tools for Image Processing. Morgan & Claypool, San Rafael (2014)MATH
4.
Zurück zum Zitat Gianluigi, C., Raimondo, S.: An innovative algorithm for key frame extraction in video summarization. J. Real-Time Image Proc. 1, 69–88 (2006)CrossRef Gianluigi, C., Raimondo, S.: An innovative algorithm for key frame extraction in video summarization. J. Real-Time Image Proc. 1, 69–88 (2006)CrossRef
5.
Zurück zum Zitat Guo, Y., Xu, Q., Sun, S., Luo, X., Sbert, M.: Selecting video key frames based on relative entropy and the extreme studentized deviate test. Entropy 18(3), 73 (2016)CrossRef Guo, Y., Xu, Q., Sun, S., Luo, X., Sbert, M.: Selecting video key frames based on relative entropy and the extreme studentized deviate test. Entropy 18(3), 73 (2016)CrossRef
6.
Zurück zum Zitat Li, R., Zeng, B., Liou, M.L.: A new three-step search algorithm for block motion estimation. IEEE Trans. Circ. Syst. Video Technol. 4(4), 438–442 (1994)CrossRef Li, R., Zeng, B., Liou, M.L.: A new three-step search algorithm for block motion estimation. IEEE Trans. Circ. Syst. Video Technol. 4(4), 438–442 (1994)CrossRef
7.
Zurück zum Zitat Lienhart, R., Pfeiffer, S., Effelsberg, W.: Video abstracting. Commun. ACM 40, 54–62 (1997)CrossRef Lienhart, R., Pfeiffer, S., Effelsberg, W.: Video abstracting. Commun. ACM 40, 54–62 (1997)CrossRef
8.
Zurück zum Zitat Liu, T., Kender, J.R.: Computational approaches to temporal sampling of video sequences. ACM Trans. Multimedia Comput. Commun. Appl. 3, 217–218 (2007)CrossRef Liu, T., Kender, J.R.: Computational approaches to temporal sampling of video sequences. ACM Trans. Multimedia Comput. Commun. Appl. 3, 217–218 (2007)CrossRef
9.
Zurück zum Zitat Ma, Y.F., Lu, L., Zhang, H.J., Li, M.: A user attention model for video summarization. In: Proceedings of the Tenth ACM International Conference on Multimedia, pp. 533–542. ACM (2002) Ma, Y.F., Lu, L., Zhang, H.J., Li, M.: A user attention model for video summarization. In: Proceedings of the Tenth ACM International Conference on Multimedia, pp. 533–542. ACM (2002)
10.
Zurück zum Zitat Mentzelopoulos, M., Psarrou, A.: Key-frame extraction algorithm using entropy difference. In: Proceedings of the 6th ACM SIGMM International Workshop on Multimedia Information Retrieval, pp. 39–45. ACM. New York, October 2004 Mentzelopoulos, M., Psarrou, A.: Key-frame extraction algorithm using entropy difference. In: Proceedings of the 6th ACM SIGMM International Workshop on Multimedia Information Retrieval, pp. 39–45. ACM. New York, October 2004
11.
Zurück zum Zitat Money, A.G., Agius, H.: Video summarisation: a conceptual framework and survey of the state of the art. J. Vis. Commun. Image Represent. 19, 121–143 (2008)CrossRef Money, A.G., Agius, H.: Video summarisation: a conceptual framework and survey of the state of the art. J. Vis. Commun. Image Represent. 19, 121–143 (2008)CrossRef
12.
Zurück zum Zitat Ngo, C.W., Ma, Y.F., Zhang, H.J.: Video summarization and scene detection by graph modeling. IEEE Trans. Circ. Syst. Video Technol. 15(2), 296–305 (2005)CrossRef Ngo, C.W., Ma, Y.F., Zhang, H.J.: Video summarization and scene detection by graph modeling. IEEE Trans. Circ. Syst. Video Technol. 15(2), 296–305 (2005)CrossRef
13.
Zurück zum Zitat Omidyeganeh, M., Ghaemmaghami, S., Shirmohammadi, S.: Video keyframe analysis using a segment-based statistical metric in a visually sensitive parametric space. IEEE Trans. Image Process. Publ. IEEE Signal Process. Soc. 20, 2730–2737 (2011)MathSciNetCrossRef Omidyeganeh, M., Ghaemmaghami, S., Shirmohammadi, S.: Video keyframe analysis using a segment-based statistical metric in a visually sensitive parametric space. IEEE Trans. Image Process. Publ. IEEE Signal Process. Soc. 20, 2730–2737 (2011)MathSciNetCrossRef
14.
Zurück zum Zitat Souza, C.L., Pádua, F.L.C., Nunes, C.F.G., Assis, G.T., Silva, G.D.: A unified approach to content-based indexing and retrieval of digital videos from television archives. Artif. Intell. Res. 3(3), 49–61 (2014)CrossRef Souza, C.L., Pádua, F.L.C., Nunes, C.F.G., Assis, G.T., Silva, G.D.: A unified approach to content-based indexing and retrieval of digital videos from television archives. Artif. Intell. Res. 3(3), 49–61 (2014)CrossRef
15.
Zurück zum Zitat Truong, B.T., Venkatesh, S.: Video abstraction: a systematic review and classification. ACM Trans. Multimedia Comput. Commun. Appl. 3, 3 (2007)CrossRef Truong, B.T., Venkatesh, S.: Video abstraction: a systematic review and classification. ACM Trans. Multimedia Comput. Commun. Appl. 3, 3 (2007)CrossRef
16.
Zurück zum Zitat C̆erneková, Z., Pitas, I., Nikou, C.: Information theory-based shot cut/fade detection and video summarization. IEEE Trans. Circ. Syst. Video Technol. 16, 82–91 (2006)CrossRef C̆erneková, Z., Pitas, I., Nikou, C.: Information theory-based shot cut/fade detection and video summarization. IEEE Trans. Circ. Syst. Video Technol. 16, 82–91 (2006)CrossRef
17.
Zurück zum Zitat Xu, Q., Liu, Y., Li, X., Yang, Z., Wang, J., Sbert, M., Scopigno, R.: Browsing and exploration of video sequences: a new scheme for key frame extraction and 3D visualization using entropy based Jensen divergence. Inf. Sci. 278, 736–756 (2014)MathSciNetCrossRef Xu, Q., Liu, Y., Li, X., Yang, Z., Wang, J., Sbert, M., Scopigno, R.: Browsing and exploration of video sequences: a new scheme for key frame extraction and 3D visualization using entropy based Jensen divergence. Inf. Sci. 278, 736–756 (2014)MathSciNetCrossRef
Metadaten
Titel
Key Frame Extraction Based on Motion Vector
verfasst von
Ziqian Qiang
Qing Xu
Shihua Sun
Mateu Sbert
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-48896-7_38

Neuer Inhalt