Skip to main content
Top
Published in: International Journal of Multimedia Information Retrieval 3/2022

23-05-2022 | Regular Paper

How can users’ comments posted on social media videos be a source of effective tags?

Author: Mehdi Ellouze

Published in: International Journal of Multimedia Information Retrieval | Issue 3/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper proposed a new approach for the extraction of tags from users’ comments made about videos. In fact, videos on the social media, like Facebook and YouTube, are usually accompanied by comments where users may give opinions about things evoked in the video. The main challenge is how to extract relevant tags from them. To the best of the authors’ knowledge, this is the first research work to present an approach to extract tags from comments posted about videos on the social media. We do not pretend that comments can be a perfect solution for tagging videos since we rather tried to investigate the reliability of comments to tag videos and we studied how they can serve as a source of tags. The proposed approach is based on filtering the comments to retain only the words that could be possible tags. We relied on the self-organizing map clustering considering that tags of a given video are semantically and contextually close. We tested our approach on the Google YouTube 8M dataset, and the achieved results show that we can rely on comments to extract tags. They could be also used to enrich and refine the existing uploaders’ tags as a second area of application. This can mitigate the bias effect of the uploader’s tags which are generally subjective.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Mazloom M, Li X, Snoek CGM (2016) 5-TagBook: a semantic video representation without supervision for event detection. IEEE Trans Multimedia Arch 18(7):1378–1388 Mazloom M, Li X, Snoek CGM (2016) 5-TagBook: a semantic video representation without supervision for event detection. IEEE Trans Multimedia Arch 18(7):1378–1388
2.
go back to reference Siersdorfer S, San Pedro J, Sanderson M (2009) Automatic video tagging using content redundancy. In: Proceedings of ACM SIGIR, pp 395–402 Siersdorfer S, San Pedro J, Sanderson M (2009) Automatic video tagging using content redundancy. In: Proceedings of ACM SIGIR, pp 395–402
3.
go back to reference Zhao W, Wu X, Ngo CW (2010) On the annotation of web videos by efficient near-duplicate search. IEEE Trans Multimedia 2:448–461CrossRef Zhao W, Wu X, Ngo CW (2010) On the annotation of web videos by efficient near-duplicate search. IEEE Trans Multimedia 2:448–461CrossRef
4.
go back to reference Viana P, Pinto JP (2017) A collaborative approach for semantic time-based video annotation using gamification, Human Centric Comput Inf Sci 7(1) Viana P, Pinto JP (2017) A collaborative approach for semantic time-based video annotation using gamification, Human Centric Comput Inf Sci 7(1)
5.
go back to reference Ballan L, Bertini M, Uricchio T, Del Bimbo A (2015) Data-driven approaches for social image and video tagging. Multimedia Tools Appl 74(4):1443–1468CrossRef Ballan L, Bertini M, Uricchio T, Del Bimbo A (2015) Data-driven approaches for social image and video tagging. Multimedia Tools Appl 74(4):1443–1468CrossRef
6.
go back to reference Ballan L, Bertini M, Serra G, Del Bimbo A (2015) A data-driven approach for tag refinement and localization in web videos. Comput Vis Image Underst 140:58–67CrossRef Ballan L, Bertini M, Serra G, Del Bimbo A (2015) A data-driven approach for tag refinement and localization in web videos. Comput Vis Image Underst 140:58–67CrossRef
7.
go back to reference Baraldi L, Grana C, Cucchiara R (2017) A video library system using scene detection and automatic tagging. In: Italian research conference on digital libraries proceedings, pp 56–67 Baraldi L, Grana C, Cucchiara R (2017) A video library system using scene detection and automatic tagging. In: Italian research conference on digital libraries proceedings, pp 56–67
8.
go back to reference Zhu X, Huang Z, Cui J, Shen HT (2013) Video-to-shot tag propagation by graph sparse group lasso. IEEE Trans Multimedia 15:633–646CrossRef Zhu X, Huang Z, Cui J, Shen HT (2013) Video-to-shot tag propagation by graph sparse group lasso. IEEE Trans Multimedia 15:633–646CrossRef
9.
go back to reference Wang M, Hong R, Li G, Zha Z-J, Yan S, Chua T-S (2012) Event driven web video summarization by tag localization and key-shot identification. IEEE Trans Multimedia 14:975–985CrossRef Wang M, Hong R, Li G, Zha Z-J, Yan S, Chua T-S (2012) Event driven web video summarization by tag localization and key-shot identification. IEEE Trans Multimedia 14:975–985CrossRef
10.
go back to reference Oorschot G, ERP M, Dijkshoorn C (2012) Automatic extraction of soccer game events from twitter, workshop on detection, representation, and exploitation of events in the semantic Oorschot G, ERP M, Dijkshoorn C (2012) Automatic extraction of soccer game events from twitter, workshop on detection, representation, and exploitation of events in the semantic
11.
go back to reference Tang A, Boring S (2012) EpicPlay: crowd-sourcing sports video highlights. In: SIGCHI conference on human factors in computing systems. ACM, pp 1569–1572 Tang A, Boring S (2012) EpicPlay: crowd-sourcing sports video highlights. In: SIGCHI conference on human factors in computing systems. ACM, pp 1569–1572
12.
go back to reference Chiraratanasopha B (2021) Sentimental analysis and keyword extraction from Thai users of facebook in COVID-19 period, progress in applied. Sci Technol 11:66–72 Chiraratanasopha B (2021) Sentimental analysis and keyword extraction from Thai users of facebook in COVID-19 period, progress in applied. Sci Technol 11:66–72
13.
go back to reference Chou CL, Tsai MH, Chao CH et al (2014) Automatic restaurant information and keyword extraction by mining blog data for Chinese restaurant search. In: Proceedings of Pacific-Asia conference on knowledge discovery and data mining. Taiwan, pp 700–711 Chou CL, Tsai MH, Chao CH et al (2014) Automatic restaurant information and keyword extraction by mining blog data for Chinese restaurant search. In: Proceedings of Pacific-Asia conference on knowledge discovery and data mining. Taiwan, pp 700–711
14.
go back to reference Yang W, Yang Z (2016) Keyword extraction method over blog community. In: Proceedings of the international conference on fuzzy systems and knowledge discovery, pp 1553–1556 Yang W, Yang Z (2016) Keyword extraction method over blog community. In: Proceedings of the international conference on fuzzy systems and knowledge discovery, pp 1553–1556
15.
go back to reference Marujo L, Ling W, Trancoso I, Dyer C, Black AW, Gershman A et al (2015) Automatic keyword extraction on twitter. In: Proceedings of the annual meeting of the association for computational linguistics and the international joint conference on natural language processing, pp 637–643 Marujo L, Ling W, Trancoso I, Dyer C, Black AW, Gershman A et al (2015) Automatic keyword extraction on twitter. In: Proceedings of the annual meeting of the association for computational linguistics and the international joint conference on natural language processing, pp 637–643
16.
go back to reference Park J, Kim J, Lee J-H (2014) Keyword extraction for blogs based on content richness. J Inf Sci 40(1):38–49 Park J, Kim J, Lee J-H (2014) Keyword extraction for blogs based on content richness. J Inf Sci 40(1):38–49
17.
go back to reference Campos R, Mangaravite V, Pasquali A, Jorge A, Nunes C, Jatowt A (2020) YAKE! keyword extraction from single documents using multiple. J Inf Sci 509:257–289 Campos R, Mangaravite V, Pasquali A, Jorge A, Nunes C, Jatowt A (2020) YAKE! keyword extraction from single documents using multiple. J Inf Sci 509:257–289
18.
20.
go back to reference Bird S, Klein E, Loper E (2009) Natural language processing with python. O’Reilly Media Inc Bird S, Klein E, Loper E (2009) Natural language processing with python. O’Reilly Media Inc
22.
go back to reference Salton G, McGill MJ (1986) Introduction to modern information retrieval. McGraw-Hill Salton G, McGill MJ (1986) Introduction to modern information retrieval. McGraw-Hill
23.
go back to reference Talabis M, McPherson R, Miyamoto I, Martin J (2015) Information security analytics: finding security insights, patterns, and anomalies in big data, pp 123–150 Talabis M, McPherson R, Miyamoto I, Martin J (2015) Information security analytics: finding security insights, patterns, and anomalies in big data, pp 123–150
24.
go back to reference Pacella M, Grieco A, Blaco M (2016) On the use of self-organizing map for text clustering in engineering change process analysis: a case study. In: Computational intelligence and neuroscience, pp 1–11 Pacella M, Grieco A, Blaco M (2016) On the use of self-organizing map for text clustering in engineering change process analysis: a case study. In: Computational intelligence and neuroscience, pp 1–11
25.
go back to reference Klami M, Lagus K (2006) Unsupervised word categorization using self-organizing maps and automatically extracted morphs. In: IDEAL, intelligent data engineering and automated learning, pp 912–919 Klami M, Lagus K (2006) Unsupervised word categorization using self-organizing maps and automatically extracted morphs. In: IDEAL, intelligent data engineering and automated learning, pp 912–919
26.
go back to reference Ellouze M, Karray H, Soltana WB, Alimi AM (2007) Utilisation de la carte de Kohonen pour la détection des plans présentateur d’un journal télévisé. In: Proceedings of international conference TAIMA , pp 271–276 Ellouze M, Karray H, Soltana WB, Alimi AM (2007) Utilisation de la carte de Kohonen pour la détection des plans présentateur d’un journal télévisé. In: Proceedings of international conference TAIMA , pp 271–276
27.
go back to reference Ellouze M, Boujemaa N, Alimi AM (2010) Scene pathfinder: unsupervised clustering techniques for movie scenes extraction. Multimedia Tools Appl 47:325–346CrossRef Ellouze M, Boujemaa N, Alimi AM (2010) Scene pathfinder: unsupervised clustering techniques for movie scenes extraction. Multimedia Tools Appl 47:325–346CrossRef
28.
go back to reference Ayadi T, Ellouze M, Hamdani TM, Alimi AM (2013) Movie scenes detection with MIGSOM based on shots semi-supervised clustering. In: Neural computing and applications, vol 22, pp 1387–1396 Ayadi T, Ellouze M, Hamdani TM, Alimi AM (2013) Movie scenes detection with MIGSOM based on shots semi-supervised clustering. In: Neural computing and applications, vol 22, pp 1387–1396
29.
go back to reference Bollegala D, Yutaka M, Mitsuru I (2007) Measuring semantic similarity between words using web search engines. In: Proceedings of international world wide web conference, pp 757–766 Bollegala D, Yutaka M, Mitsuru I (2007) Measuring semantic similarity between words using web search engines. In: Proceedings of international world wide web conference, pp 757–766
30.
go back to reference Chen PI, Lin SJ (2010) Automatic keyword prediction using Google similarity distance. Exp Syst Appl 37(3):1928–1938 Chen PI, Lin SJ (2010) Automatic keyword prediction using Google similarity distance. Exp Syst Appl 37(3):1928–1938
31.
go back to reference Xian Z, Weber K, Fesenmaier DR (2008) Representation of the online tourism domain in search engines. J Travel Res 47(2):137–150CrossRef Xian Z, Weber K, Fesenmaier DR (2008) Representation of the online tourism domain in search engines. J Travel Res 47(2):137–150CrossRef
32.
go back to reference Cilibrasi R, Vitanyi P (2007) The google similarity distance. IEEE Trans Knowl Data Eng Arch 19(3):370–383CrossRef Cilibrasi R, Vitanyi P (2007) The google similarity distance. IEEE Trans Knowl Data Eng Arch 19(3):370–383CrossRef
33.
go back to reference Fellbaum C (1998) WordNet: an electronic lexical database, language, speech, and communication. MIT Press, Cambridge, USACrossRef Fellbaum C (1998) WordNet: an electronic lexical database, language, speech, and communication. MIT Press, Cambridge, USACrossRef
35.
go back to reference Ultsch A, Siemon HP (1990) Kohonen’s self-organizing feature maps for exploratory data analysis. In: Proceedings of the international neural network conference. Kluwer Academic Press, Dordrecht Ultsch A, Siemon HP (1990) Kohonen’s self-organizing feature maps for exploratory data analysis. In: Proceedings of the international neural network conference. Kluwer Academic Press, Dordrecht
37.
go back to reference Abu-El-Haija S, Kothari N, Lee J, Natsev P, Toderici G, Varadarajan B, Vijayanarasimhan S (2016) Youtube-8m: a large-scale video classification benchmark. arXiv Abu-El-Haija S, Kothari N, Lee J, Natsev P, Toderici G, Varadarajan B, Vijayanarasimhan S (2016) Youtube-8m: a large-scale video classification benchmark. arXiv
Metadata
Title
How can users’ comments posted on social media videos be a source of effective tags?
Author
Mehdi Ellouze
Publication date
23-05-2022
Publisher
Springer London
Published in
International Journal of Multimedia Information Retrieval / Issue 3/2022
Print ISSN: 2192-6611
Electronic ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-022-00238-5

Other articles of this Issue 3/2022

International Journal of Multimedia Information Retrieval 3/2022 Go to the issue

Premium Partner