ABSTRACT
In this paper we introduce a new dataset and its evaluation tools, Div150Cred, that was designed to support shared evaluation of diversification techniques in different areas of social media photo retrieval and related areas. The dataset comes with associated relevance and diversity assessments performed by human annotators. The data consists of 300 landmark locations represented via 45,375 Flickr photos, 16M photo links for around 3,000 users, metadata, Wikipedia pages and content descriptors for text and visual modalities. To facilitate distribution, only Creative Commons content was included in the dataset. The proposed dataset was validated during the 2014 Retrieving Diverse Social Images Task at the MediaEval Benchmarking Initiative.
- S. Rudinac, A. Hanjalic, M. A. Larson, "Generating Visual Summaries of Geographic Areas Using Community - Contributed Images", IEEE Transactions on Multimedia, 15(4), pp. 921--932, 2013. Google ScholarDigital Library
- B. Taneva, M. Kacimi, G. Weikum, "Gathering and Ranking Photos of Named Entities with High Precision, High Recall, and Diversity", ACM Web Search and Data Mining, pp. 431--440, 2010. Google ScholarDigital Library
- M. L. Paramita, M. Sanderson, P. Clough, "Diversity in Photo Retrieval: Overview of the ImageCLEF Photo Task 2009", ImageCLEF 2009. Google ScholarDigital Library
- R. H. van Leuken, L. Garcia, X. Olivares, R. van Zwol, "Visual Diversification of Image Search Results", ACM World Wide Web, pp. 341--350, 2009. Google ScholarDigital Library
- B. Ionescu, A.-L. Radu, M. Menéndez, H. Müller, A. Popescu, B. Loni, "Div400: A Social Image Retrieval Result Diversification Dataset", ACM MMSys, Singapore, 2014. Google ScholarDigital Library
- D. Harman, "How effective is suffixing", JASIS, 42, 1991.Google Scholar
- A. Popescu, "CEA LIST's Participation at MediaEval 2013 Placing Task", Working Notes of MediaEval 2013, CEUR-WS, Vol. 1043, Barcelona, Spain.Google Scholar
- J. J. Randolph, "Free-Marginal Multirater Kappa (multirater κfree): an Alternative to Fleiss Fixed-Marginal Multirater Kappa", Joensuu Learning and Instruction Symposium, 2005.Google Scholar
- B. Ionescu, A. Popescu, M. Lupu, A. L. Gînscă, H. Müller, "Retrieving Diverse Social Images at MediaEval 2014: Challenge, Dataset and Evaluation", Working Notes of MediaEval, Barcelona, Spain, CEUR-WS, Vol. 1263, 2014.Google Scholar
- D.-T. Dang-Nguyen, L. Piras, G. Giacinto, G. Boato, F. De Natale, "Retrieval of Diverse Images by Pre-filtering and Hierarchical Clustering", Working Notes of MediaEval 2014, Barcelona, Spain, CEUR-WS, Vol. 1263, 2014.Google Scholar
- A. L. Gînscă, A. Popescu, B. Ionescu, A. Armagan, I. Kanellos, "Toward Estimating User Tagging Credibility for Social Image Retrieval", ACM Multimedia, Orlando, Florida, USA, 2014. Google ScholarDigital Library
Index Terms
- Div150Cred: A social image retrieval result diversification with user tagging credibility dataset
Recommendations
Div150Multi: a social image retrieval result diversification dataset with multi-topic queries
MMSys '16: Proceedings of the 7th International Conference on Multimedia SystemsIn this paper we introduce a new dataset, Div150Multi, that was designed to support shared evaluation of diversification techniques in different areas of social media photo retrieval and related areas. The dataset comes with associated relevance and ...
Div400: a social image retrieval result diversification dataset
MMSys '14: Proceedings of the 5th ACM Multimedia Systems ConferenceIn this paper we propose a new dataset, Div400, that was designed to support shared evaluation in different areas of social media photo retrieval, e.g., machine analysis (re-ranking, machine learning), human-based computation (crowdsourcing) or hybrid ...
Social Event Mining in Large Photo Collections
ICMR '15: Proceedings of the 5th ACM on International Conference on Multimedia RetrievalA significant part of publicly available photos on the Internet depicts a variety of different social events. In order to organize this steadily growing media content and to make it easily accessible, novel indexing methods are required. Essential ...
Comments