ABSTRACT
In this paper we introduce a new dataset, Div150Multi, that was designed to support shared evaluation of diversification techniques in different areas of social media photo retrieval and related areas. The dataset comes with associated relevance and diversity assessments performed by trusted annotators. The data consists of around 300 complex queries represented via 86,769 Flickr photos, around 27M photo links for around 6,000 users, metadata, Wikipedia pages and content descriptors for text and visual modalities, including state of the art deep features. To facilitate distribution, only Creative Commons content allowing redistribution was included in the dataset. The proposed dataset was validated during the 2015 Retrieving Diverse Social Images Task at the MediaEval Benchmarking.
- R. Agrawal, S. Gollapudi, A. Halverson, and S. Ieong. Diversifying search results. In WSDM, pages 5--14. ACM, 2009. Google ScholarDigital Library
- D.-T. Dang-Nguyen, G. Boato, F. G. Natale, L. Piras, G. Giacinco, F. Tuveri, and M. Angioni. Multimodal-based diversified summarization in social image retrieval. 2015.Google Scholar
- D.-T. Dang-Nguyen, L. Piras, G. Giacinto, G. Boato, and F. G. De Natale. A hybrid approach for retrieving diverse social images of landmarks. In IEEE ICME, pages 1--6, 2015.Google ScholarCross Ref
- A. Dean-Hall, C. L. Clarke, J. Kamps, P. Thomas, N. Simone, and E. Voorhees. Overview of the trec 2013 contextual suggestion track. Technical report, DTIC Document, 2013.Google Scholar
- A. L. Ginsca, A. Popescu, B. Ionescu, A. Armagan, and I. Kanellos. Toward an estimation of user tagging credibility for social image retrieval. In ACMMM, pages 1021--1024. ACM, 2014. Google ScholarDigital Library
- E. Hoque, O. Hoeber, and M. Gong. Balancing the trade-offs between diversity and precision for web image search using concept-based query expansion. Journal of Emerging Technologies in Web Intelligence, 4(1):26--34, 2012.Google ScholarCross Ref
- B. Ionescu, A. L. Gînsca, B. Boteanu, A. Popescu, M. Lupu, and H. Müller. Retrieving diverse social images at mediaeval 2015: Challenge, dataset and evaluation. In MediaEval, vol. 1436, pages 14--15, 2015.Google Scholar
- B. Ionescu, A. Popescu, M. Lupu, A.-L. Gînsca, B. Boteanu, and H. Müller. Div150cred: A social image retrieval result diversification with user tagging credibility dataset. In MMSys, pages 207--212, 2015. Google ScholarDigital Library
- B. Ionescu, A.-L. Radu, M. Menéndez, H. Müller, A. Popescu, and B. Loni. Div400: a social image retrieval result diversification dataset. In MMSys, pages 29--34. ACM, 2014. Google ScholarDigital Library
- Y. Liu, R. Song, M. Zhang, Z. Dou, T. Yamamoto, M. P. Kato, H. Ohshima, and K. Zhou. Overview of the ntcir-11 imine task. In NTCIR, 2014.Google Scholar
- M. L. Paramita, M. Sanderson, and P. Clough. Diversity in photo retrieval: overview of the imageclefphoto task 2009. In Multilingual Information Access Evaluation II. Multimedia Experiments, pages 45--59. Springer, 2009. Google ScholarDigital Library
- J. J. Randolph. Free-marginal multirater kappa (multirater k {free}): An alternative to fleiss' fixed-marginal multirater kappa. Online submission, 2005.Google Scholar
- S. Rudinac, A. Hanjalic, and M. Larson. Generating visual summaries of geographic areas using community-contributed images. Multimedia, IEEE Transactions on, 15(4):921--932, 2013. Google ScholarDigital Library
- S. Sabetghadam, J. Palotti, N. Rekabsaz, M. Lupu, and A. Hanbury. Tuw@ mediaeval 2015 retrieving diverse social images task.Google Scholar
- E. Spyromitros-Xioufis, S. Papadopoulos, A. L. Ginsca, A. Popescu, Y. Kompatsiaris, and I. Vlahavas. Improving diversity in image search via supervised relevance scoring. In ICMR, pages 323--330. ACM, 2015. Google ScholarDigital Library
- E. Spyromitros-Xioufis, A. Popescu, S. Papadopoulos, and I. Kompatsiaris. Usemp: Finding diverse images at mediaeval 2015. 2015.Google Scholar
- A. Sun and S. S. Bhowmick. Image tag clarity: in search of visual-representative tags for social images. In Proceedings of the first SIGMM workshop on Social media, pages 19--26. ACM, 2009. Google ScholarDigital Library
- B. Thomee, D. A. Shamma, G. Friedland, B. Elizalde, K. Ni, D. Poland, D. Borth, and L.-J. Li. The new data and new challenges in multimedia research. arXiv preprint arXiv:1503.01817, 2015.Google Scholar
- R. H. van Leuken, L. Garcia, X. Olivares, and R. van Zwol. Visual diversification of image search results. In WWW, pages 341--350. ACM, 2009. Google ScholarDigital Library
- K. Yang, M. Wang, X.-S. Hua, and H.-J. Zhang. Tag-based social image search: Toward relevant and diverse results. In Social Media Modeling and Computing, pages 25--45. Springer, 2011.Google ScholarCross Ref
- H.-T. Yu and F. Ren. Search result diversification via filling up multiple knapsacks. In CIKM, pages 609--618. ACM, 2014. Google ScholarDigital Library
- Y. Zhu, Y. Lan, J. Guo, X. Cheng, and S. Niu. Learning for search result diversification. In SIGIR, pages 293--302. ACM, 2014. Google ScholarDigital Library
Index Terms
- Div150Multi: a social image retrieval result diversification dataset with multi-topic queries
Recommendations
Div150Cred: A social image retrieval result diversification with user tagging credibility dataset
MMSys '15: Proceedings of the 6th ACM Multimedia Systems ConferenceIn this paper we introduce a new dataset and its evaluation tools, Div150Cred, that was designed to support shared evaluation of diversification techniques in different areas of social media photo retrieval and related areas. The dataset comes with ...
Div400: a social image retrieval result diversification dataset
MMSys '14: Proceedings of the 5th ACM Multimedia Systems ConferenceIn this paper we propose a new dataset, Div400, that was designed to support shared evaluation in different areas of social media photo retrieval, e.g., machine analysis (re-ranking, machine learning), human-based computation (crowdsourcing) or hybrid ...
Social Event Mining in Large Photo Collections
ICMR '15: Proceedings of the 5th ACM on International Conference on Multimedia RetrievalA significant part of publicly available photos on the Internet depicts a variety of different social events. In order to organize this steadily growing media content and to make it easily accessible, novel indexing methods are required. Essential ...
Comments