skip to main content
10.1145/2910017.2910620acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
research-article

Div150Multi: a social image retrieval result diversification dataset with multi-topic queries

Published:10 May 2016Publication History

ABSTRACT

In this paper we introduce a new dataset, Div150Multi, that was designed to support shared evaluation of diversification techniques in different areas of social media photo retrieval and related areas. The dataset comes with associated relevance and diversity assessments performed by trusted annotators. The data consists of around 300 complex queries represented via 86,769 Flickr photos, around 27M photo links for around 6,000 users, metadata, Wikipedia pages and content descriptors for text and visual modalities, including state of the art deep features. To facilitate distribution, only Creative Commons content allowing redistribution was included in the dataset. The proposed dataset was validated during the 2015 Retrieving Diverse Social Images Task at the MediaEval Benchmarking.

References

  1. R. Agrawal, S. Gollapudi, A. Halverson, and S. Ieong. Diversifying search results. In WSDM, pages 5--14. ACM, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. D.-T. Dang-Nguyen, G. Boato, F. G. Natale, L. Piras, G. Giacinco, F. Tuveri, and M. Angioni. Multimodal-based diversified summarization in social image retrieval. 2015.Google ScholarGoogle Scholar
  3. D.-T. Dang-Nguyen, L. Piras, G. Giacinto, G. Boato, and F. G. De Natale. A hybrid approach for retrieving diverse social images of landmarks. In IEEE ICME, pages 1--6, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  4. A. Dean-Hall, C. L. Clarke, J. Kamps, P. Thomas, N. Simone, and E. Voorhees. Overview of the trec 2013 contextual suggestion track. Technical report, DTIC Document, 2013.Google ScholarGoogle Scholar
  5. A. L. Ginsca, A. Popescu, B. Ionescu, A. Armagan, and I. Kanellos. Toward an estimation of user tagging credibility for social image retrieval. In ACMMM, pages 1021--1024. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. E. Hoque, O. Hoeber, and M. Gong. Balancing the trade-offs between diversity and precision for web image search using concept-based query expansion. Journal of Emerging Technologies in Web Intelligence, 4(1):26--34, 2012.Google ScholarGoogle ScholarCross RefCross Ref
  7. B. Ionescu, A. L. Gînsca, B. Boteanu, A. Popescu, M. Lupu, and H. Müller. Retrieving diverse social images at mediaeval 2015: Challenge, dataset and evaluation. In MediaEval, vol. 1436, pages 14--15, 2015.Google ScholarGoogle Scholar
  8. B. Ionescu, A. Popescu, M. Lupu, A.-L. Gînsca, B. Boteanu, and H. Müller. Div150cred: A social image retrieval result diversification with user tagging credibility dataset. In MMSys, pages 207--212, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. B. Ionescu, A.-L. Radu, M. Menéndez, H. Müller, A. Popescu, and B. Loni. Div400: a social image retrieval result diversification dataset. In MMSys, pages 29--34. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Y. Liu, R. Song, M. Zhang, Z. Dou, T. Yamamoto, M. P. Kato, H. Ohshima, and K. Zhou. Overview of the ntcir-11 imine task. In NTCIR, 2014.Google ScholarGoogle Scholar
  11. M. L. Paramita, M. Sanderson, and P. Clough. Diversity in photo retrieval: overview of the imageclefphoto task 2009. In Multilingual Information Access Evaluation II. Multimedia Experiments, pages 45--59. Springer, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. J. Randolph. Free-marginal multirater kappa (multirater k {free}): An alternative to fleiss' fixed-marginal multirater kappa. Online submission, 2005.Google ScholarGoogle Scholar
  13. S. Rudinac, A. Hanjalic, and M. Larson. Generating visual summaries of geographic areas using community-contributed images. Multimedia, IEEE Transactions on, 15(4):921--932, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. S. Sabetghadam, J. Palotti, N. Rekabsaz, M. Lupu, and A. Hanbury. Tuw@ mediaeval 2015 retrieving diverse social images task.Google ScholarGoogle Scholar
  15. E. Spyromitros-Xioufis, S. Papadopoulos, A. L. Ginsca, A. Popescu, Y. Kompatsiaris, and I. Vlahavas. Improving diversity in image search via supervised relevance scoring. In ICMR, pages 323--330. ACM, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. E. Spyromitros-Xioufis, A. Popescu, S. Papadopoulos, and I. Kompatsiaris. Usemp: Finding diverse images at mediaeval 2015. 2015.Google ScholarGoogle Scholar
  17. A. Sun and S. S. Bhowmick. Image tag clarity: in search of visual-representative tags for social images. In Proceedings of the first SIGMM workshop on Social media, pages 19--26. ACM, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. B. Thomee, D. A. Shamma, G. Friedland, B. Elizalde, K. Ni, D. Poland, D. Borth, and L.-J. Li. The new data and new challenges in multimedia research. arXiv preprint arXiv:1503.01817, 2015.Google ScholarGoogle Scholar
  19. R. H. van Leuken, L. Garcia, X. Olivares, and R. van Zwol. Visual diversification of image search results. In WWW, pages 341--350. ACM, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. K. Yang, M. Wang, X.-S. Hua, and H.-J. Zhang. Tag-based social image search: Toward relevant and diverse results. In Social Media Modeling and Computing, pages 25--45. Springer, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  21. H.-T. Yu and F. Ren. Search result diversification via filling up multiple knapsacks. In CIKM, pages 609--618. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Y. Zhu, Y. Lan, J. Guo, X. Cheng, and S. Niu. Learning for search result diversification. In SIGIR, pages 293--302. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Div150Multi: a social image retrieval result diversification dataset with multi-topic queries

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        MMSys '16: Proceedings of the 7th International Conference on Multimedia Systems
        May 2016
        420 pages
        ISBN:9781450342971
        DOI:10.1145/2910017
        • General Chair:
        • Christian Timmerer

        Copyright © 2016 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 10 May 2016

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        MMSys '16 Paper Acceptance Rate20of71submissions,28%Overall Acceptance Rate176of530submissions,33%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader