skip to main content
column

Report on the SIGIR 2015 Workshop on Reproducibility, Inexplicability, and Generalizability of Results (RIGOR)

Published:29 January 2016Publication History
Skip Abstract Section

Abstract

The SIGIR 2015 Workshop on Reproducibility, Inexplicability, and Generalizability of Results (RIGOR) took place on Thursday, August 13, 2015 in Santiago, Chile. The goal of the workshop was two fold. The first to provide a venue for the publication and presentation of negative results. The second was to provide a venue through which the authors of open source search engines could compare performance of indexing and searching on the same collections and on the same machines - encouraging the sharing of ideas and discoveries in a like-to-like environment. In total three papers were presented and seven systems participated.

References

  1. T. Armstrong, A. Moffat, W. Webber, and J. Zobel. Improvements that don't add up: Ad-hoc retrieval results since 1998. In CIKM 2009, pages 601--610, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. E. Di Buccio, G.M. Di Nunzio, N. Ferro, D. Harman, M. Maistro, and G. Silvello. Unfolding off-the-shelf IR systems for reproducibility. In RIGOR 2015, 2015.Google ScholarGoogle Scholar
  3. B. Carterette and K. Sabhnani. Using simulation to analyze the potential for reproducibility. In RIGOR 2015, 2015.Google ScholarGoogle Scholar
  4. X. Lu, A. Moffat, and S. Culpepper. Observed volatility in effectiveness metrics. In RIGOR 2015, 2015.Google ScholarGoogle Scholar
  5. H. Mhleisen, T. Samar, J. Lin, and A. de Vries. Old dogs are great at new tricks: Column stores for ir prototyping. In SIGIR 2014, pages 863--866, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. A. Trotman, A. Puurula, and B. Burgess. Improvements to BM25 and language models examined. In ADCS 2014, pages 58--65, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image ACM SIGIR Forum
    ACM SIGIR Forum  Volume 49, Issue 2
    December 2015
    141 pages
    ISSN:0163-5840
    DOI:10.1145/2888422
    Issue’s Table of Contents

    Copyright © 2016 Authors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 29 January 2016

    Check for updates

    Qualifiers

    • column

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader