skip to main content
review-article

Novel tools to streamline the conference review process: experiences from SIGKDD'09

Published:27 May 2010Publication History
Skip Abstract Section

Abstract

The SIGKDD'09 Research Track received 537 paper submissions, which were reviewed by a Program Committee of 199 members, and a Senior Program Committee of 22 members. We used techniques from artificial intelligence and data mining to streamline and support this complicated process at three crucial stages: bidding by PC members on papers, assigning papers to reviewers, and calibrating scores obtained from the reviews. In this paper we report on the approaches taken, evaluate how well they worked, and describe some further work done after the conference.

References

  1. G. Smolka and J. Walser. Review Assignment for CP97, 1997. http://www.ps.uni-sb.de/~walser/reviewing.ps.Google ScholarGoogle Scholar
  2. M. Berkelaar, K. Eikland and P. Notebaert. lp solve : Open source (Mixed-Integer) Linear Programming system. http://lpsolve.sourceforge.net/.Google ScholarGoogle Scholar
  3. T. Minka. Expectation propagation for approximate bayesian inference. In J. S. Breese and D. Koller, editors, Proceedings of the 17th Conference in Uncertainty in Artificial Intelligence, pages 362--369. Morgan Kaufmann, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. T. Minka. Divergence measures and message passing. Technical report, Microsoft Research, 2005.Google ScholarGoogle Scholar
  5. T. Minka, J. Winn, J. Guiver, and A. Kannan. Infer. NET 2.3, 2009. Microsoft Research Cambridge. http://research.microsoft.com/infernet.Google ScholarGoogle Scholar
  6. G. Salton, A. Wong, and C. S. Yang. A vector space model for automatic indexing. Commun. ACM, 18(11):613--620, 1975. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. K. Spärck-Jones. A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation, 28(1):11--21, 1972.Google ScholarGoogle ScholarCross RefCross Ref
  8. S. Spiegler. Comparative study of clustering algorithms on textual databases - clustering of curricula vitae into comptency-based groups to support knowledge management. Master's thesis, Technical University Ilmenau, Ilmenau, Germany, February 2007.Google ScholarGoogle Scholar
  9. J. Walser. Integer Optimization by Local Search, volume 1637 of Lecture Notes in Computer Science, pages 81--93. Springer, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image ACM SIGKDD Explorations Newsletter
    ACM SIGKDD Explorations Newsletter  Volume 11, Issue 2
    December 2009
    128 pages
    ISSN:1931-0145
    EISSN:1931-0153
    DOI:10.1145/1809400
    Issue’s Table of Contents

    Copyright © 2010 Authors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 27 May 2010

    Check for updates

    Qualifiers

    • review-article

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader