David Mimno
ABSTRACT
An essential part of an expert-finding task, such as matching reviewers to submitted papers, is the ability to model the expertise of a person based on documents. We evaluate several measures of the association between an author in an existing collection of research papers and a previously unseen document. We compare two language model based approaches with a novel topic model, Author-Persona-Topic (APT). In this model, each author can write under one or more "personas," which are represented as independent distributions over hidden topics. Examples of previous papers written by prospective reviewers are gathered from the Rexa database, which extracts and disambiguates author mentions from documents gathered from the web. We evaluate the models using a reviewer matching task based on human relevance judgments determining how well the expertise of proposed reviewers matches a submission. We find that the APT topic model outperforms the other models.
- K. Balog, L. Azzopardi, and M. de Rijke. Formal models for expert finding in enterprise corpora. In SIGIR, 2006. Google Scholar
Digital Library
- C. Basu, H. Hirsh, W. Cohen, and C.Nevill-Manning. Recommending papers by mining the web. In IJCAI, 1999.Google Scholar
- S. Benferhat and J.Lang. Conference paper assignment. Int. J. Intell. Syst, 16: 1183, 2001.Google ScholarCross Ref
- D. Blei, A. Ng, and M. Jordan. Latent Dirichlet allocation. Journal of Machine Learning Research, 3: 993--1022, January 2003. Google ScholarDigital Library
- C. Buckley and E. M. Voorhees. Retrieval evaluation with incomplete information. In SIGIR, 2004. Google ScholarDigital Library
- S. T. Dumais and J. Nielsen. Automating the assignment of submitted manuscripts to reviewers. In SIGIR, page 233, 1992. Google ScholarDigital Library
- S. Hettich and M. J. Pazzani. Mining for proposal reviewers: lessons learned at the national science foundation. In KDD, 2006. Google ScholarDigital Library
- A. McCallum, A. Corrada-Emmanuel, and X. Wang. Topic and role discovery in social networks. In IJCAI, 2005. Google ScholarDigital Library
- D. Petkova and W. B. Croft. Hierarchical language models for expert finding in enterprise corpora. In International Conference on Tools with Artificial Intelligence, 2006. Google ScholarDigital Library
- J. M. Ponte and W. B. Croft. A language modeling approach to information retrieval. In SIGIR, 1998. Google ScholarDigital Library
- M. A. Rodriguez and J. Bollen. An algorithm to determine peer-reviews. Technical report, Los Alamos National Laboratory, 2006.Google Scholar
- M. Rosen-Zvi, T. Griffiths, M. Steyvers, and P. Smyth. The author-topic model for authors and documents. In UAI, 2004. Google ScholarDigital Library
- X. Wei and B. Croft. LDA-based document models for ad-hoc retrieval. In SIGIR 2006, 2006. Google ScholarDigital Library
- C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to ad hoc information retrieval. In SIGIR, 2001. Google ScholarDigital Library
Index Terms
- Expertise modeling for matching papers with reviewers
Recommendations
Multi-aspect expertise matching for review assignment
CIKM '08: Proceedings of the 17th ACM conference on Information and knowledge managementReview assignment is a common task that many people such as conference organizers, journal editors, and grant administrators would have to do routinely. As a computational problem, it involves matching a set of candidate reviewers with a paper or ...
Modeling online reviews with multi-grain topic models
WWW '08: Proceedings of the 17th international conference on World Wide WebIn this paper we present a novel framework for extracting the ratable aspects of objects from online user reviews. Extracting such aspects is an important challenge in automatically mining product opinions from the web and in generating opinion-based ...
On optimization of expertise matching with various constraints
This paper studies the problem of expertise matching with various constraints. Expertise matching, which aims to find the alignment between experts and queries, is a common problem in many applications such as conference paper-reviewer assignment, ...
Comments