Dan Cosley
Dan Frankowski
Loren Terveen
John Riedl
ABSTRACT
Member-maintained communities ask their users to perform tasks the community needs. From Slashdot, to IMDb, to Wikipedia, groups with diverse interests create community-maintained artifacts of lasting value (CALV) that support the group's main purpose and provide value to others. Said communities don't help members find work to do, or do so without regard to individual preferences, such as Slashdot assigning meta-moderation randomly. Yet social science theory suggests that reducing the cost and increasing the personal value of contribution would motivate members to participate more.We present SuggestBot, software that performs intelligent task routing (matching people with tasks) in Wikipedia. SuggestBot uses broadly applicable strategies of text analysis, collaborative filtering, and hyperlink following to recommend tasks. SuggestBot's intelligent task routing increases the number of edits by roughly four times compared to suggesting random articles. Our contributions are: 1) demonstrating the value of intelligent task routing in a real deployment; 2) showing how to do intelligent task routing; and 3) sharing our experience of deploying a tool in Wikipedia, which offered both challenges and opportunities for research.
- G. Beenen, K. Ling, X. Wang, K. Chang, D. Frankowski, P. Resnick, and R. E. Kraut. Using social psychology to motivate contributions to online communities. In Proc. CSCW2004, Chicago, IL, 2004. Google Scholar
Digital Library
- S. L. Bryant, A. Forte, and A. Bruckman. Becoming wikipedian: transformation of participation in a collaborative online encyclopedia. In GROUP '05, pages 1--10, 2005. Google ScholarDigital Library
- R. Burke. Hybrid recommender systems: Survey and experiments. UMUAI, 12(4):331--370, 2002. Google ScholarDigital Library
- A. Ciffolilli. Phantom authority, self-selective recruitment and retention of members in virtual communities: The case of wikipedia. First Monday, 8(12), 2003.Google Scholar
- T. Connolly and B. Thorn. Discretionary databases: Theory, data, and implications. Organizations and Communication Technology, pages 219--233, 1990.Google ScholarCross Ref
- D. Cosley, D. Frankowski, S. Kiesler, L. Terveen, and J. Riedl. How oversight improves member-maintained communities. In CHI '05, Portland, OR, 2005. Google ScholarDigital Library
- D. Cosley, D. Frankowski, L. Terveen, and J. Riedl. Using intelligent task routing and contribution review to help communities build artifacts of lasting value. In CHI'06, Montreal, CA, 2006. Google ScholarDigital Library
- D. Cosley, S. Lawrence, and D. M. Pennock. REFEREE: An open framework for practical testing of recommender systems using researchindex. In VLDB'02, Hong Kong, August 20--23 2002. Google ScholarDigital Library
- D. Cosley, P. Ludford, and L. Terveen. Studying the effect of similarity in online task-focused interactions. In GROUP'03, pages 321--329, 2003. Google ScholarDigital Library
- W. G. Emigh and S. C. Herring. Collaborative authoring on the web: A genre analysis of online encyclopedias. In HICSS, 2005. Google ScholarDigital Library
- R. Hardin. Collective Action. Johns Hopkins, Baltimore, 1982.Google Scholar
- S. G. Harkins. Social loafing and social facilitation. Journal of Experimental Social Psych., 23:1--18, 1987.Google ScholarCross Ref
- F. M. Harper, X. Li, Y. Chen, and J. A. Konstan. An economic model of user rating in an online recommender system. In User Modeling, page 307, Edinburgh, Scotland, 2005. Springer Berlin. Google ScholarDigital Library
- J. Herlocker, J. Konstan, A. Borchers, and J. Riedl. An algorithmic framework for performing collaborative filtering. In SIGIR '99, 1999. Google ScholarDigital Library
- J. Herlocker, J. Konstan, L. Terveen, and J. Riedl. Evaluating collaborative filtering recommender systems. ACM TOIS, 22(1):5--53, Jan. 2004. Google ScholarDigital Library
- W. C. Hill, J. D. Hollan, D. Wroblewski, and T. McCandless. Edit wear and read wear. In Proceedings of CHI 1992, pages 3--9, 1992. Google ScholarDigital Library
- C. Höscher and G. Strube. Web search behavior of internet experts and newbies. In WWW '00, pages 337--346, 2000. Google ScholarDigital Library
- E. Joyce and R. E. Kraut. Predicting continued participation in newsgroups. JCMC, 11(3), 2006.Google Scholar
- N. L. Kerr. Motivation losses in small groups: a social dilemma analysis. J. Pers. Soc. Psych., 45:819--828, 1983.Google ScholarCross Ref
- K. Lakhani and E. von Hippel. How open source software works: "free" user-to-user assistance. Research Policy, 32:923--943, 2002.Google ScholarCross Ref
- C. Lampe and P. Resnick. Slash(dot) and burn: distributed moderation in a large online conversation space. In CHI '04, pages 543--550, 2004. Google ScholarDigital Library
- B. Latané, K. Williams, and S. Harkins. Many hands make light the work: The causes and consequences of social loafing. J. Pers. Soc. Psych., 37:822--832, 1979.Google ScholarCross Ref
- J. Lave and E. Wenger. Situated learning: Legitimate peripheral participation. Cambridge University, New York, NY, 1991.Google ScholarCross Ref
- J. O. Ledyard. Public Goods: A Survey of Experimental Research, pages 111--194. The Handbook of Experimental Research. Princeton University Press, Princeton, NJ, 1995.Google Scholar
- A. Lih. Wikipedia as participatory journalism: Reliable sources? metrics for evaluating collaborative media as a news resource. In 5th International Symposium on Online Journalism, Austin, TX, 2004.Google Scholar
- K. Ling, G. Beenen, P. Ludford, X. Wang, K. Chang, X. Li, D. Cosley, D. Frankowski, and L. Terveen. Using social psychology to motivate contributions to online communities. JCMC, 10(4), 2005.Google Scholar
- P. J. Ludford, D. Cosley, D. Frankowski, and L. Terveen. Think different: increasing online community participation using uniqueness and group dissimilarity. In CHI '04, pages 631--638, 2004. Google ScholarDigital Library
- S. McNee, I. Albert, D. Cosley, P. Gopalkrishnan, S. K. Lam, A. M. Rashid, J. Konstan, and J. Riedl. On the recommending of citations for research papers. In CSCW '02, November 2002. Google ScholarDigital Library
- S. M. McNee, S. K. Lam, J. A. Konstan, and J. Riedl. Interfaces for eliciting new user preferences in recommender systems. In User Modeling, pages 178--187, Johnstown, PA, USA, 2003. Springer Verlag. Google ScholarDigital Library
- M. Morita and Y. Shinoda. Information filtering based on user behavior analysis and best match text retrieval. In SIGIR '94, page 48, 1994. Google ScholarDigital Library
- B. A. Nardi, editor. Context and Consciousness: Activity Theory and Human-Computer Interaction. MIT Press, Cambridge, Mass., 1996. Google ScholarDigital Library
- G. B. Newby and C. Franks. Distributed proofreading. In Proc. JCDL2003, pages 361--363, 2003. Google ScholarDigital Library
- J. O'Donovan and B. Smyth. Is trust robust?: An analysis of trust-based recommendation. In IUI '06, pages 101--108, New York, NY, USA, 2006. Google ScholarDigital Library
- A. M. Rashid, K. Ling, R. D. Tassone, P. Resnick, R. Kraut, and J. Riedl. Motivating participation by displaying the value of contribution. In Extended Abstracts of CHI '06, 2006. Google ScholarDigital Library
- P. Resnick, N. Iacovou, M. Suchak, P. Bergstrom, and J. Riedl. Group-Lens: An open architecture for collaborative filtering of netnews. In CSCW '94, pages 175--186, 1994. Google ScholarDigital Library
- G. Salton and M. McGill. Introduction to Modern Information Retrival. McGraw-Hill, 1983. Google ScholarDigital Library
- B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. Item-based collaborative filtering recommendation algorithms. In WWW '01, pages 285--295, 2001. Google ScholarDigital Library
- C. Silverstein, H. Marais, M. Henzinger, and M. Moricz. Analysis of a very large web search engine query log. SIGIR Forum, 33(1):6--12, 1999. Google ScholarDigital Library
- B. Stvilia, M. Twidale, L. Smith, and L. Gasser. Assessing information quality of a community-based encyclopedia. In Proc. International Conference on Information Quality, pages 442--454, 2005.Google Scholar
- F. B. Viégas, M. Wattenberg, and K. Dave. Studying cooperation and conflict between authors with history flow visualizations. In CHI '04, pages 575--582, 2004. Google ScholarDigital Library
- J. Voss. Measuring wikipedia. In Proc. International Conference of the International Society for Scientometrics and Informetrics, Stockholm, 2005.Google Scholar
- C.-N. Ziegler, G. Lausen, and L. Schmidt-Thieme. Taxonomy-driven computation of product recommendations. In CIKM '04, pages 406--415, 2004. Google ScholarDigital Library
Index Terms
- SuggestBot: using intelligent task routing to help people find work in wikipedia
Recommendations
Using intelligent task routing and contribution review to help communities build artifacts of lasting value
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsMany online communities are emerging that, like Wikipedia, bring people together to build community-maintained artifacts of lasting value (CALVs). Motivating people to contribute is a key problem because the quantity and quality of contributions ...
Predicting Member Productivity and Withdrawal from Pre-Joining Attachments in Online Production Groups
CSCW '17: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social ComputingProductive and dedicated members are critical to the success of online production communities like Wikipedia. Many communities organize in subgroups where members voluntarily work on projects of shared interest. In this paper, we investigate how members'...
Out With The Old, In With The New?: Unpacking Member Turnover in Online Production Groups
Nearly any group is subject to turnover : some people leave, while others join. Turnover can be especially high in online groups, since participation typically is strictly voluntary. We investigated the effects of member turnover in online groups, ...
Comments