skip to main content
10.1145/2818048.2820009acmconferencesArticle/Chapter ViewAbstractPublication PagescscwConference Proceedingsconference-collections
research-article
Public Access

Early Activity Diversity: Assessing Newcomer Retention from First-Session Activity

Published:27 February 2016Publication History

ABSTRACT

Online communities suffer serious newcomer attrition. This paper explores whether and how early activity diversity - the degree to which a newcomer engages in a wide range of a site's activities in the first session - is associated with their longevity. We introduce a metric (DSCORE) to characterize early activity diversity in online sites and run our analyses on an online community ‘MovieLens’. We find that DSCORE is significant both by itself and in conjunction with a measure of quantity of activity in predicting longevity. This finding is robust to different measures of longevity (aggregate number of sessions and attritions after sessions 1, 5, and 10). The immediate implication is an effective classifier for identifying users with higher (or lower) expected longevity from the first-session activity. We also find DSCORE is more useful than a traditional measure of measuring diversity such as the Gini-Simpson index. We conclude by discussing how early activity diversity may be more broadly effective in supporting design and management of online communities.

References

  1. Jaime Arguello, Brian S. Butler, Elisabeth Joyce, Robert Kraut, Kimberly S. Ling, Carolyn Rosé, and Xiaoqing Wang. 2006. Talk to me: foundations for successful individual-group interactions in online communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), 959-968. http://doi.acm.org/10.1145/1124772.1124916 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Talya N. Bauer, Todd E Bodner, Berrin Erdogan, Donald M. Truxillo, and Jennifer S. Tucker. 2007. Newcomer Adjustment During Organizational Socialization: A Meta-Analytic Review of Antecedents, Outcomes, and Methods. Journal of Applied Psychology 92, 3: 707–721.Google ScholarGoogle ScholarCross RefCross Ref
  3. Zoheb H. Borbora and Jaideep Srivastava. 2012. User Behavior Modelling Approach for Churn Prediction in Online Games. In Proceedings of the 2012 ASE/IEEE International Conference on Social Computing and 2012 ASE/IEEE International Conference on Privacy, Security, Risk and Trust (SOCIALCOM-PASSAT '12), 51-60. http://dx.doi.org/10.1109/SocialCom-PASSAT.2012.84 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Moira Burke, Cameron Marlow, and Thomas Lento. 2009. Feed me: motivating newcomer contribution in social network sites. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09), 945-954. http://doi.acm.org/10.1145/1518701.1518847 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Moira Burke, Cameron Marlow, and Thomas Lento. 2010. Social network activity and social well-being. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10), 1909-1912. http://doi.acm.org/10.1145/1753326.1753613 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Derek S. Chapman, Krista L. Uggerslev, Sarah A. Carroll, Kelly A. Piasentin, and David A. Jones. 2005. Applicant Attraction to Organizations and Job Choice: A Meta-Analytic Review of the Correlates of Recruiting Outcomes. Journal of Applied Psychology 90, 5: 928-944.Google ScholarGoogle ScholarCross RefCross Ref
  7. Boreum Choi, Kira Alexander, Robert E. Kraut, and John M. Levine. 2010. Socialization tactics in Wikipedia and their effects. In Proceedings of the 2010 ACM conference on Computer supported cooperative work (CSCW '10), 107-116. http://doi.acm.org/10.1145/1718918.1718940 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Giovanni Luca Ciampaglia and Dario Taraborelli. 2015. MoodBar: Increasing New User Retention in Wikipedia through Lightweight Socialization. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15), 734-742. http://doi.acm.org/10.1145/2675133.2675181 Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Robert K. Colwell. 2009. Biodiversity: concepts, patterns and measurement. In The Princeton guide to ecology (1st. ed.), Simon A. Levin (eds.). Princeton University Press, Princeton, NJ, 257-263.Google ScholarGoogle Scholar
  10. Gideon Dror, Dan Pelleg, Oleg Rokhlenko, and Idan Szpektor. 2012. Churn prediction in new users of Yahoo! answers. In Proceedings of the 21st international conference companion on World Wide Web (WWW '12 Companion), 829-834. http://doi.acm.org/10.1145/2187980.2188207 Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Nicolas Ducheneaut. 2005. Socialization in an Open Source Software Community: A Socio-Technical Analysis. Comput. Supported Coop. Work 14, 4: 323-368. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Kate Ehrlich, Michael Muller, Tara Matthews, Ido Guy, and Inbal Ronen. 2014. What motivates members to contribute to enterprise online communities? In Proceedings of the companion publication of the 17th ACM conference on Computer supported cooperative work & social computing (CSCW Companion '14), 149-152. http://doi.acm.org/10.1145/2556420.2556477 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. John Fox. 2002. Cox Proportional-Hazards Regression for Survival Data. Retrieved July 24, 2015 from https://socserv.socsci.mcmaster.ca/jfox/Books/Companion-1E/appendix-cox-regression.pdfGoogle ScholarGoogle Scholar
  14. Jill Freyne, Michal Jacovi, Ido Guy, and Werner Geyer. 2009. Increasing engagement through early recommender intervention. In Proceedings of the third ACM conference on Recommender systems (RecSys '09), 85-92. http://doi.acm.org/10.1145/1639714.1639730 Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Paul Fugelstad, Patrick Dwyer, Jennifer Filson Moses, John Kim, Cleila Anna Mannino, Loren Terveen, and Mark Snyder. 2012. What makes users rate (share, tag, edit...)?: predicting patterns of participation in online communities. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (CSCW '12), 969-978. http://doi.acm.org/10.1145/2145204.2145349 Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. R. Stuart Geiger and Aaron Halfaker. 2013. Using edit sessions to measure participation in wikipedia. In Proceedings of the 2013 conference on Computer supported cooperative work (CSCW '13). ACM, New York, NY, USA, 861-870. http://doi.acm.org/10.1145/2441776.2441873 Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Corrado Gini. 1912. Variabilità e mutabilità contributo allo studio delle distribuzioni e delle relazioni statistiche. {Fasc. I.} Tipogr. di P. Cuppini.Google ScholarGoogle Scholar
  18. Alberto Jiménez-Valverde, and Jorge M. Lobo. 2007. Threshold criteria for conversion of probability of species presence to either-or presence-absence. Acta Oecologica 31, 3: 361-369.Google ScholarGoogle ScholarCross RefCross Ref
  19. Lou Jost. 2006. Entropy and diversity. Oikos 113, 2: 363-375.Google ScholarGoogle ScholarCross RefCross Ref
  20. Elisabeth Joyce and Robert Kraut. 2006. Predicting continued participation in newsgroups. Computer-Mediated Communication 11, 3: 723-747.Google ScholarGoogle ScholarCross RefCross Ref
  21. Sanjay Ram Kairam, Dan J. Wang, and Jure Leskovec. 2012. The life and death of online groups: predicting group growth and longevity. In Proceedings of the fifth ACM international conference on Web search and data mining (WSDM '12), 673-682. http://doi.acm.org/10.1145/2124295.2124374 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Jaya Kawale, Aditya Pal, and Jaideep Srivastava. 2009. Churn Prediction in MMORPGs: A Social Influence Based Approach. In Proceedings of the 2009 International Conference on Computational Science and Engineering - Volume 04 (CSE '09), 423-428. http://dx.doi.org/10.1109/CSE.2009.80 Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Amy Jo Kim. 2000. Community Building on the Web: Secret Strategies for Successful Online Communities (1st ed.). Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Amy L. Kristof. 1996. Person-organization fit: An integrative review of its conceptualizations, measurement, and implications. Personnel Psychology 49, 1: 1-49.Google ScholarGoogle ScholarCross RefCross Ref
  25. Amy L. Kristof-Brown, Ryan D. Zimmerman, and Eric C. Johnson. 2005. Consequences of Individuals' Fit at Work: A Meta-Analysis of Person-Job, Person-Organization, Person-Group, and Person-Supervisor Fit. Personnel Psychology 58, 2: 281-320.Google ScholarGoogle ScholarCross RefCross Ref
  26. John M. Levine and Richard L. Moreland. 1994. Group socialization: Theory and research. In European Review of Social Psychology (Vol. 5), Wolfgang. Stroebe & Miles Hewstone (eds.). John Wiley & Sons, NY, 305-336.Google ScholarGoogle Scholar
  27. Michael Muller, N. Sadat Shami, David R. Millen, and Jonathan Feinberg. 2010. We are all lurkers: consuming behaviors among authors and readers in an enterprise file-sharing service. In Proceedings of the 16th ACM international conference on Supporting group work (GROUP '10), 201-210. http://doi.acm.org/10.1145/1880071.1880106 Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Blair Nonnecke and Jenny Preece. 2000. Lurker demographics: counting the silent. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '00), 73-80. http://doi.acm.org/10.1145/332040.332409 Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Oded Nov. 2007. What motivates Wikipedians? Commun. ACM 50, 11: 60-64. http://doi.acm.org/10.1145/1297797.1297798 Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Aditya Pal, Shuo Chang, and Joseph A. Konstan. 2012. Evolution of experts in Question Answering Communities. In Proceedings of the Sixth International AAAI Conference on Web and Social Media (ICWSM'12), 274-281.Google ScholarGoogle Scholar
  31. Katherine Panciera, Aaron Halfaker, and Loren Terveen. 2009. Wikipedians are born, not made: a study of power editors on Wikipedia. In Proceedings of the ACM 2009 international conference on Supporting group work (GROUP '09), 51-60. http://doi.acm.org/10.1145/1531674.1531682 Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Derek M. Powazek. 2002. Design for Community: The Art of Connecting Real People in Virtual Places. New Riders. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Jenny Preece, Blair Nonnecke, Dorine Andrews. 2004. The top five reasons for lurking: improving community experiences for everyone. Computers in Human Behavior 20, 1: 201–223.Google ScholarGoogle ScholarCross RefCross Ref
  34. Jagat Sastry Pudipeddi, Leman Akoglu, and Hanghang Tong. 2014. User churn in focused question answering sites: characterizations and prediction. In Proceedings of the companion publication of the 23rd international conference on World wide web companion (WWW Companion '14), 469-474. http://dx.doi.org/10.1145/2567948.2576965 Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Frederick F. Reichheld, W. Earl Sasser. 1990. Zero Defections: Quality Comes to Services. Harvard Business Review 68, 5: 105-111Google ScholarGoogle Scholar
  36. Larry J. Rosenberg and John A. Czepiel. 1984. A Marketing Approach For Customer Retention. Journal of Consumer Marketing 1, 2: 45-51.Google ScholarGoogle ScholarCross RefCross Ref
  37. Claude Elwood Shannon. 2001. A mathematical theory of communication. SIGMOBILE Mob. Comput. Commun. 5, 1: 3-55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Edward H. Simpson. 1949. Measurement of diversity. Nature 163: 688-688.Google ScholarGoogle ScholarCross RefCross Ref
  39. Donna Spencer. 2009. Card Sorting: Designing Usable Categories. Rosenfeld Media.Google ScholarGoogle Scholar
  40. Katherine J. Stewart and Sanjay Gosain. 2006. The impact of ideology on effectiveness in open source software development teams. MIS Quarterly 30, 2: 291-314 Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Tammara Combs Turner, Marc A. Smith, Danyel Fisher, and Howard T. Welser. 2005. Picturing Usenet: Mapping computer mediated collective action. In Computer-Mediated Commun. 10, 4: 00-00.Google ScholarGoogle Scholar
  42. Howard T. Welser, Eric Gleave, Danyel Fisher, and Marc Smith. 2007. Visualizing the signatures of social roles in online discussion groups. Journal of social structure 8, 2: 1-32.Google ScholarGoogle Scholar
  43. Jason Tsong-Li Wang, Huiyuan Shan, Dennis Shasha, and William H. Piel. 2003. TreeRank: a similarity measure for nearest neighbor searching in phylogenetic databases. In Proc. of the 15th International Conference on Scientific and Statistical Database Management (ICSSDM'03), 171-180. http://dx.doi.org/10.1109/SSDM.2003.1214978 Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. M. McLure Wasko, and Sameer Faraj. 2000. 'It is what one does': why people participate and help others in electronic communities of practice. Journal of Strategic Information Systems 9, 2-3: 155-173.Google ScholarGoogle Scholar
  45. The Wikimedia Foundation. Attracting and retaining participants. Retrieved July 21, 2015 from https://strategy.wikimedia.org/wiki/Attracting_and_retaining_participantsGoogle ScholarGoogle Scholar
  46. Jiang Yang, Wei Xiao, Mark S. Ackerman, and Lada A. Adamic. 2010.Activity Lifespan: An Analysis of User Survival Patterns in Online Knowledge Sharing Communities. In Proceedings of the Fourth International AAAI Conference on Web and Social Media (ICWSM'10), 186-193.Google ScholarGoogle Scholar
  47. Alcides Velasquez, Rick Wash, Cliffe Lampe, and Tor Bjornrud. 2013. Latent users in an online user-generated content community. Comput. Supported Coop. Work 14, 23: 21-50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Haiyi Zhu, Robert Kraut, and Aniket Kittur. 2012. Organizing without formal organization: group identification, goal setting and social modeling in directing online production. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (CSCW '12), 935-944. http://doi.acm.org/10.1145/2145204.2145344 Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Haiyi Zhu, Robert E. Kraut, and Aniket Kittur. 2014. The impact of membership overlap on the survival of online communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 281-290. http://doi.acm.org/10.11 Google ScholarGoogle ScholarDigital LibraryDigital Library
  1. Early Activity Diversity: Assessing Newcomer Retention from First-Session Activity

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader