skip to main content
10.1145/1978942.1979366acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Design lessons from the fastest q&a site in the west

Published:07 May 2011Publication History

ABSTRACT

This paper analyzes a Question & Answer site for programmers, Stack Overflow, that dramatically improves on the utility and performance of Q&A systems for technical domains. Over 92% of Stack Overflow questions about expert topics are answered - in a median time of 11 minutes. Using a mixed methods approach that combines statistical data analysis with user interviews, we seek to understand this success. We argue that it is not primarily due to an a priori superior technical design, but also to the high visibility and daily involvement of the design team within the community they serve. This model of continued community leadership presents challenges to both CSCW systems research as well as to attempts to apply the Stack Overflow model to other specialized knowledge domains.

References

  1. Ackerman, M. S. and Malone, T. W. Answer Garden: a tool for growing organizational memory. Proceedings of the ACM SIGOIS and IEEE CS TC-OA conference on Office information systems, ACM (1990), 31--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Adamic, L. A., Zhang, J., Bakshy, E., and Ackerman, M. S. Knowledge sharing and yahoo answers: everyone knows something. Proceeding of WWW 2008, ACM (2008), 665--674. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Barcellini, F., Détienne, F., Burkhardt, J., and Sack, W. Thematic coherence and quotation practices in OSS design-oriented online discussions. Proceedings of GROUP 2005, ACM (2005), 177--186. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Bouguessa, M., Dumoulin, B., and Wang, S. Identifying authoritative actors in question-answering forums: the case of Yahoo! answers. Proceeding of ACM SIGKDD 2008, ACM (2008), 866--874. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Brandt, J., Dontcheva, M., Weskamp, M., and Klemmer, S. R. Example-centric programming: integrating web search into the development environment. Proceedings of CHI 2010, ACM (2010), 513--522. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Brooks, F. P. The Design of Design: Essays from a Computer Scientist. Addison-Wesley Professional 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Corbin, J. and Strauss, A. C. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Sage Publications, Inc, 2007.Google ScholarGoogle Scholar
  8. Dearman, D. and Truong, K. N. Why users of Yahoo! Answers do not answer questions. Proceedings of CHI 2010, ACM (2010), 329--332. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Grudin, J. Groupware and social dynamics: eight challenges for developers. Communications of the ACM 37, 1 (1994), 92--105. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Gyöngyi, Z., Koutrika, G., Pedersen, J., and Garcia-Molina, H. Questioning Yahoo! Answers. Proceedings of the First Workshop on Question Answering on the Web (at WWW 2008), (2008).Google ScholarGoogle Scholar
  11. Harper, F. M., Moy, D., and Konstan, J. A. Facts or friends?: distinguishing informational and conversational questions in social Q&A sites. Proceedings of CHI 2009, ACM (2009), 759--768. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Hartmann, B., MacDougall, D., Brandt, J., and Klemmer, S. R. What would other programmers do: suggesting solutions to error messages. Proceedings of CHI 2010, ACM (2010), 1019--1028. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Horowitz, D. and Kamvar, S. D. The anatomy of a large-scale social search engine. Proceedings of WWW 2010, ACM (2010), 431--440. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hsieh, G. and Counts, S. mimir: a market-based real-time question and answer service. Proceedings of CHI 2009, ACM (2009), 769--778. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Hsieh, G., Kraut, R. E., and Hudson, S. E. Why pay? Exploring how financial incentives are used for question & answer. Proceedings of CHI 2010, ACM (2010), 305--314. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Kleinberg, J. M. Authoritative sources in a hyperlinked environment. Journal of the ACM 46/5, 1999, 604--632. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Konstan, J. A., Miller, B. N., Maltz, D., Herlocker, J. L., Gordon, L. R., and Riedl, J. GroupLens: applying collaborative filtering to Usenet news. Communications of the ACM 40, 1997, 77--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kumar, R., Lifshits, Y., and Tomkins, A. Evolution of two-sided markets. Proceedings of the third ACM international conference on Web search and data mining, ACM (2010), 311--320. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Lampe, C. and Resnick, P. Slash(dot) and burn: distributed moderation in a large online conversation space. Proceedings of CHI 2004, ACM (2004), 543--550. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Morris, M. R., Teevan, J., and Panovich, K. What do people ask their social networks, and why?: a survey study of status message q&a behavior. Proceedings of CHI 2010, ACM (2010), 1739--1748. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Nam, K. K., Ackerman, M. S., and Adamic, L. A. Questions in, knowledge in? A study of Naver's question answering community. Proceedings of CHI 2009, ACM (2009), 779--788. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Oktay, H., Taylor, B. J., and Jensen, D. D. Causal Discovery in Social Media Using Quasi-Experimental Designs. Proceedings of the ACM/SIGKDD Workshop on Social Media Analytics, (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Raban, D. R. and Harper, F. M. Motivations for Answering Questions Online Abstract. New Media and Innovative Technologies, (2008).Google ScholarGoogle Scholar
  24. Raymond, E. S. Homesteading the Noosphere. In The Cathedral and the Bazaar. O'Reilly, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Rodrigues, E. M. and Milic-Frayling, N. Socializing or knowledge sharing? Characterizing social intent in community question answering. Proceedings of CHI 2009, ACM (2009), 1127--1136. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Torrey, C., Churchill, E. F., and McDonald, D. W. Learning how: the search for craft knowledge on the internet. Proceedings of CHI 2009, ACM (2009), 1371--1380. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Zhang, J., Ackerman, M. S., and Adamic, L. Expertise networks in online communities: structure and algorithms. Proceedings of WWW 2007, ACM (2007), 221--230. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Design lessons from the fastest q&a site in the west
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
          May 2011
          3530 pages
          ISBN:9781450302289
          DOI:10.1145/1978942

          Copyright © 2011 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 7 May 2011

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          CHI '11 Paper Acceptance Rate410of1,532submissions,27%Overall Acceptance Rate6,199of26,314submissions,24%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader