Skip to main content
Top
Published in: Social Network Analysis and Mining 1/2018

01-12-2018 | Original Article

Social-collaborative determinants of content quality in online knowledge production systems: comparing Wikipedia and Stack Overflow

Authors: Sorin Adam Matei, Amani Abu Jabal, Elisa Bertino

Published in: Social Network Analysis and Mining | Issue 1/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Online knowledge production sites, such as Wikipedia and Stack Overflow, are dominated by small groups of contributors. How does this affect knowledge quality and production? Does the persistent presence of some key contributors among the most productive members improve the quality of the knowledge, considered in the aggregate? The paper addresses these issues by correlating week-by-week value changes in contribution unevenness, elite resilience (stickiness), and content quality. The goal is to detect if and how changes in social structural variables may influence the quality of the knowledge produced by two representative online knowledge production sites: Wikipedia and Stack Overflow. Regression analysis shows that on Stack Overflow both unevenness and elite stickiness have a curvilinear effect on quality. Quality is optimized at specific levels of elite stickiness and unevenness. At the same time, on Wikipedia, quality increases linearly with a decline in entropy, overall, and with an increase in stickiness in the maturation phase, after an entropy elite stickiness, quality of content peak is reached.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Adler BT, de Alfaro L, Pye I, Raman V (2008) Measuring author contributions to the Wikipedia. In: Proceedings of the 4th international symposium on Wikis, ACM, p 15 Adler BT, de Alfaro L, Pye I, Raman V (2008) Measuring author contributions to the Wikipedia. In: Proceedings of the 4th international symposium on Wikis, ACM, p 15
go back to reference Anderson A, Huttenlocher D, Kleinberg J, Leskovec J (2012) Discovering value from community activity on focused question answering sites: a case study of stack overflow. In: Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM, pp 850–858 Anderson A, Huttenlocher D, Kleinberg J, Leskovec J (2012) Discovering value from community activity on focused question answering sites: a case study of stack overflow. In: Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM, pp 850–858
go back to reference Arora P, Ganguly D, Jones GJ (2015) The good, the bad and their kins: Identifying questions with negative scores in stackoverflow. In: Proceedings of the 2015 IEEE/ACM international conference on advances in social networks analysis and mining 2015, ACM, pp 1232–1239 Arora P, Ganguly D, Jones GJ (2015) The good, the bad and their kins: Identifying questions with negative scores in stackoverflow. In: Proceedings of the 2015 IEEE/ACM international conference on advances in social networks analysis and mining 2015, ACM, pp 1232–1239
go back to reference Bailey KD (1985) Entropy measures of inequality. Sociol Inq 55(2):200–211CrossRef Bailey KD (1985) Entropy measures of inequality. Sociol Inq 55(2):200–211CrossRef
go back to reference Baltadzhieva A, Chrupała G (2015) Predicting the quality of questions on stackoverflow. In: Proceedings of the international conference recent advances in natural language processing, pp 32–40 Baltadzhieva A, Chrupała G (2015) Predicting the quality of questions on stackoverflow. In: Proceedings of the international conference recent advances in natural language processing, pp 32–40
go back to reference Blumenstock JE (2008) Size matters: word count as a measure of quality on Wikipedia. In: Proceedings of the 17th international conference on World Wide Web, ACM, pp 1095–1096 Blumenstock JE (2008) Size matters: word count as a measure of quality on Wikipedia. In: Proceedings of the 17th international conference on World Wide Web, ACM, pp 1095–1096
go back to reference Bruno R (2010) A democracy of unequals (Ph.D. dissertation) Bruno R (2010) A democracy of unequals (Ph.D. dissertation)
go back to reference Burel G, He Y, Alani H (2012) Automatic identification of best answers in online enquiry communities. The semantic web: research and applications, pp 514–529 Burel G, He Y, Alani H (2012) Automatic identification of best answers in online enquiry communities. The semantic web: research and applications, pp 514–529
go back to reference Cross T (2006) Puppy smoothies: improving the reliability of open, collaborative wikis. First Monday 11(9) Cross T (2006) Puppy smoothies: improving the reliability of open, collaborative wikis. First Monday 11(9)
go back to reference Jurczyk P, Agichtein E (2007) Discovering authorities in question answer communities by using link analysis. In: Proceedings of the sixteenth ACM conference on conference on information and knowledge management, ACM, pp 919–922 Jurczyk P, Agichtein E (2007) Discovering authorities in question answer communities by using link analysis. In: Proceedings of the sixteenth ACM conference on conference on information and knowledge management, ACM, pp 919–922
go back to reference Kittur A, Kraut RE (2008) Harnessing the wisdom of crowds in Wikipedia: quality through coordination. In: Proceedings of the 2008 ACM conference on computer supported cooperative work, ACM, pp 37–46 Kittur A, Kraut RE (2008) Harnessing the wisdom of crowds in Wikipedia: quality through coordination. In: Proceedings of the 2008 ACM conference on computer supported cooperative work, ACM, pp 37–46
go back to reference Kittur A, Lee B, Kraut RE (2009) Coordination in collective intelligence: the role of team structure and task interdependence. In: Proceedings of the SIGCHI conference on human factors in computing systems, ACM, pp 1495–1504 Kittur A, Lee B, Kraut RE (2009) Coordination in collective intelligence: the role of team structure and task interdependence. In: Proceedings of the SIGCHI conference on human factors in computing systems, ACM, pp 1495–1504
go back to reference Kuk G (2006) Strategic interaction and knowledge sharing in the KDE developer mailing list. Manag Sci 52(7):1031–1042CrossRef Kuk G (2006) Strategic interaction and knowledge sharing in the KDE developer mailing list. Manag Sci 52(7):1031–1042CrossRef
go back to reference Liu X, Croft WB, Koll M (2005) Finding experts in community-based question-answering services. In: Proceedings of the 14th ACM international conference on Information and knowledge management, ACM, pp 315–316 Liu X, Croft WB, Koll M (2005) Finding experts in community-based question-answering services. In: Proceedings of the 14th ACM international conference on Information and knowledge management, ACM, pp 315–316
go back to reference Matei SA, Britt BC (2017) Structural differentiation in social media: adhocracy, entropy, and the “1 % effect”, 1st edn. Springer, BerlinCrossRef Matei SA, Britt BC (2017) Structural differentiation in social media: adhocracy, entropy, and the “1 % effect”, 1st edn. Springer, BerlinCrossRef
go back to reference Matei SA, Bruno RJ (2015) Pareto’s 80/20 law and social differentiation: a social entropy perspective. Public Relat Rev 41(2):178–186CrossRef Matei SA, Bruno RJ (2015) Pareto’s 80/20 law and social differentiation: a social entropy perspective. Public Relat Rev 41(2):178–186CrossRef
go back to reference Matei SA, Dobrescu C (2010) Wikipedia’s neutral point of view: settling conflict through ambiguity. Inf Soc 27(1):40–51CrossRef Matei SA, Dobrescu C (2010) Wikipedia’s neutral point of view: settling conflict through ambiguity. Inf Soc 27(1):40–51CrossRef
go back to reference Movshovitz-Attias D, Movshovitz-Attias Y, Steenkiste P, Faloutsos C (2013) Analysis of the reputation system and user contributions on a question answering website: Stackoverflow. In: Proceedings of the 2013 IEEE/ACM international conference on advances in social networks analysis and mining, ACM, pp 886–893 Movshovitz-Attias D, Movshovitz-Attias Y, Steenkiste P, Faloutsos C (2013) Analysis of the reputation system and user contributions on a question answering website: Stackoverflow. In: Proceedings of the 2013 IEEE/ACM international conference on advances in social networks analysis and mining, ACM, pp 886–893
go back to reference Pal A, Chang S, Konstan JA (2012) Evolution of experts in question answering communities. In: ICWSM Pal A, Chang S, Konstan JA (2012) Evolution of experts in question answering communities. In: ICWSM
go back to reference Palloff RM, Pratt K (2010) Collaborating online: learning together in community, vol 32. Wiley, Oxford Palloff RM, Pratt K (2010) Collaborating online: learning together in community, vol 32. Wiley, Oxford
go back to reference Ravi S, Pang B, Rastogi V, Kumar R (2014) Great question! question quality in community Q&A. In: ICWSM Ravi S, Pang B, Rastogi V, Kumar R (2014) Great question! question quality in community Q&A. In: ICWSM
go back to reference Shah C, Pomerantz J (2010) Evaluating and predicting answer quality in community QA. In: Proceedings of the 33rd international ACM SIGIR conference on research and development in information retrieval, ACM, pp 411–418 Shah C, Pomerantz J (2010) Evaluating and predicting answer quality in community QA. In: Proceedings of the 33rd international ACM SIGIR conference on research and development in information retrieval, ACM, pp 411–418
go back to reference Shannon CE, Weaver W (1998) The mathematical theory of communication. University of Illinois Press, IllinoisMATH Shannon CE, Weaver W (1998) The mathematical theory of communication. University of Illinois Press, IllinoisMATH
go back to reference Stvilia B, Twidale MB, Smith LC, Gasser L (2008) Information quality work organization in Wikipedia. J Assoc Inf Sci Technol 59(6):983–1001CrossRef Stvilia B, Twidale MB, Smith LC, Gasser L (2008) Information quality work organization in Wikipedia. J Assoc Inf Sci Technol 59(6):983–1001CrossRef
go back to reference Stvilia B, Twidale MB, Smith LC, Gasser L (2005) Assessing information quality of a community-based encyclopedia. In: IQ Stvilia B, Twidale MB, Smith LC, Gasser L (2005) Assessing information quality of a community-based encyclopedia. In: IQ
go back to reference Warncke-Wang M, Ayukaev VR, Hecht B, Terveen LG (2015) The success and failure of quality improvement projects in peer production communities. In: Proceedings of the 18th ACM conference on computer supported cooperative work and social computing, ACM, pp 743–756 Warncke-Wang M, Ayukaev VR, Hecht B, Terveen LG (2015) The success and failure of quality improvement projects in peer production communities. In: Proceedings of the 18th ACM conference on computer supported cooperative work and social computing, ACM, pp 743–756
go back to reference Zeng H, Alhossaini MA, Ding L, Fikes R, McGuinness DL (2006) Computing trust from revision history. Tech. rep, Stanford Univ Ca Knowledge Systems LAB Zeng H, Alhossaini MA, Ding L, Fikes R, McGuinness DL (2006) Computing trust from revision history. Tech. rep, Stanford Univ Ca Knowledge Systems LAB
Metadata
Title
Social-collaborative determinants of content quality in online knowledge production systems: comparing Wikipedia and Stack Overflow
Authors
Sorin Adam Matei
Amani Abu Jabal
Elisa Bertino
Publication date
01-12-2018
Publisher
Springer Vienna
Published in
Social Network Analysis and Mining / Issue 1/2018
Print ISSN: 1869-5450
Electronic ISSN: 1869-5469
DOI
https://doi.org/10.1007/s13278-018-0512-3

Other articles of this Issue 1/2018

Social Network Analysis and Mining 1/2018 Go to the issue

Premium Partner