Skip to main content
SpringerLink
Log in

Determinants of collective intelligence quality: comparison between Wiki and Q&A services in English and Korean users

  • Empirical Article
  • Published:
Service Business Aims and scope Submit manuscript

Abstract

Although web-enabled collective intelligence (CI) plays a critical role in organizational innovation and collaboration, the dubious quality of CI is still a substantial problem faced by many CI services. Thus, it is important to identify determinants of CI quality and to analyze the relationship between CI quality and its usefulness. One of the most successful services of web-enabled CI is Wikipedia accessible all over the world. Another type of CI service is Naver KnowledgeiN, a typical and popular CI site offering question and answer (Q&A) services in Korea. Wikipedia is a multilingual and web-based encyclopedia. Thus, it is necessary to study the influence relationships among CI quality, its determinants, and CI usefulness according to different CI type and languages. In this paper, we propose a new research model reflecting multi-dimensional factors related to CI quality from user’s perspective. To test a total of 15 hypotheses drawn from the research model, a total of 691 responses were collected from Wikipedia and KnowledgeiN users in South Korea and US. Expertise of contributors, community size, and diversity of contributors were identified as determinants of perceived CI quality. Perceived CI quality has significantly influenced on perceived CI usefulness from user’s perspective. CI type and different language partially play a role of moderators. The expertise of contributors plays a more important role in CI quality in the case of Q&A services such as KnowledgeiN compared to Wiki services such as Wikipedia. This implies that Q&A service requires more expertise and experiences in particular areas rather than the case of Wiki service to improve service quality. The relationship between community size and perceived CI quality was different according to CI type. The community size has a greater effect on CI quality in case of Wiki service than that of Q&A service. The number of contributors in Wikipedia is important because Wiki is an encyclopedia service which is edited and revised repeatedly from many contributors while the answer given in Naver KnowledgeiN cannot be edited by others. Finally, CI quality has a greater effect on its usefulness in case of Wiki service rather than Q&A service. In this paper, we suggested implications for practitioners and theorists.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Alag S (2009) Collective intelligence in action. Manning Publication Co, Greenwich

    Google Scholar 

  • Anthony D, Smith SW, Williamson T (2005) Explaining quality in internet collective goods: Zealots and good samaritans the case of Wikipedia. Retrieved from http://web.mit.edu/iandeseminar/Papers/Fall2005/anthony.pdf

  • Arazy O, Nov O, Patterson R, Yeo L (2011) Information quality in Wikipedia: the effects of group composition and task conflict. J Manag Inf Syst 27(4):71–98

    Article  Google Scholar 

  • Black EW (2008) Wikipedia and academic peer review? Wikipedia as a recognized medium for scholarly publication? Online Inf Rev 32(1):73–88

    Article  Google Scholar 

  • Boder A (2006) Collective intelligence: a keystone in knowledge management. J Knowl Manag 10(1):81–93

    Article  Google Scholar 

  • Bonabeau E (2009) Decisions 2.0: the power of collective intelligence. Sloan Manag Rev 50(2):45–52

    Google Scholar 

  • Bonaccorsi A, Rossi C (2004) Altruistic individuals, selfish firms? The structure of motivation in open source software. Retrieved from http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/1113/1033

  • Brabham DC (2008) Crowdsourcing as a model for problem solving: an introduction and cases. Convergence 14(1):75–90

    Google Scholar 

  • Brabham DC (2010) Moving the crowd at Threadless. Inf Commun Soc 13(8):1122–1145

    Article  Google Scholar 

  • Bray D, Laubavher R, Malone T (2008) Collective intelligence: promoting diversity, crowd performance algorithms, and better decision outcomes. MIT Sloan School of Management. Retrieved from http://ssrn.com/abstract=1215863

  • Callahan ES, Herring SC (2011) Cultural bias in Wikipedia content on famous persons. J Am Soc Inf Sci 62(10):1899–1915

    Article  Google Scholar 

  • Chesney T (2006) An empirical examination of Wikipedia’s credibility. First Monday 11(11)

  • Chin WW (2000) Frequently asked questions—partial least squares & PLS-Graph. Retrieved from http://disc-nt.cba.uh.edu/chin/plsfaq.htm

  • Convertino G, Grasso A, DiMicco J, De Michelis G, Chi EH (2010) Collective intelligence in organizations: toward a research agenda. In: Proceedings of the 2010 ACM conference on computer supported cooperative, vol 6, No. 10, pp 613–614

  • Danielson DR (2005) Web credibility. In: Ghaoui C (ed) Encyclopedia of human–computer interaction. Idea Group, Hershey, pp 713–721

    Chapter  Google Scholar 

  • Denning P, Horning J, Parnas D, Weinstein L (2005) Wikipedia risks. Commun ACM 48(12):152

    Article  Google Scholar 

  • Doan A, Ramakrishnan R, Halevy A (2011) Crowdsourcing systems on the World-Wide Web. Commun ACM 54(4):86–96

    Article  Google Scholar 

  • Fallis D (2008) Toward an epistemology of Wikipedia. J Am Soc Inf Sci Technol 59(10):1662–1674

    Article  Google Scholar 

  • Fornell C, Larcker DF (1981) Evaluating structural equation models with unobservable variables and measurement error. J Mark Res 18(1):39–50

    Article  Google Scholar 

  • Furtado V, Ayres L, Oliveira M, Vasconcelos E, Caminha C, D’Orleans J, Belchior M (2010) Collective intelligence in law enforcement—the WikiCrimes system. Inf Sci 180:4–17

    Article  Google Scholar 

  • Gholami B, Safavi R (2010) Harnessing collective intelligence: Wiki and social network from end-user perspective. In: Proceedings of International Conference on e-Education, e-Business, e-Management and e-Learning, pp 242–246

  • Giles J (2005) Internet encyclopedias go head to head nature. Nature 438:900–901

    Article  Google Scholar 

  • Gong W, Zhang GL, Stump RL (2007) Global internet use and access: cultural considerations. Asia Pacific J Mark Logist 19(1):57–74

    Article  Google Scholar 

  • Gronlund J, Sjodin DR, Frishammar J (2010) Open innovation and the stage-gate process: a revised model for new product development. Calif Manag Rev 52(3):106–131

    Article  Google Scholar 

  • Gruber TR (2008) Collective knowledge systems: where the social web meets the Semantic Web. Web Semant 6(1):4–13

    Article  Google Scholar 

  • Hair JF, Black WC, Babin BJ, Anderson RE (2010) Multivariate data analysis, 7th edn. Pearson Education, Upper Saddle River

    Google Scholar 

  • Hara N, Shachaf P, Hew K (2010) Cross cultural analysis of the Wikipedia community. J Am Soc Inf Sci Technol 61(10):2097–2108

    Article  Google Scholar 

  • Hars A, Ou S (2002) Working for free? Motivations for participating in open source projects. Int J Electron Commerce 6:25–39

    Google Scholar 

  • Hong L, Page S (2004) Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proc Natl Acad Sci USA 101(46):16385–16389

    Article  Google Scholar 

  • Howe J (2006) Unadulterated (and scalable) crowdsourcing, crowdsourcing: tracking the rise of the amateur. Retrieved from http://crowdsourcing.-typepad.com/cs/2006-/06/pure_unadultera.html

  • Howe J (2008) Crowdsourcing: why the power of the crowd is driving the future of business. Crown Business, New York

    Google Scholar 

  • Hu M, Lim EP, Sun A, Lauw HW, Vuong BQ (2007) Measuring article quality in Wikipedia: models and evaluation. In: Proceedings of CIKM, pp 243-252

  • Javanmardi S, Ganjisaffar Y, Lopes C, Baldi P (2009) User contribution and trust in Wikipedia. In: Proceedings of collaborative computing: networking. applications and worksharing conference, pp 1–6

  • Juho S (2009) Applying collective intelligence to idea evaluation at the front end of innovation. Retrieved from http://www.doria.fi/bitstream/handle/10024/46992/nbnfi-fe200908031990.pdf

  • Kuznetsov S (2006) Motivations of contributors to Wikipedia. ACM SIGCAS Comput Soc 36(2):1–7

    Article  Google Scholar 

  • Lane S (2010) Collective intelligence for competitive advantage: crowdsourcing and open innovation. Retrieved from https://scholarsbank.uoregon.edu/xmlui/bitstream/handle/1794/10210/Lane-2010.pdf

  • Lee Y, Strong D, Kahn B, Wang R (2002) AIMQ: a methodology for information quality assessment. Inf Manag 40:133–146

    Article  Google Scholar 

  • Lee SM, Kim T, Noh Y, Lee B (2010) Success factors of platform leadership in Web 2.0 service business. Serv Bus 4:89–103

    Article  Google Scholar 

  • Leimeister JM (2010) Collective intelligence. Bus Inf Syst Eng 2(4):245–248

    Article  Google Scholar 

  • Lih A (2004) Wikipedia as participatory journalism: reliable sources? Metrics for evaluating collaborative media as a news resource. In: Proceedings of 5th International Symposium on Online Journalism. Retrieved from http://jmsc.hku.hk/faculty/alih/publications/utaustin-2004-wikipedia-rc2.pdf

  • Luyt B, Tan D (2010) Improving Wikipedia’s credibility: references and citations in a sample of history articles. J Am Soc Inf Sci Technol 61(4):715–722

    Google Scholar 

  • Lykourentzou I, Papadaki K, Vergados DJ, Polemi D, Loumos V (2010) CorpWiki: a self-regulating Wiki to promote corporate collective intelligence through expert peer matching. Inf Sci 180(1):18–38

    Article  Google Scholar 

  • Maio P (2009) Making sense of collective intelligence. Retrieved from http://www.cutter.com/surveys/socialnetworksuse/bir0809_surveypremium.pdf

  • Malone TW, Laubacher R, Dellarocas C (2010) The collective intelligence genome. Sloan Manag Rev 51(3):21–32

    Google Scholar 

  • Nam K, Ackerman MS, Adamic LA (2009) Question in knowledge IN? A study of Naver’s question answering community. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, ACM, New York, pp 779–788

  • Narasimhan E, Banerjee U, Nanda H (2007) Applying collective intelligence to knowledge management. In: Proceeding of the 2nd International Conference on Informatics, Selangor, Malaysia, pp 7–13

  • Nicolaou AI, McKnight DH (2006) Perceived information quality in data exchanges: effects on risk, trust, expected performance and intention to use. Inf Syst Res 17(4):332–351

    Article  Google Scholar 

  • Normatov IR, Joo JH (2011) A study on quality factors of web enabled collective intelligence as a donor for business success. Inf Syst 20(3):209–235

    Google Scholar 

  • Noubel F (2007) Collective intelligence, the invisible revolution. Retrieved from http://www.thetransitioner.org/Collective_Intelligence_Invisible_Revolution_JFNoubel.pdf

  • Nunnally JC, Bernstein IH (1994) Psychometric theory, 3rd edn. McGraw-Hill, New York

    Google Scholar 

  • Page S (2007) The difference: how the power of diversity creates better groups, firms, schools, and societies. Princeton University Press, Princeton

    Google Scholar 

  • Prasarnphanich P, Wagner C (2009) The role of Wiki technology and altruism in collaborative knowledge creation. J Comput Inf Syst 49(4):33–41

    Google Scholar 

  • Rubio R, Martín S, Morán S (2007) Collaborative web learning tools: Wikis and blogs. Comput Appl Eng Educ 18(3):502–511

    Article  Google Scholar 

  • Saeed KA, Abdinnour-Helm S (2008) Examining the effects of information system characteristics and perceived usefulness on post adoption usage of information systems. Inf Manag 45(9):376–386

    Article  Google Scholar 

  • Steinbock D, Kaplan C, Rodriguez M, Diaz J, Der N, Garcia S (2000) Collective intelligence quantified for computer-mediated group problem solving. University of California Santa Cruz. Retrieved from http://files.uniteddiversity.com/Decision_Making_and_Democracy/Collective_Intelligence_for_Group_Problem_Solving.pdf

  • Stremtan F (2008) Some considerations regarding collective intelligence. Retrieved from http://www.territorialintelligence.eu/index.php/esl/content/download/1415/14253/file/Besancon08-Stremtan.pdf

  • Stvilia B, Twidale MB, Smith LC, Gasser L (2008) Information quality work organization in Wikipedia. J Am Soc Inf Sci 59(6):983–1001

    Article  Google Scholar 

  • Surowiecki J (2004) The wisdom of the crowds. Random House, London

    Google Scholar 

  • Terranova T (2004) Network culture: politics for the information age. Pluto Press, London

    Google Scholar 

  • Urzay I (2008) Collective intelligence approaches to malware recognition. Netw Secur 2008(5):14–16

    Article  Google Scholar 

  • Venkatesh V, Davis FD (2000) A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag Sci 46(2):186–204

    Article  Google Scholar 

  • Wagner C, Majchrzak A (2006) Enabling customer-centricity using Wikis and the Wiki way. J Manag Inf Syst 23(3):17–43

    Article  Google Scholar 

  • Wikipedia (2012) Wikimedia Foundation Inc. Retrieved from http://en.wikipedia.org/wiki/Wikipedia

  • Wilkinson DM, Huberman BA (2007) Assessing the value of cooperation in Wikipedia. First Monday 12(4). Retrieved from http://journals.uic.edu/fm/article/view/1763/1643

  • Yang J, Adamic LA, Ackerman MS (2008) Crowdsourcing and knowledge sharing: Strategic user behavior. Proceedings of 9th ACM conference on Electronic Commerce 246–255

  • Yuan W, Chen Y, Wang R, Du Z (2007) Collective intelligence in knowledge management. Res Pract Issues Enterp Inf Syst 1:651–655

    Google Scholar 

  • Zwass V (2010) Co-creation: toward a taxonomy and an integrated research perspective. Int J Electron Commerce 15(1):11–48

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Information Management Department, Dongguk University, 707 Sukjang-dong, Gyeongju, Gyeongbuk, 780-714, South Korea

    Jaehun Joo

  2. Cooperative Department of Electronic Commerce, Dongguk University, Gyeongju, South Korea

    Ismatilla Normatov

Authors
  1. Jaehun Joo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ismatilla Normatov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jaehun Joo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Joo, J., Normatov, I. Determinants of collective intelligence quality: comparison between Wiki and Q&A services in English and Korean users. Serv Bus 7, 687–711 (2013). https://doi.org/10.1007/s11628-013-0183-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11628-013-0183-0

Keywords

Search

Navigation