Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1518701.1518928acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Coordination in collective intelligence: the role of team structure and task interdependence

Published: 04 April 2009 Publication History

Abstract

The success of Wikipedia has demonstrated the power of peer production in knowledge building. However, unlike many other examples of collective intelligence, tasks in Wikipedia can be deeply interdependent and may incur high coordination costs among editors. Increasing the number of editors increases the resources available to the system, but it also raises the costs of coordination. This suggests that the dependencies of tasks in Wikipedia may determine whether they benefit from increasing the number of editors involved. Specifically, we hypothesize that adding editors may benefit low-coordination tasks but have negative consequences for tasks requiring a high degree of coordination. Furthermore, concentrating the work to reduce coordination dependencies should enable more efficient work by many editors. Analyses of both article ratings and article review comments provide support for both hypotheses. These results suggest ways to better harness the efforts of many editors in social collaborative systems involving high coordination tasks.

References

[1]
Aiken, L.&West, S. Multiple regression: Testing and interpreting interactions. Sage, CA (1991).
[2]
Argote, L. Input uncertainty and organizational coordination in hospital emergency rooms. Administrative Science Quarterly 27 (1982), 420--434.
[3]
Atkinson, A.B. On the measurement of inequality. Journal of Economic Theory 2 (1970), 244--263.
[4]
Baecker, R.M., Nastos, D., Posner, I.R.&Mawby, K.L. The user-centered iterative design of collaborative writing software. Proc. CHI, ACM Press (1993). 399--405.
[5]
Benkler, Y. Coase's penguin, or Linux and the nature of the firm. Yale Law Journal 112 (2002), 367--445.
[6]
Brooks, F.P. The mythical man month. Addison-Wesley Longman Publishing Co., Inc. Boston, MA (1975).
[7]
Cataldo, M., Wagstrom, P., Herbsleb, J.D.,&Carley, K. Identification of coordination requirements: Implications for the design of collaboration and awareness tools. ACM Press, New York, 2006.
[8]
Cohen, J., Cohen, P., West, S.G.,&Aiken, L.S. Applied multiple regression/correlation analysis for the behavioral sciences. Lawrence Erlbaum Associates, Mahwah, New Jersey (2003).
[9]
Cosley, D., Frankowski, D., Terveen, L., Riedl, J. SuggestBot: Using intelligent task routing to help people find work in Wikipedia. Proc. IUI, ACM Press (2007), 32--41.
[10]
Galton, F. Vox populi. Nature 75 (1907), 7.
[11]
Giles, G. Internet encyclopaedias go head to head. Nature 438 (2005), 900--901.
[12]
Gittell, J.H. Coordinating mechanisms in care provider groups: Relational coordination as a mediator and input uncertainty as a moderator of performance effects. Management Science 48 (2002), 1408--1426.
[13]
Hill, G.W. Group versus individual performance. Are N = 1 heads better than one? Psychological Bulletin 91, 3 (1982), 517--539.
[14]
Wikipedia Database Download. http://en.wikipedia.org/wiki/Wikipedia:Database_download
[15]
Wikipedia Featured Article Criteria. http://en.wikipedia.org/wiki/Wikipedia:Featured_article_criteria
[16]
Wikipedia Featured Article Statistics. http://en.wikipedia.org/wiki/Wikipedia:Featured_article_statistics
[17]
Kittur, A., Suh, B., Chi, E.,&Pendleton, B. A. He says, she says: Conflict and coordination in Wikipedia. Proc. CHI 2007, ACM Press (2007), 453--462.
[18]
Kittur, A., Chi, E.,&Suh, B. Crowdsourcing user studies with Mechanical Turk. Proc. CHI 2008, ACM Press (2008), 453--456.
[19]
Kittur, A., Chi, E., Pendleton, B. A., Suh, B.,&Mytkowicz, T. Power of the few vs. wisdom of the crowd: Wikipedia and the rise of the bourgeoisie. Alt.CHI, 2007, San Jose, CA (2007).
[20]
Kittur, A.,&Kraut, R. E. (2008). Harnessing the wisdom of crowds in Wikipedia: Quality through coordination. CSCW 2008, San Diego, CA (2008).
[21]
Kozlow, M.,&Bellamy, P. Experimental study on the impact of the 6+1 trait writing model on student achievement in writing. Association for Supervision and Curriculum Development Conference 2005, Orlando, FL (2005).
[22]
Malone, T.W.,&Crowston, K. The interdisciplinary study of coordination. ACM Computing Surveys (CSUR) 26, 1 (1994), 87--119.
[23]
Mockus, A., Fielding, R. T.,&Herbsleb, J. D. Two case studies of open source software development: Apache and mozilla. ACM Transactions on Software Engineering and Methodology 11, 3 (2002), 309--346.
[24]
Northwest Regional Educational Laboratory. 6+1 Trait Writing: Scoring Continuum. (2001). Available online http://www.nwrel.org/assessment/pdfRubrics/6plus1traits.PDF
[25]
O'Reilly, T. (2005, Sep 30). What is Web 2.0? Design patterns and business models for the next generation of software. Retrieved Aug 15, 2008, from http://www.oreillynet.com/pub/a/oreilly/tim/news/2005/09/30/whatis-web-20.html
[26]
Priedhorsky, R., Chen, J., Lam, S., Panciera, K., Terveen, L.,&Riedl, J. Creating, destroying, and restoring value in Wikipedia. Proc. GROUP 2007, ACM Press (2007), 259--268.
[27]
Raymond, E. The cathedral and the bazaar. Knowledge, Technology, and Policy 12 (1999), 23 -- 49.
[28]
Rouse, W.B., Cannon-Bowers, J. A.,&Salas, E. The role of mental models in team performance in complex systems. IEEE Transactions on Systems, Man, and Cybernetics 22 (1992) 1296--1308.
[29]
Steiner, I. D. Group process and productivity. New York: Academic Press (1972).
[30]
Stewart, G. L. A meta-analytic review of relationships between team design features and team performance. Journal of Management 32, 1 (2006), 29.
[31]
Stvilia, B., Twidale, M. B., Smith, L. C.,&Gasser, L. Assessing information quality of a community-based encyclopedia. Proc. ICIQ 2005, MIT Press (2005), 442--454.
[32]
Surowiecki, J. The wisdom of crowds. New York: Doubleday (2005).
[33]
Tushman, M. Work characteristics and subunit communication structure: A contingency analysis. Administrative Science Quarterly 24 (1979), 82--98.
[34]
Van de Ven, A., Delbecq, A.,&Koenig, R. Determinants of coordination modes within organizations. American Sociological Review 41 (1976), 322--338.
[35]
Wilkinson, D.M.,&Huberman, B.A. Assessing the value of cooperation in Wikipedia. First Monday 12, 4 (2007).

Cited By

View all
  • (2024)CCTFv2: Modeling Cyber CompetitionsEntropy10.3390/e2605038426:5(384)Online publication date: 30-Apr-2024
  • (2023)Adversarial Dynamics in Centralized Versus Decentralized Intelligent SystemsTopics in Cognitive Science10.1111/tops.12705Online publication date: 30-Oct-2023
  • (2023)Multidisciplinary learning through collective performance favors decentralizationProceedings of the National Academy of Sciences10.1073/pnas.2303568120120:34Online publication date: 14-Aug-2023
  • Show More Cited By

Index Terms

  1. Coordination in collective intelligence: the role of team structure and task interdependence

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
      April 2009
      2426 pages
      ISBN:9781605582467
      DOI:10.1145/1518701
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 04 April 2009

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Wiki
      2. Wikipedia
      3. collective intelligence
      4. coordination
      5. social collaboration
      6. social computing

      Qualifiers

      • Research-article

      Conference

      CHI '09
      Sponsor:

      Acceptance Rates

      CHI '09 Paper Acceptance Rate 277 of 1,130 submissions, 25%;
      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)69
      • Downloads (Last 6 weeks)6
      Reflects downloads up to 13 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)CCTFv2: Modeling Cyber CompetitionsEntropy10.3390/e2605038426:5(384)Online publication date: 30-Apr-2024
      • (2023)Adversarial Dynamics in Centralized Versus Decentralized Intelligent SystemsTopics in Cognitive Science10.1111/tops.12705Online publication date: 30-Oct-2023
      • (2023)Multidisciplinary learning through collective performance favors decentralizationProceedings of the National Academy of Sciences10.1073/pnas.2303568120120:34Online publication date: 14-Aug-2023
      • (2023)Digital Facilitation of Group Work to Gain Predictable PerformanceGroup Decision and Negotiation10.1007/s10726-023-09856-833:1(113-145)Online publication date: 20-Oct-2023
      • (2022)Relationship of Seminal Plasma Anti-Müllerian Hormone Concentration with Sperm Morphology and Sperm DNA DamageJournal of Urological Surgery10.4274/jus.galenos.2022.2021.01219:4(272-280)Online publication date: 1-Dec-2022
      • (2022)Self-organization in online collaborative work settingsCollective Intelligence10.1177/263391372210780051:1(263391372210780)Online publication date: 9-Sep-2022
      • (2022)“Just like meeting in person” - Examination of interdependencies in dementia-friendly virtual activities.Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544815(1-15)Online publication date: 23-Oct-2022
      • (2022)Understanding Open Collaboration of Wikipedia Good Articles with Factor AnalysisJournal of Information & Knowledge Management10.1142/S021964922250030721:03Online publication date: 17-May-2022
      • (2022)(Re)discovering Laws of Music Theory Using Information Lattice LearningIEEE BITS the Information Theory Magazine10.1109/MBITS.2022.3205288(1-13)Online publication date: 2022
      • (2021)Intelligence as a Substantial Basis of Intellectual PotentialEconomic Herald of the Donbas10.12958/1817-3772-2021-2(64)-183-192(183-192)Online publication date: 2021
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media