Towards content-driven reputation for collaborative code repositories
Authors: 
Andrew G. West, 
Insup LeeAuthors Info & Claims
Andrew G. West, Insup LeeAuthors Info & ClaimsArticle No.: 13, Pages 1 - 4
Abstract
As evidenced by SourceForge and GitHub, code repositories now integrate Web 2.0 functionality that enables global participation with minimal barriers-to-entry. To prevent detrimental contributions enabled by crowdsourcing, reputation is one proposed solution. Fortunately this is an issue that has been addressed in analogous version control systems such as the wiki for natural language content. The WikiTrust algorithm ("content-driven reputation"), while developed and evaluated in wiki environments operates under a possibly shared collaborative assumption: actions that "survive" subsequent edits are reflective of good authorship.
In this paper we examine WikiTrust's ability to measure author quality in collaborative code development. We first define a mapping from repositories to wiki environments and use it to evaluate a production SVN repository with 92,000 updates. Analysis is particularly attentive to reputation loss events and attempts to establish ground truth using commit comments and bug tracking. A proof-of-concept evaluation suggests the technique is promising (about two-thirds of reputation loss is justified) with false positives identifying areas for future refinement. Equally as important, these false positives exemplify differences in content evolution and the cooperative process between wikis and code repositories.
References
[1]
Mediawiki. http://www.mediawiki.org.
[2]
WikiTrust (online). http://wikitrust.soe.ucsc.edu/.
[3]
B. Adler and L. de Alfaro. A content-driven reputation system for the Wikipedia. In WWW, 2007.
[4]
M. Cataldo. Sources of error in distributed development projects: Implications for collaborative tools. In CSCW '10.
[5]
C. Dillow. DARPA's Vehicleforge.mil aims to crowd-source next-gen combat vehicles. Popular Science (online), 2011.
[6]
T. L. Graves, A. F. Karr, et al. Predicting fault incidence using software change history. IEEE Transactions on Software Engineering, 26(7):653--661, 2000.
[7]
B. Livshits and T. Zimmermann. Dynamine: Finding common error patterns by mining software revision histories. In ESEC/FSE, pages 296--305, 2005.
[8]
R. Priedhorsky, J. Chen, et al. Creating, destroying, and restoring value in Wikipedia. In GROUP, 2007.
[9]
I. Stamelos, L. Angelis, et al. Code quality analysis in open source software development. Info. Sys. Journal, 12, 2002.
[10]
H. Zeng, M. Alhossaini, et al. Computing trust from revision history. In Intl. Conf. on Privacy, Security, and Trust, 2006.
Index Terms
- Towards content-driven reputation for collaborative code repositories
Recommendations
A Systematic Mapping Study on Analysis of Code Repositories
Code repositories contain valuable information, which can be extracted, processed and synthesized into valuable information. It enabled developers to improve maintenance, increase code quality and understand software evolution, among other insights. ...
The Role of Reputation on Trust and Loyalty: A Cross-Cultural Analysis of Tablet E-Tailing
The purpose of this article is to empirically examine the role of online retailer's website reputation on tablet commerce and to compare the trust arbitration between reputation and loyalty in two cultures-Finland and Nigeria. Data was collected from ...
Supporting awareness of content-related controversies in a Wiki-based learning environment
OpenSym '14: Proceedings of The International Symposium on Open CollaborationUser generated content in Wikis is mainly distributed on the article view and its corresponding talk page. Potentials of analysing and supporting discussants' knowledge construction processes on the level of talk pages have still been rarely researched. ...
Comments
Information & Contributors
Information
Published In
Copyright © 2012 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web
- TJEF: The John Ernest Foundation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 August 2012
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
WikiSym '12
Sponsor:
Acceptance Rates
WikiSym '12 Paper Acceptance Rate 21 of 37 submissions, 57%;
Overall Acceptance Rate 69 of 145 submissions, 48%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 91Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 30 Aug 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in