Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2505515.2505610acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Assessing quality score of Wikipedia article using mutual evaluation of editors and texts

Published: 27 October 2013 Publication History

Abstract

In this paper, we propose a method for assessing quality scores of Wikipedia articles by mutually evaluating editors and texts. Survival ratio based approach is a major approach to assessing article quality. In this approach, when a text survives beyond multiple edits, the text is assessed as good quality, because poor quality texts have a high probability of being deleted by editors. However, many vandals, low quality editors, delete good quality texts frequently, which improperly decreases the survival ratios of good quality texts. As a result, many good quality texts are unfairly assessed as poor quality. In our method, we consider editor quality score for calculating text quality score, and decrease the impact on text quality by vandals. Using this improvement, the accuracy of the text quality score should be improved. However, an inherent problem with this idea is that the editor quality scores are calculated by the text quality scores. To solve this problem, we mutually calculate the editor and text quality scores until they converge. In this paper, we prove that the text quality score converges. We did our experimental evaluation, and confirmed that our proposed method could accurately assess the text quality scores.

References

[1]
Adler, B., Chatterjee, K., de Alfaro, L., Faella, M., Pye, I., and Raman, V. Measuring Author Contributions to the Wikipedia. In Proceedings of the 2008 International Symposium on Wikis (WikiSym '08) (2008).
[2]
Adler, B., and de Alfaro, L. A content-driven reputation system for the Wikipedia. In Proceedings of the 16th international conference on World Wide Web (WWW '07) (2007), pp. 261--270.
[3]
Adler, B. T., Chatterjee, K., de Alfaro, L., Faella, M., Pye, I., and Raman, V. Assigning Trust to Wikipedia Content. In Proceedings of the International Symposium on Wikis (WikiSym '08) (2008), ACM.
[4]
Baeza-Yates, R., and Ribeiro-Neto, B. Modern Information Retrieval: the concepts and technology behind search. Addison-Wesley, 2011.
[5]
Hu, M., Lim, E., Sun, A., Lauw, H. W., and Vuong, B. Measuring Article Quality in Wikipedia: Models and Evaluation. In Proceedings of ACM International Conference on Information and Knowledge Management (CIKM 2007) (2007), pp. 243--252.
[6]
Toms, E. G., Mackenzie, T., Jordan, C., and Hall, S. wikiSearch: enabling interactivity in search. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2009) (2009), p. 843.
[7]
Wilkinson, D. M., and Huberman, B. A. Cooperation and quality in wikipedia. In Proceedings of the 2007 international symposium on Wikis (WikiSym'07) (2007), ACM, pp. 157--164.

Cited By

View all
  • (2023)Automatic Quality Assessment of Wikipedia Articles—A Systematic Literature ReviewACM Computing Surveys10.1145/362528656:4(1-37)Online publication date: 10-Nov-2023
  • (2021)Content-Based Knowledge Quality Assessment and Its Application in Health Management SystemJournal of Shanghai Jiaotong University (Science)10.1007/s12204-021-2266-826:1(116-128)Online publication date: 26-Jan-2021
  • (2019)Quality Assessment of Peer-Produced Content in Knowledge Repositories Using Big Data and Social NetworksACM SIGMIS Database: the DATABASE for Advances in Information Systems10.1145/3371041.337104550:4(28-51)Online publication date: 1-Nov-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge Management
October 2013
2612 pages
ISBN:9781450322638
DOI:10.1145/2505515
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. edit history
  2. peer review
  3. quality
  4. vandalism
  5. wikipedia

Qualifiers

  • Research-article

Conference

CIKM'13
Sponsor:
CIKM'13: 22nd ACM International Conference on Information and Knowledge Management
October 27 - November 1, 2013
California, San Francisco, USA

Acceptance Rates

CIKM '13 Paper Acceptance Rate 143 of 848 submissions, 17%;
Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)2
Reflects downloads up to 16 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Automatic Quality Assessment of Wikipedia Articles—A Systematic Literature ReviewACM Computing Surveys10.1145/362528656:4(1-37)Online publication date: 10-Nov-2023
  • (2021)Content-Based Knowledge Quality Assessment and Its Application in Health Management SystemJournal of Shanghai Jiaotong University (Science)10.1007/s12204-021-2266-826:1(116-128)Online publication date: 26-Jan-2021
  • (2019)Quality Assessment of Peer-Produced Content in Knowledge Repositories Using Big Data and Social NetworksACM SIGMIS Database: the DATABASE for Advances in Information Systems10.1145/3371041.337104550:4(28-51)Online publication date: 1-Nov-2019
  • (2017)Structure-Based Features for Predicting the Quality of Articles in WikipediaPrediction and Inference from Social Networks and Social Media10.1007/978-3-319-51049-1_6(115-140)Online publication date: 18-Mar-2017
  • (2017)A general multiview framework for assessing the quality of collaboratively created content on web 2.0Journal of the Association for Information Science and Technology10.1002/asi.2365068:2(286-308)Online publication date: 1-Feb-2017
  • (2016)Assessing the Quality of Wikipedia Editors through CrowdsourcingProceedings of the 25th International Conference Companion on World Wide Web10.1145/2872518.2891113(1001-1006)Online publication date: 11-Apr-2016
  • (2015)Quality Assessment of Wikipedia Articles Using h-indexJournal of Information Processing10.2197/ipsjjip.23.2223:1(22-30)Online publication date: 2015
  • (2015)Measuring Article Quality in Wikipedia using the Collaboration NetworkProceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 201510.1145/2808797.2808895(464-471)Online publication date: 25-Aug-2015
  • (2015)Automatically Assessing Wikipedia Article Quality by Exploiting Article–Editor NetworksAdvances in Information Retrieval10.1007/978-3-319-16354-3_64(574-580)Online publication date: 2015
  • (2014)Improved Automatic Maturity Assessment of Wikipedia Medical ArticlesOn the Move to Meaningful Internet Systems: OTM 2014 Conferences10.1007/978-3-662-45563-0_37(612-622)Online publication date: 2014

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media