research-article

On ranking controversies in wikipedia: models and evaluation

Authors:

Hady Wirawan Lauw,

Kuiyu ChangAuthors Info & Claims

WSDM '08: Proceedings of the 2008 International Conference on Web Search and Data Mining

Pages 171 - 182

https://doi.org/10.1145/1341531.1341556

Published: 11 February 2008 Publication History

Abstract

Wikipedia 1 is a very large and successful Web 2.0 example. As the number of Wikipedia articles and contributors grows at a very fast pace, there are also increasing disputes occurring among the contributors. Disputes often happen in articles with controversial content. They also occur frequently among contributors who are "aggressive" or controversial in their personalities. In this paper, we aim to identify controversial articles in Wikipedia. We propose three models, namely the Basic model and two Controversy Rank (CR) models. These models draw clues from collaboration and edit history instead of interpreting the actual articles or edited content. While the Basic model only considers the amount of disputes within an article, the two Controversy Rank models extend the former by considering the relationships between articles and contributors. We also derived enhanced versions of these models by considering the age of articles. Our experiments on a collection of 19,456 Wikipedia articles shows that the Controversy Rank models can more effectively determine controversial articles compared to the Basic and other baseline models

References

[1]

B. Adler and L. de Alfaro. A content-driven reputation system for the Wikipedia. In Proc. of WWW'07, pages 261--270, 2007.

Digital Library

[2]

R. Almeida, B. Mozafari, and J. Cho. On the evolution of Wikipedia. In Proc. of ICWSM'07, 2007.

[3]

D. Anthony, S. Smith, and T. Williamson. Explaining quality in internet collective goods: Zealots and good samaritans in the case of Wikipedia, 2005. Hanover: Dartmouth College.

[4]

BBC News. Wikipedia survives research test, 2005. Published online: 15 December 2005 http://news.bbc.co.uk/2/hi/technology/4530930.stm.

[5]

S. Flexner and L. Hauck. Random House Unabridged Dictionary. Random House, New York, NY, 2nd edition, 1993.

[6]

J. Giles. Internet encyclopaedias go head to head, 2005. Published online: 14 December 2005 http://www.nature.com/news/2005/051212/full/438900a.html.

[7]

M. Hu, E.-P. Lim, A. Sun, H. Lauw, and B.-Q. Vuong. Measuring article quality in wikipedia: Models and evaluation. In Proc. of CIKM'07, 2007.

Digital Library

[8]

K. Jarvelin and J. Kekalainen. IR evaluation methods for retrieving highly relevant documents. In Proc. of SIGIR'00, pages 41--48, July 2000.

Digital Library

[9]

A. Kittur, B. Suh, B. Pendleton, and E. Chi. He says, she says: con ict and coordination in wikipedia. In Proc. of SIGCHI'07, pages 453--462, 2007.

Digital Library

[10]

A. Lih. Wikipedia as participatory journalism: Reliable sources? metrics for evaluating collaborative media as a news resource. In Proc. of the 5th International Symposium on Online Journalism, April 2004.

[11]

E.-P. Lim, B.-Q. Vuong, H. Lauw, and A. Sun. Measuring qualities of articles contributed by online communities. In Proc. of WI'06, December 2006.

Digital Library

[12]

P. Schönhofen. Identifying document topics using the Wikipedia category network. In Proc. of WI'06, pages 456--462, 2006.

Digital Library

[13]

A. Smola and B. Schölkopf. A tutorial on support vector regression. statistics and computing. Statistics and Computing, 14:199--222, 2004.

Digital Library

[14]

J. Voss. Measuring wikipedia. In Proc. of International Confererence of the International Society for Scientometrics and Informetrics, Stockholm, Sweden, July 2005.

[15]

J. Wales. Wikipedia sociographics, 2004. Retrieved online: www.ccc.de/congress/2004/fahrplan/files/372-wikipedia-sociographics-slides.pdf.

[16]

Wikipedia. Wikipedia, 2007. http://en.wikipedia.org/wiki/Wikipedia Accessed on April 2007.

[17]

Wikipedia. Wikipedia in academic studies, 2007. http://en.wikipedia.org/wiki/Wikipedia: Wikipedia_in_academic_studies Accessed on April 2007.

[18]

H. Zeng, M. Alhossaini, L. Ding, R. Fikes, and D. McGuinness. Computing trust from revision history. In Proc. of International Conference on Privacy, Security and Trust, October-November 2006.

Digital Library

Cited By

Ren YZhang HKraut R(2023)How Did They Build the Free Encyclopedia? A Literature Review of Collaboration and Coordination among Wikipedia EditorsACM Transactions on Computer-Human Interaction10.1145/361736931:1(1-48)Online publication date: 29-Nov-2023
https://dl.acm.org/doi/10.1145/3617369
Fisichella MCeroni A(2021)Event Detection in Wikipedia Edit History Improved by Documents Web Based Automatic AssessmentBig Data and Cognitive Computing10.3390/bdcc50300345:3(34)Online publication date: 4-Aug-2021
https://doi.org/10.3390/bdcc5030034
Kavehzadeh PSamadi MAmir Haeri M(2021)Unsupervised Anomaly Detection on Node Attributed Networks: A Deep Learning ApproachProceedings of the 4th International Conference on Information Science and Systems10.1145/3459955.3460597(35-40)Online publication date: 17-Mar-2021
https://dl.acm.org/doi/10.1145/3459955.3460597
Show More Cited By

Index Terms

On ranking controversies in wikipedia: models and evaluation
1. Information systems
  1. Information retrieval

Recommendations

Societal Controversies in Wikipedia Articles
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Collaborative content creation inevitably reaches situations where different points of view lead to conflict. We focus on Wikipedia, the free encyclopedia anyone may edit, where disputes about content in controversial articles often reflect larger ...
Entity ranking using Wikipedia as a pivot
CIKM '10: Proceedings of the 19th ACM international conference on Information and knowledge management

In this paper we investigate the task of Entity Ranking on the Web. Searchers looking for entities are arguably better served by presenting a ranked list of entities directly, rather than a list of web pages with relevant but also potentially redundant ...
Contropedia - the analysis and visualization of controversies in Wikipedia articles
OpenSym '14: Proceedings of The International Symposium on Open Collaboration

Collaborative content creation inevitably reaches situations where different points of view lead to conflict. In Wikipedia, one of the most prominent examples of collaboration online, conflict is mediated by both policy and software, and conflicts often ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WSDM '08: Proceedings of the 2008 International Conference on Web Search and Data Mining

February 2008

270 pages

ISBN:9781595939272

DOI:10.1145/1341531

General Chair:
Marc Najork
Microsoft, USA
,
Program Chairs:
Andrei Broder
Yahoo!, USA
,
Soumen Chakrabarti
IIT Bombay, India

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 February 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Acceptance Rates

Overall Acceptance Rate 498 of 2,863 submissions, 17%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

58
Total Citations
View Citations
1,126
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ren YZhang HKraut R(2023)How Did They Build the Free Encyclopedia? A Literature Review of Collaboration and Coordination among Wikipedia EditorsACM Transactions on Computer-Human Interaction10.1145/361736931:1(1-48)Online publication date: 29-Nov-2023
https://dl.acm.org/doi/10.1145/3617369
Fisichella MCeroni A(2021)Event Detection in Wikipedia Edit History Improved by Documents Web Based Automatic AssessmentBig Data and Cognitive Computing10.3390/bdcc50300345:3(34)Online publication date: 4-Aug-2021
https://doi.org/10.3390/bdcc5030034
Kavehzadeh PSamadi MAmir Haeri M(2021)Unsupervised Anomaly Detection on Node Attributed Networks: A Deep Learning ApproachProceedings of the 4th International Conference on Information Science and Systems10.1145/3459955.3460597(35-40)Online publication date: 17-Mar-2021
https://dl.acm.org/doi/10.1145/3459955.3460597
Sharevski FJachim PPieroni E(2020)WikipediaBot: Machine Learning Assisted Adversarial Manipulation of Wikipedia ArticlesProceedings of the 2020 Workshop on DYnamic and Novel Advances in Machine Learning and Intelligent Cyber Security10.1145/3477997.3478008(1-8)Online publication date: 7-Dec-2020
https://dl.acm.org/doi/10.1145/3477997.3478008
Osborne CGraham MDittus M(2020)Edit Wars in a Contested Digital City: Mapping Wikipedia’s Uneven Augmentations of BerlinThe Professional Geographer10.1080/00330124.2020.1800493(1-11)Online publication date: 11-Sep-2020
https://doi.org/10.1080/00330124.2020.1800493
Benjakob OAviram R(2018)A Clockwork Wikipedia: From a Broad Perspective to a Case StudyJournal of Biological Rhythms10.1177/074873041876812033:3(233-244)Online publication date: 17-Apr-2018
https://doi.org/10.1177/0748730418768120
Madkour AAref WPrabhakar SAli MBykau S(2018)TrueWebProceedings of the International Workshop on Semantic Big Data10.1145/3208352.3208357(1-6)Online publication date: 10-Jun-2018
https://dl.acm.org/doi/10.1145/3208352.3208357
Hamad MSkowron MSchedl M(2018)Regressing Controversy of Music Artists from Microblogs2018 IEEE 30th International Conference on Tools with Artificial Intelligence (ICTAI)10.1109/ICTAI.2018.00090(548-555)Online publication date: Nov-2018
https://doi.org/10.1109/ICTAI.2018.00090
Jankowski-Lorek MOstrowski LTurek PWierzbicki A(2018)Wikipedia Knowledge Community ModelingEncyclopedia of Social Network Analysis and Mining10.1007/978-1-4939-7131-2_269(3402-3411)Online publication date: 12-Jun-2018
https://doi.org/10.1007/978-1-4939-7131-2_269
Rudas CSurányi OYasseri TTörök J(2017)Understanding and coping with extremism in an online collaborative environment: A data-driven modelingPLOS ONE10.1371/journal.pone.017356112:3(e0173561)Online publication date: 21-Mar-2017
https://doi.org/10.1371/journal.pone.0173561
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents