Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3306446.3340833acmotherconferencesArticle/Chapter ViewAbstractPublication PagesopencollabConference Proceedingsconference-collections
research-article

Approving automation: analyzing requests for permissions of bots in wikidata

Published: 20 August 2019 Publication History

Abstract

Wikidata, initially developed to serve as a central structured knowledge base for Wikipedia, is now a melting point for structured data for companies, research projects and other peer production communities. Wikidata's community consists of humans and bots, and most edits in Wikidata come from these bots. Prior research has raised concerns regarding the challenges for editors to ensure the quality of bot-generated data, such as the lack of quality control and knowledge diversity. In this research work, we provide one way of tackling these challenges by taking a closer look at the approval process of bot activity on Wikidata. We collected all bot requests, i.e. requests for permissions (RfP) from October 2012 to July 2018. We analyzed these 683 bot requests by classifying them regarding activity focus, activity type, and source mentioned. Our results show that the majority of task requests deal with data additions to Wikidata from internal sources, especially from Wikipedia. However, we can also show the existing diversity of external sources used so far. Furthermore, we examined the reasons which caused the unsuccessful closing of RfPs. In some cases, the Wikidata community is reluctant to implement specific bots, even if they are urgently needed because there is still no agreement in the community regarding the technical implementation. This study can serve as a foundation for studies that connect the approved tasks with the editing behavior of bots on Wikidata to understand the role of bots better for quality control and knowledge diversity.

References

[1]
Emilio Ferrara, Onur Varol, Clayton A Davis, Filippo Menczer, and Alessandro Flammini. 2016. The rise of social bots. Commun. ACM 59, 7 (2016), 96--104.
[2]
Michael Färber, Frederic Bartscherer, Carsten Menne, and Achim Rettinger. 2018. Linked data quality of DBpedia, Freebase, OpenCyc, Wikidata, and YAGO. Semantic Web 9, 1 (Jan. 2018), 77--129.
[3]
R. Stuart Geiger. 2009. The social roles of bots and assisted editing programs. In Int. Sym. Wikis.
[4]
R Stuart Geiger. 2012. Bots are users, too! Rethinking the roles of software agents in HCI. Tiny Transactions on Computer Science 1 (2012), 1.
[5]
R. Stuart Geiger and Aaron Halfaker. 2013. When the levee breaks: without bots, what happens to Wikipedia's quality control processes?. In Proceedings of the 9th International Symposium on Open Collaboration (WikiSym '13). ACM, New York, NY, USA, 6:1--6:6.
[6]
R Stuart Geiger and Aaron Halfaker. 2017. Operationalizing conflict and cooperation between automated software agents in Wikipedia: a replication and expansion of "even good bots fight". ACM Hum.-Comput. Interact. 1, 2 (Nov. 2017), 33.
[7]
R. Stuart Geiger and David Ribes. 2010. The work of sustaining order in Wikipedia: the banning of a vandal. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 117--126.
[8]
Aaron Halfaker, R Stuart Geiger, Jonathan T. Morgan, and John Riedl. 2013. The rise and decline of an open collaboration system: how Wikipedia's reaction to popularity is causing its decline. 57(5) (2013), 664--688.
[9]
Aaron Halfaker and John Riedl. 2012. Bots and cyborgs: Wikipedia's immune system. Computer 45, 3 (March 2012), 79--82.
[10]
Andrew Hall, Loren Terveen, and Aaron Halfaker. 2018. Bot detection in Wikidata using behavioral and other informal cues. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 1--18.
[11]
Lucie-Aimée Kaffee, Alessandro Piscopo, Pavlos Vougiouklis, Elena Simperl, Leslie Carr, and Lydia Pintscher. 2017. A glimpse into Babel: an analysis of multilinguality in Wikidata. In Proceedings of the 13th International Symposium on Open Collaboration (OpenSym '17). ACM, New York, NY, USA, 14:1--14:5.
[12]
Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research Methods in Human-Computer Interaction (2nd ed.). Morgan Kaufmann.
[13]
Brenda Leong and Evan Selinger. 2019. Robot Eyes Wide Shut: Understanding Dishonest Anthropomorphism. ACM, New York, New York, USA.
[14]
Randall M. Livingstone. 4 January 2016. Population automation: An interview with Wikipedia bot pioneer Ram-Man. First Monday 21, 1 (4 January 2016).
[15]
Claudia Müller-Birn. 2019. Bots in Wikipedia: Unfolding their duties. Technical Reports Serie B TR-B-19-01. Freie Universität, Berlin. https://refubium.fu-berlin.de/handle/fub188/24775
[16]
Claudia Müller-Birn, Benjamin Karran, Janette Lehmann, and Markus Luczak-Rösch. 2015. Peer-production system or collaborative ontology engineering effort: What is Wikidata?. In Proceedings of the 11th International Symposium on Open Collaboration. ACM, 20.
[17]
Alessandro Piscopo. 2018. Wikidata: A New Paradigm of Human-Bot Collaboration? arXiv:1810.00931 {cs} (Oct. 2018). http://arxiv.org/abs/1810.00931 arXiv:1810.00931.
[18]
Alessandro Piscopo, Lucie-Aimée Kaffee, Chris Phethean, and Elena Simperl. 2017. Provenance information in a collaborative knowledge graph: an evaluation of Wikidata external references. In The Semantic Web - ISWC 2017 (Lecture Notes in Computer Science). Springer, Cham, 542--558.
[19]
Alessandro Piscopo, Chris Phethean, and Elena Simperl. 2017. What makes a good collaborative knowledge graph: group composition and quality in Wikidata. In Social Informatics (Lecture Notes in Computer Science), Giovanni Luca Ciampaglia, Afra Mashhadi, and Taha Yasseri (Eds.). Springer International Publishing, 305--322.
[20]
Thomas Steiner. 2014. Bots vs. Wikipedians, Anons vs. Logged-Ins (Redux): a global study of editactivity on Wikipedia and Wikidata. In Proceedings of The International Symposium on Open Collaboration (OpenSym '14). ACM, New York, NY, USA, 25:1--25:7.
[21]
Margaret-Anne Storey and Alexey Zagalsky. 2016. Disrupting developer productivity one bot at a time. In Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE 2016). ACM, New York, NY, USA, 928--931.
[22]
Wikidata. 2013. RfP ElphiBot_3. www.wikidata.org/wiki/Wikidata:Requests_for_permissions/Bot/ElphiBot_3 {Last accessed 01 August 2018}.
[23]
Wikidata. 2013. RfP ImplicatorBot. www.wikidata.org/wiki/Wikidata:Requests_for_permissions/Bot/ImplicatorBot {Last accessed 01 August 2018}.
[24]
Wikidata. 2014. RfP Structor. www.wikidata.org/wiki/Wikidata:Requests_for_permissions/Bot/Structor {Last accessed 01 August 2018}.
[25]
Wikidata. 2014. RfP VlsergeyBot. www.wikidata.org/wiki/Wikidata:Requests_for_permissions/Bot/VlsergeyBot {Last accessed 01 August 2018}.
[26]
Wikidata. 2016. RfP Phenobot. www.wikidata.org/wiki/Wikidata:Requests_for_permissions/Bot/Phenobot {Last accessed 01 August 2018}.
[27]
Wikidata. 2016. RfP WikiLovesESBot. www.wikidata.org/wiki/Wikidata:Requests_for_permissions/Bot/WikiLovesESBot {Last accessed 01 August 2018}.

Cited By

View all
  • (2021)Representing COVID-19 information in collaborative knowledge graphs: The case of WikidataSemantic Web10.3233/SW-210444(1-32)Online publication date: 28-Sep-2021

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
OpenSym '19: Proceedings of the 15th International Symposium on Open Collaboration
August 2019
197 pages
ISBN:9781450363198
DOI:10.1145/3306446
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 August 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Wikidata
  2. bot
  3. task approval

Qualifiers

  • Research-article

Funding Sources

Conference

OpenSym '19

Acceptance Rates

OpenSym '19 Paper Acceptance Rate 17 of 23 submissions, 74%;
Overall Acceptance Rate 108 of 195 submissions, 55%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Representing COVID-19 information in collaborative knowledge graphs: The case of WikidataSemantic Web10.3233/SW-210444(1-32)Online publication date: 28-Sep-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media