research-article

Work Always in Progress: Analysing Maintenance Practices in Spatial Crowd-sourced Datasets

Authors:

Giovanni Quattrone,

Licia CapraAuthors Info & Claims

CSCW '17: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing

Pages 1876 - 1889

https://doi.org/10.1145/2998181.2998267

Published: 25 February 2017 Publication History

Abstract

Crowd-mapping is a form of collaborative work that empowers users to share geographic knowledge. Despite geographic information being intrinsically evolving, little research has so far gone into analysing maintenance practices in these domains. In this paper, we quantitatively capture maintenance dynamics in geographic crowd-sourced datasets, in terms of: the extent to which different maintenance actions are taking place, the type of spatial information that is being maintained, who engages in these practices and where. We apply this method to 117 countries in OpenStreetMap, one of the most successful examples of geographic crowd-sourced datasets. Furthermore, we explore what triggers maintenance, by means of an online survey to which 96 OpenStreetMap contributors took part. Our findings reveal that, although maintenance practices vary substantially from country to country in terms of how widespread they are, strong commonalities exist in terms of what metadata is being maintained, by whom, and what triggers them.

References

[1]

Jennings Anderson, Robert Soden, Kenneth M Anderson, Marina Kogan, and Leysia Palen. 2016. EPIC-OSM: A Software Framework for OpenStreetMap Data Analytics. In 2016 49th Hawaii International Conference on System Sciences (HICSS). IEEE, 5468--5477.

Digital Library

[2]

J.J. Arsanjani, C. Barron, M. Bakillah, and M. Helbich. 2013. Assessing the Quality of OpenStreetMap Contributors together with their Contributions. In Proc. of AGILE.

[3]

Daren Brabham. 2013. Crowdsourcing. MIT Press.

Digital Library

[4]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77--101.

[5]

P. Clifford, S. Richardson, and D. Hemon. 1989. Assessing the significance of the correlation between two spatial processes. Biometrics 45, 1 (1989), 123--134.

[6]

Djellel Eddine Difallah, Gianluca Demartini, and Philippe Cudre-Mauroux. 2013. Pick-a-crowd: tell me what you like, and i'll tell you what to do. In Proceedings of the 22nd international conference on World Wide Web. ACM, 367--374.

Digital Library

[7]

Martin Dittus, Giovanni Quattrone, and Licia Capra. 2016. Analysing volunteer engagement in humanitarian mapping: building contributor communities at large scale. In Proc. of CSCW. ACM.

Digital Library

[8]

H. Fana, A. Zipfa, Q. Fub, and P. Neisa. 2014. Quality assessment for building footprints data on OpenStreetMap. International Journal of Geographical Information Science (IJGIS) 28, 4 (2014), 700--719.

Digital Library

[9]

Michela Ferron and Paolo Massa. 2011a. Collective memory building in Wikipedia: the case of North African uprisings. In Proceedings of the 7th International Symposium on Wikis and Open Collaboration. ACM, 114--123.

Digital Library

[10]

Michela Ferron and Paolo Massa. 2011b. Studying collective memories in Wikipedia. Journal of Social Theory 3, 4 (2011), 449--466.

[11]

J.F. Girres and G. Touya. 2010. Quality assessment of the French OpenStreetMap dataset. Transactions in GIS 14, 4 (2010), 435--459.

[12]

M.F. Goodchild. 2007. Citizens as Sensors: the World of Volunteered Geography. GeoJournal 69, 4 (2007), 211--221.

[13]

M. Haklay. 2010. How good is volunteered geographical information? A comparative study of OpenStreetMap and Ordnance Survey datasets. Environment and Planning B: Planning and Design 37, 4 (2010), 682--703.

[14]

M.M. Haklay, S. Basiouka, V. Antoniou, and A. Ather. 2010. How Many Volunteers Does it Take to Map an Area Well? The Validity of Linus Law to Volunteered Geographic Information. The Cartographic Journal 47, 4 (2010), 315--322.

[15]

A. Halfaker, R.S. Geiger, J. Morgan, and J. Riedl. 2013. The Rise and Decline of an Open Collaboration System: How Wikipedia's reaction to sudden popularity is causing its decline. American Behavioral Scientist 57, 5 (2013), 664--688.

[16]

Jeff Howe. 2006. The Rise of Crowdsourcing. Wired (2006).

[17]

Panagiotis G Ipeirotis and Evgeniy Gabrilovich. 2014. Quizz: Targeted crowdsourcing with a billion (potential) users. In Proceedings of the 23rd international conference on World Wide Web. ACM, 143--154.

Digital Library

[18]

K. Ishida. 2012. Geographical Bias on Social Media and Geo-local Contents System with Mobile Devices. In Proc. of HICSS. 1790--1796.

Digital Library

[19]

Luis G Jaimes, Idalides J Vergara-Laurens, and Andrew Raij. 2015. A survey of incentive techniques for mobile crowd sensing. IEEE Internet of Things Journal 2, 5 (2015), 370--380.

[20]

Andreas Kaltenbrunner and David Laniado. 2012. There is no deadline: time evolution of Wikipedia discussions. In Proceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration. ACM, 6.

Digital Library

[21]

Brian Keegan, Darren Gergle, and Noshir Contractor. 2012. Do editors or articles drive collaboration?: multilevel statistical network analysis of wikipedia coauthorship. In Proceedings of the ACM 2012 conference on computer supported cooperative work. ACM, 427--436.

Digital Library

[22]

Aniket Kittur, Bongwon Suh, Bryan A Pendleton, and Ed H Chi. 2007. He says, she says: conflict and coordination in Wikipedia. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 453--462.

Digital Library

[23]

Marina Kogan, Jennings Anderson, Robert Soden, Kenneth M Anderson, and Leysia Palen. 2016. Collaboration in OpenStreetMap: A Network Analysis of Two Humanitarian Events. In Proc. of CHI.

[24]

David Laniado and Riccardo Tasso. 2011. Co-authorship 2.0: Patterns of collaboration in Wikipedia. In Proceedings of the 22nd ACM conference on Hypertext and hypermedia. ACM, 201--210.

Digital Library

[25]

Hongwei Li, Bo Zhao, and Ariel Fuxman. 2014. The wisdom of minority: Discovering and targeting the right group of workers for crowdsourcing. In Proceedings of the 23rd international conference on World Wide Web. ACM, 165--176.

Digital Library

[26]

Jun Liu and Sudha Ram. 2011. Who does what: Collaboration patterns in the wikipedia and their impact on article quality. ACM Transactions on Management Information Systems (TMIS) 2, 2 (2011), 11.

Digital Library

[27]

I. Ludwig, A. Voss, and M. Krause-Traudes. 2011. A Comparison of the Street Networks of Navteq and OSM in Germany. Advancing Geoinformation Science for a Changing World 1, 2 (2011), 65--84.

[28]

Afra Mashhadi, Giovanni Quattrone, and Licia Capra. 2013. Putting ubiquitous crowd-sourcing into context. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 611--622.

Digital Library

[29]

Afra Mashhadi, Giovanni Quattrone, Licia Capra, and Peter Mooney. 2012. On the accuracy of urban crowd-sourcing for maintaining large-scale geospatial databases. In Proceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration. ACM, 15.

Digital Library

[30]

P. Mooney and P. Corcoran. 2013. Analysis of Interaction and Co-editing Patterns amongst OpenStreetMap Contributors. Transactions in GIS 2013 (2013).

[31]

J.L. Myers and A.D. Well. 2003. Research Design and Statistical Analysis (2nd ed.). Routledge. 508 pages.

[32]

Leysia Palen, Robert Soden, T Jennings Anderson, and Mario Barrenechea. 2015. Success & scale in a data-producing organization: The socio-technical evolution of OpenStreetMap in response to humanitarian events. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, 4113--4122.

Digital Library

[33]

Katherine Panciera, Aaron Halfaker, and Loren Terveen. 2009. Wikipedians are born, not made: a study of power editors on Wikipedia. In Proceedings of the ACM 2009 international conference on Supporting group work. ACM, 51--60.

Digital Library

[34]

Reid Priedhorsky, Mikhil Masli, and Loren Terveen. 2010. Eliciting and focusing geographic volunteer work. In Proceedings of the 2010 ACM conference on Computer supported cooperative work. ACM, 61--70.

Digital Library

[35]

Giovanni Quattrone, Licia Capra, and Pasquale De Meo. 2015. There's no such thing as the perfect map: Quantifying bias in spatial crowd-sourcing datasets. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1021--1032.

Digital Library

[36]

G. Quattrone, A. Mashhadi, and L. Capra. 2014a. Mind the Map: The Impact of Culture and Economic Affluence on Crowd-Mapping Behaviours. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 934--944.

Digital Library

[37]

Giovanni Quattrone, Afra Mashhadi, Daniele Quercia, Chris Smith-Clarke, and Licia Capra. 2014b. Modelling growth of urban crowd-sourced information. In Proceedings of the 7th ACM international conference on Web search and data mining. ACM, 563--572.

Digital Library

[38]

Markus Rokicki, Sergej Zerr, and Stefan Siersdorfer. 2015. Groupsourcing: Team Competition Designs for Crowdsourcing. In Proceedings of the 24th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 906--915.

Digital Library

[39]

Bongwon Suh, Gregorio Convertino, Ed H Chi, and Peter Pirolli. 2009. The singularity is not near: slowing growth of Wikipedia. In Proceedings of the 5th International Symposium on Wikis and Open Collaboration. ACM, 8.

Digital Library

[40]

Dennis M Wilkinson and Bernardo A Huberman. 2007. Assessing the value of coooperation in wikipedia. arXiv preprint cs/0702140 (2007).

[41]

Dejun Yang, Guoliang Xue, Xi Fang, and Jian Tang. 2012. Crowdsourcing to smartphones: incentive mechanism design for mobile phone sensing. In Proceedings of the 18th annual international conference on Mobile computing and networking. ACM, 173--184.

Digital Library

[42]

Dejun Yang, Guoliang Xue, Xi Fang, and Jian Tang. 2015. Incentive mechanisms for crowdsensing: Crowdsourcing with smartphones. (2015).

[43]

D. Zielstra and A. Zipf. 2010. A Comparative Study of Proprietary Geodata and Volunteered Geographic Information for Germany. In Proc. of AGILE.

Cited By

Sehra SSingh JSehra SRai H(2022)Extending QGIS processing toolbox for assessing the geometrical properties of OpenStreetMap dataSpatial Information Research10.1007/s41324-022-00480-331:2(135-144)Online publication date: 24-Sep-2022
https://doi.org/10.1007/s41324-022-00480-3
Wallace SPapoutsaki ATan NGuo HHuang J(2021)Case Studies on the Motivation and Performance of Contributors Who Verify and Maintain In-Flux Tabular DatasetsProceedings of the ACM on Human-Computer Interaction10.1145/34795925:CSCW2(1-25)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479592
Verdezoto NBagalkot NAkbar SSharma SMackintosh NHarrington DGriffiths P(2021)The Invisible Work of Maintenance in Community HealthProceedings of the ACM on Human-Computer Interaction10.1145/34491655:CSCW1(1-31)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449165
Show More Cited By

Index Terms

Work Always in Progress: Analysing Maintenance Practices in Spatial Crowd-sourced Datasets
1. Information systems
  1. Information systems applications

Recommendations

Exploring Maintenance Practices in Crowd-Mapping
HT '16: Proceedings of the 27th ACM Conference on Hypertext and Social Media

Crowd-mapping is a form of collaborative work that empowers users to gather and share geographic knowledge. OpenStreetMap is one of the most successful examples of such paradigm, where the goal of building a global map of the world is collectively ...
Assessing the relationship between socio-demographic characteristics and OpenStreetMap contributor behaviours
GeoSocial '23: Proceedings of the 1st ACM SIGSPATIAL International Workshop on Geocomputational Analysis of Socio-Economic Data

'Volunteered Geographic Information' (VGI) has particular importance - in part - for its democratisation of geographic information. However, some recent research has suggested that despite being publicly open, several successful VGI platforms have ...
Semantically enriching VGI in support of implicit feedback analysis
W2GIS'11: Proceedings of the 10th international conference on Web and wireless geographical information systems

In recent years, the proliferation of Volunteered Geographic Information (VGI) has enabled many Internet users to contribute to the construction of rich and increasingly complex spatial datasets. This growth of geo-referenced information and the often ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '17: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing

February 2017

2556 pages

ISBN:9781450343350

DOI:10.1145/2998181

General Chairs:
Charlotte P. Lee
University of Washington
,
Steve Poltrock
Retired
,
Program Chairs:
Louise Barkhuus
Stockholm University and Cornell Tech
,
Marcos Borges
Universidade Federal do Rio de Janeiro
,
Wendy Kellogg
IBM T.J. Watson Research Center

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 February 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CSCW '17

Sponsor:

SIGCHI

CSCW '17: Computer Supported Cooperative Work and Social Computing

February 25 - March 1, 2017

Oregon, Portland, USA

Acceptance Rates

CSCW '17 Paper Acceptance Rate 183 of 530 submissions, 35%;

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
172
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)2

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sehra SSingh JSehra SRai H(2022)Extending QGIS processing toolbox for assessing the geometrical properties of OpenStreetMap dataSpatial Information Research10.1007/s41324-022-00480-331:2(135-144)Online publication date: 24-Sep-2022
https://doi.org/10.1007/s41324-022-00480-3
Wallace SPapoutsaki ATan NGuo HHuang J(2021)Case Studies on the Motivation and Performance of Contributors Who Verify and Maintain In-Flux Tabular DatasetsProceedings of the ACM on Human-Computer Interaction10.1145/34795925:CSCW2(1-25)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479592
Verdezoto NBagalkot NAkbar SSharma SMackintosh NHarrington DGriffiths P(2021)The Invisible Work of Maintenance in Community HealthProceedings of the ACM on Human-Computer Interaction10.1145/34491655:CSCW1(1-31)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449165
Roper BChapman AMartin DCavazzi S(2021)Mapping Trusted Paths to VGIProvenance and Annotation of Data and Processes10.1007/978-3-030-80960-7_13(207-210)Online publication date: 9-Jul-2021
https://doi.org/10.1007/978-3-030-80960-7_13
Seto TKanasugi HNishimura Y(2020)Quality Verification of Volunteered Geographic Information Using OSM Notes Data in a Global ContextISPRS International Journal of Geo-Information10.3390/ijgi90603729:6(372)Online publication date: 6-Jun-2020
https://doi.org/10.3390/ijgi9060372
Maddalena EIbáñez LSimperl E(2020)Mapping Points of Interest Through Street View Imagery and Paid CrowdsourcingACM Transactions on Intelligent Systems and Technology10.1145/340393111:5(1-28)Online publication date: 10-Aug-2020
https://dl.acm.org/doi/10.1145/3403931
Hall AThebault-Spieker JSen SHecht BTerveen L(2018)Exploring the Relationship Between "Informal Standards" and Contributor Practice in OpenStreetMapProceedings of the 14th International Symposium on Open Collaboration10.1145/3233391.3233962(1-11)Online publication date: 22-Aug-2018
https://dl.acm.org/doi/10.1145/3233391.3233962
Wurhofer DMeneweger TFuchsberger VTscheligi MForte APrilla MVivacqua AMüller CRobert L(2018)Reflections on Operators' and Maintenance Engineers' Experiences of Smart FactoriesProceedings of the 2018 ACM International Conference on Supporting Group Work10.1145/3148330.3148349(284-296)Online publication date: 7-Jan-2018
https://dl.acm.org/doi/10.1145/3148330.3148349
Sehra SSingh JRai H(2017)Assessing OpenStreetMap Data Using Intrinsic Quality Indicators: An Extension to the QGIS Processing ToolboxFuture Internet10.3390/fi90200159:2(15)Online publication date: 21-Apr-2017
https://doi.org/10.3390/fi9020015

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents