research-article

Ethics and tactics of professional crowdwork

Authors:

M. Six Silberman,

Lilly Irani,

Joel RossAuthors Info & Claims

XRDS: Crossroads, The ACM Magazine for Students, Volume 17, Issue 2

Pages 39 - 43

https://doi.org/10.1145/1869086.1869100

Published: 01 December 2010 Publication History

Get Access

Abstract

Paid crowd workers are not just an API call---but all too often, they are treated like one.

References

[1]

Silberman, M. S., et al. Sellers' problems in human computation markets. In Proceedings of HCOMP 2010.

Digital Library

Google Scholar

[2]

Ross, J., et al. Who are the crowdworkers? shifting demographics in Mechanical Turk. In Proceedings of CHI 2010: 2863--2872.

Digital Library

Google Scholar

[3]

Ipeirotis, P. Mechanical Turk: the demographics. http://behind-the-enemy-lines.blogspot.com/2008/03/mechanical-turk-demographics.html.

Google Scholar

[4]

Kochhar, S., et al. The anatomy of a large-scale human computation engine. In Proceedings of HCOMP 2010.

Digital Library

Google Scholar

[5]

Felstiner, A. Working the crowd: employment and labor law in the crowdsourcing industry. http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1593853.

Google Scholar

[6]

Chilton, L., et al. Task search in a human computation market. In Proceedings of HCOMP 2010.

Digital Library

Google Scholar

[7]

Franklin, J., et al. An inquiry into the nature and causes of the wealth of internet miscreants. In Proceedings of CCS '07: 375--388.

Digital Library

Google Scholar

[8]

Jain, S. and D. Parkes. The role of game theory in human computation systems. In Proceedings of HCOMP 2009.

Digital Library

Google Scholar

[9]

Horton, J. J. and L. Chilton. The labor economics of paid crowdsourcing. arXiv:1001.0627v1 {cs:HC}, 2010.

Google Scholar

Cited By

View all

Jiang LWagner C(2024)How Low is Low? Crowdworker Perceptions of Microtask Payments in Work versus Leisure SituationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642601(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642601
Gussek LWiesche M(2024)Understanding the careers of freelancers on digital labor platforms: The case of IT workInformation Systems Journal10.1111/isj.1250934:5(1664-1702)Online publication date: 6-Feb-2024
https://doi.org/10.1111/isj.12509
McCartney JAlisa Lê J(2024)Different systems, similar experiences: felt accountability in labor platforms and traditional organizationsThe International Journal of Human Resource Management10.1080/09585192.2024.2361710(1-29)Online publication date: 10-Jun-2024
https://doi.org/10.1080/09585192.2024.2361710
Show More Cited By

Index Terms

Ethics and tactics of professional crowdwork
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Social and professional topics
  1. Computing / technology policy

Recommendations

Incentivizing high quality crowdwork

We study the causal effects of financial incentives on the quality of crowdwork. We focus on performance-based payments (PBPs), bonus payments awarded to workers for producing high quality work. We design and run randomized behavioral experiments on the ...
Incentivizing High Quality Crowdwork
WWW '15: Proceedings of the 24th International Conference on World Wide Web

We study the causal effects of financial incentives on the quality of crowdwork. We focus on performance-based payments (PBPs), bonus payments awarded to workers for producing high quality work. We design and run randomized behavioral experiments on the ...
Accessible Crowdwork?: Understanding the Value in and Challenge of Microtask Employment for People with Disabilities
CSCW '15: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing

We present the first formal study of crowdworkers who have disabilities via in-depth open-ended interviews of 17 people (disabled crowdworkers and job coaches for people with disabilities) and a survey of 631 adults with disabilities. Our findings ...

Comments

Information & Contributors

Information

Published In

cover image XRDS: Crossroads, The ACM Magazine for Students

XRDS: Crossroads, The ACM Magazine for Students Volume 17, Issue 2

Comp-YOU-Ter

Winter 2010

53 pages

ISSN:1528-4972

EISSN:1528-4980

DOI:10.1145/1869086

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2010

Published in XRDS Volume 17, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

121
Total Citations
View Citations
4,346
Total Downloads

Downloads (Last 12 months)56
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Jiang LWagner C(2024)How Low is Low? Crowdworker Perceptions of Microtask Payments in Work versus Leisure SituationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642601(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642601
Gussek LWiesche M(2024)Understanding the careers of freelancers on digital labor platforms: The case of IT workInformation Systems Journal10.1111/isj.1250934:5(1664-1702)Online publication date: 6-Feb-2024
https://doi.org/10.1111/isj.12509
McCartney JAlisa Lê J(2024)Different systems, similar experiences: felt accountability in labor platforms and traditional organizationsThe International Journal of Human Resource Management10.1080/09585192.2024.2361710(1-29)Online publication date: 10-Jun-2024
https://doi.org/10.1080/09585192.2024.2361710
Xia H(2024)Undue Influence or Exploitation — A Qualitative Inquiry into an Ethical Dilemma Around Payment in Crowd Work-Based Research in the U.S.Computer Supported Cooperative Work10.1007/s10606-023-09472-933:3(329-369)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1007/s10606-023-09472-9
Kashima HOyama SArai HMori J(2024)Trustworthy human computation: a surveyArtificial Intelligence Review10.1007/s10462-024-10974-157:12Online publication date: 12-Oct-2024
https://doi.org/10.1007/s10462-024-10974-1
Bates JGerakopoulou EChecco A(2023)Addressing labour exploitation in the data science pipeline: views of precarious US-based crowdworkers on adversarial and co-operative interventionsJournal of Information, Communication and Ethics in Society10.1108/JICES-08-2022-006921:3(342-357)Online publication date: 26-May-2023
https://doi.org/10.1108/JICES-08-2022-0069
Gussek LGrabbe AWiesche M(2023)Challenges of IT freelancers on digital labor platforms: A topic model approachElectronic Markets10.1007/s12525-023-00675-y33:1Online publication date: 23-Oct-2023
https://doi.org/10.1007/s12525-023-00675-y
Xie HMaddalena EQarout RChecco A(2023)The Dark Side of Recruitment in Crowdsourcing: Ethics and Transparency in Micro-Task MarketplacesComputer Supported Cooperative Work (CSCW)10.1007/s10606-023-09464-932:3(439-474)Online publication date: 28-Jul-2023
https://doi.org/10.1007/s10606-023-09464-9
Rechkemmer AYin M(2022)Understanding the Microtask Crowdsourcing Experience for Workers with Disabilities: A Comparative ViewProceedings of the ACM on Human-Computer Interaction10.1145/35551376:CSCW2(1-30)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555137
Dutta SLinder RLowe DRosenbalm RKuzminykh AWilliams A(2022)Mobilizing Crowdwork:A Systematic Assessment of the Mobile Usability of HITsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501876(1-20)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501876
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Abstract

References

Cited By

Index Terms

Recommendations

Incentivizing high quality crowdwork

Incentivizing High Quality Crowdwork

Accessible Crowdwork?: Understanding the Value in and Challenge of Microtask Employment for People with Disabilities

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Digital Edition

Magazine Site

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations