Article

Labeling images with a computer game

Authors:

Luis von Ahn and

Laura DabbishAuthors Info & Claims

CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2004

Pages 319 - 326

https://doi.org/10.1145/985692.985733

Published: 25 April 2004 Publication History

Abstract

We introduce a new interactive system: a game that is fun and can be used to create valuable output. When people play the game they help determine the contents of images by providing meaningful labels for them. If the game is played as much as popular online games, we estimate that most images on the Web can be labeled in a few months. Having proper labels associated with each image on the Web would allow for more accurate image search, improve the accessibility of sites (by providing descriptions of images to visually impaired individuals), and help users block inappropriate images. Our system makes a significant contribution because of its valuable output and because of the way it addresses the image-labeling problem. Rather than using computer vision techniques, which don't work well enough, we encourage people to do the work by taking advantage of their desire to be entertained.

References

[1]

AltaVista Company. Altavista Search Home. http://www.altavista.com/

[2]

Barnard, K., Duygulu, P., and Forsyth, D. A. Clustering Art. IEEE conference on Computer Vision and Pattern Recognition, 2001, pages 434--441.

[3]

Barnard, K., and Forsyth, D. A. Learning the Semantics of Words and Pictures. International Conference of Computer Vision, 2001, pages 408--415.

[4]

Carson, C., and Ogle, V. E. Storage and Retrieval of Feature Data for a Very Large Online Image Collection <http://elib.cs.berkeley.edu/papers/dataeng.html>. IEEE Computer Society Bulletin of the Technical Committee on Data Engineering, 1996, Vol. 19 No. 4.

[5]

Columbia University Center for Telecommunications Research. webSEEK. www.ctr.columbia.edu/webseek/

[6]

Corbis. Stock Photography and Pictures. http://www.corbis.com/

[7]

Duygulu, P., Barnard, K., de Freitas, N., and Forsyth, D. A. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. 7th European Conference on Computer Vision, <http://www.itu.dk/events/eccv02/>2002, pages 97--112.

Digital Library

[8]

Electronic Arts. Pogo.com. http://www.pogo.com

[9]

Fleck, M. M., Forsyth, D. A., and Bregler, C. Finding Naked People. ECCV, 1996, pages 593--602.

Digital Library

[10]

Google Inc. Google Web Search. http://www.google.com

[11]

Lempel, R. and Soffer, A. PicASHOW: Pictorial Authority Search by Hyperlinks on the Web. WWW10.

Digital Library

[12]

Microsoft Corporation. MSN Gaming Zone. http://zone.msn.com

[13]

Milliman, R. E. Website Accessibility And The Private Sector. www.rit.edu/~easi/itd/itdv08n2/milliman.html

[14]

N2H2, Inc. N2H2 Filter. http://www.n2h2.com

[15]

O'Connor, B. and O'Connor, M. Categories, Photographs & Predicaments: Exploratory Research on Representing Pictures for Access. Bulletin of the American Society for Information Science 25.6, 1999, page 17--20.

[16]

Random Bounce Me Website. http://random.bounceme.net/

[17]

Scheniderman, H. and Kanade, T. Object Detection Using the Statistics of Parts <http://www.ri.cmu.edu/pubs/pub_3977.html>. International Journal of Computer Vision, 2002.

Digital Library

[18]

Stork, D. G. and Lam C. P. Open Mind Animals: Ensuring the quality of data openly contributed over the World Wide Web. AAAI Workshop on Learning with Imbalanced Data Sets, 2000, pages 4--9.

[19]

Stork, D. G. The Open Mind Initiative. IEEE Intelligent Systems & Their Applications, 14-3, 1999, pages 19--20.

[20]

Trask, R. L. Language Change. Routledge, 1994

[21]

Yahoo!, Inc. Yahoo! Games. http://games.yahoo.com

Cited By

Li Z(2024)When Being a Data Annotator Was Not Yet a Job: The Laboratory Origins of Dispersible Labor in Computer Vision ResearchSocius: Sociological Research for a Dynamic World10.1177/2378023124125961710Online publication date: 24-Jun-2024
https://doi.org/10.1177/23780231241259617
Osborn NCooper S(2024)Asynchronous Collaboration with Quality-Diversity Search in Human Computation GamesProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3656977(1-4)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3656977
Kong Y(2024)Dominantly Truthful Peer Prediction Mechanisms with a Finite Number of TasksJournal of the ACM10.1145/363823971:2(1-49)Online publication date: 10-Apr-2024
https://dl.acm.org/doi/10.1145/3638239
Show More Cited By

Index Terms

Labeling images with a computer game

Recommendations

Sensing game play. Exploring computer game play in a game café and a mass LAN party
CGAMES '11: Proceedings of the 2011 16th International Conference on Computer Games

In this article we discuss the sensory experiences of playing computer games by exploring the sight, the sound, the taste, smell, and touch of games. We reflect on how senses and the social atmosphere gives meaning to players' experiences of playing ...
Read More
Exploring Game Leadership and Online Game Community
VS-GAMES '09: Proceedings of the 2009 Conference in Games and Virtual Worlds for Serious Applications

Online games have become a major leisure activity in recent years. Players go through a variety of social experiences, building up game communities such as guilds, blood pledges, and other small teams in virtual worlds. Game communities offer similar ...
Read More
Improving accessibility of the web with a computer game
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Images on the Web present a major accessibility issue for the visually impaired, mainly because the majority of them do not have proper captions. This paper addresses the problem of attaching proper explanatory text descriptions to arbitrary images on ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2004

742 pages

ISBN:1581137028

DOI:10.1145/985692

Conference Chairs:
Elizabeth Dykstra-Erickson
Kinoma
,
Manfred Tscheligi
CURE, Austria

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI04

Sponsor:

CHI04: CHI 2004 Conference on Human Factors in Computing Systems

April 24 - 29, 2004

Vienna, Austria

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI PLAY '24

Sponsor:
sigchi

The Annual Symposium on Computer-Human Interaction in Play

October 14 - 17, 2024

Tampere , Finland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,272
Total Citations
View Citations
7,448
Total Downloads

Downloads (Last 12 months)350
Downloads (Last 6 weeks)41

Other Metrics

View Author Metrics

Citations

Cited By

Li Z(2024)When Being a Data Annotator Was Not Yet a Job: The Laboratory Origins of Dispersible Labor in Computer Vision ResearchSocius: Sociological Research for a Dynamic World10.1177/2378023124125961710Online publication date: 24-Jun-2024
https://doi.org/10.1177/23780231241259617
Osborn NCooper S(2024)Asynchronous Collaboration with Quality-Diversity Search in Human Computation GamesProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3656977(1-4)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3656977
Kong Y(2024)Dominantly Truthful Peer Prediction Mechanisms with a Finite Number of TasksJournal of the ACM10.1145/363823971:2(1-49)Online publication date: 10-Apr-2024
https://dl.acm.org/doi/10.1145/3638239
Mandryk RMirza-Babaei PDenisova AFreeman GJohnson D(2024)Games and Play SIG: Connecting Games Research to the Broader HCI ContextExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3643986(1-6)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3643986
Yang YShin AKim NWoo HChung JSong J(2024)Find the Bot!: Gamifying Facial Emotion Recognition for Both Human Training and Machine Learning Data CollectionProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642880(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642880
Jiang LJung CPhutane MStangl AAzenkot S(2024)“It’s Kind of Context Dependent”: Understanding Blind and Low Vision People’s Video Accessibility Preferences Across Viewing ScenariosProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642238(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642238
Xu SZhang YResnick PSchoenebeck GChua TNgo CKa-Wei Lee RKumar RLauw H(2024)Spot Check Equivalence: An Interpretable Metric for Information Elicitation MechanismsProceedings of the ACM on Web Conference 202410.1145/3589334.3645679(276-287)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645679
Mao YYan XLiu JYe Y(2024)ConGMC: Consistency-Guided Multimodal Clustering via Mutual Information MaximinIEEE Transactions on Multimedia10.1109/TMM.2023.333009326(5131-5146)Online publication date: 2024
https://doi.org/10.1109/TMM.2023.3330093
Mao YYan XHu SYe Y(2024)Contrastive cross-modal clustering with twin networkPattern Recognition10.1016/j.patcog.2024.110645(110645)Online publication date: May-2024
https://doi.org/10.1016/j.patcog.2024.110645
Salar AAhmadi A(2024)Improving loss function for deep convolutional neural network applied in automatic image annotationThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02873-340:3(1617-1629)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1007/s00371-023-02873-3
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents