research-article

Declarative platform for data sourcing games

Authors:

Ohad Greenshpan,

Boris Kostenko,

Tova MiloAuthors Info & Claims

WWW '12: Proceedings of the 21st international conference on World Wide Web

Pages 779 - 788

https://doi.org/10.1145/2187836.2187942

Published: 16 April 2012 Publication History

Abstract

Harnessing a crowd of users for the collection of mass data (data sourcing) has recently become a wide-spread practice. One effective technique is based on games as a tool that attracts the crowd to contribute useful facts. We focus here on the data management layer of such games, and observe that the development of this layer involves challenges such as dealing with probabilistic data, combined with recursive manipulation of this data. These challenges are difficult to address using current declarative data management framework works, and we thus propose here a novel such framework, and demonstrate its usefulness in expressing different aspects in the data management of Trivia-like games. We have implemented a system prototype with our novel data management framework at its core, and we highlight key issues in the system design, as well as our experimentations that indicate the usefulness and scalability of the approach.

References

[1]

P. Agrawal, O. Benjelloun, A. Das Sarma, C. Hayworth, S. U. Nabar, T. Sugihara, and J. Widom. Trio: A system for data, uncertainty, and lineage. In VLDB '06.

Digital Library

[2]

L. Antova, C. Koch, and D. Olteanu. "Query Language Support for Incomplete Information in the MayBMS System". In Proc. VLDB, 2007.

Digital Library

[3]

A. Arasu, S. Chaudhuri, and R. Kaushik. Learning string transformations from examples. PVLDB, 2(1), 2009.

Digital Library

[4]

M. Bernstein, D. S. Tan, G. Smith, M. Czerwinski, and E. Horvitz. Collabio: a game for annotating people within social networks. In UIST '09. ACM.

Digital Library

[5]

G. Beskales, I. F. Ilyas, and L. Golab. Sampling the repairs of functional dependency violations under hard constraints. In VLDB '10.

Digital Library

[6]

J. Bleiholder and F. Naumann. Declarative data fusion - syntax, semantics, and implementation. In ADBIS, '05.

Digital Library

[7]

D. C. Brabham. Crowdsourcing as a Model for Problem Solving: An Introduction and Cases. Convergence, 14(1), 2008.

[8]

M. K. Cowles and B. P. Carlin. Markov chain monte carlo convergence diagnostics: A comparative review. Journal of the American Statistical Association, 91, 1996.

[9]

N. Dalvi and D. Suciu. "Efficient query evaluation on probabilistic databases". In Proc. VLDB, 2004.

Digital Library

[10]

D. Deutch, O. Greenshpan, B. Kostenko, and T. Milo. Using markov chain monte carlo to play trivia (demo). In ICDE, 2011.

Digital Library

[11]

D. Deutch, C. Koch, and T. Milo. On probabilistic fixpoint and markov chain query languages. In PODS '10.

Digital Library

[12]

R. Fink, D. Olteanu, and S. Rath. Providing support for full relational algebra in probabilistic databases. In ICDE, 2011.

Digital Library

[13]

M. J. Franklin, D. Kossmann, T. Kraska, S. Ramesh, and R. Xin. Crowddb: answering queries with crowdsourcing. In SIGMOD Conference, 2011.

Digital Library

[14]

D. Freedman. Markov Chains. Springer-Verlag, 1983.

[15]

A. Galland, S. Abiteboul, A. Marian, and P. Senellart. Corroborating information from disagreeing views. In WSDM '10.

Digital Library

[16]

S. Hacker and L. von Ahn. Matchin: eliciting user preferences with an online game. In CHI '09.

Digital Library

[17]

J. Huang, L. Antova, C. Koch, and D. Olteanu. Maybms: a probabilistic database management system. In SIGMOD Conference, 2009.

Digital Library

[18]

R. Jampani, F. Xu, M. Wu, L. L. Perez, C. Jermaine, and P. J. Haas. Mcdb: a monte carlo approach to managing uncertain data. In SIGMOD '08.

Digital Library

[19]

C. Koch. Approximating predicates and expressive queries on probabilistic databases. In PODS '08.

Digital Library

[20]

N. Leone and et al. "The INFOMIX system for advanced integration of incomplete and inconsistent data". In Proc. SIGMOD, 2005.

Digital Library

[21]

H. Ma, R. Chandrasekar, C. Quirk, and A. Gupta. Improving search engines using human computation games. In CIKM '09.

Digital Library

[22]

A. Marcus, E. Wu, D. R. Karger, S. Madden, and R. C. Miller. Human-powered sorts and joins. PVLDB, 5(1), 2011.

Digital Library

[23]

A. Marcus, E. Wu, S. Madden, and R. C. Miller. Crowdsourced databases: Query processing with people. In CIDR, 2011.

[24]

A. Marian and M. Wu. Corroborating information from web sources. IEEE Data Eng. Bull., 34(3), 2011.

[25]

Amazon's mechanical turk. https://www.mturk.com/.

[26]

C. Re, N. Dalvi, and D. Suciu. Efficient top-k query evaluation on probabilistic data. In ICDE '07.

[27]

C. P. Robert and G. Casella. Monte Carlo Statistical Methods (Springer Texts in Statistics). Springer-Verlag, Inc., 2005.

[28]

Shannon and Weaver. The Mathematical Theory of Communication. University of Illinois Press, Urbana, 1949.

[29]

Q. Su, D. Pavlov, J.-H. Chow, and W. C. Baker. Internet-scale collection of human-reviewed data. In WWW '07.

Digital Library

[30]

Top coder. http://www.topcoder.com/.

[31]

L. von Ahn and L. Dabbish. Labeling images with a computer game. In CHI '04.

Digital Library

[32]

L. von Ahn and L. Dabbish. Designing games with a purpose. Commun. ACM, 51(8), 2008.

Digital Library

Cited By

Machado TGopstein DNealen ANov OTogelius J(2018)AI-Assisted Game Debugging with Cicero2018 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC.2018.8477829(1-8)Online publication date: Jul-2018
https://doi.org/10.1109/CEC.2018.8477829
Amer-Yahia SRoy SDas GLykourentzou IRahman HThirumuruganathan S(2018)Human Factors Modeling in CrowdsourcingEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_80659(1723-1729)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_80659
Fang ZZhou XTang JShao WFong ASun LDing YZhou LLuo JLi JWang XGarofalakis MSoboroff ISuel TWang M(2014)Modeling Paying Behavior in Game Social NetworksProceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management10.1145/2661829.2662024(411-420)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2661829.2662024
Show More Cited By

Index Terms

Declarative platform for data sourcing games
1. Information systems
  1. Data management systems
    1. Query languages
2. Theory of computation
  1. Theory and algorithms for application domains
    1. Database theory
      1. Database query languages (principles)

Recommendations

Gamers, citizen scientists, and data

Two key problems for crowd-sourcing systems are motivating contributions from participants and ensuring the quality of these contributions. Games have been suggested as a motivational approach to encourage contribution, but attracting participation ...
Towards understanding balancing in exertion games
ACE '14: Proceedings of the 11th Conference on Advances in Computer Entertainment Technology

Playing exertion games with others can be engaging. However, players with different physical skill levels competing against each other can experience reduced engagement because they are either not challenged enough, or challenged too much. Balancing ...
Games for Crowds: A Crowdsourcing Game Platform for the Enterprise
CSCW '15: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing

In this paper, we present a crowdsourcing game platform that allows users to play, create, and share simple games that harness the collective intelligence of employees within the enterprise. The platform uses the wizard design pattern to guide users ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

WWW '12: Proceedings of the 21st international conference on World Wide Web

April 2012

1078 pages

ISBN:9781450312295

DOI:10.1145/2187836

General Chairs:
Alain Mille
Université de Lyon, France
,
Fabien Gandon
INRIA, France
,
Jacques Misselis
HP, France
,
Program Chairs:
Michael Rabinovich
Case Western Reserve University, USA
,
Steffen Staab
University of Koblenz-Landau, Germany

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Univ. de Lyon: Universite de Lyon

In-Cooperation

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 April 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

WWW 2012

Sponsor:

Univ. de Lyon

WWW 2012: 21st World Wide Web Conference 2012

April 16 - 20, 2012

Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
238
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Machado TGopstein DNealen ANov OTogelius J(2018)AI-Assisted Game Debugging with Cicero2018 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC.2018.8477829(1-8)Online publication date: Jul-2018
https://doi.org/10.1109/CEC.2018.8477829
Amer-Yahia SRoy SDas GLykourentzou IRahman HThirumuruganathan S(2018)Human Factors Modeling in CrowdsourcingEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_80659(1723-1729)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_80659
Fang ZZhou XTang JShao WFong ASun LDing YZhou LLuo JLi JWang XGarofalakis MSoboroff ISuel TWang M(2014)Modeling Paying Behavior in Game Social NetworksProceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management10.1145/2661829.2662024(411-420)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2661829.2662024
Kaplan HLotosh IMilo TNovgorodov S(2013)Answering planning queries with the crowdProceedings of the VLDB Endowment10.14778/2536360.25363696:9(697-708)Online publication date: 1-Jul-2013
https://dl.acm.org/doi/10.14778/2536360.2536369
Park HWidom J(2013)Query optimization over crowdsourced dataProceedings of the VLDB Endowment10.14778/2536206.25362076:10(781-792)Online publication date: 1-Aug-2013
https://dl.acm.org/doi/10.14778/2536206.2536207
Amsterdamer YGrossman YMilo TSenellart PRoss KSrivastava DPapadias D(2013)Crowd miningProceedings of the 2013 ACM SIGMOD International Conference on Management of Data10.1145/2463676.2465318(241-252)Online publication date: 22-Jun-2013
https://dl.acm.org/doi/10.1145/2463676.2465318
Park HPang RParameswaran AGarcia-Molina HPolyzotis NWidom J(2013)An overview of the deco systemACM SIGMOD Record10.1145/2430456.243046241:4(22-27)Online publication date: 17-Jan-2013
https://dl.acm.org/doi/10.1145/2430456.2430462
Milo T(2013)Making Collective Wisdom WiserProceedings of the 24th International Conference on Database and Expert Systems Applications - Volume 805510.1007/978-3-642-40285-2_3(7-8)Online publication date: 26-Aug-2013
https://dl.acm.org/doi/10.1007/978-3-642-40285-2_3

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents