research-article

Disagreement for control of rational cheating in peer review: a simulation

Authors:

Mario Paolucci,

Francisco GrimaldoAuthors Info & Claims

AAMAS '12: Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 3

Pages 1357 - 1358

Published: 04 June 2012 Publication History

Get Access

Abstract

Understanding the peer review process could help research and shed light on mechanisms that underlie crowdsourcing. We present an agent-based model of peer review built on three entities - the paper, the scientist and the conference. The model allows us to define a rich model of scoring, evaluating and selecting papers for conferences. Some of the reviewers apply a strategy (called "rational cheating") aimed to prevent papers better than their own to be accepted. We show how programme committee update, based on disagreement control, can remove rational cheaters.

References

[1]

D. Callahan. Rational Cheating: Everyone's Doing It. Journal of Forensic Accounting, pages 575+, Oct. 2004.

Google Scholar

[2]

F. Casati, M. Marchese, A. Ragone, and M. Turrini. Is peer review any good? A quantitative analysis of peer review. Technical report, Ingegneria e Scienza dell'Informazione, University of Trento, 2009.

Google Scholar

[3]

B. D. Neff and J. D. Olden. Is Peer Review a Game of Chance? BioScience, 56(4):333--340, Apr. 2006.

Crossref

Google Scholar

[4]

F. Squazzoni and C. Gandelli. San Matthew Is Always There. A Study on Peer Review and the Scientific Community Structure. 2011.

Google Scholar

[5]

S. Thurner and R. Hanel. Peer-review in a world with rational scientists: Toward selection of the average. Aug. 2010.

Google Scholar

Index Terms

Disagreement for control of rational cheating in peer review: a simulation
1. Computing methodologies
  1. Artificial intelligence
    1. Knowledge representation and reasoning
      1. Cognitive robotics
    2. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science

Recommendations

Trustworthiness of Acquaintances in Peer-to-Peer(P2P) Overlay Networks
CISIS '10: Proceedings of the 2010 International Conference on Complex, Intelligent and Software Intensive Systems

Systems using peer-to-peer (P2P) overlay networks are getting a central position in information systems. P2P systems are in nature fully distributed, with no centralized coordinator and each peer is autonomous. Each peer has to obtain information on ...
Incentive and rebuke based reputation model for peer to peer applications
ICWET '10: Proceedings of the International Conference and Workshop on Emerging Trends in Technology

Peer-to-peer applications are very popular due to their decentralized and anonymous characteristics. Though this provides more opportunities for information exchange it still faces problems from malicious behavior. It is necessary to motivate peers to ...
ReDS: A Framework for Reputation-Enhanced DHTs

Distributed hash tables (DHTs), such as Chord and Kademlia, offer an efficient means to locate resources in peer-to-peer networks. Unfortunately, malicious nodes on a lookup path can easily subvert such queries. Several systems, including Halo (based on ...

Comments

Information & Contributors

Information

Published In

AAMAS '12: Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 3

June 2012

376 pages

ISBN:0981738133

In-Cooperation

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

International Foundation for Autonomous Agents and Multiagent Systems

Richland, SC

Publication History

Published: 04 June 2012

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AAMAS 12

Sponsor:

The International Foundation for Autonomous Agents and Multiagent Systems

AAMAS 12: International Conference on Autonomous Agents and Multiagent Systems

June 4 - 8, 2012

Valencia, Spain

Acceptance Rates

Overall Acceptance Rate 1,155 of 5,036 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
76
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Index Terms

Recommendations

Trustworthiness of Acquaintances in Peer-to-Peer(P2P) Overlay Networks

Incentive and rebuke based reputation model for peer to peer applications

ReDS: A Framework for Reputation-Enhanced DHTs

Comments

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Login options

Full Access

PDF

eReader

Abstract

References

Index Terms

Recommendations

Trustworthiness of Acquaintances in Peer-to-Peer(P2P) Overlay Networks

Incentive and rebuke based reputation model for peer to peer applications

ReDS: A Framework for Reputation-Enhanced DHTs

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations