short-paper

ReSkill: Relative Skill-Level Calculation System

Authors:

George Pavlidis,

Dimitris KallesAuthors Info & Claims

SETN '16: Proceedings of the 9th Hellenic Conference on Artificial Intelligence

Article No.: 39, Pages 1 - 4

https://doi.org/10.1145/2903220.2903224

Published: 18 May 2016 Publication History

Abstract

The introduction of social dynamics in multi-agent environments with synthetic agents is an effective way to simulate real-life conditions. Nowadays there is a trend towards the integration of social dynamics in multi-agent virtual environments to better assess the performance of synthetic agents in competitive situations. This assessment is usually carried out using human rating methods, such as Elo and Glicko, two of the most widespread methods, primarily used for chess. This paper introduces a web-based system that was developed to provide a way for everyone to be able to use these well-known human rating systems in various multi-agent rating experiments. A large-scale experiment has been conducted and the results have been used to present and prove the functionality of the developed system.

References

[1]

Gilbert, N. and Troitzsch, K. G., 2005. Simulation for the Social Scientist. Open University Press, 2nd ed.

Digital Library

[2]

Shoham, Y. and Leyton, K. B., 2009. Multiagent Systems: Algorithmic, Game-Theoretic and Logical Foundations. Cambridge University Press, New York.

Digital Library

[3]

Ferber, J. 1999. Multi-Agent Systems: An Introduction to Distributed Artificial Intelligence. Addison-Wesley.

Digital Library

[4]

Kiourt, C. and Kalles, D. 2012. Social Reinforcement Learning in Game Playing. In IEEE International Conference on Tools with Artificial Intelligence, 322--326, Athens, Greece.

Digital Library

[5]

Caballero, A., Botia, J., and Gomez-Skarmeta, A. 2011. Using cognitive agents in social simulations. Engineering Applications of Artificial Intelligence, 24, 7, 1098--1109.

Digital Library

[6]

Marivate, V. N. 2008. Social Learning Methods in Board Game Agents. In IEEE Symposium Computational Intelligence and Games, 323--328, Perth, Australia.

[7]

Kiourt, C., Kalles, D., and Pavlidis, G. 2015. Human Rating Methods on Multi-Agent Systems. In 13th European Conference on Multi-Agent Systems Athens, Greece.

[8]

Kiourt, C. and Kalles, D. 2015. Learning in Multi Agent Social Environments with Opponent Models. In 13th European Conference on Multi-Agent Systems Athens, Greece.

[9]

Harkness, K. 1967. Official Chess Handbook. McKay.

[10]

Elo, A. E. 1978. The Rating of Chess Players, Past and Present. New York: Arco Publishing.

[11]

Logan, Y. and Kagan, T. 2013. Elo Ratings for Structural Credit Assignment in Multiagent Systems. In Twenty-Seventh AAAI Conference on Artificial Intelligence (Late-Breaking De-velopments).

Digital Library

[12]

Glickman, E. and Albyn, J. C. 1999. Rating the chess rating system. Chance, 12, 2, 21--28.

[13]

Herbrich, R., Minka, T., and Graepel, T. 2007. TrueSkill(TM): A Bayesian Skill Rating System. In in Advances in Neural Information Processing Systems 20, MIT Press.

[14]

Grady, J. O. 1995. System Engineering Planning and Enterprise Identity. Taylor & Francis.

[15]

Kalles, D. and Kanellopoulos, P. 2001. On Verifying Game Design and Playing Strategies using Reinforcement Learning. In Proceedings of ACM Symposium on Applied Computing, special track on Artificial Intelligence and Computation Logic Las Vegas.

Digital Library

[16]

Sutton, R. and Barto, A. 1998. Reinforcement Learning: An Introduction. MITPress,Cam-bridge, MA.

Digital Library

Cited By

Kiourt CKalles DPavlidis G(2019)Rating the skill of synthetic agents in competitive multi-agent environmentsKnowledge and Information Systems10.1007/s10115-018-1234-658:1(35-58)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1007/s10115-018-1234-6
Kiourt CKalles DKanellopoulos P(2018)How Game Complexity Affects the Playing Behavior of Synthetic AgentsMulti-Agent Systems and Agreement Technologies10.1007/978-3-030-01713-2_22(307-322)Online publication date: 14-Oct-2018
https://doi.org/10.1007/978-3-030-01713-2_22
Kiourt CKalles D(2016)Synthetic learning agents in game-playing social environmentsAdaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems10.1177/105971231667923924:6(411-427)Online publication date: 1-Dec-2016
https://dl.acm.org/doi/10.1177/1059712316679239

ReSkill: Relative Skill-Level Calculation System
1. Applied computing
  1. Computers in other domains
    1. Personal computers and PC applications
2. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence

Recommendations

Case amazon: ratings and reviews as part of recommendations
RecSys '07: Proceedings of the 2007 ACM conference on Recommender systems

We studied user behavior in a recommender-rich environment, Amazon online store, to see what role the algorithm-based and user-generated recommendations play in finding items of interest. We used applied ethnography, on-location interviewing and ...
An Adaptive Rating System for Service Computing
TRUSTCOM '13: Proceedings of the 2013 12th IEEE International Conference on Trust, Security and Privacy in Computing and Communications

Many service rating systems have been proposed for service computing to help users select services. Most of these systems do not consider the unfair rating problem. As a result, malicious users and services might explore the weakness of the existing ...
Beyond skill-based rating systems: analyzing and evaluating player performance
AcademicMindtrek '17: Proceedings of the 21st International Academic Mindtrek Conference

Being competitive is a core element of human nature and rating systems are a great tool for satisfying the need of ranking players for the skills they demonstrate. But the games of today have left rating systems behind in their evolution, making it more ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

SETN '16: Proceedings of the 9th Hellenic Conference on Artificial Intelligence

May 2016

249 pages

ISBN:9781450337342

DOI:10.1145/2903220

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

EETN: Hellenic Artificial Intelligence Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

SETN '16

SETN '16: 9th Hellenic Conference on Artificial Intelligence

May 18 - 20, 2016

Thessaloniki, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
87
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kiourt CKalles DPavlidis G(2019)Rating the skill of synthetic agents in competitive multi-agent environmentsKnowledge and Information Systems10.1007/s10115-018-1234-658:1(35-58)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1007/s10115-018-1234-6
Kiourt CKalles DKanellopoulos P(2018)How Game Complexity Affects the Playing Behavior of Synthetic AgentsMulti-Agent Systems and Agreement Technologies10.1007/978-3-030-01713-2_22(307-322)Online publication date: 14-Oct-2018
https://doi.org/10.1007/978-3-030-01713-2_22
Kiourt CKalles D(2016)Synthetic learning agents in game-playing social environmentsAdaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems10.1177/105971231667923924:6(411-427)Online publication date: 1-Dec-2016
https://dl.acm.org/doi/10.1177/1059712316679239

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents