Computer Science > Multiagent Systems
[Submitted on 23 Feb 2024 (v1), last revised 7 Jul 2024 (this version, v5)]
Title:Open Ad Hoc Teamwork with Cooperative Game Theory
View PDF HTML (experimental)Abstract:Ad hoc teamwork poses a challenging problem, requiring the design of an agent to collaborate with teammates without prior coordination or joint training. Open ad hoc teamwork (OAHT) further complicates this challenge by considering environments with a changing number of teammates, referred to as open teams. One promising solution in practice to this problem is leveraging the generalizability of graph neural networks to handle an unrestricted number of agents with various agent-types, named graph-based policy learning (GPL). However, its joint Q-value representation over a coordination graph lacks convincing explanations. In this paper, we establish a new theory to understand the representation of the joint Q-value for OAHT and its learning paradigm, through the lens of cooperative game theory. Building on our theory, we propose a novel algorithm named CIAO, based on GPL's framework, with additional provable implementation tricks that can facilitate learning. The demos of experimental results are available on this https URL, and the code of experiments is published on this https URL.
Submission history
From: Jianhong Wang [view email][v1] Fri, 23 Feb 2024 11:04:33 UTC (8,391 KB)
[v2] Mon, 27 May 2024 16:48:35 UTC (8,471 KB)
[v3] Fri, 31 May 2024 16:28:10 UTC (8,471 KB)
[v4] Mon, 10 Jun 2024 22:01:50 UTC (8,472 KB)
[v5] Sun, 7 Jul 2024 12:43:35 UTC (8,471 KB)
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.