Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3520304.3528912acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
poster

Cooperative attack-defense evolution of large-scale agents: a multi-population high-dimensional mean-field game approach

Published: 19 July 2022 Publication History

Abstract

The traditional optimization and control technologies deal with the dynamic interactions between individuals separately, with the increase in the agents' number, the modeling process of cooperative attack-defense problems tends to be complex, and the difficulty of solving the optimal strategy will increase significantly. Moreover, to carry out more accurate real-time control of agents, the state variables used to characterize their kinematics are usually high-dimensional. To overcome these challenges, we formulate the cooperative attack-defense evolution of large-scale agents as a multi-population high-dimensional stochastic mean-field game (MPHD-MFG). Numerical methods for MPHD-MFGs are practically non-existent, because, the heterogeneity of the multi-population model increases the complexity of sequential games, and grid-based spatial discretization leads to dimension explosion. Thus, we propose a generative adversarial network-based method, where we use a coupled alternating neural network composed of multiple generators and multiple discriminators, to tractably solve MPHD-MFGs. Simulation experiments are carried out for various attack-defense scenarios, the results verify the feasibility and effectiveness of our proposed model and algorithm.

Supplementary Material

ZIP File (p89-wang-suppl.zip)
Supplemental material.

References

[1]
Yaodong Yang, Rui Luo, Minne Li, Ming Zhou, Weinan Zhang, and Jun Wang. Mean field multi-agent reinforcement learning. In Jennifer Dy and Andreas Krause, editors, Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 5571--5580. PMLR, 10--15 Jul 2018.
[2]
Jean-Michel Lasry and Pierre-Louis Lions. Mean field games. Japanese Journal of Mathematics, 2(1):229--260, March 2007.
[3]
Minyi Huang, Peter E. Caines, and Roland P. Malhame. Large-population cost-coupled LQG problems with nonuniform agents: Individual-mass behavior and decentralized $\varepsilon$-nash equilibria. IEEE Transactions on Automatic Control, 52(9):1560--1571, September 2007.
[4]
Olivier Guéant, Jean-Michel Lasry, and Pierre-Louis Lions. Mean field games and applications. In Paris-Princeton Lectures on Mathematical Finance 2010, pages 205--266. Springer Berlin Heidelberg, 2011.
[5]
Alex Tong Lin, Samy Wu Fung, Wuchen Li, Levon Nurbekyan, and Stanley J. Osher. Alternating the population and control neural networks to solve high-dimensional stochastic mean-field games. Proceedings of the National Academy of Sciences, 118(31):e2024713118, July 2021.
[6]
Guofang Wang, Wang Yao, Xiao Zhang, and Zijia Niu. Coupled alternating neural networks for solving multi-population high-dimensional mean-field games with stochasticity. January 2022.
[7]
J. M. Schulte. Adjoint methods for Hamilton-Jacobi-Bellman equations. PhD thesis, University of Munster, November 2010.

Cited By

View all
  • (2023)Preface to the Special Issue on “Recent Advances in Swarm Intelligence Algorithms and Their Applications”—Special Issue BookMathematics10.3390/math1112262411:12(2624)Online publication date: 8-Jun-2023
  • (2022)A Multi-Population Mean-Field Game Approach for Large-Scale Agents Cooperative Attack-Defense Evolution in High-Dimensional EnvironmentsMathematics10.3390/math1021407510:21(4075)Online publication date: 2-Nov-2022

Index Terms

  1. Cooperative attack-defense evolution of large-scale agents: a multi-population high-dimensional mean-field game approach

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        GECCO '22: Proceedings of the Genetic and Evolutionary Computation Conference Companion
        July 2022
        2395 pages
        ISBN:9781450392686
        DOI:10.1145/3520304
        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 19 July 2022

        Check for updates

        Author Tags

        1. high-dimensional solution space
        2. large-scale agents
        3. multi-population mean-field game
        4. neural networks

        Qualifiers

        • Poster

        Funding Sources

        • Science and Technology Innovation 2030-Key Project

        Conference

        GECCO '22
        Sponsor:

        Acceptance Rates

        Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)23
        • Downloads (Last 6 weeks)4
        Reflects downloads up to 01 Sep 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2023)Preface to the Special Issue on “Recent Advances in Swarm Intelligence Algorithms and Their Applications”—Special Issue BookMathematics10.3390/math1112262411:12(2624)Online publication date: 8-Jun-2023
        • (2022)A Multi-Population Mean-Field Game Approach for Large-Scale Agents Cooperative Attack-Defense Evolution in High-Dimensional EnvironmentsMathematics10.3390/math1021407510:21(4075)Online publication date: 2-Nov-2022

        View Options

        Get Access

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media