Abstract
This paper discusses feedback Stackelberg strategies for the continuous-time mean-field type stochastic systems with multiple followers in infinite horizon. First, optimal control problems of the followers are studied in the sense of Nash equilibrium. With the help of a set of generalized algebraic Riccati equations (GAREs), sufficient conditions for the solvability are put forward. Then, the leader faces a constrained optimal control problem by transforming the cost functional into a trace criterion. Employing the Karush-Kuhn-Tucker (KKT) conditions, necessary conditions are presented in term of the solvability of the cross-coupled stochastic algebraic equations (CSAEs). Moreover, feedback Stackelberg strategies are obtained based on the solutions of the CSAEs. In addition, an iterative scheme is introduced to obtain efficiently the solutions of the CSAEs. Finally, an example is given to shed light on the effectiveness of the proposed results.
Similar content being viewed by others
References
Von-Stackelberg H, The Theory of the Market Economy, Oxford University Press, New York, 1952.
Chen C I and Cruz J B, Stackelberg solution for two-person games with biased information patterns, IEEE Transactions on Automatic Control, 1972, 17(6): 791–798.
Pindyck R, Optimal economic stabilization policies under decentralized control and conflicting objectives, IEEE Transactions on Automatic Control, 1977, 22: 517–530.
Simaan M and Cruz J B, On the Stackelberg strategy in nonzero-sum games, Journal of Optimization Theory and Applications, 1973, 11(5): 533–555.
Simaan M and Cruz J B, Additional aspects of the Stackelberg strategy in nonzero-sum games, Journal of Optimization Theory and Applications, 1973, 11(6): 613–626.
Abou-Kandil H and Bertrand P, Analytical solution for an open-loop Stackelberg game, IEEE Transactions on Automatic Control, 1985, 30(12): 1222–1224.
Xu J J, Zhang H S, and Chai T Y, Necessary and sufficient condition for two-player Stackelberg strategy, IEEE Transactions on Automatic Control, 2015, 60(5): 1356–1361.
Medanic J, Closed-loop Stackelberg strategies in linear-quadratic problems, IEEE Transactions on Automatic Control, 1978, 23(4): 632–637.
Abou-Kandil H, Closed-form solution for discrete-time linear-quadratic Stackelberg games, Journal of Optimization Theory and Applications, 1990, 65(1): 139–147.
Basar T and Olsder G J, Team-optimal closed-loop Stackelberg strategies in hierarchical control problems, Automatica, 1980, 16: 409–414.
Jungers M, Feedback strategies for discrete-time linear-quadratic two-player descriptor games, Linear Algebra and Its Applications, 2014, 440: 1–23.
Yong J M, Leader-follower stochastic linear quadratic differential game, SIAM Journal on Control and Optimization, 2002, 41(4): 1015–1041.
Mukaidani H and Xu H, Stackelberg strategies for stochastic systems with multiple followers, Automatica, 2015, 53: 53–59.
Mukaidani H and Xu H, Infinite horizon linear-quadratic Stackelberg games for discrete-time stochastic systems, Automatica, 2017, 76: 301–308.
Mukaidani H and Xu H, Incentive Stackelberg games for stochastic linear systems with H∞ constraint, IEEE Transactions on Cybernetics, 2019, 49(4): 1463–1474.
Shi J T, Wang G C, and Xiong J, Leader-follower stochastic differential game with asymmetric information and applications, Automatica, 2016, 63: 60–73.
Xu J J, Shi J T, and Zhang H S, A leader-follower stochastic linear quadratic differential game with time delay, Science China-Information Sciences, 2018, 61: 112202.
Bensoussan A, Frehse J, and Yam S C P, Mean Field Games and Mean Field Type Control Theory, Springer, New York, 2013.
Goreac D, Controllability properties of linear mean-field stochastic systems, Stochastic Analysis and Applications, 2014, 32: 280–297.
Ahdersson D and Djehiche B, A maximum principle for SDEs of mean-field type, Applied Mathematics and Optimization, 2011, 63(3): 341–356.
Li J, Stochastic maximum principle in the mean-field controls, Automatica, 2012, 48: 366–373.
Wang G C, Zhang C H, and Zhang W H, Stochastic maximum principle for mean-field type optimal control under partial information, IEEE Transactions on Automatic Control, 2014, 59: 522–528.
Yong J M, A linear-quadratic optimal control problem for mean-field stochastic differential equations, SIAM Journal on Control and Optimization, 2013, 51(4): 2809–2838.
Huang J H, Li X, and Yong J M, A linear-quadratic optimal control problem for mean-field stochastic differential equations in infinite horizon, Mathematical Control and Related Fields, 2015, 5(1): 97–139.
Elliott R, Li X, and Ni Y H, Discrete time mean-field stochastic linear-quadratic optimal control problems, Automatica, 2013, 49: 3222–3233.
Ni Y H, Elliott R, and Li X, Discrete-time mean-field stochastic linear-quadratic optimal control problems, II: Infinite horizon case, Automatica, 2015, 57: 65–77.
Li X, Sun J R, and Xiong J, Linear quadratic optimal control problems for mean-field backward stochastic differential equations, Applied Mathematics and Optimization, 2019, 80: 223–250.
Ma L M, Zhang T L, Zhang W H, et al., Finite horizon mean-field stochastic H2/H∞ control for continuous-time systems with (x, v)-dependent noise, Journal of the Franklin Institute, 2015, 352: 5393–5414.
Zhang W H, Ma L M, and Zhang T L, Discrete-time mean-field stochastic H2/H∞ control, Journal of Systems Science and Complexity, 2017, 30(4): 765–781.
Ma L M, Zhang T L, and Zhang W H, H∞ control for continuous-time mean-field stochastic systems, Asian Journal of Control, 2016, 18(5): 1630–1640.
Lin Y N, Zhang T L, and Zhang W H, Pareto-based guaranteed cost control of the uncertain mean-field stochastic systems in infinite horizon, Automatica, 2018, 92: 197–209.
Lin Y N, Jiang X S, and Zhang W H, An open-loop Stackelberg strategy for the linear quadratic mean-field stochastic differential game, IEEE Transactions on Automatic Control, 2019, 64(1): 97–110.
Wang G C and Zhang S S, A mean-field linear-quadratic stochastic Stackelberg differential game with one leader and two followers, Journal of Systems Science and Complexity, 2020, 33(5): 1383–1401.
Wang G C, Wang Y, and Zhang S S, An asymmetric information mean-field type linear-quadratic stochastic Stackelberg differential game with one leader and two followers, Optimal Control Applications and Methods, 2020, 41(4): 1034–1051.
Lin Y N, Feedback Stackelberg strategies for the discrete-time mean-field stochastic systems in infinite horizon, Journal of the Franklin Institute, 2019, 356(10): 5222–5239.
El-Ghaoui L and Ait-Rami M, Robust state-feedback stabilization of jump linear systems via LMIs, International Journal of Robust and Nonlinear Control, 2010, 6: 1015–1022.
Boyd S and Vandenberghe L, Convex Optimization, Cambridge University Press, Cambridge, 2004.
Gajić Z and Shen X, Parallel Algorithms for Optimal Control of Large Scale Linear Systems, Springer, New York, 1993.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
The authors declare no conflict of interest.
Additional information
This research was supported by the National Natural Science Foundation of China under Grant Nos. 61903234 and 61973198.
Rights and permissions
About this article
Cite this article
Lin, Y., Zhang, W. Feedback Stackelberg Solution for Mean-Field Type Stochastic Systems with Multiple Followers. J Syst Sci Complex 36, 1519–1539 (2023). https://doi.org/10.1007/s11424-023-1145-9
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-023-1145-9