Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Feedback Stackelberg Solution for Mean-Field Type Stochastic Systems with Multiple Followers

  • Published:
Journal of Systems Science and Complexity Aims and scope Submit manuscript

Abstract

This paper discusses feedback Stackelberg strategies for the continuous-time mean-field type stochastic systems with multiple followers in infinite horizon. First, optimal control problems of the followers are studied in the sense of Nash equilibrium. With the help of a set of generalized algebraic Riccati equations (GAREs), sufficient conditions for the solvability are put forward. Then, the leader faces a constrained optimal control problem by transforming the cost functional into a trace criterion. Employing the Karush-Kuhn-Tucker (KKT) conditions, necessary conditions are presented in term of the solvability of the cross-coupled stochastic algebraic equations (CSAEs). Moreover, feedback Stackelberg strategies are obtained based on the solutions of the CSAEs. In addition, an iterative scheme is introduced to obtain efficiently the solutions of the CSAEs. Finally, an example is given to shed light on the effectiveness of the proposed results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Von-Stackelberg H, The Theory of the Market Economy, Oxford University Press, New York, 1952.

    Google Scholar 

  2. Chen C I and Cruz J B, Stackelberg solution for two-person games with biased information patterns, IEEE Transactions on Automatic Control, 1972, 17(6): 791–798.

    Article  MATH  Google Scholar 

  3. Pindyck R, Optimal economic stabilization policies under decentralized control and conflicting objectives, IEEE Transactions on Automatic Control, 1977, 22: 517–530.

    Article  MathSciNet  MATH  Google Scholar 

  4. Simaan M and Cruz J B, On the Stackelberg strategy in nonzero-sum games, Journal of Optimization Theory and Applications, 1973, 11(5): 533–555.

    Article  MathSciNet  MATH  Google Scholar 

  5. Simaan M and Cruz J B, Additional aspects of the Stackelberg strategy in nonzero-sum games, Journal of Optimization Theory and Applications, 1973, 11(6): 613–626.

    Article  MathSciNet  MATH  Google Scholar 

  6. Abou-Kandil H and Bertrand P, Analytical solution for an open-loop Stackelberg game, IEEE Transactions on Automatic Control, 1985, 30(12): 1222–1224.

    Article  MathSciNet  MATH  Google Scholar 

  7. Xu J J, Zhang H S, and Chai T Y, Necessary and sufficient condition for two-player Stackelberg strategy, IEEE Transactions on Automatic Control, 2015, 60(5): 1356–1361.

    Article  MathSciNet  MATH  Google Scholar 

  8. Medanic J, Closed-loop Stackelberg strategies in linear-quadratic problems, IEEE Transactions on Automatic Control, 1978, 23(4): 632–637.

    Article  MATH  Google Scholar 

  9. Abou-Kandil H, Closed-form solution for discrete-time linear-quadratic Stackelberg games, Journal of Optimization Theory and Applications, 1990, 65(1): 139–147.

    Article  MathSciNet  MATH  Google Scholar 

  10. Basar T and Olsder G J, Team-optimal closed-loop Stackelberg strategies in hierarchical control problems, Automatica, 1980, 16: 409–414.

    Article  MathSciNet  MATH  Google Scholar 

  11. Jungers M, Feedback strategies for discrete-time linear-quadratic two-player descriptor games, Linear Algebra and Its Applications, 2014, 440: 1–23.

    Article  MathSciNet  MATH  Google Scholar 

  12. Yong J M, Leader-follower stochastic linear quadratic differential game, SIAM Journal on Control and Optimization, 2002, 41(4): 1015–1041.

    Article  MathSciNet  MATH  Google Scholar 

  13. Mukaidani H and Xu H, Stackelberg strategies for stochastic systems with multiple followers, Automatica, 2015, 53: 53–59.

    Article  MathSciNet  MATH  Google Scholar 

  14. Mukaidani H and Xu H, Infinite horizon linear-quadratic Stackelberg games for discrete-time stochastic systems, Automatica, 2017, 76: 301–308.

    Article  MathSciNet  MATH  Google Scholar 

  15. Mukaidani H and Xu H, Incentive Stackelberg games for stochastic linear systems with H constraint, IEEE Transactions on Cybernetics, 2019, 49(4): 1463–1474.

    Article  Google Scholar 

  16. Shi J T, Wang G C, and Xiong J, Leader-follower stochastic differential game with asymmetric information and applications, Automatica, 2016, 63: 60–73.

    Article  MathSciNet  MATH  Google Scholar 

  17. Xu J J, Shi J T, and Zhang H S, A leader-follower stochastic linear quadratic differential game with time delay, Science China-Information Sciences, 2018, 61: 112202.

    Article  MathSciNet  Google Scholar 

  18. Bensoussan A, Frehse J, and Yam S C P, Mean Field Games and Mean Field Type Control Theory, Springer, New York, 2013.

    Book  MATH  Google Scholar 

  19. Goreac D, Controllability properties of linear mean-field stochastic systems, Stochastic Analysis and Applications, 2014, 32: 280–297.

    Article  MathSciNet  MATH  Google Scholar 

  20. Ahdersson D and Djehiche B, A maximum principle for SDEs of mean-field type, Applied Mathematics and Optimization, 2011, 63(3): 341–356.

    Article  MathSciNet  MATH  Google Scholar 

  21. Li J, Stochastic maximum principle in the mean-field controls, Automatica, 2012, 48: 366–373.

    Article  MathSciNet  MATH  Google Scholar 

  22. Wang G C, Zhang C H, and Zhang W H, Stochastic maximum principle for mean-field type optimal control under partial information, IEEE Transactions on Automatic Control, 2014, 59: 522–528.

    Article  MathSciNet  MATH  Google Scholar 

  23. Yong J M, A linear-quadratic optimal control problem for mean-field stochastic differential equations, SIAM Journal on Control and Optimization, 2013, 51(4): 2809–2838.

    Article  MathSciNet  MATH  Google Scholar 

  24. Huang J H, Li X, and Yong J M, A linear-quadratic optimal control problem for mean-field stochastic differential equations in infinite horizon, Mathematical Control and Related Fields, 2015, 5(1): 97–139.

    Article  MathSciNet  MATH  Google Scholar 

  25. Elliott R, Li X, and Ni Y H, Discrete time mean-field stochastic linear-quadratic optimal control problems, Automatica, 2013, 49: 3222–3233.

    Article  MathSciNet  MATH  Google Scholar 

  26. Ni Y H, Elliott R, and Li X, Discrete-time mean-field stochastic linear-quadratic optimal control problems, II: Infinite horizon case, Automatica, 2015, 57: 65–77.

    Article  MathSciNet  MATH  Google Scholar 

  27. Li X, Sun J R, and Xiong J, Linear quadratic optimal control problems for mean-field backward stochastic differential equations, Applied Mathematics and Optimization, 2019, 80: 223–250.

    Article  MathSciNet  MATH  Google Scholar 

  28. Ma L M, Zhang T L, Zhang W H, et al., Finite horizon mean-field stochastic H2/H control for continuous-time systems with (x, v)-dependent noise, Journal of the Franklin Institute, 2015, 352: 5393–5414.

    Article  MATH  Google Scholar 

  29. Zhang W H, Ma L M, and Zhang T L, Discrete-time mean-field stochastic H2/H control, Journal of Systems Science and Complexity, 2017, 30(4): 765–781.

    Article  MathSciNet  MATH  Google Scholar 

  30. Ma L M, Zhang T L, and Zhang W H, H∞ control for continuous-time mean-field stochastic systems, Asian Journal of Control, 2016, 18(5): 1630–1640.

    Article  MathSciNet  MATH  Google Scholar 

  31. Lin Y N, Zhang T L, and Zhang W H, Pareto-based guaranteed cost control of the uncertain mean-field stochastic systems in infinite horizon, Automatica, 2018, 92: 197–209.

    Article  MathSciNet  MATH  Google Scholar 

  32. Lin Y N, Jiang X S, and Zhang W H, An open-loop Stackelberg strategy for the linear quadratic mean-field stochastic differential game, IEEE Transactions on Automatic Control, 2019, 64(1): 97–110.

    Article  MathSciNet  MATH  Google Scholar 

  33. Wang G C and Zhang S S, A mean-field linear-quadratic stochastic Stackelberg differential game with one leader and two followers, Journal of Systems Science and Complexity, 2020, 33(5): 1383–1401.

    Article  MathSciNet  MATH  Google Scholar 

  34. Wang G C, Wang Y, and Zhang S S, An asymmetric information mean-field type linear-quadratic stochastic Stackelberg differential game with one leader and two followers, Optimal Control Applications and Methods, 2020, 41(4): 1034–1051.

    Article  MathSciNet  MATH  Google Scholar 

  35. Lin Y N, Feedback Stackelberg strategies for the discrete-time mean-field stochastic systems in infinite horizon, Journal of the Franklin Institute, 2019, 356(10): 5222–5239.

    Article  MathSciNet  MATH  Google Scholar 

  36. El-Ghaoui L and Ait-Rami M, Robust state-feedback stabilization of jump linear systems via LMIs, International Journal of Robust and Nonlinear Control, 2010, 6: 1015–1022.

    Article  MathSciNet  MATH  Google Scholar 

  37. Boyd S and Vandenberghe L, Convex Optimization, Cambridge University Press, Cambridge, 2004.

    Book  MATH  Google Scholar 

  38. Gajić Z and Shen X, Parallel Algorithms for Optimal Control of Large Scale Linear Systems, Springer, New York, 1993.

    Book  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yaning Lin.

Ethics declarations

The authors declare no conflict of interest.

Additional information

This research was supported by the National Natural Science Foundation of China under Grant Nos. 61903234 and 61973198.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lin, Y., Zhang, W. Feedback Stackelberg Solution for Mean-Field Type Stochastic Systems with Multiple Followers. J Syst Sci Complex 36, 1519–1539 (2023). https://doi.org/10.1007/s11424-023-1145-9

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11424-023-1145-9

Keywords