Abstract
This paper surveys recent results in the field of optimal control of hybrid and switched systems. We first summarize results that use different problem formulations and then explore the underlying relations among them. Specifically, based on the type of switching, we focus on two important classes of problems: internally forced switching (IFS) problems and externally forced switching (EFS) problems. For IFS problems, we focus on optimal control techniques for piecewise affine systems. For EFS problems, methodologies of two-stage optimization, embedding transformation and switching LQR design are investigated. Detailed optimization methods found in the literature are discussed.
Similar content being viewed by others
References
Antsaklis PJ (2000) Special issue on hybrid systems: theory and applications. A brief introduction to the theory and applications of hybrid systems. Proc IEEE 88(7):879–887
Antsaklis PJ, Koutsoukos X D (2002) Hybrid systems control. Encyclopedia of physical science and technology, 3rd edn 7:445–458
Antsaklis PJ, Koutsoukos X D (2005) Hybrid systems: review and recent progress. Wiley, pp 273–298
Antsaklis PJ, Nerode A (1998) Hybrid control systems: an introductory discussion to the special issue. IEEE Trans Autom Control 43(4):457–460
Antsaklis PJ, Koutsoukos X, Zaytoon J (1998) On hybrid control of complex systems: a survey. Eur J Autom 32:1023–1045
Axelsson H, Wardi Y, Egerstedt M (2005a) Transition-time optimization for switched systems. In: IFAC Proceedings volumes, vol 16. pp 453–458
Axelsson H, Wardi Y, Egerstedt M, Verriest E (2005b) A provably convergent algorithm for transition-time optimization in switched systems. In: Proceedings 44th IEEE conference on decision and control and European control conference. pp 1397–1402
Axelsson H, Wardi Y, Egerstedt M, Verriest E (2008) Gradient descent approach to optimal mode scheduling in hybrid dynamical systems. J Optim Theory Appl 136:167–186
Azuma S, Egerstedt M, Wardi Y (2006) Output-based optimal timing control of switched systems. In: Hybrid systems: computation and control, lecture notes in computer science, vol 3927. Springer, pp 64–78
Baotic M, Christophersen F, Morari M (2003a) A new algorithm for constrained finite time optimal control of hybrid systems with a linear performance index. In: European control conference. pp 3335–3340
Baotic M, Christophersen F J, Morari M (2003b) Infinite time optimal control of hybrid systems with a linear performance index. In: Proceedings. 42nd IEEE conference on decision and control, vol 3. pp 3191– 3196
Baotic M, Christophersen F, Morari M (2006) Constrained optimal control of hybrid systems with a linear performance index. IEEE Trans Autom Control 51(12):1903–1919
Baric M, Grieder P, Baotic M, Morari M (2005) Optimal control of pwa systems by exploiting problem structure. In: IFAC World Congress, vol 16. pp 307–312
Baric M, Grieder P, Baotic M, Morari M (2008) An efficient algorithm for optimal control of pwa systems with polyhedral performance indices. Automatica 44(1):296–301
Bemporad A, Morari M (1999a) Control of systems integrating logic, dynamics, and constraints. Automatica 35:407–427
Bemporad A, Morari M (1999b) Control of systems integrating logic, dynamics, and constraints. Automatica 35(3):407–427
Bemporad A, Borrelli F, Morari M (2000a) Optimal controllers for hybrid systems: stability and piecewise linear explicit form. In: Proceedings of the 39th IEEE conference on decision and control, vol 2. pp 1810–1815
Bemporad A, Borrelli F, Morari M (2000b) Piecewise linear optimal controllers for hybrid systems. In: Proceedings of the IEEE American control conference, vol 2. pp 1190–1194
Bemporad A, Ferrari-Trecate G, Morari M (2000c) Observability and controllability of piecewise affine and hybrid systems. IEEE Trans Autom Control 45(10):1864–1876
Bemporad A, Borrelli F, Morari M (2002a) On the optimal control law for linear discrete time hybrid systems. In: International workshop on hybrid systems: computation and control. pp 105–119
Bemporad A, Giua A, Seatzu C (2002b) An iterative algorithm for the optimal control of continuous-time switched linear systems. In: Proceedings. 6th international workshop on discrete event systems. pp 335–340
Bemporad A, Giua A, Seatzu C (2002c) A master-slave algorithm for the optimal control of continuous-time switched affine systems. In: Proceedings of the 41st IEEE conference on decision and control, vol 2. pp 1976–1981
Bemporad A, Giua A, Seatzu C (2002d) Synthesis of state-feedback optimal controllers for continuous-time switched linear systems. In: Proceedings of the 41st IEEE conference on decision and control, vol 3. pp 3182–3187
Bemporad A, Corona D, Giua A, Seatzu C (2003) Optimal state-feedback quadratic regulation of linear hybrid automata. In: Proceedings 2003 IFAC conference on analysis and design of hybrid systems. pp 407–412
Bengea SC, DeCarlo RA (2005) Optimal control of switching systems. Automatica 41(1):11–27
Berkovitz L D (1974) Optimal control theory. Springer, New York
Borrelli F, Baotic M, Bemporad A, Morari M (2003) An efficient algorithm for computing the state feedback optimal control law for discrete time hybrid systems. In: Proceedings of the IEEE American control conference, vol 6. pp 4717–4722
Borrelli F, Baotic M, Bemporad A, Morari M (2005) Dynamic programming for constrained optimal control of discrete-time linear hybrid systems. Automatica 41(10):1709–1721
Branicky MS, Mitter SK (1995) Algorithms for optimal hybrid control. In: Proceedings of the 34th IEEE conference on decision and control, vol 3. pp 2661–2666
Branicky MS, Borkar V S, Mitter SK (1998) A unified framework for hybrid control: model and optimal control theory. IEEE Trans Autom Control 43(1):31–45
Caines P, Shaikh M (2006) Optimality zone algorithms for hybrid systems: efficient algorithms for optimal location and control computation, vol 3927. Springer Berlin / Heidelberg. pp 123–137
Caines PE, Shaikh MS (2005) Optimality zone algorithms for hybrid systems computation and control: From exponential to linear complexity. In: Proceedings of the IEEE international symposium on intelligent control, Mediterrean conference on control and automation. pp 1292–1297
Caldwell T, Murphey T (2012a) Projection-based switched system optimization: Absolute continuity of the line search. In: IEEE 51st conference on decision and control. pp 699–706
Caldwell T, Murphey T (2012b) Single integration optimization of linear time-varying switched systems. IEEE Trans Autom Control 57(6)
Caldwell TM, Murphey T (2010) An adjoint method for second-order switching time optimization. In: 49th IEEE conference on decision and control. pp 2155–2162
Caldwell TM, Murphey T (2011) Single integration optimization of linear timevarying switched systems. In: American control conference. pp 2024–2030
Caldwell TM, Murphey T (2012c) Projection-based switched system optimization. In: American control conference. pp 4552–4557
Cassandras CG, Pepyne DL, Wardi Y (1998) Optimal control of systems with time-driven and event-driven dynamics. In: Proceedings of the 37th IEEE conference on decision and control, vol 1. pp 7–12
Cassandras CG, Pepyne DL, Wardi Y (2001) Optimal control of a class of hybrid systems. IEEE Trans Autom Control 46(3):398–415
Cho YC, Cassandras CG, Pepyne DL (2000) Forward algorithms for optimal control of a class of hybrid systems. In: Proceedings of the 39th IEEE conference on decision and control, vol 1. pp 975–980
Christophersen F J, Baotić M, Morari M (2005) Optimal control of piecewise affine systems: a dynamic programming approach. In: Control and observer design for nonlinear finite and infinite dimensional systems Meurer T, Graichen K, Gilles ED (eds), vol 322, Springer-Verlag
Corona D, Giua A, Seatzu C (2004a) Optimal feedback switching laws for autonomous hybrid automata. In: Proceedings of the 2004 IEEE international symposium on intelligent control. pp 31–36
Corona D, Seatzu C, Giua A, Gromov D, Mayer E, Raisch J (2004b) Optimal hybrid control for switched affine systems under safety and liveness constraints. In: IEEE international symposium on computer aided control systems design. pp 35–40
Das T, Mukherjee R (2008) Optimally switched linear systems. Automatica 44(5):1437–1441
Ding X, Wardi Y, Egerstedt M (2009a) On-line adaptive optimal timing control of switched systems. In: Proceedings of the 48th IEEE conference on decision and control Chinese control conference. pp 5305–5310
Ding X, Wardi Y, Egerstedt M (2009b) On-line optimization of switched-mode dynamical systems. IEEE Trans Autom Control 54(9):2266–2271
Egerstedt M, Wardi Y, Delmotte F (2003) Optimal control of switching times in switched dynamical systems. In: Proceedings 42nd IEEE conference on decision and control, vol 3. pp 2138–2143
Egerstedt M, Azuma S, Wardi Y (2006a) Optimal timing control of switched linear systems based on partial information. Nonlinear Anal Theory Methods Appl 65(9):1736–1750
Egerstedt M, Wardi Y, Axelsson H (2006b) Transition-time optimization for switched-mode dynamical systems. IEEE Trans Autom Control 51(1):110–115
Feng Z G, Teo K L, Rehbock V (2009) A discrete filled function method for the optimal control of switched systems in discrete time. Optim Control Appl Methods 30(6):585–593
Ferrari-Trecate G, Mignone D, Morari M (2002) Moving horizon estimation for hybrid systems. IEEE Trans Autom Control 47(10):1663–1676
Fotiou I, Beccuti A, Papafotiou G, Morari M (2006a) Optimal control of piece-wise polynomial hybrid systems using cylindrical algebraic decomposition. In: Hybrid systems: computation and control. pp 227–241
Fotiou I, Rostalski P, Parrilo P, Morari M (2006b) Parametric optimization and optimal control using algebraic geometry methods. Int J Control 79(11):1340–1358
Giua A, Seatzu C, der Mee CV (2001a) Optimal control of switched autonomous linear systems. In: Proceedings of the 40th IEEE conference on decision and control, vol 3. pp 2472–2477
Giua A, Seatzu C, Mee CVD (2001b) Optimal control of autonomous linear systems switched with a pre-assigned finite sequence. In: Proceedings of the 2001 IEEE international symposium on intelligent control. pp 144–149
Goebel R, Sanfelice R, Teel A (2009) Hybrid dynamical systems. IEEE Control Syst 29(2):28–93
Gokbayrak K, Cassandras CG (2000a) A hierarchical decomposition method for optimal control of hybrid systems. In: Proceedings of the 39th IEEE conference on decision and control, vol 2. pp 1816–1821
Gokbayrak K, Cassandras CG (2000b) Hybrid controllers for hierarchically decomposed systems Proceedings of the 3rd international workshop on hybrid systems: computation and control. Springer-Verlag, London, pp 117–129
Gonzalez H, Vasudevan R, Kamgarpour M, Sastry SS, Bajcsy R, Tomlin C (2010a) A numerical method for the optimal control of switched systems. In: 49th IEEE conference on decision and control. pp 7519–7526
Gonzalez H, Vasudevan R, Kamgarpour M, Sastry SS, Bajcsy R, Tomlin CJ (2010b) A descent algorithm for the optimal control of constrained nonlinear switched dynamical systems. In: Proceedings of the 13th ACM international conference on hybrid systems: computation and control, HSCC ’10. pp 51–60
Görges D, Izák M, Liu S (2011) Optimal control and scheduling of switched systems. IEEE Trans Autom Control 56(1):135–140
Hedlund S, Rantzer A (1999a) CDP Tool, a Matlab tool for optimal control of hybrid systems
Hedlund S, Rantzer A (1999b) Optimal control of hybrid systems. In: Proceedings of the 38th IEEE conference on decision and control, vol 4. pp 3972–3977
Hedlund S, Rantzer A (2002) Convex dynamic programming for hybrid systems. IEEE Trans Autom Control 47(9):1536–1540
Imura J, van der Schaft A (2000) Characterization of well-posedness of piecewise-linear systems. IEEE Trans Autom Control 45(9):1600–1619
Johnson E, Murphey T (2009) Second order switching time optimization for time-varying nonlinear systems. In: IEEE 48th conference on decision and control. pp 5281–5286
Johnson E, Murphey T (2011) Second-order switching time optimization for nonlinear time-varying dynamic systems. IEEE Trans Autom Control 56(8):1953–1957
Kerrigan E, Mayne D (2002) Optimal control of constrained, piecewise affine systems with bounded disturbances. In: Proceedings of the 41st IEEE conference on decision and control, 2002, vol 2. pp 1552–1557
Kvasnica M, Grieder P, Baotić MMulti-Parametric Toolbox (MPT). http://control.ee.ethz.ch/mpt/
Lin H, Antsaklis P (2009) Stability and stabilizability of switched linear systems: a survey of recent results. IEEE Trans Autom Control 54(2):308–322
Lincoln B, Rantzer A (2006) Relaxing dynamic programming. IEEE Trans Autom Control 51(8):1249–1260. doi:10.1109/TAC.2006.878720
Lofberg J (2004) Yalmip: a toolbox for modeling and optimization in MATLAB. In: Proceedings of the CACSD conference
Loxton R, Teo K, Rehbock V (2009) Computational method for a class of switched system optimal control problems. IEEE Trans Autom Control 54(10):2455–2460
Lunze J, Lamnabhi-Lagarrigue F (2009) Handbook of hybrid systems control. Cambridge University Press
Matveev AS, Savkin AV (2000) Qualitative theory of hybrid dynamical systems. Birkhauser, Boston
Mignone D, Ferrari-Trecate G, Morari M (2000) Stability and stabilization of piecewise affine and hybrid systems: an lmi approach. In: Proceedings of the 39th IEEE conference on decision and control, 2000, vol 1. pp 504–509
Mojica Nava, E, Meziat R, Quijano N, Gauthier A, Rakoto-Ravalontsalama N (2008) Optimal control of switched systems: a polynomial approach. In: IFAC Proceedings Volumes, vol 17. pp 7808–7813
Mojica-Nava E, Quijano N, Rakoto-Ravalontsalama N (2013) A polynomial approach for optimal control of switched nonlinear systems. Int J Robust Nonlinear Control Early Access
Piccoli B (1999) Necessary conditions for hybrid optimization. In: Proceedings of the 38th IEEE conference on decision and control, vol 1. pp 410–415
Rantzer A (2006) Relaxed dynamic programming in switching systems. IEE Proc Control Theory Appl 153(5):567–574
Rantzer A, Johansson M (2000) Piecewise linear quadratic optimal control. IEEE Trans Autom Control 45(4):629–637
Riedinger P, Kratz F, Iung C, Zanne C (1999) Linear quadratic optimization for hybrid systems. In: Proceedings of the 38th IEEE conference on decision and control, vol 3. pp 3059–3064
Roll J, Bemporad A, Ljung L (2004) Identification of piecewise affine systems via mixed-integer programming. Automatica 40(1):37–50
Savkin AV, Evans R J (2002) Hybrid dynamical systems. Birkhauser, Boston
van der Schaft S (2000) An introduction to hybrid dynamical systems. Springer-Verlag
Seatzu C, Corona D, Giua A, Bemporad A (2006a) Optimal control of continuous-time switched affine systems. IEEE Trans Autom Control 51(5):726–741
Seatzu C, Gromov D, Raisch J, Corona D, Giua A (2006b) Optimal control of discrete-time hybrid automata under safety and liveness constraints. Nonlinear Anal Theory Methods Appl 65(6):1188–1210
Sebastain Engell GF, Schnieder E (2002) Modeling, analysis, and design of hybrid systems. Springer-Verlag
Shaikh M, Caines P (2003) On the optimal control of hybrid systems: optimization of trajectories, switching times, and location schedules. In: Hybrid systems: computation and control, lecture notes in computer science, vol 2623. pp 466–481
Shaikh MS, Caines PE (2002) On trajectory optimization for hybrid systems: theory and algorithms for fixed schedules. In: Proceedings of the 41st IEEE conference on decision and control, vol 2. pp 1997–1998
Sontag E (1981) Nonlinear regulation: the piecewise linear approach. IEEE Trans Autom Control 26(2):346–358
Sontag ED (1996) Interconnected automata and linear systems: a theoretical framework in discrete-time. In: Proceedings of the DIMACS/SYCON workshop on Hybrid systems III: verification and control: verification and control. Springer-Verlag New York, Inc., Secaucus, pp 436–448
Sussmann H J (2000) Set-valued differentials and the hybrid maximum principle. In: Proceedings of the 39th IEEE conference on decision and control, vol 1. pp 558–563
Tabuada P (2009) Verification and control of hybrid systems. Springer-Verlag
Wardi Y, Egerstedt M (2012) Algorithm for optimal mode scheduling in switched systems. In: American control conference. pp 4546–4551
Wardi Y, Ding X, Egerstedt M, Azuma S (2007) On-line optimization of switched-mode systems: algorithms and convergence properties. In: 46th IEEE conference on decision and control. pp 5005–5010
Wardi Y, Twu P, Egerstedt M (2010) On-line optimal timing control of switched systems. In: 49th IEEE conference on decision and control. pp 2137–2142
Wassim M Haddad VC, Nersesov SG (2006) Impulsive and hybrid dynamical systems. Princeton University Press
Wei S, Uthaichana K, Zefran M, DeCarlo RA, Bengea S (2007) Applications of numerical optimal control to nonlinear hybrid systems. Nonlinear Anal Hybrid Syst 1(2):264–279
Xu X, Antsaklis P (2000a) A dynamic programming approach for optimal control of switched systems. In: Proceedings of the 39th IEEE conference on decision and control, vol 2. pp 1822–1827
Xu X, Antsaklis P (2000b) Optimal control of switched systems: new results and open problems. In: Proceedings of the IEEE American control conference, vol 4. pp 2683–2687
Xu X, Antsaklis P (2002a) An approach to general switched linear quadratic optimal control problems with state jumps. In: Proceedings 15th international symposium on mathematical theory of networks and systems (MTNS). pp 1–12
Xu X, Antsaklis P (2002b) Optimal control of switched autonomous systems. In: Proceedings of the 41st IEEE conference on decision and control, vol 4. pp 4401–4406
Xu X, Antsaklis P (2002c) Optimal control of switched systems via non-linear optimization based on direct differentiations of value functions, vol 75
Xu X, Antsaklis P (2003) Results and perspectives on computational methods for optimal control of switched systems. In: 6th international workshop hybrid systems: computation and control, vol 2623. Springer, pp 540–550
Xu X, Antsaklis P (2004a) Optimal control of switched systems based on parameterization of the switching instants. IEEE Trans Autom Control 49(1):2–16
Xu X, Antsaklis P (2004b) Optimal control of switched systems based on parameterization of the switching instants. IEEE Trans Autom Control 49(1):2–16
Zhang P, Cassandras CG (2001) An improved forward algorithm for optimal control of a class of hybrid systems. In: Proceedings of the 40th IEEE conference on decision and control, vol 2. pp 1235–1236
Zhang W, Hu J (2008a) On optimal quadratic regulation for discrete-time switched linear systems. In: Hybrid systems: computation and control, lecture notes in computer science Egerstedt M, Mishra B (eds), vol 4981, Springer, Berlin / Heidelberg
Zhang W, Hu J (2008b) Optimal quadratic regulation for discrete-time switched linear systems: a numerical approach.In: IEEE Proceedings of American control conference. pp 4615–4620
Zhang W, Abate A, Hu J (2009a) Efficient suboptimal solutions of switched lqr problems. In: IEEE Proceedings of American control conference. pp 1084–1091
Zhang W, Hu J, Abate A (2009b) On the value functions of the discrete-time switched lqr problem. IEEE Trans Autom Control 54(11):2669–2674
Acknowledgments
The support of the National Science Foundation under the CPS Large Grant No. CNS-1035655 is gratefully acknowledged. We also would like to thank the anonymous reviewers for their helpful comments that have improved the manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhu, F., Antsaklis, P.J. Optimal control of hybrid switched systems: A brief survey. Discrete Event Dyn Syst 25, 345–364 (2015). https://doi.org/10.1007/s10626-014-0187-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10626-014-0187-5