article

Identification of piecewise affine systems via mixed-integer programming

Authors:

Alberto Bemporad,

Lennart LjungAuthors Info & Claims

Automatica (Journal of IFAC), Volume 40, Issue 1

Pages 37 - 50

https://doi.org/10.1016/j.automatica.2003.08.006

Published: 01 January 2004 Publication History

Abstract

This paper addresses the problem of identification of hybrid dynamical systems, by focusing the attention on hinging hyperplanes and Wiener piecewise affine autoregressive exogenous models, in which the regressor space is partitioned into polyhedra with affine submodels for each polyhedron. In particular, we provide algorithms based on mixed-integer linear or quadratic programming which are guaranteed to converge to a global optimum. For the special case where the estimation data only seldom switches between the different submodels, we also suggest a way of trading off between optimality and complexity by using a change detection approach.

References

[1]

A multilayer neural network with piecewise-linear structure and back-propagation learning. IEEE Transactions on Neural Networks. v2 i3. 395-403.

[2]

Bemporad, A. (2000). Identification of hybrid systems: Global convergence via mixed-integer programming. Technical report AUT00-28, ETH, Zürich.

[3]

Observability and controllability of piecewise affine and hybrid systems. IEEE Transactions on Automatic Control. v45 i10. 1864-1876.

[4]

Bemporad, A., Garulli, A., Paoletti, S., & Vicino, A. (2003). A greedy approach to identification of piecewise affine models. In O. Maler & A. Pnueli (Eds.), Hybrid systems: Computation and control. Lecture Notes in Computer Science, Vol. 2623 (pp. 97-112). Berlin: Springer.

[5]

Bemporad, A., Mignone, D., & Morari, M. (1999). Moving horizon estimation for hybrid systems and fault detection. In Proceedings of American control conference. Chicago, IL (pp. 2471-2475).

[6]

Control of systems integrating logic, dynamics, and constraints. Automatica. v35 i3. 407-427.

[7]

Bemporad, A., Roll, J., & Ljung, L. (2000b). Identification of hybrid systems via mixed-integer programming. Technical report AUT00-29, ETH, Zürich.

[8]

Bemporad, A., Roll, J., & Ljung, L. (2001). Identification of hybrid systems via mixed-integer programming. In Proceedings of the 40th IEEE conference on decision and control (pp. 786-792).

[9]

Bemporad, A., Torrisi, F. D., & Morari, M. (2000c). Optimization-based verification and stability characterization of piecewise affine and hybrid systems. In Hybrid systems: Computation and control. Lecture Notes in Computer Science, Vol. 1790 (pp. 45-58). Berlin: Springer.

[10]

Multiple Lyapunov functions and other analysis tools for switched and hybrid systems. IEEE Transactions on Automatic Control. v43 i4. 475-482.

[11]

A unified framework for hybrid control: Model and optimal control theory. . IEEE Transactions on Automatic Control. v43 i1. 31-45.

[12]

Hinging hyperplanes for regression, classification, and function approximation. IEEE Transactions on Information Theory. v39 i3. 999-1013.

[13]

Constructive neural networks with piecewise interpolation capabilities for function approximations. IEEE Transactions on Neural Networks. v5 i6. 936-944.

[14]

Computational techniques for hybrid system verification. IEEE Transactions on Automatic Control. v48 i1. 64-75.

[15]

Dash Associates (1999). XPRESS-MP user guide. URL http://www.dashopt.com.

[16]

Ernst, S. (1998). Hinging hyperplane trees for approximation and identification. In Proceedings of the 37th IEEE conference on decision and control, Vol. 2 (pp. 1266-1271).

[17]

A clustering technique for the identification of piecewise affine systems. Automatica. v39 i2. 205-217.

[18]

A new algorithm for learning in piecewise-linear neural networks. Neural Networks. v13 i4-5. 485-505.

[19]

. 2000. Wiley, New York.

[20]

Hagenblad, A., & Ljung, L. (2000). Maximum likelihood estimation of Wiener models. In Proceedings of the 39th IEEE conference on decision and control (pp. 2417-2418).

[21]

Equivalence of hybrid dynamical models. Automatica. v37 i7. 1085-1091.

[22]

Piecewise linear system modeling based on a continuous threshold decomposition. IEEE Transactions on Signal Processing. v44 i6. 1440-1453.

[23]

Efficient algorithms for function approximation with piecewise linear sigmoidal networks. IEEE Transactions on Neural Networks. v9 i6. 1129-1141.

[24]

ILOG, Inc. (1999). CPLEX 6.5 user manual. ILOG S.A., Gentilly Cedex, France.

[25]

Computation of piecewise quadratic Lyapunov functions for hybrid systems. IEEE Transactions on Automatic Control. v43 i4. 555-559.

[26]

High level canonical piecewise linear representation using a simplicial partition. IEEE Transactions on Circuits and Systems I. v46. 463-480.

[27]

Canonical piecewise-linear approximation of smooth functions. IEEE Transactions on Circuits and Systems-I: Fundamental Theory and Applications. v45 i5. 567-571.

[28]

The complete canonical piecewise-linear representation-part i: The geometry of the domain space. . IEEE Transactions on Circuits and Systems I. v39. 222-236.

[29]

Identification of Wiener-type nonlinear systems in a noisy environment. International Journal on Control. v66 i6. 927-941.

[30]

Canonical piecewise-linear approximations. IEEE Transactions on Circuits and Systems I. v39 i8. 697-699.

[31]

Recursive subspace identification of linear and nonlinear Wiener state-space models. Automatica. v36 i11. 1639-1650.

[32]

Diagnosis of quantized systems based on a timed discrete-event model. IEEE Transactions on Systems, Man & Cybernetics, Part A. v30 i3. 322-335.

[33]

Controllers for reachability specifications for hybrid systems. Automatica. v35 i3. 349-370.

[34]

Medeiros, M. C., Resende, M. G. C., & Veiga, A. (1999). Piecewise linear time series estimation with GRASP. Technical report, AT&T Labs Research, Florham Park, NJ 07932 USA.

[35]

Murray-Smith, R., Johansen, T. A. (Eds.) (1997). Multiple model approaches to modelling and control. London: Taylor & Francis.

[36]

On the hinge-finding algorithm for hinging hyperplanes. IEEE Transactions on Information Theory. v44 i3. 1310-1319.

[37]

Roll, J. (2001). Robust verification and identification of piecewise affine systems. Licentiate thesis, Department of Electrical Engineering, Linköping University. URL http://www.control.isy.liu.se/.

[38]

Roll, J. (2003). Local and piecewise affine approaches to system identification. Ph.D. thesis, Department of Electrical Engineering, Linköping University, SE-581 83 Linköping, Sweden.

[39]

Sahinidis, N. V. (2000). BARON-Branch and reduce optimization navigator. Technical report, University of Illinois at Urbana-Champaign, Department of Chemical Engineering, Urbana, IL, USA. URL http://archimedes.scs.uiuc.edu/baron/manuse.pdf.

[40]

Nonlinear black-box modeling in system identification: A unified overview. . Automatica. v31 i12. 1691-1724.

[41]

Construction of composite models from observed data. International Journal on Control. v55 i1. 141-152.

[42]

Nonlinear regulation: The piecewise linear approach. . IEEE Transactions on Automatic Control. v26 i2. 346-358.

[43]

Sontag, E. D. (1996). Interconnected automata and linear systems: A theoretical framework in discrete-time. In R. Alur, T. A. Henzinger, & E. D. Sontag (Eds.), Hybrid systems III-verification and control, Vol. 1066, Lecture Notes in Computer Science (pp. 436-448). Berlin: Springer.

[44]

Strömberg, J.-E., Gustafsson, F., & Ljung, L. (1991). Trees as black-box model structures for dynamical systems. In Proceedings of European control conference (pp. 1175-1180). Grenoble, France.

[45]

Recursive prediction error identification using the nonlinear Wiener model. Automatica. v29 i4. 1011-1025.

Cited By

Liu YMagliacane SKofinas MGavves ESalakhutdinov RKolter ZHeller KWeller AOliver NScarlett JBerkenkamp F(2024)Amortized equation discovery in hybrid dynamical systemsProceedings of the 41st International Conference on Machine Learning10.5555/3692070.3693349(31645-31668)Online publication date: 21-Jul-2024
https://dl.acm.org/doi/10.5555/3692070.3693349
Berger GNarasimhamurthy MSankaranarayanan S(2024)Algorithms for Identifying Flagged and Guarded Linear SystemsProceedings of the 27th ACM International Conference on Hybrid Systems: Computation and Control10.1145/3641513.3650140(1-13)Online publication date: 14-May-2024
https://dl.acm.org/doi/10.1145/3641513.3650140
Bencherki FTürkay SAkçay H(2023)Basis transform in linear switched system models from input–output dataInternational Journal of Adaptive Control and Signal Processing10.1002/acs.367737:12(3151-3168)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1002/acs.3677
Show More Cited By

Identification of piecewise affine systems via mixed-integer programming
1. Theory of computation
  1. Design and analysis of algorithms

Recommendations

Extending the QCR method to general mixed-integer programs

Let (MQP) be a general mixed integer quadratic program that consists of minimizing a quadratic function subject to linear constraints. In this paper, we present a convex reformulation of (MQP), i.e. we reformulate (MQP) into an equivalent program, with ...
Global solutions of nonconvex standard quadratic programs via mixed integer linear programming reformulations
Abstract
A standard quadratic program is an optimization problem that consists of minimizing a (nonconvex) quadratic form over the unit simplex. We focus on reformulating a standard quadratic program as a mixed integer linear programming problem. We ...
Mixed-integer quadratic programming

This paper considers mixed-integer quadratic programs in which the objective function is quadratic in the integer and in the continuous variables, and the constraints are linear in the variables of both types. The generalized Benders' decomposition is a ...

Comments

Information & Contributors

Information

Published In

cover image Automatica (Journal of IFAC)

Automatica (Journal of IFAC) Volume 40, Issue 1

January, 2004

160 pages

ISSN:0005-1098

Issue’s Table of Contents

Copyright © Elsevier Ltd © 2003.

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 January 2004

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu YMagliacane SKofinas MGavves ESalakhutdinov RKolter ZHeller KWeller AOliver NScarlett JBerkenkamp F(2024)Amortized equation discovery in hybrid dynamical systemsProceedings of the 41st International Conference on Machine Learning10.5555/3692070.3693349(31645-31668)Online publication date: 21-Jul-2024
https://dl.acm.org/doi/10.5555/3692070.3693349
Berger GNarasimhamurthy MSankaranarayanan S(2024)Algorithms for Identifying Flagged and Guarded Linear SystemsProceedings of the 27th ACM International Conference on Hybrid Systems: Computation and Control10.1145/3641513.3650140(1-13)Online publication date: 14-May-2024
https://dl.acm.org/doi/10.1145/3641513.3650140
Bencherki FTürkay SAkçay H(2023)Basis transform in linear switched system models from input–output dataInternational Journal of Adaptive Control and Signal Processing10.1002/acs.367737:12(3151-3168)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1002/acs.3677
Bako LYahya O(2022)Piecewise Affine System identification: A least harmonic mean approach2019 IEEE 58th Conference on Decision and Control (CDC)10.1109/CDC40024.2019.9030163(2660-2665)Online publication date: 28-Dec-2022
https://dl.acm.org/doi/10.1109/CDC40024.2019.9030163
Auber RPouliquen MGoudjil APigeon EGehan OMenard TChapon PMoussay SBonargent T(2022)Identification for Switched FIR Linear Systems using Binary Measurements2019 IEEE 58th Conference on Decision and Control (CDC)10.1109/CDC40024.2019.9029940(791-796)Online publication date: 28-Dec-2022
https://dl.acm.org/doi/10.1109/CDC40024.2019.9029940
Paoletti SSavelli IGarulli AVicino A(2022)A bilevel programming framework for piecewise affine system identification2019 IEEE 58th Conference on Decision and Control (CDC)10.1109/CDC40024.2019.9029786(7376-7381)Online publication date: 28-Dec-2022
https://dl.acm.org/doi/10.1109/CDC40024.2019.9029786
Ozbay BCamps OSznaier M(2022)Efficient Identification of Error-in-Variables Switched Systems via a Sum-of-Squares Polynomial Based Subspace Clustering Method2019 IEEE 58th Conference on Decision and Control (CDC)10.1109/CDC40024.2019.9029570(3429-3434)Online publication date: 28-Dec-2022
https://dl.acm.org/doi/10.1109/CDC40024.2019.9029570
García Soto MHenzinger TSchilling C(2022)Synthesis of Parametric Hybrid Automata from Time SeriesAutomated Technology for Verification and Analysis10.1007/978-3-031-19992-9_22(337-353)Online publication date: 25-Oct-2022
https://dl.acm.org/doi/10.1007/978-3-031-19992-9_22
Torchio MMagni LBraatz RRaimondo D(2021)Optimal charging of a Li-ion cell: A hybrid Model Predictive Control approach2016 IEEE 55th Conference on Decision and Control (CDC)10.1109/CDC.2016.7798883(4053-4058)Online publication date: 10-Mar-2021
https://dl.acm.org/doi/10.1109/CDC.2016.7798883
Zhang XCheng YWang YSznaier MCamps O(2021)Identification of switched wiener systems based on local embedding2016 IEEE 55th Conference on Decision and Control (CDC)10.1109/CDC.2016.7798859(3904-3909)Online publication date: 10-Mar-2021
https://dl.acm.org/doi/10.1109/CDC.2016.7798859
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents