Showing 1–50 of 50 results for author: Petreczky, M

Length independent generalization bounds for deep SSM architectures

Authors: Dániel Rácz, Mihály Petreczky, Bálint Daróczy

Abstract: Many state-of-the-art models trained on long-range sequences, for example S4, S5 or LRU, are made of sequential blocks combining State-Space Models (SSMs) with neural networks. In this paper we provide a PAC bound that holds for these kind of architectures with stable SSM blocks and does not depend on the length of the input sequence. Imposing stability of the SSM blocks is a standard practice in… ▽ More Many state-of-the-art models trained on long-range sequences, for example S4, S5 or LRU, are made of sequential blocks combining State-Space Models (SSMs) with neural networks. In this paper we provide a PAC bound that holds for these kind of architectures with stable SSM blocks and does not depend on the length of the input sequence. Imposing stability of the SSM blocks is a standard practice in the literature, and it is known to help performance. Our results provide a theoretical justification for the use of stable SSM blocks as the proposed PAC bound decreases as the degree of stability of the SSM blocks increases. △ Less

Submitted 11 July, 2024; v1 submitted 30 May, 2024; originally announced May 2024.

Comments: 20 pages, no figures, accepted at ICML 2024 Next Generation of Sequence Modeling Architectures Workshop

MSC Class: 68 ACM Class: I.2.6

A finite-sample generalization bound for stable LPV systems

Authors: Daniel Racz, Martin Gonzalez, Mihaly Petreczky, Andras Benczur, Balint Daroczy

Abstract: One of the main theoretical challenges in learning dynamical systems from data is providing upper bounds on the generalization error, that is, the difference between the expected prediction error and the empirical prediction error measured on some finite sample. In machine learning, a popular class of such bounds are the so-called Probably Approximately Correct (PAC) bounds. In this paper, we deri… ▽ More One of the main theoretical challenges in learning dynamical systems from data is providing upper bounds on the generalization error, that is, the difference between the expected prediction error and the empirical prediction error measured on some finite sample. In machine learning, a popular class of such bounds are the so-called Probably Approximately Correct (PAC) bounds. In this paper, we derive a PAC bound for stable continuous-time linear parameter-varying (LPV) systems. Our bound depends on the H2 norm of the chosen class of the LPV systems, but does not depend on the time interval for which the signals are considered. △ Less

Submitted 21 May, 2024; v1 submitted 16 May, 2024; originally announced May 2024.

Comments: 8 pages, 1 figure, under review

MSC Class: 68 ACM Class: I.2.0

Minimal covariance realization and system identification algorithm for a class of stochastic linear switched systems with i.i.d. switching

Authors: Elie Rouphael, Manas Mejari, Mihaly Petreczky, Lotfi Belkoura

Abstract: In this paper, we consider stochastic realization theory of Linear Switched Systems (LSS) with i.i.d. switching. We characterize minimality of stochastic LSSs and show existence and uniqueness (up to isomorphism) of minimal LSSs in innovation form. We present a realization algorithm to compute a minimal LSS in innovation form from output and input covariances. Finally, based on this realization al… ▽ More In this paper, we consider stochastic realization theory of Linear Switched Systems (LSS) with i.i.d. switching. We characterize minimality of stochastic LSSs and show existence and uniqueness (up to isomorphism) of minimal LSSs in innovation form. We present a realization algorithm to compute a minimal LSS in innovation form from output and input covariances. Finally, based on this realization algorithm, by replacing true covariances with empirical ones, we propose a statistically consistent system identification algorithm. △ Less

Submitted 4 April, 2024; v1 submitted 21 March, 2024; originally announced March 2024.

Towards stochastic realization theory for Generalized Linear Switched Systems with inputs: decomposition into stochastic and deterministic components and existence and uniqueness of innovation form

Authors: Elie Rouphael, Manas Mejari, Mihaly Petreczky, Lotfi Belkoura

Abstract: In this paper, we study a class of stochastic Generalized Linear Switched System (GLSS), which includes subclasses of jump-Markov, piecewide-linear and Linear Parameter-Varying (LPV) systems. We prove that the output of such systems can be decomposed into deterministic and stochastic components. Using this decomposition, we show existence of state-space representation in innovation form, and we pr… ▽ More In this paper, we study a class of stochastic Generalized Linear Switched System (GLSS), which includes subclasses of jump-Markov, piecewide-linear and Linear Parameter-Varying (LPV) systems. We prove that the output of such systems can be decomposed into deterministic and stochastic components. Using this decomposition, we show existence of state-space representation in innovation form, and we provide sufficient conditions for such representations to be minimal and unique up to isomorphism. △ Less

Submitted 16 March, 2024; originally announced March 2024.

PAC-Bayes Generalisation Bounds for Dynamical Systems Including Stable RNNs

Authors: Deividas Eringis, John Leth, Zheng-Hua Tan, Rafal Wisniewski, Mihaly Petreczky

Abstract: In this paper, we derive a PAC-Bayes bound on the generalisation gap, in a supervised time-series setting for a special class of discrete-time non-linear dynamical systems. This class includes stable recurrent neural networks (RNN), and the motivation for this work was its application to RNNs. In order to achieve the results, we impose some stability constraints, on the allowed models. Here, stabi… ▽ More In this paper, we derive a PAC-Bayes bound on the generalisation gap, in a supervised time-series setting for a special class of discrete-time non-linear dynamical systems. This class includes stable recurrent neural networks (RNN), and the motivation for this work was its application to RNNs. In order to achieve the results, we impose some stability constraints, on the allowed models. Here, stability is understood in the sense of dynamical systems. For RNNs, these stability conditions can be expressed in terms of conditions on the weights. We assume the processes involved are essentially bounded and the loss functions are Lipschitz. The proposed bound on the generalisation gap depends on the mixing coefficient of the data distribution, and the essential supremum of the data. Furthermore, the bound converges to zero as the dataset size increases. In this paper, we 1) formalize the learning problem, 2) derive a PAC-Bayesian error bound for such systems, 3) discuss various consequences of this error bound, and 4) show an illustrative example, with discussions on computing the proposed bound. Unlike other available bounds the derived bound holds for non i.i.d. data (time-series) and it does not grow with the number of steps of the RNN. △ Less

Submitted 15 December, 2023; originally announced December 2023.

Comments: Accepted to AAAI2024 conference

Journal ref: AAAI, vol. 38, no. 11, pp. 11901-11909, Mar. 2024

Loewner functions for bilinear systems

Authors: Pauline Kergus, Ion Victor Gosea, Mihaly Petreczky

Abstract: This work brings together the moment matching approach based on Loewner functions and the classical Loewner framework based on the Loewner pencil in the case of bilinear systems. New Loewner functions are defined based on the bilinear Loewner framework, and a Loewner equivalent model is produced using these functions. This model is composed of infinite series that needs to be truncated in order to… ▽ More This work brings together the moment matching approach based on Loewner functions and the classical Loewner framework based on the Loewner pencil in the case of bilinear systems. New Loewner functions are defined based on the bilinear Loewner framework, and a Loewner equivalent model is produced using these functions. This model is composed of infinite series that needs to be truncated in order to be implemented in practice. In this context, a new notion of approximate Loewner equivalence is introduced. In the end, it is shown that the moment matching procedure based on the proposed Loewner functions and the classical interpolatory bilinear Loewner framework both result in $κ$-Loewner equivalent models, the main difference being that the latter preserves bilinearity at the expense of a higher order. △ Less

Submitted 10 November, 2023; originally announced November 2023.

Optimization dependent generalization bound for ReLU networks based on sensitivity in the tangent bundle

Authors: Dániel Rácz, Mihály Petreczky, András Csertán, Bálint Daróczy

Abstract: Recent advances in deep learning have given us some very promising results on the generalization ability of deep neural networks, however literature still lacks a comprehensive theory explaining why heavily over-parametrized models are able to generalize well while fitting the training data. In this paper we propose a PAC type bound on the generalization error of feedforward ReLU networks via esti… ▽ More Recent advances in deep learning have given us some very promising results on the generalization ability of deep neural networks, however literature still lacks a comprehensive theory explaining why heavily over-parametrized models are able to generalize well while fitting the training data. In this paper we propose a PAC type bound on the generalization error of feedforward ReLU networks via estimating the Rademacher complexity of the set of networks available from an initial parameter vector via gradient descent. The key idea is to bound the sensitivity of the network's gradient to perturbation of the input data along the optimization trajectory. The obtained bound does not explicitly depend on the depth of the network. Our results are experimentally verified on the MNIST and CIFAR-10 datasets. △ Less

Submitted 4 December, 2023; v1 submitted 26 October, 2023; originally announced October 2023.

Comments: 17 pages, 5 figures, OPT2023: 15th Annual Workshop on Optimization for Machine Learning at the 37th NeurIPS 2023, New Orleans, LA, USA

MSC Class: 68 ACM Class: I.2.6

Theoretical Evaluation of Asymmetric Shapley Values for Root-Cause Analysis

Authors: Domokos M. Kelen, Mihály Petreczky, Péter Kersch, András A. Benczúr

Abstract: In this work, we examine Asymmetric Shapley Values (ASV), a variant of the popular SHAP additive local explanation method. ASV proposes a way to improve model explanations incorporating known causal relations between variables, and is also considered as a way to test for unfair discrimination in model predictions. Unexplored in previous literature, relaxing symmetry in Shapley values can have coun… ▽ More In this work, we examine Asymmetric Shapley Values (ASV), a variant of the popular SHAP additive local explanation method. ASV proposes a way to improve model explanations incorporating known causal relations between variables, and is also considered as a way to test for unfair discrimination in model predictions. Unexplored in previous literature, relaxing symmetry in Shapley values can have counter-intuitive consequences for model explanation. To better understand the method, we first show how local contributions correspond to global contributions of variance reduction. Using variance, we demonstrate multiple cases where ASV yields counter-intuitive attributions, arguably producing incorrect results for root-cause analysis. Second, we identify generalized additive models (GAM) as a restricted class for which ASV exhibits desirable properties. We support our arguments by proving multiple theoretical results about the method. Finally, we demonstrate the use of asymmetric attributions on multiple real-world datasets, comparing the results with and without restricted model families using gradient boosting and deep learning models. △ Less

Submitted 15 October, 2023; originally announced October 2023.

Comments: 10 pages, 6 figures, to be published in IEEE ICDM 2023

PAC bounds of continuous Linear Parameter-Varying systems related to neural ODEs

Authors: Dániel Rácz, Mihály Petreczky, Bálint Daróczy

Abstract: We consider the problem of learning Neural Ordinary Differential Equations (neural ODEs) within the context of Linear Parameter-Varying (LPV) systems in continuous-time. LPV systems contain bilinear systems which are known to be universal approximators for non-linear systems. Moreover, a large class of neural ODEs can be embedded into LPV systems. As our main contribution we provide Probably Appro… ▽ More We consider the problem of learning Neural Ordinary Differential Equations (neural ODEs) within the context of Linear Parameter-Varying (LPV) systems in continuous-time. LPV systems contain bilinear systems which are known to be universal approximators for non-linear systems. Moreover, a large class of neural ODEs can be embedded into LPV systems. As our main contribution we provide Probably Approximately Correct (PAC) bounds under stability for LPV systems related to neural ODEs. The resulting bounds have the advantage that they do not depend on the integration interval. △ Less

Submitted 7 July, 2023; originally announced July 2023.

Comments: 12 pages

MSC Class: 68 ACM Class: I.2.0

Minimal realizations of input-output behaviors by LPV state-space representations with affine dependency

Authors: Mihály Petreczky, Roland Tóth, Guillaume Mercère

Abstract: The paper makes the first steps towards a behavioral theory of LPV state-space representations with an affine dependency on scheduling, by characterizing minimality of such state-space representations. It is shown that minimality is equivalent to observability, and that minimal realizations of the same behavior are isomorphic.Finally, we establish a formal relationship between minimality of LPV st… ▽ More The paper makes the first steps towards a behavioral theory of LPV state-space representations with an affine dependency on scheduling, by characterizing minimality of such state-space representations. It is shown that minimality is equivalent to observability, and that minimal realizations of the same behavior are isomorphic.Finally, we establish a formal relationship between minimality of LPV state-space representations with an affine dependence on scheduling and minimality of LPV state-space representations with a dynamic and meromorphic dependence on scheduling. △ Less

Submitted 16 June, 2023; v1 submitted 15 May, 2023; originally announced May 2023.

PAC-Bayesian bounds for learning LTI-ss systems with input from empirical loss

Authors: Deividas Eringis, John Leth, Zheng-Hua Tan, Rafael Wisniewski, Mihaly Petreczky

Abstract: In this paper we derive a Probably Approxilmately Correct(PAC)-Bayesian error bound for linear time-invariant (LTI) stochastic dynamical systems with inputs. Such bounds are widespread in machine learning, and they are useful for characterizing the predictive power of models learned from finitely many data points. In particular, with the bound derived in this paper relates future average predictio… ▽ More In this paper we derive a Probably Approxilmately Correct(PAC)-Bayesian error bound for linear time-invariant (LTI) stochastic dynamical systems with inputs. Such bounds are widespread in machine learning, and they are useful for characterizing the predictive power of models learned from finitely many data points. In particular, with the bound derived in this paper relates future average prediction errors with the prediction error generated by the model on the data used for learning. In turn, this allows us to provide finite-sample error bounds for a wide class of learning/system identification algorithms. Furthermore, as LTI systems are a sub-class of recurrent neural networks (RNNs), these error bounds could be a first step towards PAC-Bayesian bounds for RNNs. △ Less

Submitted 29 March, 2023; originally announced March 2023.

Comments: arXiv admin note: text overlap with arXiv:2212.14838

Learning stability of partially observed switched linear systems

Authors: Zheming Wang, Raphaël M. Jungers, Mihály Petreczky, Bo Chen, Li Yu

Abstract: This paper deals with learning stability of partially observed switched linear systems under arbitrary switching. Such systems are widely used to describe cyber-physical systems which arise by combining physical systems with digital components. In many real-world applications, the internal states cannot be observed directly. It is thus more realistic to conduct system analysis using the outputs of… ▽ More This paper deals with learning stability of partially observed switched linear systems under arbitrary switching. Such systems are widely used to describe cyber-physical systems which arise by combining physical systems with digital components. In many real-world applications, the internal states cannot be observed directly. It is thus more realistic to conduct system analysis using the outputs of the system. Stability is one of the most frequent requirement for safety and robustness of cyber-physical systems. Existing methods for analyzing stability of switched linear systems often require the knowledge of the parameters and/or all the states of the underlying system. In this paper, we propose an algorithm for deciding stability of switched linear systems under arbitrary switching based purely on observed output data. The proposed algorithm essentially relies on an output-based Lyapunov stability framework and returns an estimate of the joint spectral radius (JSR). We also prove a probably approximately correct error bound on the quality of the estimate of the JSR from the perspective of statistical learning theory. △ Less

Submitted 19 January, 2023; originally announced January 2023.

PAC-Bayesian-Like Error Bound for a Class of Linear Time-Invariant Stochastic State-Space Models

Authors: Deividas Eringis, John Leth, Zheng-Hua Tan, Rafal Wisniewski, Mihaly Petreczky

Abstract: In this paper we derive a PAC-Bayesian-Like error bound for a class of stochastic dynamical systems with inputs, namely, for linear time-invariant stochastic state-space models (stochastic LTI systems for short). This class of systems is widely used in control engineering and econometrics, in particular, they represent a special case of recurrent neural networks. In this paper we 1) formalize the… ▽ More In this paper we derive a PAC-Bayesian-Like error bound for a class of stochastic dynamical systems with inputs, namely, for linear time-invariant stochastic state-space models (stochastic LTI systems for short). This class of systems is widely used in control engineering and econometrics, in particular, they represent a special case of recurrent neural networks. In this paper we 1) formalize the learning problem for stochastic LTI systems with inputs, 2) derive a PAC-Bayesian-Like error bound for such systems, 3) discuss various consequences of this error bound. △ Less

Submitted 30 December, 2022; originally announced December 2022.

Noisy Learning for Neural ODEs Acts as a Robustness Locus Widening

Authors: Martin Gonzalez, Hatem Hajri, Loic Cantat, Mihaly Petreczky

Abstract: We investigate the problems and challenges of evaluating the robustness of Differential Equation-based (DE) networks against synthetic distribution shifts. We propose a novel and simple accuracy metric which can be used to evaluate intrinsic robustness and to validate dataset corruption simulators. We also propose methodology recommendations, destined for evaluating the many faces of neural DEs' r… ▽ More We investigate the problems and challenges of evaluating the robustness of Differential Equation-based (DE) networks against synthetic distribution shifts. We propose a novel and simple accuracy metric which can be used to evaluate intrinsic robustness and to validate dataset corruption simulators. We also propose methodology recommendations, destined for evaluating the many faces of neural DEs' robustness and for comparing them with their discrete counterparts rigorously. We then use this criteria to evaluate a cheap data augmentation technique as a reliable way for demonstrating the natural robustness of neural ODEs against simulated image corruptions across multiple datasets. △ Less

Submitted 16 June, 2022; originally announced June 2022.

Comments: Accepted at ICLM 2022 Workshop "PODS"

ACM Class: I.2.6

Realization Theory Of Recurrent Neural ODEs Using Polynomial System Embeddings

Authors: Martin Gonzalez, Thibault Defourneau, Hatem Hajri, Mihaly Petreczky

Abstract: In this paper we show that neural ODE analogs of recurrent (ODE-RNN) and Long Short-Term Memory (ODE-LSTM) networks can be algorithmically embeddeded into the class of polynomial systems. This embedding preserves input-output behavior and can suitably be extended to other neural DE architectures. We then use realization theory of polynomial systems to provide necessary conditions for an input-outp… ▽ More In this paper we show that neural ODE analogs of recurrent (ODE-RNN) and Long Short-Term Memory (ODE-LSTM) networks can be algorithmically embeddeded into the class of polynomial systems. This embedding preserves input-output behavior and can suitably be extended to other neural DE architectures. We then use realization theory of polynomial systems to provide necessary conditions for an input-output map to be realizable by an ODE-LSTM and sufficient conditions for minimality of such systems. These results represent the first steps towards realization theory of recurrent neural ODE architectures, which is is expected be useful for model reduction and learning algorithm analysis of recurrent neural ODEs. △ Less

Submitted 1 August, 2022; v1 submitted 24 May, 2022; originally announced May 2022.

Comments: 10 pages. Corrected typos and added references

Journal ref: Systems & Control Letters 173 (2023)

On minimal LPV state-space representations in innovation form: an algebraic characterization

Authors: Elie Rouphael, Mihaly Petreczky, Lotfi Belkoura

Abstract: In this paper we will propose a definition of the concept of minimal state-space representations in innovation form for LPV. We also present algebraic conditions for a stochastic LPV state-space representation to be minimal in forward innovation form and discuss an algorithm for transforming any stochastic LPV state-space representation to a minimal one in innovation form. In this paper we will propose a definition of the concept of minimal state-space representations in innovation form for LPV. We also present algebraic conditions for a stochastic LPV state-space representation to be minimal in forward innovation form and discuss an algorithm for transforming any stochastic LPV state-space representation to a minimal one in innovation form. △ Less

Submitted 21 April, 2022; v1 submitted 29 March, 2022; originally announced March 2022.

Explicit construction of the minimum error variance estimator for stochastic LTI state-space systems

Authors: Deividas Eringis, John Leth, Zheng-Hua Tan, Rafal Wisniewski, Mihaly Petreczky

Abstract: In this short article, we showcase the derivation of the optimal (minimum error variance) estimator, when one part of the stochastic LTI system output is not measured but is able to be predicted from the measured system outputs. Similar derivations have been done before but not using state-space representation. In this short article, we showcase the derivation of the optimal (minimum error variance) estimator, when one part of the stochastic LTI system output is not measured but is able to be predicted from the measured system outputs. Similar derivations have been done before but not using state-space representation. △ Less

Submitted 1 January, 2023; v1 submitted 6 September, 2021; originally announced September 2021.

Application of robust control for CSR formalization and stakeholders interest

Authors: Sana Ben Abdallah, Dhafer Saidane, Mihaly Petreczky

Abstract: In this paper, we propose a new definition of sustainability that includes dynamics and equity. We propose a theoretical framework that allows finding a fair equilibrium and sustainable strategies for all stakeholders. The goal is to propose a strategy such that in the long run the attributes get close to an equilibrium point which is Pareto-optimal for the stakeholders. In order to calculate a st… ▽ More In this paper, we propose a new definition of sustainability that includes dynamics and equity. We propose a theoretical framework that allows finding a fair equilibrium and sustainable strategies for all stakeholders. The goal is to propose a strategy such that in the long run the attributes get close to an equilibrium point which is Pareto-optimal for the stakeholders. In order to calculate a strategy, we model stakeholders and actors as dynamical systems in state-space form. Furthermore, we use robust control and linear matrix inequalities (LMIs) to calculate the desired feedback strategy. We use several simulation scenarios to show the effectiveness of our proposed framework. △ Less

Submitted 3 September, 2021; originally announced September 2021.

Reduced-order modeling of LPV systems in the Loewner framework

Authors: Ion Victor Gosea, Mihaly Petreczky, Athanasios C. Antoulas

Abstract: We propose a model reduction method for LPV systems. We consider LPV state-space representations with an affine dependence on the scheduling variables. The main idea behind the proposed method is to compute the reduced order model in such a manner that its frequency domain transfer function coincides with that of the original model for some frequencies. The proposed method uses Loewner-like matric… ▽ More We propose a model reduction method for LPV systems. We consider LPV state-space representations with an affine dependence on the scheduling variables. The main idea behind the proposed method is to compute the reduced order model in such a manner that its frequency domain transfer function coincides with that of the original model for some frequencies. The proposed method uses Loewner-like matrices, which can be calculated from the frequency domain representation of the system. The contribution of the paper represents an extension of the well-established Loewner framework to LPV models. △ Less

Submitted 21 April, 2021; originally announced April 2021.

Comments: 9 pages, 2 figures

MSC Class: 93C05; 93C10

LPV Modeling of Nonlinear Systems: A Multi-Path Feedback Linearization Approach

Authors: Hossam S. Abbas, Roland Tóth, Mihály Petreczky, Nader Meskin, Javad Mohammadpour Velni, Patrick J. W. Koelewijn

Abstract: This paper introduces a systematic approach to synthesize linear parameter-varying (LPV) representations of nonlinear (NL) systems which are described by input affine state-space (SS) representations. The conversion approach results in LPV-SS representations in the observable canonical form. Based on the relative degree concept, first the SS description of a given NL representation is transformed… ▽ More This paper introduces a systematic approach to synthesize linear parameter-varying (LPV) representations of nonlinear (NL) systems which are described by input affine state-space (SS) representations. The conversion approach results in LPV-SS representations in the observable canonical form. Based on the relative degree concept, first the SS description of a given NL representation is transformed to a normal form. In the SISO case, all nonlinearities of the original system are embedded into one NL function, which is factorized, based on a proposed algorithm, to construct an LPV representation of the original NL system. The overall procedure yields an LPV model in which the scheduling variable depends on the inputs and outputs of the system and their derivatives, achieving a practically applicable transformation of the model in case of low order derivatives. In addition, if the states of the NL model can be measured or estimated, then a modified procedure is proposed to provide LPV models scheduled by these states. Examples are included to demonstrate both approaches. △ Less

Submitted 26 March, 2021; originally announced March 2021.

PAC-Bayesian theory for stochastic LTI systems

Authors: Deividas Eringis, John Leth, Zheng-Hua Tan, Rafal Wisniewski, Alireza Fakhrizadeh Esfahani, Mihaly Petreczky

Abstract: In this paper we derive a PAC-Bayesian error bound for autonomous stochastic LTI state-space models. The motivation for deriving such error bounds is that they will allow deriving similar error bounds for more general dynamical systems, including recurrent neural networks. In turn, PACBayesian error bounds are known to be useful for analyzing machine learning algorithms and for deriving new ones. In this paper we derive a PAC-Bayesian error bound for autonomous stochastic LTI state-space models. The motivation for deriving such error bounds is that they will allow deriving similar error bounds for more general dynamical systems, including recurrent neural networks. In turn, PACBayesian error bounds are known to be useful for analyzing machine learning algorithms and for deriving new ones. △ Less

Submitted 25 March, 2021; v1 submitted 23 March, 2021; originally announced March 2021.

Model reduction of linear hybrid systems

Authors: Ion Victor Gosea, Mihaly Petreczky, John Leth, Rafael Wisniewski, Athanasios C. Antoulas

Abstract: The paper proposes a model reduction algorithm for linear hybrid systems, i.e., hybrid systems with externally induced discrete events, with linear continuous subsystems, and linear reset maps. The model reduction algorithm is based on balanced truncation. Moreover, the paper also proves an analytical error bound for the difference between the input-output behaviors of the original and the reduced… ▽ More The paper proposes a model reduction algorithm for linear hybrid systems, i.e., hybrid systems with externally induced discrete events, with linear continuous subsystems, and linear reset maps. The model reduction algorithm is based on balanced truncation. Moreover, the paper also proves an analytical error bound for the difference between the input-output behaviors of the original and the reduced order model. This error bound is formulated in terms of singular values of the Gramians used for model reduction. △ Less

Submitted 17 March, 2020; originally announced March 2020.

Minimality and identifiability of discrete-time SARX systems

Authors: M. Petreczky, L. Bako, S. Lecoeuche, K. M. D. Motchon

Abstract: The paper studies the problem of minimality and identifiability for Switched Auto-Regressive eXogenous (abbreviated by SARX) systems. We propose formal definitions of the concepts of identifiability and minimality for SARX models. Based on these formalizations, we derive conditions for minimality and identifiability of SARX systems. In particular, we show that polynomially parametrized SARX system… ▽ More The paper studies the problem of minimality and identifiability for Switched Auto-Regressive eXogenous (abbreviated by SARX) systems. We propose formal definitions of the concepts of identifiability and minimality for SARX models. Based on these formalizations, we derive conditions for minimality and identifiability of SARX systems. In particular, we show that polynomially parametrized SARX systems are generically identifiable. △ Less

Submitted 5 February, 2020; originally announced February 2020.

Improved PAC-Bayesian Bounds for Linear Regression

Authors: Vera Shalaeva, Alireza Fakhrizadeh Esfahani, Pascal Germain, Mihaly Petreczky

Abstract: In this paper, we improve the PAC-Bayesian error bound for linear regression derived in Germain et al. [10]. The improvements are twofold. First, the proposed error bound is tighter, and converges to the generalization loss with a well-chosen temperature parameter. Second, the error bound also holds for training data that are not independently sampled. In particular, the error bound applies to cer… ▽ More In this paper, we improve the PAC-Bayesian error bound for linear regression derived in Germain et al. [10]. The improvements are twofold. First, the proposed error bound is tighter, and converges to the generalization loss with a well-chosen temperature parameter. Second, the error bound also holds for training data that are not independently sampled. In particular, the error bound applies to certain time series generated by well-known classes of dynamical models, such as ARX models. △ Less

Submitted 6 December, 2019; originally announced December 2019.

Journal ref: Thirty-Fourth AAAI Conference on Artificial Intelligence, Feb 2020, New York, United States

Realization and identification algorithm for stochastic LPV state-space models with exogenous inputs

Authors: Manas Mejari, Mihaly Petreczky

Abstract: In this paper, we present a realization and an identification algorithm for stochastic Linear Parameter-Varying State-Space Affine (LPV-SSA) representations. The proposed realization algorithm combines the deterministic LPV input output to LPV state-space realization scheme based on correlation analysis with a stochastic covariance realization algorithm. Based on this realization algorithm, a comp… ▽ More In this paper, we present a realization and an identification algorithm for stochastic Linear Parameter-Varying State-Space Affine (LPV-SSA) representations. The proposed realization algorithm combines the deterministic LPV input output to LPV state-space realization scheme based on correlation analysis with a stochastic covariance realization algorithm. Based on this realization algorithm, a computationally efficient and statistically consistent identification algorithm is proposed to estimate the LPV model matrices, which are computed from the empirical covariance matrices of outputs, inputs and scheduling signal observations. The effectiveness of the proposed algorithm is shown via a numerical case study. △ Less

Submitted 24 May, 2019; originally announced May 2019.

Realization theory of recurrent neural networks and rational systems

Authors: Thibault Defourneau, Mihaly Petreczky

Abstract: In this paper, we show that, under mild assumptions, input-output behavior of a continous-time recurrent neural network (RNN) can be represented by a rational or polynomial nonlinear system. The assumptions concern the activation function of RNNs, and it is satisfied by many classical activation functions such as the hyperbolic tangent. We also present an algorithm for constructing the polynomial… ▽ More In this paper, we show that, under mild assumptions, input-output behavior of a continous-time recurrent neural network (RNN) can be represented by a rational or polynomial nonlinear system. The assumptions concern the activation function of RNNs, and it is satisfied by many classical activation functions such as the hyperbolic tangent. We also present an algorithm for constructing the polynomial and rational system. This embedding of RNNs into rational systems can be useful for stability, identifiability, and realization theory for RNNs, as these problems have been studied for polynomial/rational systems. In particular, we use this embedding for deriving necessary conditions for realizability of an input-output map by RNN, and for deriving sufficient conditions for minimality of an RNN. △ Less

Submitted 18 March, 2019; v1 submitted 13 March, 2019; originally announced March 2019.

Towards Efficient Maximum Likelihood Estimation of LPV-SS Models

Authors: Pepijn B. Cox, Roland Tóth, Mihály Petreczky

Abstract: How to efficiently identify multiple-input multiple-output (MIMO) linear parameter-varying (LPV) discrete-time state-space (SS) models with affine dependence on the scheduling variable still remains an open question, as identification methods proposed in the literature suffer heavily from the curse of dimensionality and/or depend on over-restrictive approximations of the measured signal behaviors.… ▽ More How to efficiently identify multiple-input multiple-output (MIMO) linear parameter-varying (LPV) discrete-time state-space (SS) models with affine dependence on the scheduling variable still remains an open question, as identification methods proposed in the literature suffer heavily from the curse of dimensionality and/or depend on over-restrictive approximations of the measured signal behaviors. However, obtaining an SS model of the targeted system is crucial for many LPV control synthesis methods, as these synthesis tools are almost exclusively formulated for the aforementioned representation of the system dynamics. Therefore, in this paper, we tackle the problem by combining state-of-the-art LPV input-output (IO) identification methods with an LPV-IO to LPV-SS realization scheme and a maximum likelihood refinement step. The resulting modular LPV-SS identification approach achieves statical efficiency with a relatively low computational load. The method contains the following three steps: 1) estimation of the Markov coefficient sequence of the underlying system using correlation analysis or Bayesian impulse response estimation, then 2) LPV-SS realization of the estimated coefficients by using a basis reduced Ho-Kalman method, and 3) refinement of the LPV-SS model estimate from a maximum-likelihood point of view by a gradient-based or an expectation-maximization optimization methodology. The effectiveness of the full identification scheme is demonstrated by a Monte Carlo study where our proposed method is compared to existing schemes for identifying a MIMO LPV system. △ Less

Submitted 5 August, 2018; originally announced August 2018.

Data-driven model order reduction of linear switched systems

Authors: Ion Victor Gosea, Mihaly Petreczky, Athanasios C. Antoulas

Abstract: The Loewner framework for model reduction is extended to the class of linear switched systems. One advantage of this framework is that it introduces a trade-off between accuracy and complexity. Moreover, through this procedure, one can derive state-space models directly from data which is related to the input-output behavior of the original system. Hence, another advantage of the framework is that… ▽ More The Loewner framework for model reduction is extended to the class of linear switched systems. One advantage of this framework is that it introduces a trade-off between accuracy and complexity. Moreover, through this procedure, one can derive state-space models directly from data which is related to the input-output behavior of the original system. Hence, another advantage of the framework is that it does not require the initial system matrices. More exactly, the data used in this framework consists in frequency domain samples of input-output mappings of the original system. The definition of generalized transfer functions for linear switched systems resembles the one for bilinear systems. A key role is played by the coupling matrices, which ensure the transition from one active mode to another. △ Less

Submitted 15 December, 2017; originally announced December 2017.

Comments: 35 pages, 12 figures

MSC Class: 93A15 93A30 93B11 93C05 93C10

Balanced truncation for linear switched systems

Authors: Ion Victor Gosea, Mihaly Petreczky, Athanasios C. Antoulas, Christophe Fiter

Abstract: We propose a model order reduction approach for balanced truncation of linear switched systems. Such systems switch among a finite number of linear subsystems or modes. We compute pairs of controllability and observability Gramians corresponding to each active discrete mode by solving systems of coupled Lyapunov equations. Depending on the type, each such Gramian corresponds to the energy associ… ▽ More We propose a model order reduction approach for balanced truncation of linear switched systems. Such systems switch among a finite number of linear subsystems or modes. We compute pairs of controllability and observability Gramians corresponding to each active discrete mode by solving systems of coupled Lyapunov equations. Depending on the type, each such Gramian corresponds to the energy associated to all possible switching scenarios that start or, respectively end, in a particular operational mode. In order to guarantee that hard to control and hard to observe states are simultaneously eliminated, we construct a transformed system, whose Gramians are equal and diagonal. Then, by truncation, directly construct reduced order models. One can show that these models preserve some properties of the original model, such as stability and that it is possible to obtain error bounds relating the observed output, the control input and the entries of the diagonal Gramians. △ Less

Submitted 6 December, 2017; originally announced December 2017.

Comments: 35 pages, 5 figure, submitted to a special issue journal

MSC Class: 93A15; 93A30; 93B11; 93C05; 93C10

Comparing global input-output behavior of frozen-equivalent LPV state-space models

Authors: Ziad Alkhoury, Mihály Petreczky, Guillaume Mercère

Abstract: It is known that in general, \emph{frozen equivalent} (Linear Parameter-Varying) LPV models, \emph{i.e.}, LPV models which have the same input-output behavior for each constant scheduling signal, might exhibit different input-output behavior for non-constant scheduling signals. In this paper, we provide an analytic error bound on the difference between the input-output behaviors of two LPV models… ▽ More It is known that in general, \emph{frozen equivalent} (Linear Parameter-Varying) LPV models, \emph{i.e.}, LPV models which have the same input-output behavior for each constant scheduling signal, might exhibit different input-output behavior for non-constant scheduling signals. In this paper, we provide an analytic error bound on the difference between the input-output behaviors of two LPV models which are frozen equivalent. This error bound turns out to be a function of both the speed of the change of the scheduling signal and the discrepancy between the coherent bases of the two LPV models. In particular, the difference between the outputs of the two models can be made arbitrarily small by choosing a scheduling signal which changes slowly enough. An illustrative example is presented to show that the choice of the scheduling signal can reduce the difference between the input-output behaviors of frozen-equivalent LPV models. △ Less

Submitted 10 March, 2017; originally announced March 2017.

Model Reduction for Aperiodically Sampled Data Systems

Authors: Mert Bastug, Laurentiu Hetel, Mihaly Petreczky

Abstract: Two approaches to moment matching based model reduction of aperiodically sampled data systems are given. The term "aperiodic sampling" is used in the paper to indicate that the time between two consecutive sampling instants can take its value from a pre-specified finite set of allowed sampling intervals. Such systems can be represented by discrete-time linear switched (LS) state space (SS) models.… ▽ More Two approaches to moment matching based model reduction of aperiodically sampled data systems are given. The term "aperiodic sampling" is used in the paper to indicate that the time between two consecutive sampling instants can take its value from a pre-specified finite set of allowed sampling intervals. Such systems can be represented by discrete-time linear switched (LS) state space (SS) models. One of the approaches investigated in the paper is to apply model reduction by moment matching on the linear time-invariant (LTI) plant model, then compare the responses of the LS SS models acquired from the original and reduced order LTI plants. The second approach is to apply a moment matching based model reduction method on the LS SS model acquired from the original LTI plant, and then compare the responses of the original and reduced LS SS models. It is proven that for both methods, as long as the original LTI plant is stable, the resulting reduced order LS SS model of the sampled data system is quadratically stable. The results from two approaches are compared with numerical examples. △ Less

Submitted 6 March, 2017; originally announced March 2017.

Rational observers of rational systems

Authors: Jana Nemcova, Mihaly Petreczky, Jan H. van Schuppen

Abstract: Rational observers are to be constructed for rational systems while polynomial observers are to be constructed for polynomial systems. An observer synthesis procedure is formulated. First an output-based rational realization is synthesized for the considered rational system. Then a perturbation technique creates an observer. Finite algebraic observability of the rational system impies the existenc… ▽ More Rational observers are to be constructed for rational systems while polynomial observers are to be constructed for polynomial systems. An observer synthesis procedure is formulated. First an output-based rational realization is synthesized for the considered rational system. Then a perturbation technique creates an observer. Finite algebraic observability of the rational system impies the existence of a output-based rational realization. Several examples of rational observers are provided including a polynomial system of which the state-space dimension of the polynomial observer is strictly higher than that of the corresponding system. △ Less

Submitted 23 December, 2016; originally announced December 2016.

Comments: This report is the original submission to the 55th IEEE Conference on Decision and Control held in December 2016. The proceedings of the conference contains the six page final version. The submission has 8 pages. The submission contains two more examples but less explicit results on the performance of the observer

Minimax Observers for Linear DAEs

Authors: Sergiy Zhuk, Mihaly Petreczky

Abstract: In this note we construct minimax observers for linear stationary DAEs with bounded uncertain inputs, given noisy measurements. We prove a new duality principle and show that a finite (infinite) horizon minimax observer exists if and only if the DAE is $\ell$-impulse observable ($\ell$-detectable) . Remarkably, the regularity of the DAE is not required. In this note we construct minimax observers for linear stationary DAEs with bounded uncertain inputs, given noisy measurements. We prove a new duality principle and show that a finite (infinite) horizon minimax observer exists if and only if the DAE is $\ell$-impulse observable ($\ell$-detectable) . Remarkably, the regularity of the DAE is not required. △ Less

Submitted 17 February, 2017; v1 submitted 29 August, 2016; originally announced August 2016.

Comments: The only difference with respect to the previous version is that a few typos have been corrected

Structural properties of LPV to LFR transformation: minimality, input-output behavior and identifiability

Authors: Ziad Alkhoury, Mihály Petreczky, Guillaume Mercère

Abstract: In this paper, we introduce and study important properties of the transformation of Affine Linear Parameter-Varying (ALPV) state-space representations into Linear Fractional Representations (LFR). More precisely, we show that $(i)$ state minimal ALPV representations yield minimal LFRs, and vice versa, $(ii)$ the input-output behavior of the ALPV represention determines uniquely the input-output be… ▽ More In this paper, we introduce and study important properties of the transformation of Affine Linear Parameter-Varying (ALPV) state-space representations into Linear Fractional Representations (LFR). More precisely, we show that $(i)$ state minimal ALPV representations yield minimal LFRs, and vice versa, $(ii)$ the input-output behavior of the ALPV represention determines uniquely the input-output behavior of the resulting LFR, $(iii)$ structurally identifiable ALPVs yield structurally identifiable LFRs, and vice versa. We then characterize LFR models which correspond to equivalent ALPV models based on their input-output maps. As illustrated all along the paper, these results have important consequences for identification and control of systems described by LFRs. △ Less

Submitted 25 August, 2016; originally announced August 2016.

Relationship between Granger non-causality and graph structure of state-space representations

Authors: M. Jozsa, M. Petreczky, M. K. Camlibel

Abstract: In this paper we present an equivalent form of Granger noncausality in state space representation. As a generalization of this result, necessary and sufficient conditions are provided for an output process to admit a particular minimal coordinated state space representation. In this paper we present an equivalent form of Granger noncausality in state space representation. As a generalization of this result, necessary and sufficient conditions are provided for an output process to admit a particular minimal coordinated state space representation. △ Less

Submitted 14 July, 2016; originally announced July 2016.

Moment matching for bilinear systems with nice selections

Authors: Mihály Petreczky, Rafael Wisniewski, John Leth

Abstract: The paper develops a method for model reduction of bilinear control systems. It leans upon the observation that the input-output map of a bilinear system has a particularly simple Fliess series expansion. Subsequently, a model reduction algorithm is formulated such that the coefficients of Fliess series expansion for the original and reduced systems match up to certain predefined sets - nice selec… ▽ More The paper develops a method for model reduction of bilinear control systems. It leans upon the observation that the input-output map of a bilinear system has a particularly simple Fliess series expansion. Subsequently, a model reduction algorithm is formulated such that the coefficients of Fliess series expansion for the original and reduced systems match up to certain predefined sets - nice selections. Algorithms for computing matrix representations of unobservability and reachability spaces complying with a nice selection are provided. Subsequently, they are used for calculating a partial realization of a given input-output map. △ Less

Submitted 14 May, 2016; originally announced May 2016.

Comments: Extended version of the conference paper accepted to NOLCOS 2016

Realization Theory for LPV State-Space Representations with Affine Dependence

Authors: Mihály Petreczky, Roland Tóth, Guillaume Mercère

Abstract: In this paper we present a Kalman-style realization theory for linear parameter-varying state-space representations whose matrices depend on the scheduling variables in an affine way (abbreviated as LPV-SSA representations). We deal both with the discrete-time and the continuous-time cases. We show that such a LPV-SSA representation is a minimal (in the sense of having the least number of state-va… ▽ More In this paper we present a Kalman-style realization theory for linear parameter-varying state-space representations whose matrices depend on the scheduling variables in an affine way (abbreviated as LPV-SSA representations). We deal both with the discrete-time and the continuous-time cases. We show that such a LPV-SSA representation is a minimal (in the sense of having the least number of state-variables) representation of its input-output function, if and only if it is observable and span-reachable. We show that any two minimal LPV-SSA representations of the same input-output function are related by a linear isomorphism, and the isomorphism does not depend on the scheduling variable.We show that an input-output function can be represented by a LPV-SSA representation if and only if the Hankel-matrix of the input-output function has a finite rank. In fact, the rank of the Hankel-matrix gives the dimension of a minimal LPV-SSA representation. Moreover, we can formulate a counterpart of partial realization theory for LPV-SSA representation and prove correctness of the Kalman-Ho algorithm. These results thus represent the basis of systems theory for LPV-SSA representation. △ Less

Submitted 18 February, 2017; v1 submitted 12 January, 2016; originally announced January 2016.

Comments: The main difference with respect to the previous version is as follows: typos have been fixed

Moment Matching Based Model Reduction for LPV State-Space Models

Authors: Mert Bastug, Mihaly Petreczky, Roland Toth, Rafael Wisniewski, John Leth, Denis Efimov

Abstract: We present a novel algorithm for reducing the state dimension, i.e. order, of linear parameter varying (LPV) discrete-time state-space (SS) models with affine dependence on the scheduling variable. The input-output behavior of the reduced order model approximates that of the original model. In fact, for input and scheduling sequences of a certain length, the input-output behaviors of the reduced a… ▽ More We present a novel algorithm for reducing the state dimension, i.e. order, of linear parameter varying (LPV) discrete-time state-space (SS) models with affine dependence on the scheduling variable. The input-output behavior of the reduced order model approximates that of the original model. In fact, for input and scheduling sequences of a certain length, the input-output behaviors of the reduced and original model coincide. The proposed method can also be interpreted as a reachability and observability reduction (minimization) procedure for LPV-SS representations with affine dependence. △ Less

Submitted 14 August, 2015; originally announced August 2015.

An Algorithm for System Identification of a Discrete-Time Polynomial System without Inputs

Authors: Jana Němcová, Mihály Petreczky, Jan H. van Schuppen

Abstract: A subalgebraic approximation algorithm is proposed to estimate from a set of time series the parameters of the observer representation of a discrete-time polynomial system without inputs which can generate an approximation of the observed time series. A major step of the algorithm is to construct a set of generators for the polynomial function from the past outputs to the future outputs. For this… ▽ More A subalgebraic approximation algorithm is proposed to estimate from a set of time series the parameters of the observer representation of a discrete-time polynomial system without inputs which can generate an approximation of the observed time series. A major step of the algorithm is to construct a set of generators for the polynomial function from the past outputs to the future outputs. For this singular value decompositions and polynomial factorizations are used. An example is provided. △ Less

Submitted 8 July, 2015; originally announced July 2015.

Comments: IFAC Symposium System Identification 2015. The arxiv report is equal to the initial conference submission, except for the last two words of the title

MSC Class: 93B30

Realization Theory of Stochastic Jump-Markov Linear Systems

Authors: Mihaly Petreczky, René Vidal

Abstract: In this paper, we present a complete stochastic realization theory for stochastic jump-linear systems. We present necessary and sufficient conditions for the existence of a realization, along with a characterization of minimality in terms of reachability and observability. We also formulate a realization algorithm and argue that minimality can be checked algorithmically. The main tool for solving… ▽ More In this paper, we present a complete stochastic realization theory for stochastic jump-linear systems. We present necessary and sufficient conditions for the existence of a realization, along with a characterization of minimality in terms of reachability and observability. We also formulate a realization algorithm and argue that minimality can be checked algorithmically. The main tool for solving the stochastic realization problem for jump-linear systems is the formulation and solution of a stochastic realization problem for a general class of bilinear systems with non-white-noise inputs. The solution to this generalized stochastic bilinear realization problem is based on the theory of formal power series. Stochastic jump-linear systems represent a special case of generalized stochastic bilinear systems. △ Less

Submitted 5 July, 2016; v1 submitted 16 December, 2014; originally announced December 2014.

Comments: This paper is partially based on the following conference paper: Mihaly Petreczky and Rene Vidal. Realization Theory of Stochastic Jump-Markov Linear Systems. 46th IEEE Conference on Decision and Control, 2007. In the new version some minor typos and mistakes have been corrected and Remark 9-10 were added

Model Reduction of Linear Switched Systems by Restricting Discrete Dynamics

Authors: Mert Bastug, Mihaly Petreczky, Rafael Wisniewski, John Leth

Abstract: We present a procedure for reducing the number of continuous states of discrete-time linear switched systems, such that the reduced system has the same behavior as the original system for a subset of switching sequences. The proposed method is expected to be useful for abstraction based control synthesis methods for hybrid systems. We present a procedure for reducing the number of continuous states of discrete-time linear switched systems, such that the reduced system has the same behavior as the original system for a subset of switching sequences. The proposed method is expected to be useful for abstraction based control synthesis methods for hybrid systems. △ Less

Submitted 11 September, 2014; v1 submitted 4 September, 2014; originally announced September 2014.

Model Reduction by Moment Matching for Linear Switched Systems

Authors: Mert Bastug, Mihaly Petreczky, Rafael Wisniewski, John Leth

Abstract: Two moment-matching methods for model reduction of linear switched systems (LSSs) are presented. The methods are similar to the Krylov subspace methods used for moment matching for linear systems. The more general one of the two methods, is based on the so called "nice selection" of some vectors in the reachability or observability space of the LSS. The underlying theory is closely related to the… ▽ More Two moment-matching methods for model reduction of linear switched systems (LSSs) are presented. The methods are similar to the Krylov subspace methods used for moment matching for linear systems. The more general one of the two methods, is based on the so called "nice selection" of some vectors in the reachability or observability space of the LSS. The underlying theory is closely related to the (partial) realization theory of LSSs. In this paper, the connection of the methods to the realization theory of LSSs is provided, and algorithms are developed for the purpose of model reduction. Conditions for applicability of the methods for model reduction are stated and finally the results are illustrated on numerical examples. △ Less

Submitted 29 January, 2015; v1 submitted 7 March, 2014; originally announced March 2014.

Comments: Sent for publication in IEEE TAC, on October 2014

Solutions of differential-algebraic equations as outputs of LTI systems: application to LQ control problem

Authors: Mihaly Petreczky, Sergiy Zhuk

Abstract: In this paper we synthesize behavioral ideas with geometric control theory and propose a unified geometric framework for representing all solutions of a Linear Time Invariant Differential-Algebraic Equation (DAE-LTI) as outputs of classical Linear Time Invariant systems (ODE-LTI). An algorithm for computing an ODE-LTI that generates solutions of a given DAE-LTI is described. It is shown that two d… ▽ More In this paper we synthesize behavioral ideas with geometric control theory and propose a unified geometric framework for representing all solutions of a Linear Time Invariant Differential-Algebraic Equation (DAE-LTI) as outputs of classical Linear Time Invariant systems (ODE-LTI). An algorithm for computing an ODE-LTI that generates solutions of a given DAE-LTI is described. It is shown that two different ODE-LTIs which represent the same DAE-LTI are feedback equivalent. The proposed framework is then used to solve an LQ optimal control problem for DAE-LTIs with rectangular matrices. △ Less

Submitted 31 October, 2016; v1 submitted 29 December, 2013; originally announced December 2013.

Comments: The main difference with respect to the previous version is that the supplementary files were included which were missing from the previous version. Note that part of the material of this report appeared in arXiv:1309.1235. A version of this paper was submitted to Automatica, first in January 2014 and then in November 2014, and then in November 2015

Infinite horizon control and minimax observer design for linear DAEs

Authors: Sergiy Zhuk, Mihaly Petreczky

Abstract: In this paper we construct an infinite horizon minimax state observer for a linear stationary differential-algebraic equation (DAE) with uncertain but bounded input and noisy output. We do not assume regularity or existence of a (unique) solution for any initial state of the DAE. Our approach is based on a generalization of Kalman's duality principle. The latter allows us to transform minimax stat… ▽ More In this paper we construct an infinite horizon minimax state observer for a linear stationary differential-algebraic equation (DAE) with uncertain but bounded input and noisy output. We do not assume regularity or existence of a (unique) solution for any initial state of the DAE. Our approach is based on a generalization of Kalman's duality principle. The latter allows us to transform minimax state estimation problem into a dual control problem for the adjoint DAE: the state estimate in the original problem becomes the control input for the dual problem and the cost function of the latter is, in fact, the worst-case estimation error. Using geometric control theory, we construct an optimal control in the feed-back form and represent it as an output of a stable LTI system. The latter gives the minimax state estimator. In addition, we obtain a solution of infinite-horizon linear quadratic optimal control problem for DAEs. △ Less

Submitted 13 September, 2013; v1 submitted 5 September, 2013; originally announced September 2013.

Comments: This is an extended version of the paper which is to appear in the proceedings of the 52nd IEEE Conference on Decision and Control, Florence, Italy, December 10-13, 2013

Local Nash Realizations

Authors: Jana Němcová, Mihály Petreczky

Abstract: In this paper we investigate realization theory of a class of non-linear systems, called Nash systems. Nash systems are non-linear systems whose vector fields and readout maps are analytic semi-algebraic functions. In this paper we will present a characterization of minimality in terms of observability and reachability and show that minimal Nash systems are isomorphic. The results are local in nat… ▽ More In this paper we investigate realization theory of a class of non-linear systems, called Nash systems. Nash systems are non-linear systems whose vector fields and readout maps are analytic semi-algebraic functions. In this paper we will present a characterization of minimality in terms of observability and reachability and show that minimal Nash systems are isomorphic. The results are local in nature, i.e. they hold only for small time intervals. The hope is that the presented results can be extended to hold globally. △ Less

Submitted 2 May, 2013; originally announced May 2013.

Comments: 8 pages, extended conference paper

MSC Class: 93B15; 93B05; 93B07

Balanced truncation for linear switched systems

Authors: Mihaly Petreczky, Rafael Wisniewski, John Leth

Abstract: In this paper, we present a theoretical analysis of the model reduction algorithm for linear switched systems. This algorithm is a reminiscence of the balanced truncation method for linear parameter varying systems. Specifically in this paper, we provide a bound on the approximation error in L2 norm for continuous-time and l2 norm for discrete-time linear switched systems. We provide a system theo… ▽ More In this paper, we present a theoretical analysis of the model reduction algorithm for linear switched systems. This algorithm is a reminiscence of the balanced truncation method for linear parameter varying systems. Specifically in this paper, we provide a bound on the approximation error in L2 norm for continuous-time and l2 norm for discrete-time linear switched systems. We provide a system theoretic interpretation of grammians and their singular values. Furthermore, we show that the performance of bal- anced truncation depends only on the input-output map and not on the choice of the state-space representation. For a class of stable discrete-time linear switched systems (so called strongly stable systems), we define nice controllability and nice observability grammians, which are genuinely related to reachability and controllability of switched systems. In addition, we show that quadratic stability and LMI estimates of the L2 and l2 gains depend only on the input-output map. △ Less

Submitted 15 March, 2013; v1 submitted 1 February, 2013; originally announced February 2013.

Comments: We have corrected a number of typos and inconsistencies. In addition, we added new results in Theorem 3

Affine LPV systems: realization theory, input-output equations and relationship with linear switched systems

Authors: Mihaly Petreczky, Guillaume Mercère, Roland Tóth

Abstract: We formulate a Kalman-style realization theory for discrete-time affine LPV systems. By an affine LPV system we mean an LPV system whose matrices are affine functions of the scheduling parameter. In this paper we characterize those input-output behaviors which exactly correspond to affine LPV systems. In addition, we characterize minimal affine LPV systems which realize a given input-output behavi… ▽ More We formulate a Kalman-style realization theory for discrete-time affine LPV systems. By an affine LPV system we mean an LPV system whose matrices are affine functions of the scheduling parameter. In this paper we characterize those input-output behaviors which exactly correspond to affine LPV systems. In addition, we characterize minimal affine LPV systems which realize a given input-output behavior. Furthermore, we explain the relationship between Markov-parameters, Hankel-matrices, existence of an affine LPV realization and minimality. The results are derived by reducing the problem to the realization problem for linear switched systems. In this way, as a secondary contribution, we formally demonstrate the close relationship between LPV systems and linear switched systems. In addition we show that an input-output map has a realization by an affine LPV system if and only if it satisfies certain types of input-output equations. △ Less

Submitted 28 September, 2013; v1 submitted 3 September, 2012; originally announced September 2012.

Comments: This paper is an extended version of Mihály Petreczky, Guillaume Mercère: Affine LPV systems: Realization theory, input-output equations and relationship with linear switched systems. CDC 2012: 4511-4516. 2012. The main difference with respect to the previous version is that some errors have been corrected, proofs and explanation were added. arXiv admin note: text overlap with arXiv:1103.1343 by other authors

Identification of Piecewise Linear Models of Complex Dynamical Systems

Authors: Ronald L. Westra, Mihály Petreczky, Ralf L. M. Peeters

Abstract: The paper addresses the realization and identification problem or a subclass of piecewise-affine hybrid systems. The paper provides necessary and sufficient conditions for existence of a realization, a characterization of minimality, and an identification algorithm for this subclass of hybrid systems. The considered system class and the identification problem are motivated by applications in syste… ▽ More The paper addresses the realization and identification problem or a subclass of piecewise-affine hybrid systems. The paper provides necessary and sufficient conditions for existence of a realization, a characterization of minimality, and an identification algorithm for this subclass of hybrid systems. The considered system class and the identification problem are motivated by applications in systems biology. △ Less

Submitted 24 March, 2011; originally announced March 2011.

MSC Class: 93B15; 93B20; 93B25; 93C99

On the notion of persistence of excitation for linear switched systems

Authors: Mihaly Petreczky, Laurent Bako

Abstract: The paper formulates the concept of persistence of excitation for discrete-time linear switched systems, and provides sufficient conditions for an input signal to be persistently exciting. Persistence of excitation is formulated as a property of the input signal, and it is not tied to any specific identification algorithm. The results of the paper rely on realization theory and on the notion of Ma… ▽ More The paper formulates the concept of persistence of excitation for discrete-time linear switched systems, and provides sufficient conditions for an input signal to be persistently exciting. Persistence of excitation is formulated as a property of the input signal, and it is not tied to any specific identification algorithm. The results of the paper rely on realization theory and on the notion of Markov-parameters for linear switched systems. △ Less

Submitted 7 March, 2011; originally announced March 2011.

MSC Class: 93B15; 93B20; 93B25; 93C99

Partial-realization theory and algorithms for linear switched systems: A formal power series approach

Authors: Mihaly Petreczky, Jan H. van Schuppen

Abstract: The paper presents partial-realization theory and realization algorithms for linear switched systems. Linear switched systems are a particular subclass of hybrid systems. We formulate a notion of a partial realization and we present conditions for existence of a minimal partial realization. We propose two partial-realization algorithms and we show that under certain conditions they yield a complet… ▽ More The paper presents partial-realization theory and realization algorithms for linear switched systems. Linear switched systems are a particular subclass of hybrid systems. We formulate a notion of a partial realization and we present conditions for existence of a minimal partial realization. We propose two partial-realization algorithms and we show that under certain conditions they yield a complete realization. Our main tool is the theory of rational formal power series. △ Less

Submitted 25 October, 2010; originally announced October 2010.

MSC Class: 93B15; 93B20; 93B25; 93C99