Linear Optimal Control Systems
Linear Optimal Control Systems
CONTROL SYSTEMS
Linear Optimal
Control Systems
I
I
HUIBERT KWAKERNAAK
Twente Uniucrdy of Technology
Enrchcde, The Nefherlur~ds
i
I RAPHAEL SIVAN
Technion, I m e l Institute of Technology
Hoifo, Israel
. - .
WILEY-INTERSCIENCE, a Diuision of John Wiley & Sons, Inc.
New York Chichester Brisbane Toronto
Copyright 01972, by Jo!m Wiley &Sons, Inc.
A l l rights reserved. Published simultaneously in Canada.
Reproduclion or translation of any part of this work beyond
that permitted by Sections 107 or 108 of the 1976 United States
Copyright Act without the permission of the copyright owner
is unlawful. Requests for permission or further information
should be addressed to the Permissions Department. John
Wiley & Sons, Inc.
During the last few years modem linear control theory has advanced rapidly
and is now being recognized as a powerful and eminently practical tool for
the solution of linear feedback control problems. The main characteristics of
modern linear control theory are the state space description of systems,
optimization in terms of quadratic performance criteria, and incorporation
of Kalman-Bucy optimal state reconstruction theory. The significant ad-
vantage of modern linear control theory over the classical theory is its ap-
plicability to control problems involving multiinput multioutput systems and
time-varying situations; the classical theory is essentially restricted to single-
input single-output time-invariant situations.
The use of the term "modem" control theory could suggest a disregard for
"classical," or "conventional," control theory, namely, the theory that con-
sists of design methods based upon suitably shaping the transmission and
loop gain functions, employing pole-zero techniques. However, we do not
share such a disregard; on the contrary, we believe that the classical approach
is well-established and proven by practice, and distinguishes itself by a cnl-
lection of sensible and useful goals and problem formulations.
This book attempts to reconcile modern linear control theory with classical
control theory. One of the major concerns of this text is to present design
methods, employing modern techniques, for obtaining control systems that
stand up to the requirements that have been so well developed in the classical
expositions of control theory. Therefore, among other things, an entire
chapter is devoted to a description of the analysis of control systems, mostly
following the classical lines of thought. In the later chapters of the book, in
which modern synthesis methods are developed, the chapter on analysis is
recurrently referred to. Furthermore, special attention is paid to subjects that
are standard in classical control theory but are frequently overlooked in
modern treatments, such as nonzero set point control systems, tracking
systems, and control systems that have to cope with constant disturbances.
Also, heavy emphasis is placed upon the stochastic nature of control problems
because the stochastic aspects are so essential.
vii
viii Preface
We believe that modern and classical control theory can very well be taught
simultaneously, since they cover different aspects of the same problems.
There is no inherent reason for teaching the classical theory first in under-
graduate courses and to defer the modern theory, particularly the stochastic
part of it, t o graduate courses. In fact, we believe that a modern course
should be a blend of classical, modern, and stochastic control theory. This is
the approach followed in this hook.
The book bas been organized as follows. About half of the material,
containingmost of the analysis and design methods, as well as alarge number
of examples, is presented in unmarked sections. The finer points, such as
conditions for existence, detailed results concerning convergence to steady-
state solutions, and asymptotic properties, are dealt with in sections whose
titles have been marked with an asterisk. TIE i~~iniarlcedsectro~is have been so
written that they forni a textbook for a tiso-se!i~esterjirstcourse on control
theory at the senior orfist-year grodlrate level. The marked sections consist
of supplementary material of a more advanced nature. The control engineer
who is interested in applying the material wiU find most design methods in
the unmarked sections but may have to refer to the remaining sections for
more detailed information on difficult points.
The following background is assumed. The reader should have had a
k s t course on linear systems or linear circuits and should possess some
introductory knowledge of stochastic processes. I t is also recommended that
the reader have some experience in digital computer programming and that he
have access to a computer. We do not believe that it 1s necessary for the
reader to have followed a course on classical control theory before studying
the material of this book.
A chapter-by-chapter description of the book follows.
In Chapter 1, "Elements of Linear System Theory," the description of
linear systems in terms of their state is the startingpoint, while transfer matrix
and frequency response concepts are derived from the state description.
Topics important for the steady-state analysis of linear optimal systems are
carefully discussed. They are: controllability, stabilizability, reconstructibility,
detectability, and duality. The last two sections of this chapter are devoted to
a description of vector stochastic processes, with special emphasis on the
representation of stochastic processes as the outputs of linear differential
systems driven by white noise. In later chapters this material is extensively
employed.
Chapter 2, "Analysis of Control Systems," gives a general description of
control problems. Furthermore, it includes a step-by-step analysis of the
Various aspects of control system performance. Single-input single-output
and multivariable control systems are discussed in a unified framework by
the use of the concepts of mean square tracking error and mean square input.
Preface ix
Chapter 3, "Optimal Linear State Feedback Control Systems," not only
presents the usual exposition of the linear optimal regulator problem but
also gives a rather complete survey of the steady-state properties of the
Riccati equation and the optimal regulator. I t deals with the numerical
solution of Riccati equations and treats stochastic optimal regulators, optimal
tracking systems, and regulators with constant disturbances and nonzero
set points. As a special feature, the asymptotic properties of steady-state
control laws and the maximally achievable accuracy of regulators and track-
ing systems are discussed.
Chapter 4, "Optimal Linear Reconstruction of the State," derives the
Kalman-Bucy filter starting with observer theory. Various special cases, such
as singular observer problems and problems with colored observation noise,
are also treated. The various steady-state and asymptotic properties of
optimal observers are reviewed.
In Chapter 5, "Optimal Linear Output Feedback Control Systems," the
state feedback controllers of Chapter 3 are connected to the observers of
Chapter 4. A heuristic and relatively simple proof of the separation principle
is presented based on the innovations concept, which is discussed in Chapter
4. Guidelines are given for the des~gnof various types of output feedback
control systems, and a review of the design of reduced-order controllers is
included.
In Chapter 6, "Linear Optimal ControlTheory for Discrete-Time Systems,"
the entire theory of Chapters 1 through 5 is repeated in condensed form for
linear discrete-time control systems. Special attention is given to state dead-
beat and output deadbeat control systems, and to questions concerning the
synchronization of the measurements and the control actuation.
Throughout the book important concepts are introduced in definitions,
and the main results summarized in the form of theorems. Almost every
section concludes with one or more examples, many of which are numerical.
These examples serve to clarify the material of the text and, by their physical
significance, to emphasize the practical applicability of the results. Most
examples are continuations of earlier examples so that a specific problem is
developed over several sections or even chapters. Whenever numerical values
are used, care has been taken to designate the proper dimensions of the
various quantities. To this end, the SI system of units has been employed,
which is now being internationally accepted (see, e.g., Barrow, 1966; IEEE
Standards Committee, 1970). A complete review of the SI system can be
found in the Reconinieiidotiotis of the International Organizat~onfor Stand-
ardization (various dates).
The book contains about 50 problems. They can be divided into two
categories: elementary exercises, directly illustrating the material of the text;
and supplementary results, extending the material of the text. A few of the
problems require the use of a digital computer. The problems marked with
an asterisk are not considered to belong to the textbook material. Suitable
term projects could consist of writing and testing the computer subroutines
listed in Section 5.8.
Many references are quoted throughout the book, but no attempt has
been made to reach any degree of completeness or to do justice to history.
The fact that a particular publication is mentioned simply means that it has
been used by us as source material or that related material can be found in it.
The references are indicated by the author's name, the year of publication,
and a letter indicating which publication is intended (e.g., Miller, 1971b).
ACKNOWLEDGMENTS
5.8 Conclnsio~rs,436
5.9 i'roblems, 438
References 553
Index
N O T A T I O N A N D SYMBOLS
Chapters are subdivided into sections, which are numbered 1.1, 1.2, 1.3, and
so on. Sections may he divided into subsections, which are numbered 1.1.1,
1.1.2, and so on. Theorems, examples, figures, and similar features are
numbered consecutively within each chapter, prefixed by the chapter number.
The section number is usually given in parentheses if reference is made to an
item in another section.
Vectors are denoted by lowercase letters (such as x and 1 0 , matrices by
uppercase letters (such as A and B) and scalars by lower case Greek lellers
(such as a. and p). It has not been possible to adhere to these rules completely
consistently; notable exceptions are f for time, i and j for integers, and so on.
The components of vectors are denoted by lowercase Greek letters which
correspond as closely as possible to the Latin letter that denotes the vector;
thus the 11-dimensional vector x has as components the scalars C,, f2, . . . , f,,,
the 111-dimensional vector 1/ has as components the scalars ~ 1?la. ~ '. ' ' , ?7.,
and so on. Boldrace capitals indicate the Laplace or z-transform of the
corresponding lowercase time functions [X(s) for the Laplace transform of
x(t), Y(z) for the z-transform of ~ ( i )etc.].
,
diag (A1, A,, . . . , A,,) dit~gonalmatrix with diagonal entries A,, A,, . . . ,A,
(el, e,, ... , en) partitioning of a matrix into its columns el, e,, . . .,e,,
A ampere
Hz hertz
kg kilogram
kmol kilomole
m meter
N newton
rad radian
S second
v volt
n ohm