Advanced Control, An Overview On Robust Control
Advanced Control, An Overview On Robust Control
'
Prerequisites Nyquist criterion, gain and phase margin, LQG state space
control
Version 1.0
1 raoul.herzog@heig–vd.ch
2 juerg.keller1@fhnw.ch
Advanced Control, An Overview on Robust Control MSE
• dynamics are often consciously neglected1 to make the model tractable, e.g.
unmodeled sensor and actuator dynamics, higher order modes from large scale
structures modeled by finite elements (FEM),
1
It’s common to say: “My model is precise up to . . . Hz.”
• parameters are often not exactly known, either because they are hard to mea-
sure precisely, or because of varying manufacturing conditions2 .
• the choice of norm used in the optimization problem associated with the con-
troller synthesis. The linear quadratic gaussian LQG control is based on the
optimization of a ||·||2 norm, whereas H∞ control is based on the optimization
of a || · ||∞ norm.
The L2 (Euclidean) norm of a time–domain scalar signal u(t) is defined as:
sZ
∞
||u||2 = u2 (t) dt. (1)
−∞
u1 (t)
u2 (t)
u(t) = .. . (2)
.
un (t)
ẋ = Ax + Bu
y = Cx + Du
Similar to signals, we would like to define different norms for systems, respectively for
transfer functions. Two systems G1 and G2 are “close” if the norm of the difference
of their transfer functions ||G1 − G2 || is “small”. Two systems might be “close” with
respect to one defined norm, but “far” with respect to another norm7 .
The H2 norm of a stable system G(s) is defined as the L2 norm of its impulse
response g(t). When dealing with stochastic signals, the H2 norm of a system
corresponds to the variance E[||y||2 ] of the system response y(t) when the system is
excited by a unit intensity white noise input u(t).
1
7
With the metric induced by the H∞ norm, the two systems P1 (s) = s+ǫ and P2 (s) = 1s are
infinitely “far”, no matter how small ǫ is. This may seem illogical because a reasonable controller
will stabilize both plants P1 and P2 simultaneously, and the resulting closed–loop systems will be
nearly identical. A remedy consists in using the so–called Vinnicombe metric, which also allows to
treat marginally stable and unstable systems.
The H∞ norm of a stable transfer function G(s) is defined as the maximum RMS
amplification over arbitrary square integrable input signals u 6= 0.
||y||2
||G||∞ = sup (5)
u∈L2 ||u||2
Note that the H∞ norm for a system is induced by the L2 norm for signals. The
physical interpretation of the H∞ norm corresponds simply to the maximum energy
amplification over all input signals. It can be shown that for single–input single–
output systems ||G||∞ equals the peak magnitude in the Bode diagram of the transfer
function G(j ω):
||G||∞ = sup |G(j ω)| (6)
ω
Bode Diagram
2
10
Magnitude (abs)
1
10
0
10
−1
10
0
−45
Phase (deg)
−90
−135
−180
−2 −1 0
10 10 10
Frequency (Hz)
1
Figure 1: Example: The || · ||∞ norm of G(s) = s2 +0.1s+1
is ||G||∞ ≈ 10.
magnitude plots (no more peak). When minimizing the absolute peak in the Bode
magnitude diagram, automatically other local peaks pop up. This effect is called
“waterbed–effect”. Finally, the value of all local peaks join the value of the absolute
peak, and the response becomes “flat”. The theoretical background of this comes
from the Bode integral theorem, see equation (12) and figure 6 page 12.
Waterbed effect
1
10
minimize
the peak !
magnitude will pop up
elsewhere !
0
10
magnitude of a closed−loop function
−1
10
−2
10
−3
10
−1 0
10 10
frequency Hz
Instead of “flat” Bode magnitude plots we can also impose a given shape. This
corresponds to a modern version of classical loop–shaping. In this context, important
design parameters are frequency dependent weighting functions W (s). They allow
to shape given closed–loop functions, e.g. the sensitivity S(s), by optimizing their
weighted norm ||W S||∞ .
The H∞ norm of a multivariable (MIMO) transfer matrix G(s) needs the im-
portant concept of singular values which is beyond the scope of this document.
loop gain
L(s)
dcrit = min
ω
(dist(L(jω), scrit )) = min
ω
||L(jω) − scrit ||2 = min
ω
||1 + L(jω)||2 . (7)
It follows that the critical distance dcrit is the reciprocal of the sensitivity function
peak:
1 1
dcrit = , where S(jω) = . (8)
||S||∞ 1 + L(jω)
Maximizing the critical distance dcrit corresponds to minimizing the || · ||∞ norm of
the sensitivity function. Therefore, one of the natural objectives10 of robust control
consists of minimizing the || · ||∞ norm of the sensitivity function.
10
It is important to see that sensitivity peak minimization is not the only objective in real world
problems. In fact, minimizing only the || · ||∞ norm of the sensitivity function turns out to be an
ill-posed problem, because the gain of the resulting controller would be infinite.
complex plane
0.5
imaginary part
−1 L(j ∞) L(j 0)
0
1/Am
dcrit
−0.5
φm
−1
L(j ω)
Figure 4: Definition of the critical distance dcrit and the classical stability margins
bandwidth12 . However, the small gain theorem has a great utility for analyzing
feedback loops with unstructured uncertainty.
perturbed plant P
'a feedback
seen by '
additive uncertainty +
'a P0 +
-C
nominal plant +
P0 +
'a
controller
C -C
1+P0C
−C −C
seen by ∆a is 1+P 0C
. The corresponding loop gain is ∆a · 1+P 0C
. Since both ∆a and
the nominal closed–loop are stable we can apply the small gain theorem for the
feedback loop seen by ∆a . A sufficient condition for the stability of the perturbed
system is therefore:
−C
∆a · < 1. (9)
1 + P0 C ∞
Using the submultiplicative property of norms ||AB|| ≤ ||A|| · ||B||, the sufficient
stability condition becomes:
C 1
||∆a ||∞ · < 1 =⇒ ||∆a ||∞ < . (10)
1 + P0 C ∞ C
1+P
C
0 ∞
12
If the controller includes an integral action (e.g. the I part of PID), the loop gain is infinite at
0 Hz, and hence ||L||∞ = ∞.
A high sensitivity peak value ||S||∞ leads to a small tolerable multiplicative pertur-
bation ∆m , which is intuitively clear since the distance dcrit of the nominal loop gain
L0 = P0 · C to the critical point −1 is small.
We will now discuss an extremely fundamental relationship, called Bode integral
theorem: Z ∞ X
ln |S(jω)| dω = Re(p). (12)
0 unstable poles p of L(s)
This law can be seen as a conservation law: the integrated value of the log of the
magnitude of sensitivity function S(jω) is conserved under the action of feedback.
If the open–loop L(s) is stable, then the integral becomes zero. At low frequencies,
in order to have good tracking performance, the sensitivity must be much smaller
than 1 (negative dB levels), i.e. ln |S(jω)| must become negative. The Bode in-
tegral theorem states that the average sensitivity improvement at low frequencies
is compensated by the average sensitivity deterioration at high frequencies. This is
illustrated by figure 6. If the plant is unstable, the situation is becoming worse since
the right hand side of equation (12) is now positive. This means that the average
sensitivity deterioration is always larger than the improvement. The more unstable
the plant is, the more positive the real part of the unstable poles, the more diffi-
cult the situation becomes. This applies to every controller, no matter how it was
designed. Unstable plants are inherently more difficult to control than stable plants
[1].
10
L og Ma gnitude
1.0
0.1
0.0 0.5 1.0 1.5 2.0
Frequency
The example shows that it is not always clear how to classify the disturbances.
Therefore, it is not surprising that in µ–synthesis the two categories of disturbances
are handled within the same formalism. For H∞ –controller design plant uncertainty
results from approximating the real system with a mathematical model of tractable
complexity. Additionally its physical parameters are not exactly known.
As explained in the motivation section, the aim of H∞ –based controller design is
to include uncertainty into controller design. To achieve this it is necessary to have
a mathematical description of model uncertainty. In this section, two different types
of uncertainty descriptions will be introduced. The first is unstructured uncertainty,
whereas the second is structured uncertainty.
where P (s) is the actual, perturbed plant, and P0 (s) is the nominal plant.
˜ a (s)
∆a (s) = W2 (s) · ∆ (14)
˜ a ||∞ ≤ 1
||∆ (15)
13
Index 2 for W is commonly used for uncertainty weighting functions.
P (s)
∆m (s) = − 1. (21)
P0 (s)
The magnitude of the perturbations ∆a (jω) and ∆m (jω) are shown in figure 10.
As defined in (14), frequency dependency is specified with the weighting transfer
function W2 (s). The solid line in the figures is an envelope of all error frequency
responses and ∆(s) = W2 (s) · ∆(s) is therefore an upper bound for the uncertainty.
0.5
nominal plant 10
5
0
10
−0.5
−1
−1 0 1 2 3
10 10 10 10 10
−1.5
0
−2
−100
−2.5
−200
−3 −300
−1 0 1 2 3 4 5 −1 0 1 2 3
10 10 10 10 10
Additive weighting:
7.5s
W2a (s) = . (22)
(s + 1)(s + 15)
Multiplicative weighting:
0.997s(s + 170)
W2m (s) = . (23)
(s + 9)(s + 135)
0 1
10 10
approx. error bound approx. error bound
additive. errors multipl. errors
0
10
−1
10
−1
10
−2
10
−2
10
−3 −3
10 10
−1 0 1 2 3 −1 0 1 2 3
10 10 10 10 10 10 10 10 10 10
5
0.5 10
perturbed plant set(w)
0
0
10
−0.5
−5
−1 10
−1 0 1 2 3
10 10 10 10 10
−1.5 100
0
−2
−100
−2.5
−200
−3 −300
−1 0 1 2 3 4 5 6 −1 0 1 2 3
10 10 10 10 10
ω = 10 rad/s the 0–gain point lies within the uncertainty set. As a consequence, a
plant phase cannot be determined anymore. In the Bode diagram of figure phase
bounds are set to −270 and 90 degrees, in order to get a nice bode plot.
In a similar way, static nonlinearities (sector criterion) or uncertain dead–time
can be described with unstructured uncertainties.
There arises the question, which of the representations of uncertainty should be
used. Since the optimal H∞ –controller has the order of the plant plus the orders of
all the weighting functions, it is preferable to choose a representation which leads
to a minimal order weighting. In the SISO case, additive uncertainty can be recast
into multiplicative uncertainty with simple algebraic operations:
Since the additive representation includes the plant transfer function P0 (s) it is
expected, that an additive representation usually is of higher degree. To illustrate
this: uncertain dead–time can be fit into a multiplicative uncertainty description
which is independent of the the plant:
1
10
0
10
−1
10
−2
10
−3
10
−1 0 1 2 3
10 10 10 10 10
solution for all different uncertainty descriptions can be obtained, if the control
system is described in the feedback structure shown in figure 13. The plant P is
h
g
Define:
F(P, ∆) := P22 + P21 ∆(I − P11 ∆)−1 P12 (29)
The example before shows that the conservative error bounds on the plant can be
large, compared to the real plant perturbation. An unstructured uncertainty model
is also not suited for perturbations which only affects a part of an interconnected
system. This motivates a more general representation of uncertainty which will be
introduced in the next section.
be recasted with the following linear fractional transform in figure 14. Note that
the uncertainty block ∆ in figure 14 is diagonal with the same diagonal element ∆τ
Paug
w z
repeated twice. The reason is that the uncertain time constant τ appears twice in
the second order term P∆ (s). The augmented plant Paug (s) will be of third order
with 3 inputs and 3 outputs.
Exercise : Calculate Paug (s) and show that the associated linear fractional transform
yields
5 1
F(Paug , ∆) = · (32)
s + 1 ((τ0 + ∆τ )s + 1)2
There are available software tools capable to directly define and handle systems
with structured or unstructured uncertainty. Using the Robust Control toolbox of
Matlab the example above can be entered as follows :
5
-----
s + 1
Bode Diagram
50
Magnitude (dB)
−50
−100
−150
0
−90
Phase (deg)
−180
−270
−2 −1 0 1 2 3
10 10 10 10 10 10
Frequency (rad/sec)
The control system with controller and uncertainty model is shown in figure
16. In H∞ –controller design, the H∞ –norm of the mapping from w to z can be
minimized. As a consequence the control problem has to be formulated in this
formalism. The inputs w are typically reference or disturbance signals, whereas
the outputs z can be the control error or the controller output. The H∞ –controller
design problem cannot directly by solved in structure of figure 16. Since performance
specifications and stability conditions can both be expressed as H∞ –norm conditions
on some transfer functions, there are two ways to simplify the control system of
figure 16. Either the stability conditions are formulated in the same formalism
as performance specifications, resulting in a structure as in figure 17(a), or the
performance specification is formulated similarly to the uncertainty description ∆p
(see figure 17(b)). For unstructured uncertainties the structure of figure 17(a) is
easier to go, but for structured uncertainties, only the structure in figure 17(b) leads
to an elegant representation. The structured uncertainty problem is solved with
µ-synthesis, which is beyond the scope of this introduction. Consequently, the first
approach will be followed in the sequel.
(a) Robust Stability as norm condition (b) Performance as artificial plant uncer-
tainty
As a result from the small gain section, it is clear that as system is robustly
stable, if
for additive uncertainty:
||W2 C(I + P C)−1 ||∞ ≤ 1 (33)
2
10
1
10
0
10
−2 −1 0 1 2
10 10 10 10 10
Multiplicative uncertainty:
" #
γW1 (I + P C)−1
W2,m P C(I + P C)
−1
. (37)
∞
mapping of signals.
A controller can be found by solving the following optimization problem:
Additive uncertainty:
" #
γW1 (s)(I + P C)−1
max
γ
W2,a (s)C(I + P C)−1
= 1, (38)
∞
With some matrix algebra, the equation (38) can be transformed into a lower
linear fractional transformation F(P, C) as shown in figure 20. Therefore, the fol-
lowing problem has to be solved:
representation is:
ẋ = Ax + B1 w + B2 u (40)
z = C1 x + D11 w + D12 u (41)
y = C2 x + D21 w + D22 u (42)
(43)
A closed optimal solution for the above general system is not yet published. For
the H∞ problem a closed solution was first developped in [2] for the following special
case:
..
A . B1 B2
· · · · · · " · ·#
·
.. 0
Gs = C . (45)
1 . 0
I
.. h i
C2 . 0 I 0
In a design tool the general state space description of equation (44) is transformed
into the representation of equation (45) by means of loop shifting [3]. The transfor-
mation of D21 and D12 into the form with the identity matrix, requires that the two
matrices have full rank. This condition is usually violated, when weighting func-
tions are strictly proper, i.e. have a zero D–matrix. To circumvent this problem,
the weighting D-matrix can usually be set to a small value, without influencing the
controller design.
For a solution to exist, (A, B2 ) must be stabilisable and (A, C2 ) must be de-
tectable.
Another important aspect is that the H∞ problem must have a solution at
ω = ∞. An unappropriate weighting at ω = ∞ can lead to unsatisfactory con-
troller designs. For a closed loop system with plant as in equation (44) the direct
feedthrough term (gain at ω = ∞) is:
7 Limitation of H∞ Methods
In this section some of the limitations of H∞ –controller design will be summarized.
• The H∞ –controller design methods offers powerful tools to solve various design
problems. Nevertheless H∞ performance measures are not always adequate
for the investigated design problem and although robustness and performance
measures are combined in the design procedure, it does not really guarantee,
that performance is robust with respect to plant uncertainty. Consequently
it was proposed to combine H∞ robustness measures with other performance
measures, for example measures similar to the LQR-design, the mixed H2 /H∞
design. Also LMI (see chapter ’outlook’) offers many possibilities for ’mixed’
design problems.
• H∞ –controller design leads to controllers of high order. A high order controller
needs more ressources for its implementation and is suspect to numerical prob-
lems. Therefore it is favorable to have low order controllers. The optimal
solution for a system as described by equation ((44)) has the same order as
the system itself (size of the A-matrix). The order of the system is the order
of the plant to be controlled and the sum of the orders of all the weighting
functions, see figure 19. As already mentioned in the section on uncertainty
description, the weighting functions have to be of minimal order. The prob-
lem of high order controllers can be diminished with order reduction methods.
There are several order reduction methods available. These can be applied
either on plant before H∞ –controller design or after design on the controller
itself. The designer should be cautious not to spoil the controller design with a
radical order reduction. There are also suboptimal H∞ –controller design algo-
rithm which allow a direct design of a reduced order controller, but these are
not currently available in the commercially available controller design tools,
although a direct low order controller design is doubtless the way to go.
• As it can be seen from figures 11 the uncertainty description is not tight in
the sense, that it incorporates a much larger set of plants than necessary. This
leads to a conservative controller design, which might result in very poor closed
loop performance. This problem is reduced, when a structured uncertainty
description is used in conjuction with µ–synthesis (see Chapter ’Outlook’).
Feasibility problem: Find a solution x to the LMI system A(x) < 0. The set of
all solutions is also called feasibility set.
Efficient15 interior–point algorithms [4] are available to solve these three generic
LMI problems. Many control problems and general design specifications can be
formulated in terms of LMI. The main strength of LMI formulations is the ability to
14
It is possible to convert from scalar decision variables to matrix valued variables.
15
However the complexity of LMI computations can grow quickly with the problem order. For
example, the number of operations required to solve a standard Riccati equation is o(n3 ) where n
is the state dimension. Solving an equivalent LMI Riccati inequality needs o(n6 ) operations!
3. robust H∞ control
4. multi–objective synthesis
It is fair to say the advent of LMI optimization has significantly influenced the
direction of research in robust control. A widely–accepted technique for numerically
solving robust control problems is to reduce them to LMI problems.
9 Conclusion
Robust control emerged around 1980, and the progress in theory and numerical
algorithms during the last 25 years has been enormous. Efficient commercial and
public domain software tools are available nowadays. It is possible to successfully
use these tools without understanding the deepest details of the underlying theory.
However, a minimum of theoretical knowledge is necessary, and as it is the case with
any complex scientific software tools16 , a lot of practical experience is needed before
being able to solve real–world17 problems.
In robust control, specific reasons for this are the following: Modelling is a
challenging engineering task, and finding an estimation the modelling uncertainty
needs some experience. Additionally, either control specifications are not entirely
known in the beginning, i.e. incomplete, or real–world specifications may be very
complex18 to such an extent that no direct synthesis procedure exist. No matter
which controller synthesis method is used it remains an iterative process which also
needs some experience. In robust control, the user often needs to play around with
frequency weighting functions in order to understand the performance/robustness
trade–offs of his specific problem.
One of the main achievements in robust control might be the consciousness about
the industrial importance of robustness. Generally speaking, system failure is not
accepted in our society, and robustness considerations will remain very important.
16
e.g. tools for finite element modelling, or any other complex scientific tool
17
= non–academic
18
e.g. mixed time domain and frequency domain specifications, low controller order, etc.
[1] G. Stein. Respect the unstable. IEEE Control Systems Magazine, August 2003.
[2] J. Doyle, K. Glover, P.P. Khargonekar, and B.A. Francis. State–space solutions
to standard H2 and H∞ control problems. IEEE Trans. Aut. Control, 34(8),
August 1989.
[3] M. Safonov and D. Limebeer. Simplifying H∞ theory via loop shifting. Proc.
27th Conference on Decision and Control, December 1988.
[7] M. Green and D. Limebeer. Linear Robust Control. Pearson Education, Inc.,
2002.
[10] LMITOOL: A Package for LMI Optimization in Scilab User’s Guide, 1995.
[11] D. Gu, P. Petkov, and M. Konstantinov. Robust Control Design with MATLAB.
Springer, 2005.
Exercises
x1 z = x2
position
measurement
control
force
w
m1 m2
spring
k
diagonal uncertainty
block
'
h g
augmented plant
w P z
1. Find a state space realization of the augmented plant P, where the structured
parameter uncertainty is represented as a diagonal feedback block
δ1 0 0
∆ = 0 δ2 0
.
0 0 δ3
The feedback system exhibits very good gain and phase margins, but is not at all
robust with respect to simultaneous uncertainties of gain and phase.
1. Calculate the gain margin Am and the phase margin φm using Matlab.
3. Determine the distance between the Nyquist plot of loop gain L(jω) and the
critical point −1.
This example shows that it is much better to assess robustness using ||S||∞ instead
of using traditional gain and phase margins. A low value of ||S||∞ , e.g. implies good
gain and phase margins while the converse is not true. It follows from elementary
trigonometric relations that
||S||∞ 1
Am > , φm > 2 arcsin
||S||∞ − 1 ||S||∞