Practical Methods for Optimal Control and Estimation Using Nonlinear Programming Second Edition Advances in Design and Control John T. Betts - Download the full ebook set with all chapters in PDF format
Practical Methods for Optimal Control and Estimation Using Nonlinear Programming Second Edition Advances in Design and Control John T. Betts - Download the full ebook set with all chapters in PDF format
com
OR CLICK HERE
DOWLOAD EBOOK
https://ebookname.com/product/practical-methods-for-optimal-
control-using-nonlinear-programming-1st-edition-john-t-betts/
https://ebookname.com/product/nonlinear-optimal-control-
theory-1st-edition-leonard-david-berkovitz/
https://ebookname.com/product/linear-feedback-control-analysis-
and-design-with-matlab-advances-in-design-and-control-1st-
edition-dingyu-xue/
https://ebookname.com/product/words-of-the-lagoon-r-e-johannes/
Ironclads at War The Monitor vs The Merrimac 1st
Edition Dan Abnett
https://ebookname.com/product/ironclads-at-war-the-monitor-vs-
the-merrimac-1st-edition-dan-abnett/
https://ebookname.com/product/liquid-and-crystal-nanomaterials-
for-water-pollutants-remediation-1st-edition-uma-shanker-editor/
https://ebookname.com/product/catherine-the-great-2009-1st-us-
edition-edition-simon-dixon/
https://ebookname.com/product/the-complete-guide-to-customer-
support-how-to-turn-technical-assistance-into-a-profitable-
relationship-1st-edition-joe-fleischer-author/
https://ebookname.com/product/iphone-the-missing-manual-1st-
edition-david-pogue/
Law for Criminologists A Practical Guide 1st Edition
Ursula Smartt
https://ebookname.com/product/law-for-criminologists-a-practical-
guide-1st-edition-ursula-smartt/
Practical Methods
for Optimal Control
and Estimation Using
Nonlinear Programming
Advances in Design and Control
SIAM’s Advances in Design and Control series consists of texts and monographs dealing with all areas of
design and control and their applications. Topics of interest include shape optimization, multidisciplinary
design, trajectory optimization, feedback, and optimal control. The series focuses on the mathematical and
computational aspects of engineering design and control that are usable in a wide variety of scientific and
engineering disciplines.
Editor-in-Chief
Ralph C. Smith, North Carolina State University
Editorial Board
Athanasios C. Antoulas, Rice University
Siva Banda, Air Force Research Laboratory
Belinda A. Batten, Oregon State University
John Betts, The Boeing Company (retired)
Stephen L. Campbell, North Carolina State University
Eugene M. Cliff, Virginia Polytechnic Institute and State University
Michel C. Delfour, University of Montreal
Max D. Gunzburger, Florida State University
J. William Helton, University of California, San Diego
Arthur J. Krener, University of California, Davis
Kirsten Morris, University of Waterloo
Richard Murray, California Institute of Technology
Ekkehard Sachs, University of Trier
Series Volumes
Betts, John T., Practical Methods for Optimal Control and Estimation Using Nonlinear Programming, Second
Edition
Shima, Tal and Rasmussen, Steven, eds., UAV Cooperative Decision and Control: Challenges and Practical
Approaches
Speyer, Jason L. and Chung, Walter H., Stochastic Processes, Estimation, and Control
Krstic, Miroslav and Smyshlyaev, Andrey, Boundary Control of PDEs: A Course on Backstepping Designs
Ito, Kazufumi and Kunisch, Karl, Lagrange Multiplier Approach to Variational Problems and Applications
Xue, Dingyü, Chen, YangQuan, and Atherton, Derek P., Linear Feedback Control: Analysis and Design
with MATLAB
Hanson, Floyd B., Applied Stochastic Processes and Control for Jump-Diffusions: Modeling, Analysis,
and Computation
Michiels, Wim and Niculescu, Silviu-Iulian, Stability and Stabilization of Time-Delay Systems: An Eigenvalue-Based
Approach
Ioannou, Petros and Fidan, Baris,¸ Adaptive Control Tutorial
Bhaya, Amit and Kaszkurewicz, Eugenius, Control Perspectives on Numerical Algorithms and Matrix Problems
Robinett III, Rush D., Wilson, David G., Eisler, G. Richard, and Hurtado, John E., Applied Dynamic Programming
for Optimization of Dynamical Systems
Huang, J., Nonlinear Output Regulation: Theory and Applications
Haslinger, J. and Mäkinen, R. A. E., Introduction to Shape Optimization: Theory, Approximation, and
Computation
Antoulas, Athanasios C., Approximation of Large-Scale Dynamical Systems
Gunzburger, Max D., Perspectives in Flow Control and Optimization
Delfour, M. C. and Zolésio, J.-P., Shapes and Geometries: Analysis, Differential Calculus, and Optimization
Betts, John T., Practical Methods for Optimal Control Using Nonlinear Programming
El Ghaoui, Laurent and Niculescu, Silviu-Iulian, eds., Advances in Linear Matrix Inequality Methods in Control
Helton, J. William and James, Matthew R., Extending H∞ Control to Nonlinear Systems: Control of Nonlinear
Systems to Achieve Performance Objectives
Practical Methods
for Optimal Control
and Estimation Using
Nonlinear Programming
SECOND EDITION
John T. Betts
10 9 8 7 6 5 4 3 2 1
All rights reserved. Printed in the United States of America. No part of this book may be
reproduced, stored, or transmitted in any manner without the written permission of the
publisher. For information, write to the Society for Industrial and Applied Mathematics,
3600 Market Street, 6th Floor, Philadelphia, PA 19104-2688 USA.
Trademarked names may be used in this book without the inclusion of a trademark
symbol. These names are used in an editorial context only; no infringement of trademark
is intended.
is a registered trademark.
For Theon and Dorothy
He Inspired Creativity
She Cherished Education
Contents
Preface xiii
vii
viii Contents
8 Epilogue 411
Bibliography 417
Index 431
Preface
Solving an optimal control or estimation problem is not easy. Pieces of the puzzle
are found scattered throughout many different disciplines. Furthermore, the focus of this
book is on practical methods, that is, methods that I have found actually work! In fact
everything described in this book has been implemented in production software and used to
solve real optimal control problems. Although the reader should be proficient in advanced
mathematics, no theorems are presented.
Traditionally, there are two major parts of a successful optimal control or optimal
estimation solution technique. The first part is the “optimization” method. The second part
is the “differential equation” method. When faced with an optimal control or estimation
problem it is tempting to simply “paste” together packages for optimization and numerical
integration. While naive approaches such as this may be moderately successful, the goal of
this book is to suggest that there is a better way! The methods used to solve the differential
equations and optimize the functions are intimately related.
The first two chapters of this book focus on the optimization part of the problem. In
Chapter 1 the important concepts of nonlinear programming for small dense applications
are introduced. Chapter 2 extends the presentation to problems which are both large and
sparse. Chapters 3 and 4 address the differential equation part of the problem. Chapter
3 introduces relevant material in the numerical solution of differential (and differential-
algebraic) equations. Methods for solving the optimal control problem are treated in some
detail in Chapter 4. Throughout the book the interaction between optimization and integra-
tion is emphasized. Chapter 5 describes how to solve optimal estimation problems. Chapter
6 presents a collection of examples that illustrate the various concepts and techniques. Real
world problems often require solving a sequence of optimal control and/or optimization
problems, and Chapter 7 describes a collection of these “advanced applications.”
While the book incorporates a great deal of new material not covered in Practical
Methods for Optimal Control Using Nonlinear Programming [21], it does not cover every-
thing. Many important topics are simply not discussed in order to keep the overall presen-
tation concise and focused. The discussion is general and presents a unified approach to
solving optimal estimation and control problems. Most of the examples are drawn from
my experience in the aerospace industry. Examples have been solved using a particular
implementation called SOCS. I have tried to adhere to notational conventions from both
optimization and control theory whenever possible. Also, I have attempted to use consistent
notation throughout the book.
The material presented here represents the collective contributions of many peo-
ple. The nonlinear programming material draws heavily on the work of John Dennis,
Roger Fletcher, Phillip Gill, Sven Leyffer, Walter Murray, Michael Saunders, and Mar-
xiii
xiv Preface
garet Wright. The material on differential-algebraic equations (DAEs) is drawn from the
work of Uri Ascher, Kathy Brenan, and Linda Petzold. Ray Spiteri graciously shared his
classroom notes on DAEs. I was introduced to optimal control by Stephen Citron, and I
routinely refer to the text by Bryson and Ho [54]. Over the past 20 years I have been for-
tunate to participate in workshops at Oberwolfach, Munich, Minneapolis, Victoria, Banff,
Lausanne, Griefswald, Stockholm, and Fraser Island. I’ve benefited immensely simply
by talking with Larry Biegler, Hans Georg Bock, Roland Bulirsch, Rainer Callies, Kurt
Chudej, Tim Kelley, Bernd Kugelmann, Helmut Maurer, Rainer Mehlhorn, Angelo Miele,
Hans Josef Pesch, Ekkehard Sachs, Gottfried Sachs, Roger Sargent, Volker Schulz, Mark
Steinbach, Oskar von Stryk, and Klaus Well.
Three colleagues deserve special thanks. Interaction with Steve Campbell and his
students has inspired many new results and interesting topics. Paul Frank has played a
major role in the implementation and testing of the large, sparse nonlinear programming
methods described. Bill Huffman, my coauthor for many publications and the SOCS soft-
ware, has been an invaluable sounding board over the last two decades. Finally, I thank
Jennifer for her patience and understanding during the preparation of this book.
John T. Betts
Chapter 1
Introduction to Nonlinear
Programming
1.1 Preliminaries
This book concentrates on numerical methods for solving the optimal control problem.
The fundamental principle of all effective numerical optimization methods is to solve a
difficult problem by solving a sequence of simpler subproblems. In particular, the solution
of an optimal control problem will require the solution of one or more finite-dimensional
subproblems. As a prelude to our discussions on optimal control, this chapter will focus
on the nonlinear programming (NLP) problem. The NLP problem requires finding a finite
number of variables such that an objective function or performance index is optimized
without violating a set of constraints. The NLP problem is often referred to as parameter
optimization. Important special cases of the NLP problem include linear programming
(LP), quadratic programming (QP), and least squares problems.
Before proceeding further, it is worthwhile to establish the notational conventions
used throughout the book. This is especially important since the subject matter covers a
number of different disciplines, each with its own notational conventions. Our goal is to
present a unified treatment of all these fields. As a rule, scalar quantities will be denoted by
lowercase letters (e.g., α). Vectors will be denoted by boldface lowercase letters and will
usually be considered column vectors, as in
x1
x2
x = . , (1.1)
..
xn
where the individual components of the vector are x k for k = 1, . . ., n. To save space, it will
often be convenient to define the transpose, as in
xT = (x 1 , x 2 , . . . , x n ). (1.2)
1
Another Random Scribd Document
with Unrelated Content
The burning of M. Iohn Rogers, vicar of Saint Pulchers, and Reader of Paules in London.
The description of Doctour Cranmer, howe he was plucked downe from the stage, by Friers and
Papists, for the true Confession of hys Faith.
The burning of the Archbishop of Canturbury, Doctor Thomas Cranmer, in the Towne-ditch at
Oxford, with his hand first thrust into the fire, wherewith he subscribed before.
“At the beginning of the sixteenth century all but very poor
parish churches seem to have been furnished with pews, but
the whole area was not filled with them, as at a later date. Old
pews west of the doors are very rare, but they are found
sometimes, as at Brington, Northants. Generally all this space
was left clear, and there was a clear area of at least one bay,
and often much more at the west end. A church with aisles had
nearly always four blocks of pews, and the passages were broad
alleys, that in the middle being often more than a third of the
width of the nave, and the side passages were not much less.
The appropriation of special places to individuals seems to have
been usual, and even that bugbear of modern ecclesiastical
reformers, the lock-up pew or closet, was not unknown. These
in parish churches were generally chantry chapels, arranged for
private services at their own altars and for use as pews during
the public services.”
The pulpit had no fixed position: it was made movable; one of that
period still remains at Westminster. It was ordered in 1547 that the
priests and choir should kneel in the midst of the church and sing or
say the Litany; the Litany desk came into use afterwards. The
confessional had been continued in certain London churches: at St.
Margaret Patens there was the “shrivyng pew”; at St. Christopher le
Stock the “Shriving House.” The usual custom was for the penitent
to kneel or stand before the priest, who sat in a chair. The Bible and
the Paraphrases of Erasmus were chained to a desk somewhere in
the nave.
The Rood screen, which was a music gallery, carried a loft and the
organ when there was one. The loft contained desks for singers; it
was also provided with pricks for candles. The great cross rose
above the loft. In the chancel stood the high altar; when there were
no aisles two smaller altars stood one on either side. Above the altar
was a reredos of carved work; at the ends of which hung curtains.
There was generally a super altar. On the high altar stood the cross,
with figures, reliquaries, and images to adorn it. Also they laid on
the altar the Textus or Book of the Gospels, with the paxbrede or
tablet for the kiss of peace. There were generally two lights on the
altar.
Chapels were the most usual places for tombs, but they are found
in every part of the church. The various forms of them are too
familiar to require description, but the use of colour gave them much
more decorative importance in an interior than they have now. Many
were painted, and others were covered with rich cloths. Flat
gravestones had often carpets laid over them, and raised tombs had
palls of cloth of gold or other costly stuff. The church of Dunstable
still possesses such a pall: it is of crimson velvet, richly embroidered.
Tapestries and cloths of various kinds were very much used,
especially in chancels, as curtains and carpets, and as coverings for
seats and desks and the like. Every church also had special hangings
for Lent, when images and pictures were covered up generally with
white or blue cloths, marked with crosses and the emblems of the
Passion. The Lenten veil between the choir and the high altar seems
also to have been retained in 1547, but in 1548 Cranmer and his
party had partly succeeded in doing away with it. All parts of the
church were more or less adorned with imagery and pictures on
walls, in windows, or on furniture. None had been ordered to be
taken away except such as had been superstitiously abused, or
which were representations of “feigned miracles.”
The second cause was the rise of the new Religion. It was
inevitable that with the destruction of the old forms a period of
irreverence should set in. The churches quickly began to show signs
of neglect. The windows were broken, the doors were unhinged, the
walls fell into decay, the very roofs were in some places stripped of
their lead. “The Book of God,” says Stubbes, “was rent ragged, and
all be-torn.” Some of the churches were used for stabling horses.
Armed men met in the churchyard, and wrangled, or shot pigeons
with hand-guns over the graves. Pedlars sold their wares in the
church porches during service. Morrice-dancers excited inattention
and wantonness by their presence in costume, so as to be ready for
the frolics which generally followed prayers. “Many there are,” said
Sandys, preaching before Elizabeth even after her reforms, “that
hear not a sermon in seven years, I might say in seventeen.” The
friends of the new doctrine expected that all the evils of the time
would be instantly remedied. But the work of reform was extremely
gradual.
A third reason is offered for the irreverence of the people during
service, this time during the Anglican service. Many people walked
about, talked and laughed. This, however, was to show their
contempt for the new order; they were secretly attached to the
ancient Faith; they betrayed their sympathies, not only by this
intolerance, but also by crossing themselves and telling their beads
in secret.
Many of the ancient customs remained. It was long before the
people, in London, could be persuaded to give up their old customs.
Sunday remained the weekly holiday: the people held on Sundays
their wakes, ales, rush-bearings, May games, bear-baitings, dancing,
piping, picnics, and gaming; they continued so to “break the
Sabbath”—which was first made part of the Christian week by the
Puritans—until well into the seventeenth century. After the
Commonwealth I think that there were very few traces of old
customs lingering in the country, and only those, such as the
hanging of garlands in the chancel when a maiden died, which
carried with them no doctrinal significance and could prove no
occasion for drunkenness and debauchery.
Before the coming of the Puritans the funerals continued with
much of the old ritual. The body was laid out in such state as the
family circumstances allowed: tapers were burned round it by night
and by day; the church bells still rang for the prayers of the people,
though they were taught that to pray for the dead was a vain thing;
the priests who visited the house of the dead repeated the Lord’s
Prayer; if on the way to the churchyard the procession passed a
cross, they stopped and knelt, and made prayers; the body was laid
in the grave wrapped in a shroud, without a coffin; it was covered by
a pall, which was decorated with crosses. Those of the ancient Faith
would persuade the clergymen, if they could, to omit the service; if
he persisted, they left the grave and walked away. Nothing was a
stronger tie to the old Religion than its burial service, and its
assurance that the dead who died in the Church were assured of
Heaven after due purgatory, and that the prayers of the living were
of avail to shorten the pains of prison.
Machyn, the City Chronicler of this period, thus describes the
simplicity of a Protestant funeral:—
“The iij day of Aprell was browth unto saint Thomas of Acurs
in Chepe from lytyll sant Barthellmuw in Lothberes masteres ...
and ther was a gret compene of pepull, ij and ij together, and
nodur prest nor clarke, the nuw prychers in ther gowne lyke
leymen, nodur syngyng nor sayhyng tyll they came to the grave,
and a-for she was pute into the grayff a collect in Englys, and
then put into the grayff, and after took some heythe, and caste
yt on the corse and red a thynge ... for the sam, and contenent
cast the heth into the grave, and contenent red the pystyll of
sant Poll to the Stesselonyans the chapter, and after thay song
pater noster in Englys, boyth prychers and odur and women of
a nuw fassyon, and after on of them whent into the pulpytt and
made a sermon.”
The good old institution of Sanctuary died hard. Even after it was
supposed to have been finished and put away it continued to linger.
Abbot Feckenham made a vigorous appeal for its preservation. “All
princes,” he said, “and all Lawmakers, Solon in Athens, Lycurgus in
Lacedemon, all have had loca refugii, places of succour and safe-
guard for such as have transgressed laws and deserved corporal
pains. Since, therefore, ye mean not to destroy all sanctuaries, and if
your purpose be to maintain any, or if any be worthy to be
continued, Westminster, of all others, is most worthy, and that for
four causes: the first is, the antiquity and continuance of sanctuary
there; the second, the dignity of the person by whom it was
ordained; the third, the worthiness of the place itself; the fourth, the
profit and commodity that you have received thereby.”
It is a common charge against the Dissolution of the Religious
Houses that the old custom of open tables for all comers fell into
disuse. The disuse is not without exceptions. The Houses being
suppressed, of course the hospitality disappeared; but the practice
was still kept up by some of the Bishops: Archbishop Parker, for
instance, fed every day a number of poor people who waited outside
the gates of Lambeth for the broken meats; while any one who
chose to come in, whether at dinner or at supper, was received and
entertained either at the Steward’s or the Almoner’s table. Order was
observed; no loud talking was permitted; and the discourse was
directed towards framing men’s manners to Religion. Whether the
practice of indiscriminate doles should have been kept up is another
question, and one that cannot be asked of the sixteenth century.
The state and dignity maintained by this Archbishop were almost
worthy of Cardinal Wolsey: the Queen gave him a patent for forty
retainers, but his household consisted of five times that number, all
living with him and dining at his table in Lambeth Palace.
The Church House was an ecclesiastical edifice which has now
entirely passed away. I know nothing about the Church House
except what is found in the Archæological Journal, vol. xl. p. 8.
“Not a single undoubted specimen has been spared to us, though
it is not improbable that the half-timbered building attached to the
west end of the church at Langdon, in Essex, and now called the
Priest House, is really one of these. We have evidence from all parts
of the country that they were once very common. There is, indeed,
hardly an old churchwarden’s account-book which goes back beyond
the changes of the sixteenth century that does not contain some
reference to a building of this kind. They continued in being and to
be used for church purposes long after the Reformation. The
example at All Saints, Derby, stood in the churchyard and was in
existence in 1747.”... “We must picture to ourselves then a long, low
room with an ample fireplace, or rather a big open chimney
occupying one end with a cast hearth. Here the cooking was done,
and here the water boiled for brewing the church ale. There was a
large oak table in the middle with benches around, and a lean-to
building on one side to act as a cellar. This, I think, is not an
inaccurate sketch of a building which played no unimportant part in
our rural economy and rural pleasures. All the details are wanting,
and we can only fill them in by drawing on the imagination. We
know that almost all our churches were made beautiful by religious
painting on the walls. I should not be surprised if we some day
discovered that the church-house came in for its share of art, and
that pictures, not religious in the narrow sense, but grotesque and
humorous, sometimes covered the walls. It was in the church-house
that the ales were held. They were provided for in various ways, but
usually by the farmers, each of whom was wont to give his quota of
malt. There was no malt tax in those days, and as a consequence
there was a malt-kiln in almost every village. These ales were held at
various times. There was almost always one on the Feast of the
Dedication of the Church. Whitsuntide was also a very favourite
time; but they seem to have been held at any convenient time when
money was wanted for the church.... Philip Stubbes, the author of
the Anatomie of Abuses, only knew the Church Ales in their decline.
He was, Anthony Wood informs us, a most rigid Calvinist, a bitter
enemy to Popery, so that his picture must be received with
allowances for exaggeration. His account of them is certainly not a
flattering one. He tells us that ‘The Churche Wardens ... of every
parishe, with the consent of the whole parishe, provide halfe a score
or twentie quarters of mault, wherof some they buye of the churche
stocke, and some is given them of the parishioners themselves,
everyone conferryng some-what, accordyng to his abilitie; which
mault beeyng made into very strong ale or beere is sette to sale,
either in the churche or some other place assigned to that purpose.
Then, when this ... is sette abroche, well is he that can gette
soonest to it and spend the most at it; for he that sitteth the closest
to it and spendes the moste at it, he is counted the godliest man of
all the rest, and moste in God’s favour, because it is spent uppon His
church forsoth. But who, either for want can not, or otherwise for
feare of God’s wrath will not sticke to it, he is counted none destitute
both of vertue and godlines.... In this kind of practise they continue
six weekes, a quarter of a yere, yea helfe a yeare together, swillyng
and gullyng, night and daie, till they be as dronke as rattes, and as
blockishe as beastes.... That money ... if all be true which they saie
... they repair their churches and chappels with it, they buie bookes
for service, cuppes for the celebration of the sacrements, surplesses
for Sir John, and such other necessaries.’”
OLD ST. PAUL’S BEFORE THE DESTRUCTION OF THE STEEPLE
Our website is not just a platform for buying books, but a bridge
connecting readers to the timeless values of culture and wisdom. With
an elegant, user-friendly interface and an intelligent search system,
we are committed to providing a quick and convenient shopping
experience. Additionally, our special promotions and home delivery
services ensure that you save time and fully enjoy the joy of reading.
ebookname.com