Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd Logo
Upload

Welcome to Scribd!

  • 87 views

    Assn 2

    Uploaded by

    ●●●●●●●1
    This document is a homework assignment for the course 16.323 Principles of Optimal Control at MIT. It contains 6 problems related to optimal control and dynamic programming. Students are asked to use dynamic programming to find optimal paths, implement algorithms in MATLAB, solve discrete and continuous algebraic Riccati equations, and apply the matrix inversion lemma. The final question asks about Eugenio Beltrami Riccati's contribution to control theory.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd

    Assn 2

    Uploaded by

    ●●●●●●●1
    87 views3 pages
    This document is a homework assignment for the course 16.323 Principles of Optimal Control at MIT. It contains 6 problems related to optimal control and dynamic programming. Students are asked to use dynamic programming to find optimal paths, implement algorithms in MATLAB, solve discrete and continuous algebraic Riccati equations, and apply the matrix inversion lemma. The final question asks about Eugenio Beltrami Riccati's contribution to control theory.

    Original Title

    assn2

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document is a homework assignment for the course 16.323 Principles of Optimal Control at MIT. It contains 6 problems related to optimal control and dynamic programming. Students are asked to use dynamic programming to find optimal paths, implement algorithms in MATLAB, solve discrete and continuous algebraic Riccati equations, and apply the matrix inversion lemma. The final question asks about Eugenio Beltrami Riccati's contribution to control theory.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    87 views3 pages

    Assn 2

    Uploaded by

    ●●●●●●●1
    This document is a homework assignment for the course 16.323 Principles of Optimal Control at MIT. It contains 6 problems related to optimal control and dynamic programming. Students are asked to use dynamic programming to find optimal paths, implement algorithms in MATLAB, solve discrete and continuous algebraic Riccati equations, and apply the matrix inversion lemma. The final question asks about Eugenio Beltrami Riccati's contribution to control theory.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    of 3

    MIT OpenCourseWare http://ocw.mit.

    edu

    16.323 Principles of Optimal Control


    Spring 2008

    For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

    16.323 Prof. J. P. How

    Handout #2 Feb 21, 2008 Due: March 6, 2008

    16.323 Homework Assignment #2


    Any code for this homework should be submitted online using the class web page - do not forget, as it will be graded as part of your solution. 1. Using dynamic programming, nd the minimum-time path and time from point A to point B, moving only to the right. The time to travel between points is shown on each segment. Compare the DP result (path and cost) with the forward greedy path (i.e. the one where you just decide the best path of the options available as you move from A to B assuming that you also only move to the right to avoid repeated nodes).
    6 2 A 4 7 6 2 5 1 5 3 5 2 5 4 4 6 3 3 2 2 4 10 5 B 2 8

    Figure by MIT OpenCourseWare.

    2. The discrete approximation to a nonlinear continuously operating system is given by xk+1 = xk 0.4x2 k + uk
    The state and control values are constrained by
    0.0 xk 1.0 0.4 uk 0.4 Quantize the state into levels 0.0, 0.5, 1.0, and the control into levels -0.4, -0.2, 0.0, 0.2, 0.4. The performance measure to be minimized is J = 4|x2 | +
    1 k=0

    |uk |

    (a) Use dynamic programming with linear interpolation to nd the optimal control law and the associated cost for all possible values of x0 and x1 .
    (b) From the above results nd the optimal control sequence {u 0 , u1 } and the mini mum cost if the initial state is 1.0.

    (c) Implement the dynamic programming algorithm in MATLAB to conrm your answers. Use your MATLAB code to explore how the quantization levels of xk and uk aect the answer. 3. For the rst-order discrete system xk+1 = 1.05xk + uk . The performance measure to be minimized is 1 1N 2 J = x(N ) + qx2 (k ) + ru2 (k ) 2 k=0 (a) For the case N , solve the discrete equation for the steady state P and gain F as a function of q and r. (b) For q = r = 1, conrm that the backwards recursion agrees with this steady state prediction. Based on these results, how large do you think N needs to be before we can ignore the transient? (c) Compare the performance of the optimal controller (q = r = 1) with the ad-hoc design uk = 0.4xk . 4. Given the optimal control problem for a scalar nonlinear system: x = xu
    2

    x(0) = 1

    0 1

    J (u) = x(1) +

    (x(t)u(t))2 dt

    nd the optimal feedback strategy by solving the associated HJB equation. Hint: show that the HJB dierential equation admits a solution of the form J = p(t)x(t)2 . 5. Use the matrix inversion lemma to show that the discrete algebraic Riccati equation of the form: Pss = Q + AT Pss Pss B R + B T Pss B can be rewritten in the slightly cleaner form: Pss = Q + AT Pss I + BR1 B T Pss
    1 1

    B T Pss A

    (1)

    (2)

    Use this form to analytically solve for the steady state Pss = [P11 P12 ; P21 P22 ] if

    A=

    1 1 1 0

    B=

    1 0

    Q=

    1 0 0 1

    R=1

    Note that A is invertible in this case, which enables further simplication in solving for Pss . Conrm your result using Matlab. 6. So who was Riccati and what was his contribution to control theory?

    You might also like