Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2728606.2728612acmconferencesArticle/Chapter ViewAbstractPublication PagescpsweekConference Proceedingsconference-collections
research-article

Reach-avoid problems with time-varying dynamics, targets and constraints

Published: 14 April 2015 Publication History
  • Get Citation Alerts
  • Abstract

    We consider a reach-avoid differential game, in which one of the players aims to steer the system into a target set without violating a set of state constraints, while the other player tries to prevent the first from succeeding; the system dynamics, target set, and state constraints may all be time-varying. The analysis of this problem plays an important role in collision avoidance, motion planning and aircraft control, among other applications. Previous methods for computing the guaranteed winning initial conditions and strategies for each player have either required augmenting the state vector to include time, or have been limited to problems with either no state constraints or entirely static targets, constraints and dynamics. To incorporate time-varying dynamics, targets and constraints without the need for state augmentation, we propose a modified Hamilton-Jacobi-Isaacs equation in the form of a double-obstacle variational inequality, and prove that the zero sublevel set of its viscosity solution characterizes the capture basin for the target under the state constraints. Through this formulation, our method can compute the capture basin and winning strategies for time-varying games at virtually no additional computational cost relative to the time-invariant case. We provide an implementation of this method based on well-known numerical schemes and show its convergence through a simple example; we include a second example in which our method substantially outperforms the state augmentation approach.

    References

    [1]
    A. K. Akametalu, J. F. Fisac, et al. "Reachability-Based Safe Learning with Gaussian Processes". Proceedings of the 53rd IEEE Conference on Decision and Control (2014).
    [2]
    E. Barron. "Differential Games with Maximum Cost". Nonlinear analysis: Theory, methods & applications (1990), pp. 971--989.
    [3]
    E. Barron and H. Ishii. "The Bellman equation for minimizing the maximum cost". Nonlinear Analysis: Theory, Methods & Applications (1989).
    [4]
    R. Bellman. Dynamic Programming. 1st ed. Princeton, NJ, USA: Princeton University Press, 1957.
    [5]
    O. Bokanowski and H. Zidani. "Minimal time problems with moving targets and obstacles". 18th IFAC World Congress (2011).
    [6]
    O. Bokanowski, N. Forcadel, and H. Zidani. "Reachability and Minimal Times for State Constrained Nonlinear Problems without Any Controllability Assumption". SIAM Journal on Control and Optimization 48.7 (2010), pp. 4292--4316.
    [7]
    P. Cardaliaguet. "A double obstacle problem arising in differential game theory". Journal of Mathematical Analysis and Applications 360.1 (2009), pp. 95--107.
    [8]
    M. Chen, J. F. Fisac, S. Sastry, and C. J. Tomlin. "Safe Sequential Path Planning of Multi-Vehicle Systems via Double-Obstacle Hamilton-Jacobi-Isaacs Variational Inequality". Proceedings of the 14th European Control Conference (to appear) (2015).
    [9]
    E. A. Coddington and N. Levinson. Theory of ordinary differential equations. Tata McGraw-Hill Education, 1955.
    [10]
    A. Cosso. "Stochastic Differential Games Involving Impulse Controls and Double-Obstacle Quasi-Variational Inequalities". SIAM Journal on Control and Optimization 51.3 (2013), pp. 2102--2131.
    [11]
    R. J. Elliott and N. J. Kalton. The existence of value in differential games. Vol. 126. American Mathematical Soc., 1972.
    [12]
    L. C. Evans and P. E. Souganidis. "Differential games and representation formulas for solutions of Hamilton-Jacobi-Isaacs equations". Indiana University mathematics journal 33.5 (1984), pp. 773--797.
    [13]
    I. M. Mitchell. A toolbox of level set methods. 2004. URL: http://www.cs.ubc.ca/~mitchell/ToolboxLS.
    [14]
    I. M. Mitchell, A. M. Bayen, and C. J. Tomlin. "A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games". IEEE Transactions on Automatic Control 50.7 (2005), pp. 947--957.
    [15]
    I. Mitchell. "Application of Level Set Methods to Control and Reachability Problems in Continuous and Hybrid Systems". PhD thesis. Stanford University, 2002.
    [16]
    I. M. Mitchell. "Application of Level Set Methods to Control and Reachability Problems in Continuous and Hybrid Systems". PhD thesis. Stanford University, 2002.
    [17]
    S. Osher and R. Fedkiw. Level Set Methods and Dynamic Implicit Surfaces. Springer Verlag, 2003.
    [18]
    S. Osher and C.-W. Shu. "High-Order Essentially Nonoscillatory Schemes for Hamilton-Jacobi Equations". SIAM Journal on Numerical Analysis 28.4 (1991), pp. 907--922.
    [19]
    B. Peng, B. Merriman, et al. "A PDE-based fast local level set method". Journal of computational physics 155 (1999), pp. 410--438.
    [20]
    M. Quincampoix and O.-S. Serea. "A viability approach for optimal control with infimum cost". Annals. Stiint. Univ. Al. I. Cuza Iasi, sI a, Mat 1 (2002), pp. 1--20.
    [21]
    A. Rapaport. "Characterization of Barriers of Differential Games". Journal of optimization theory and applications 97.I (1998), pp. 151--179.
    [22]
    E. Roxin. "Axiomatic approach in differential games". Journal of Optimization Theory and Applications 3.3 (1969), pp. 153--163.
    [23]
    J. A. Sethian. "A fast marching level set method for monotonically advancing fronts". Proceedings of the National Academy of Sciences 93.4 (1996), pp. 1591--1595.
    [24]
    C.-W. Shu and S. Osher. "Efficient implementation of essentially non-oscillatory shock-capturing schemes". Journal of Computational Physics 77.2 (1988), pp. 439--471.
    [25]
    P. Varaiya. "On the existence of solutions to a differential game". SIAM Journal on Control 5.1 (1967), pp. 153--162.

    Cited By

    View all
    • (2024)An Improved Level Set Method for Reachability Problems in Differential GamesIEEE Transactions on Systems, Man, and Cybernetics: Systems10.1109/TSMC.2024.335226354:5(2907-2916)Online publication date: May-2024
    • (2024)Safe Set-Based Trajectory Planning for Robotic ManipulatorsIEEE Transactions on Robotics10.1109/TRO.2024.340097540(3082-3096)Online publication date: 2024
    • (2024)Continuous-Time Control Synthesis Under Nested Signal Temporal Logic SpecificationsIEEE Transactions on Robotics10.1109/TRO.2024.335308140(2272-2286)Online publication date: 2024
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    HSCC '15: Proceedings of the 18th International Conference on Hybrid Systems: Computation and Control
    April 2015
    321 pages
    ISBN:9781450334334
    DOI:10.1145/2728606
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 April 2015

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    HSCC '15
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 153 of 373 submissions, 41%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)267
    • Downloads (Last 6 weeks)29
    Reflects downloads up to 11 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)An Improved Level Set Method for Reachability Problems in Differential GamesIEEE Transactions on Systems, Man, and Cybernetics: Systems10.1109/TSMC.2024.335226354:5(2907-2916)Online publication date: May-2024
    • (2024)Safe Set-Based Trajectory Planning for Robotic ManipulatorsIEEE Transactions on Robotics10.1109/TRO.2024.340097540(3082-3096)Online publication date: 2024
    • (2024)Continuous-Time Control Synthesis Under Nested Signal Temporal Logic SpecificationsIEEE Transactions on Robotics10.1109/TRO.2024.335308140(2272-2286)Online publication date: 2024
    • (2024)Matching-Based Capture-the-Flag Games for Multiagent SystemsIEEE Transactions on Cognitive and Developmental Systems10.1109/TCDS.2023.332357216:3(993-1005)Online publication date: Jun-2024
    • (2024)Safe Model-Based Reinforcement Learning With an Uncertainty-Aware Reachability CertificateIEEE Transactions on Automation Science and Engineering10.1109/TASE.2023.329238821:3(4129-4142)Online publication date: Jul-2024
    • (2024)Homicidal Chauffeur Reach-Avoid Games via Guaranteed Winning StrategiesIEEE Transactions on Automatic Control10.1109/TAC.2023.332969369:4(2367-2382)Online publication date: Apr-2024
    • (2024)Multiple-Pursuer Single-Evader Reach-Avoid Games in Constant Flow FieldsIEEE Transactions on Automatic Control10.1109/TAC.2023.332953769:3(1789-1795)Online publication date: Mar-2024
    • (2024)A Minimum Discounted Reward Hamilton–Jacobi Formulation for Computing Reachable SetsIEEE Transactions on Automatic Control10.1109/TAC.2023.332715969:2(1097-1103)Online publication date: Feb-2024
    • (2024)Ensuring Safety at Intelligent Intersections: Temporal Logic Meets Reachability Analysis2024 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV55156.2024.10588818(292-298)Online publication date: 2-Jun-2024
    • (2024)A survey of decision making in adversarial gamesScience China Information Sciences10.1007/s11432-022-3777-y67:4Online publication date: 4-Feb-2024
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media