-
The Impact of Reference-Command Preview on Human-in-the-Loop Control Behavior
Authors:
Pedram Rabiee,
S. Alireza Seyyed Mousavi,
Amelia J. S. Sheffler,
Erik Hellström,
Mrdjan Jankovic,
Mario A. Santillo,
T. M. Seigler,
Jesse B. Hoagg
Abstract:
This article presents results from an experiment in which 44 human subjects interact with a dynamic system to perform 40 trials of a command-following task. The reference command is unpredictable and different on each trial, but all subjects have the same sequence of reference commands for the 40 trials. The subjects are divided into 4 groups of 11 subjects. One group performs the command-followin…
▽ More
This article presents results from an experiment in which 44 human subjects interact with a dynamic system to perform 40 trials of a command-following task. The reference command is unpredictable and different on each trial, but all subjects have the same sequence of reference commands for the 40 trials. The subjects are divided into 4 groups of 11 subjects. One group performs the command-following task without preview of the reference command, and the other 3 groups are given preview of the reference command for different time lengths into the future (0.5 s, 1 s, 1.5 s). A subsystem identification algorithm is used to obtain best-fit models of each subject's control behavior on each trial. The time- and frequency-domain performance, as well as the identified models of the control behavior for the 4 groups are examined to investigate the effects of reference-command preview. The results suggest that preview tends to improve performance by allowing the subjects to compensate for sensory time delay and approximate the inverse dynamics in feedforward. However, too much preview may decrease performance by degrading the ability to use the correct phase lead in feedforward.
△ Less
Submitted 29 August, 2023;
originally announced August 2023.
-
A Parallel Monte-Carlo Tree Search-Based Metaheuristic For Optimal Fleet Composition Considering Vehicle Routing Using Branch & Bound
Authors:
T. M. J. T. Baltussen,
M. Goutham,
M. Menon,
S. G. Garrow,
M. Santillo,
S. Stockar
Abstract:
Autonomous mobile robots enable increased flexibility of manufacturing systems. The design and operating strategy of such a fleet of robots requires careful consideration of both fixed and operational costs. In this paper, a Monte-Carlo Tree Search (MCTS)-based metaheuristic is developed that guides a Branch & Bound (B&B) algorithm to find the globally optimal solution to the Fleet Size and Mix Ve…
▽ More
Autonomous mobile robots enable increased flexibility of manufacturing systems. The design and operating strategy of such a fleet of robots requires careful consideration of both fixed and operational costs. In this paper, a Monte-Carlo Tree Search (MCTS)-based metaheuristic is developed that guides a Branch & Bound (B&B) algorithm to find the globally optimal solution to the Fleet Size and Mix Vehicle Routing Problem with Time Windows (FSMVRPTW).The metaheuristic and exact algorithms are implemented in a parallel hybrid optimization algorithm where the metaheuristic rapidly finds feasible solutions that provide candidate upper bounds for the B&B algorithm. The MCTS additionally provides a candidate fleet composition to initiate the B&B search. Experiments show that the proposed approach results in significant improvements in computation time and convergence to the optimal solution.
△ Less
Submitted 3 March, 2024; v1 submitted 6 March, 2023;
originally announced March 2023.
-
Multi-agent systems with CBF-based controllers -- collision avoidance and liveness from instability
Authors:
Mrdjan Jankovic,
Mario Santillo,
Yan Wang
Abstract:
Assuring system stability is typically a major control design objective. In this paper, we present a system where instability provides a crucial benefit. We consider multi-agent collision avoidance using Control Barrier Functions (CBF) and study trade-offs between safety and liveness -- the ability to reach a destination without large detours or gridlock. We compare two standard decentralized poli…
▽ More
Assuring system stability is typically a major control design objective. In this paper, we present a system where instability provides a crucial benefit. We consider multi-agent collision avoidance using Control Barrier Functions (CBF) and study trade-offs between safety and liveness -- the ability to reach a destination without large detours or gridlock. We compare two standard decentralized policies, with only the local (host) control available, to co-optimization policies (PCCA and CCS) where everyone's (virtual) control action is available. The co-optimization policies compute control for everyone even though they lack information about others' intentions. For comparison, we use a Centralized, full information policy as the benchmark. One contribution of this paper is proving feasibility for the Centralized, PCCA, and CCS policies. Monte Carlo simulations show that decentralized, host-only control policies and CCS lack liveness while the PCCA policy performs as well as the Centralized. Next, we explain the observed results by considering two agents negotiating the passing order through an intersection. We show that the structure and stability of the resulting equilibria correlates with the observed propensity to gridlock -- the policies with unstable equilibria avoid gridlocks while those with stable ones do not.
△ Less
Submitted 11 July, 2022;
originally announced July 2022.
-
Backup Control Barrier Functions: Formulation and Comparative Study
Authors:
Yuxiao Chen,
Mrdjan Jankovic,
Mario Santillo,
Aaron D. Ames
Abstract:
The backup control barrier function (CBF) was recently proposed as a tractable formulation that guarantees the feasibility of the CBF quadratic programming (QP) via an implicitly defined control invariant set. The control invariant set is based on a fixed backup policy and evaluated online by forward integrating the dynamics under the backup policy. This paper is intended as a tutorial of the back…
▽ More
The backup control barrier function (CBF) was recently proposed as a tractable formulation that guarantees the feasibility of the CBF quadratic programming (QP) via an implicitly defined control invariant set. The control invariant set is based on a fixed backup policy and evaluated online by forward integrating the dynamics under the backup policy. This paper is intended as a tutorial of the backup CBF approach and a comparative study to some benchmarks. First, the backup CBF approach is presented step by step with the underlying math explained in detail. Second, we prove that the backup CBF always has a relative degree 1 under mild assumptions. Third, the backup CBF approach is compared with benchmarks such as Hamilton Jacobi PDE and Sum-of-Squares on the computation of control invariant sets, which shows that one can obtain a control invariant set close to the maximum control invariant set under a good backup policy for many practical problems.
△ Less
Submitted 22 April, 2021;
originally announced April 2021.
-
Collision Avoidance and Liveness of Multi-agent Systems with CBF-based Controllers
Authors:
Mrdjan Jankovic,
Mario Santillo
Abstract:
In this paper we consider multi-agent navigation with collision avoidance using Control Barrier Functions (CBF). In the case of non-communicating agents, we consider trade-offs between level of safety guarantee and liveness - the ability to reach destination in short time without large detours or gridlock. We compare several CBF-based driving policies against the benchmark established by the Centr…
▽ More
In this paper we consider multi-agent navigation with collision avoidance using Control Barrier Functions (CBF). In the case of non-communicating agents, we consider trade-offs between level of safety guarantee and liveness - the ability to reach destination in short time without large detours or gridlock. We compare several CBF-based driving policies against the benchmark established by the Centralized controller that requires communication. One of the policies (CCS2) being compared is new and straddles the space between policies with only local control available and a more complex Predictor-Corrector for Collision Avoidance (PCCA) policy that adjusts local copies of everyone's control actions based on observed behavior. The paper establishes feasibility for the Centralized, PCCA and CCS2 policies. Monte Carlo simulations show that decentralized, host-only control policies lack liveness compared to the ones that use all the control inputs in calculations and that the PCCA policy performs equally well as the Centralized, even though it is decentralized.
△ Less
Submitted 18 December, 2020;
originally announced December 2020.
-
Online decentralized decision making with inequality constraints: an ADMM approach
Authors:
Yuxiao Chen,
Mario Santillo,
Mrdjan Jankovic,
Aaron D. Ames
Abstract:
We discuss an online decentralized decision making problem where the agents are coupled with affine inequality constraints. Alternating Direction Method of Multipliers (ADMM) is used as the computation engine and we discuss the convergence of the algorithm in an online setting. To be specific, when decisions have to be made sequentially with a fixed time step, there might not be enough time for th…
▽ More
We discuss an online decentralized decision making problem where the agents are coupled with affine inequality constraints. Alternating Direction Method of Multipliers (ADMM) is used as the computation engine and we discuss the convergence of the algorithm in an online setting. To be specific, when decisions have to be made sequentially with a fixed time step, there might not be enough time for the ADMM to converge before the scenario changes and the decision needs to be updated. In this case, a suboptimal solution is employed and we analyze the optimality gap given the convergence condition. Moreover, in many cases, the decision making problem changes gradually over time. We propose a warm-start scheme to accelerate the convergence of ADMM and analyze the benefit of the warm-start. The proposed method is demonstrated in a decentralized multiagent control barrier function problem with simulation.
△ Less
Submitted 19 November, 2020;
originally announced November 2020.
-
Collision Free Navigation with Interacting, Non-Communicating Obstacles
Authors:
Mario Santillo,
Mrdjan Jankovic
Abstract:
In this paper we consider the problem of navigation and motion control in an area densely populated with other agents. We propose an algorithm that, without explicit communication and based on the information it has, computes the best control action for all the agents and implements its own. Notably, the host agent (the agent executing the algorithm) computes the differences between the other agen…
▽ More
In this paper we consider the problem of navigation and motion control in an area densely populated with other agents. We propose an algorithm that, without explicit communication and based on the information it has, computes the best control action for all the agents and implements its own. Notably, the host agent (the agent executing the algorithm) computes the differences between the other agents' computed and observed control actions and treats them as known disturbances that are fed back into a robust control barrier function (RCBF) based quadratic program. A feedback loop is created because the computed control action for another agent depends on the previously used disturbance estimate. In the case of two interacting agents, stability of the feedback loop is proven and a performance guarantee in terms of constraint adherence is established. This holds whether the other agent executes the same algorithm or not.
△ Less
Submitted 27 August, 2020;
originally announced August 2020.
