Robust Q-learning algorithm for Markov decision processes under Wasserstein uncertainty
We present a novel Q-learning algorithm tailored to solve distributionally robust Markov decision problems where the corresponding ambiguity set of transition probabilities for the underlying Markov decision process is a Wasserstein ball around a ...
Maximum likelihood recursive state estimation: An incomplete-information based approach
This paper revisits classical work of Rauch et al. (1965) and develops a novel statistical method for maximum likelihood (ML) recursive state estimation in general state–space models. The new method is based on statistical estimation theory for ...
Resilient distributed state estimation with multi-hop communication
This paper investigates the problem of resilient distributed state estimation for a linear system in multi-hop communication networks. First, we introduce a graph-theoretic property, called multiple-hop strong robustness, to formalize the notion ...
Quaternion-based attitude stabilization using synergistic hybrid feedback with minimal potential functions
This paper investigates the robust global attitude stabilization problem for a rigid-body system using quaternion-based feedback. We propose a novel synergistic hybrid feedback with the following notable features: (1) It demonstrates central ...
Boundary controller design for flexible riser systems with input quantization and position constraint
In this paper, the boundary control problem for a class of flexible riser control systems with input quantization and boundary position constraints is studied. Since quantization errors can adversely affect the performance of the control system, ...
Cooperative pursuit strategy based on cascaded optimization of assignment and guidance
This paper proposes a cooperative pursuit strategy against a maneuvering target by introducing a cascaded optimization framework for assignment and guidance. The cooperative guidance algorithm, guaranteeing both encirclement and simultaneous ...
On robustification of digital event-based controllers for control-affine nonlinear systems
In this paper, the robust digital stabilization problem of nonlinear systems is investigated. In particular, a methodology for the design of robust quantized sampled-data stabilizers updated via an event-triggered mechanism is provided for time-...
A segmented model based fuel delivery control of PEM fuel cells: A port-Hamiltonian approach
This paper proposes an extended interconnection and damping assignment passivity-based control technique to control the pressure dynamics in the fuel delivery subsystem of proton exchange membrane fuel cells. The fuel cell stack is a distributed ...