-
S-SOS: Stochastic Sum-Of-Squares for Parametric Polynomial Optimization
Authors:
Richard L. Zhu,
Mathias Oster,
Yuehaw Khoo
Abstract:
Global polynomial optimization is an important tool across applied mathematics, with many applications in operations research, engineering, and physical sciences. In various settings, the polynomials depend on external parameters that may be random. We discuss a stochastic sum-of-squares (S-SOS) algorithm based on the sum-of squares hierarchy that constructs a series of semidefinite programs to jo…
▽ More
Global polynomial optimization is an important tool across applied mathematics, with many applications in operations research, engineering, and physical sciences. In various settings, the polynomials depend on external parameters that may be random. We discuss a stochastic sum-of-squares (S-SOS) algorithm based on the sum-of squares hierarchy that constructs a series of semidefinite programs to jointly find strict lower bounds on the global minimum and extract candidates for parameterized global minimizers. We prove quantitative convergence of the hierarchy as the degree increases and use it to solve unconstrained and constrained polynomial optimization problems parameterized by random variables. By employing $n$-body priors from condensed matter physics to induce sparsity, we can use S-SOS to produce solutions and uncertainty intervals for sensor network localization problems containing up to 40 variables and semidefinite matrix sizes surpassing $800 \times 800$.
△ Less
Submitted 13 June, 2024;
originally announced June 2024.
-
Variationally Correct Neural Residual Regression for Parametric PDEs: On the Viability of Controlled Accuracy
Authors:
Markus Bachmayr,
Wolfgang Dahmen,
Mathias Oster
Abstract:
This paper is about learning the parameter-to-solution map for systems of partial differential equations (PDEs) that depend on a potentially large number of parameters covering all PDE types for which a stable variational formulation (SVF) can be found. A central constituent is the notion of variationally correct residual loss function meaning that its value is always uniformly proportional to the…
▽ More
This paper is about learning the parameter-to-solution map for systems of partial differential equations (PDEs) that depend on a potentially large number of parameters covering all PDE types for which a stable variational formulation (SVF) can be found. A central constituent is the notion of variationally correct residual loss function meaning that its value is always uniformly proportional to the squared solution error in the norm determined by the SVF, hence facilitating rigorous a posteriori accuracy control. It is based on a single variational problem, associated with the family of parameter dependent fiber problems, employing the notion of direct integrals of Hilbert spaces. Since in its original form the loss function is given as a dual test norm of the residual a central objective is to develop equivalent computable expressions. A first critical role is played by hybrid hypothesis classes, whose elements are piecewise polynomial in (low-dimensional) spatio-temporal variables with parameter-dependent coefficients that can be represented, e.g. by neural networks. Second, working with first order SVFs, we distinguish two scenarios: (i) the test space can be chosen as an $L_2$-space (e.g. for elliptic or parabolic problems) so that residuals live in $L_2$ and can be evaluated directly; (ii) when trial and test spaces for the fiber problems (e.g. for transport equations) depend on the parameters, we use ultraweak formulations. In combination with Discontinuous Petrov Galerkin concepts the hybrid format is then instrumental to arrive at variationally correct computable residual loss functions. Our findings are illustrated by numerical experiments representing (i) and (ii), namely elliptic boundary value problems with piecewise constant diffusion coefficients and pure transport equations with parameter dependent convection field.
△ Less
Submitted 30 May, 2024;
originally announced May 2024.
-
A comparison study of supervised learning techniques for the approximation of high dimensional functions and feedback control
Authors:
Mathias Oster,
Luca Saluzzi,
Tizian Wenzel
Abstract:
Approximation of high dimensional functions is in the focus of machine learning and data-based scientific computing. In many applications, empirical risk minimisation techniques over nonlinear model classes are employed. Neural networks, kernel methods and tensor decomposition techniques are among the most popular model classes. We provide a numerical study comparing the performance of these metho…
▽ More
Approximation of high dimensional functions is in the focus of machine learning and data-based scientific computing. In many applications, empirical risk minimisation techniques over nonlinear model classes are employed. Neural networks, kernel methods and tensor decomposition techniques are among the most popular model classes. We provide a numerical study comparing the performance of these methods on various high-dimensional functions with focus on optimal control problems, where the collection of the dataset is based on the application of the State-Dependent Riccati Equation.
△ Less
Submitted 2 February, 2024;
originally announced February 2024.
-
A Tri-Level Optimization Model for Interdependent Infrastructure Network Resilience Against Compound Hazard Events
Authors:
Matthew R. Oster,
Ilya Amburg,
Samrat Chatterjee,
Daniel A. Eisenberg,
Dennis G. Thomas,
Feng Pan,
Auroop R. Ganguly
Abstract:
Resilient operation of interdependent infrastructures against compound hazard events is essential for maintaining societal well-being. To address consequence assessment challenges in this problem space, we propose a novel tri-level optimization model applied to a proof-of-concept case study with fuel distribution and transportation networks -- encompassing one realistic network; one fictitious, ye…
▽ More
Resilient operation of interdependent infrastructures against compound hazard events is essential for maintaining societal well-being. To address consequence assessment challenges in this problem space, we propose a novel tri-level optimization model applied to a proof-of-concept case study with fuel distribution and transportation networks -- encompassing one realistic network; one fictitious, yet realistic network; as well as networks drawn from three synthetic distributions. Mathematically, our approach takes the form of a defender-attacker-defender (DAD) model -- a multi-agent tri-level optimization, comprised of a defender, attacker, and an operator acting in sequence. Here, our notional operator may choose proxy actions to operate an interdependent system comprised of fuel terminals and gas stations (functioning as supplies) and a transportation network with traffic flow (functioning as demand) to minimize unmet demand at gas stations. A notional attacker aims to hypothetically disrupt normal operations by reducing supply at the supply terminals, and the notional defender aims to identify best proxy defense policy options which include hardening supply terminals or allowing alternative distribution methods such as trucking reserve supplies. We solve our DAD formulation at a metropolitan scale and present practical defense policy insights against hypothetical compound hazards. We demonstrate the generalizability of our framework by presenting results for a realistic network; a fictitious, yet realistic network; as well as for three networks drawn from synthetic distributions. Additionally, we demonstrate the scalability of the framework by investigating runtime performance as a function of the network size. Steps for future research are also discussed.
△ Less
Submitted 16 October, 2023;
originally announced October 2023.
-
Coupled cluster theory: Towards an algebraic geometry formulation
Authors:
Fabian M. Faulstich,
Mathias Oster
Abstract:
Coupled cluster theory produced arguably the most widely used high-accuracy computational quantum chemistry methods. Despite the approach's overall great computational success, its mathematical understanding is so far limited to results within the realm of functional analysis. The coupled cluster amplitudes, which are the targeted objects in coupled cluster theory, correspond to solutions to the c…
▽ More
Coupled cluster theory produced arguably the most widely used high-accuracy computational quantum chemistry methods. Despite the approach's overall great computational success, its mathematical understanding is so far limited to results within the realm of functional analysis. The coupled cluster amplitudes, which are the targeted objects in coupled cluster theory, correspond to solutions to the coupled cluster equations, which is a system of polynomial equations of at most degree four. The high dimensionality of the electronic Schrödinger equation and the non-linearity of the coupled cluster ansatz have so far stalled a formal analysis of this polynomial system. In this article, we present algebraic investigations that shed light on the coupled cluster equations and the root structure of this ansatz. This is of importance for the a posteriori evaluation of coupled cluster calculations. To that end, we investigate the root structure by means of Newton polytopes. We derive a general v-description, which is subsequently turned into an h-description for explicit examples. This perspective reveals an apparent connection between Pauli's exclusion principle and the geometrical structure of the Newton polytopes. We also propose an alternative characterization of the coupled cluster equations projected onto singles and doubles as cubic polynomials on an algebraic variety with certain sparsity patterns. Moreover, we provide numerical simulations of two computationally tractable systems, namely, the two electrons in four spin-orbitals system and the three electrons in six spin-orbitals system. These simulations provide novel insight into the root structure of the coupled cluster solutions when the coupled cluster ansatz is truncated.
△ Less
Submitted 28 March, 2024; v1 submitted 18 November, 2022;
originally announced November 2022.
-
Laminar model for the joint development of ocular dominance columns and CO blobs in V1
Authors:
Andrew M. Oster
Abstract:
In this paper, we present a multi--layer, activity--dependent model for the joint development of ocular dominance (OD) columns and cytochrome oxidase (CO) blobs in primate primary visual cortex (V1). For simplicity, we focus on layers 4C and 2/3 with both layers receiving direct thalamic inputs and layer 4C sending vertical projections to layer 2/3. Both the thalamic and the vertical connections a…
▽ More
In this paper, we present a multi--layer, activity--dependent model for the joint development of ocular dominance (OD) columns and cytochrome oxidase (CO) blobs in primate primary visual cortex (V1). For simplicity, we focus on layers 4C and 2/3 with both layers receiving direct thalamic inputs and layer 4C sending vertical projections to layer 2/3. Both the thalamic and the vertical connections are taken to be modifiable by activity. Using a correlation--based Hebbian learning rule with subtractive normalization, we show how the formation of an OD map in layer 4C is inherited by layer 2/3 via the vertical projections. Competition between these feedforward projections and the direct thalamic input to layer 2/3 then results in the formation of CO blobs superimposed upon the ocular dominance map. The spacing of the OD columns is determined by the spatial profile of the intralaminar connections within layer 4, while the spacing of CO blobs depends both on the width of the OD columns inherited from layer 4 and the spatial distribution of intralaminar connections within the superficial layer. The resulting CO blob distribution is shown to be consistent with experimental data. In addition, we numerically simulate monocular deprivation and find that while the CO blob distribution is unaltered, the OD pattern undergoes modification. The OD stripes of the deprived eye narrow, whereas the OD stripes for the remaining open eye widen.
△ Less
Submitted 22 August, 2022;
originally announced August 2022.
-
Virtual Reality Assisted Human Perception in ADAS Development: a Munich 3D Model Study
Authors:
Felix Bognar,
Markus Oster,
Herman Van der Auweraer,
Tong Duy Son
Abstract:
As the development of autonomous driving (AD) and advanced driver assistance systems (ADAS) progresses, the relevance of the comfort of users is gaining increasing interest. It becomes significant to test and validate perceived comfort performance from the early phase of system development before driving on roads. Most of the present ADAS test procedures are not efficient in performing such comfor…
▽ More
As the development of autonomous driving (AD) and advanced driver assistance systems (ADAS) progresses, the relevance of the comfort of users is gaining increasing interest. It becomes significant to test and validate perceived comfort performance from the early phase of system development before driving on roads. Most of the present ADAS test procedures are not efficient in performing such comfort evaluation. One of the main challenges is to integrate high-quality, realistic and predictable virtual traffic scenarios into an ADAS testing framework that has physics-based sensors capable of sensing the virtual environment. In this paper, we present our development of a virtual reality based ADAS testing framework that enhances human perception evaluation. The main contribution relies on three aspects. First, we introduce our development of a large and high-quality (realism, structure, texture) 3D traffic model of the Munich city in Germany. Second, we optimize the 3D model for virtual reality purpose, and real-time capable for human-in-the-loop ADAS testing. Finally, the model is then integrated into an ADAS framework for testing and validating ADAS functionalities and perceived comfort performance. The developed framework components are presented with illustrative examples.
△ Less
Submitted 22 August, 2022; v1 submitted 12 August, 2022;
originally announced August 2022.
-
Some suggestions concerning the conjecture in: 'Tractable semi-algebraic approximation using Christoffel-Darboux kernel'
Authors:
Mathias Oster,
Reinhold Schneider
Abstract:
In 'Tractable semi-algebraic approximation using Christoffel-Darboux kernel' Marx, Pauwels, Weisser, Henrion and Lasserre conjectured, that the approximation rate $\mathcal O(\frac 1 {\sqrt(d)})$ of a Lipschitz functions by a semi-algebraic function induced by a Christoffel- Darboux kernel of degree $d$ in the $L^1$ norm can be improved for more regular functions. Here we will show, that for semi-…
▽ More
In 'Tractable semi-algebraic approximation using Christoffel-Darboux kernel' Marx, Pauwels, Weisser, Henrion and Lasserre conjectured, that the approximation rate $\mathcal O(\frac 1 {\sqrt(d)})$ of a Lipschitz functions by a semi-algebraic function induced by a Christoffel- Darboux kernel of degree $d$ in the $L^1$ norm can be improved for more regular functions. Here we will show, that for semi-algebraic and definable functions the results can be strengthened to a rational approximation rate in the $L^\infty$ norm.
△ Less
Submitted 24 March, 2022;
originally announced March 2022.
-
Re-entrant tensegrity: A three-periodic, chiral, tensegrity structure that is auxetic
Authors:
Mathias Oster,
Marcelo A. Dias,
Timo de Wolff,
Myfanwy E. Evans
Abstract:
We present a three-periodic, chiral, tensegrity structure and demonstrate that it is auxetic. Our tensegrity structure is constructed using the chiral symmetry Π+ cylinder packing, transforming the cylinders themselves to the elastic elements and cylinder contacts to incompressible rods. The resulting structure displays local re-entrant geometry at its vertices, and is shown to be auxetic when mod…
▽ More
We present a three-periodic, chiral, tensegrity structure and demonstrate that it is auxetic. Our tensegrity structure is constructed using the chiral symmetry Π+ cylinder packing, transforming the cylinders themselves to the elastic elements and cylinder contacts to incompressible rods. The resulting structure displays local re-entrant geometry at its vertices, and is shown to be auxetic when modelled as an equilibrium configuration of spatial constraints subject to a quasi-static deformation. When the tensegrity structure is subsequently modelled as a lattice material with elastic elements, the auxetic behaviour is again confirmed through finite element modelling as well as demonstrated with a 3d printed example. The cubic symmetry of the structure means that the behaviour is independent of the chosen stretching direction and the auxetic behaviour is observed in both perpendicular directions. This structure could be the simplest three-dimensional analogue to the two-dimensional re-entrant honeycomb. This, alongside the chirality of the structure, make it an interesting design target for multifunctional materials.
△ Less
Submitted 10 May, 2021;
originally announced May 2021.
-
Approximating optimal feedback controllers of finite horizon control problems using hierarchical tensor formats
Authors:
Mathias Oster,
Leon Sallandt,
Reinhold Schneider
Abstract:
Controlling systems of ordinary differential equations (ODEs) is ubiquitous in science and engineering. For finding an optimal feedback controller, the value function and associated fundamental equations such as the Bellman equation and the Hamilton-Jacobi-Bellman (HJB) equation are essential. The numerical treatment of these equations poses formidable challenges due to their non-linearity and the…
▽ More
Controlling systems of ordinary differential equations (ODEs) is ubiquitous in science and engineering. For finding an optimal feedback controller, the value function and associated fundamental equations such as the Bellman equation and the Hamilton-Jacobi-Bellman (HJB) equation are essential. The numerical treatment of these equations poses formidable challenges due to their non-linearity and their (possibly) high-dimensionality.
In this paper we consider a finite horizon control system with associated Bellman equation. After a time-discretization, we obtain a sequence of short time horizon problems which we call local optimal control problems. For solving the local optimal control problems we apply two different methods, one being the well-known policy iteration, where a fixed-point iteration is required for every time step. The other algorithm borrows ideas from Model Predictive Control (MPC), by solving the local optimal control problem via open-loop control methods on a short time horizon, allowing us to replace the fixed-point iteration by an adjoint method.
For high-dimensional systems we apply low rank hierarchical tensor product approximation/tree-based tensor formats, in particular tensor trains (TT tensors) and multi-polynomials, together with high-dimensional quadrature, e.g. Monte-Carlo.
We prove a linear error propagation with respect to the time discretization and give numerical evidence by controlling a diffusion equation with unstable reaction term and an Allen-Kahn equation.
△ Less
Submitted 13 April, 2021;
originally announced April 2021.
-
Approximative Policy Iteration for Exit Time Feedback Control Problems driven by Stochastic Differential Equations using Tensor Train format
Authors:
Konstantin Fackeldey,
Mathias Oster,
Leon Sallandt,
Reinhold Schneider
Abstract:
We consider a stochastic optimal exit time feedback control problem. The Bellman equation is solved approximatively via the Policy Iteration algorithm on a polynomial ansatz space by a sequence of linear equations. As high degree multi-polynomials are needed, the corresponding equations suffer from the curse of dimensionality even in moderate dimensions. We employ tensor-train methods to account f…
▽ More
We consider a stochastic optimal exit time feedback control problem. The Bellman equation is solved approximatively via the Policy Iteration algorithm on a polynomial ansatz space by a sequence of linear equations. As high degree multi-polynomials are needed, the corresponding equations suffer from the curse of dimensionality even in moderate dimensions. We employ tensor-train methods to account for this problem. The approximation process within the Policy Iteration is done via a Least-Squares ansatz and the integration is done via Monte-Carlo methods. Numerical evidences are given for the (multi dimensional) double well potential and a three-hole potential.
△ Less
Submitted 9 October, 2020;
originally announced October 2020.
-
Learning Koopman Representations for Hybrid Systems
Authors:
Craig Bakker,
Arnab Bhattacharya,
Samrat Chatterjee,
Casey J. Perkins,
Matthew R. Oster
Abstract:
The Koopman operator lifts nonlinear dynamical systems into a functional space of observables, where the dynamics are linear. In this paper, we provide three different Koopman representations for hybrid systems. The first is specific to switched systems, and the second and third preserve the original hybrid dynamics while eliminating the discrete state variables; the second approach is straightfor…
▽ More
The Koopman operator lifts nonlinear dynamical systems into a functional space of observables, where the dynamics are linear. In this paper, we provide three different Koopman representations for hybrid systems. The first is specific to switched systems, and the second and third preserve the original hybrid dynamics while eliminating the discrete state variables; the second approach is straightforward, and we provide conditions under which the transformation associated with the third holds. Eliminating discrete state variables provides computational benefits when using data-driven methods to learn the Koopman operator and its observables. Following this, we use deep learning to implement each representation on two test cases, discuss the challenges associated with those implementations, and propose areas of future work.
△ Less
Submitted 22 June, 2020;
originally announced June 2020.
-
Approximating the Stationary Bellman Equation by Hierarchical Tensor Products
Authors:
Mathias Oster,
Leon Sallandt,
Reinhold Schneider
Abstract:
We treat infinite horizon optimal control problems by solving the associated stationary Hamilton-Jacobi-Bellman (HJB) equation numerically to compute the value function and an optimal feedback law. The dynamical systems under consideration are spatial discretizations of non linear parabolic partial differential equations (PDE), which means that the HJB is non linear and suffers from the curse of d…
▽ More
We treat infinite horizon optimal control problems by solving the associated stationary Hamilton-Jacobi-Bellman (HJB) equation numerically to compute the value function and an optimal feedback law. The dynamical systems under consideration are spatial discretizations of non linear parabolic partial differential equations (PDE), which means that the HJB is non linear and suffers from the curse of dimensionality. Its non linearity is handled by the Policy Iteration algorithm, where the problem is reduced to a sequence of linear, hyperbolic PDEs. These equations remain the computational bottleneck due to their high dimensions. By the method of characteristics these linearized HJB equations can be reformulated via the Koopman operator in the spirit of dynamic programming. The resulting operator equations are solved using a minimal residual method. To overcome numerical infeasability we use low rank hierarchical tensor product approximation/tree-based tensor formats, in particular tensor trains (TT tensors), and multi-polynomials, together with high dimensional quadrature, e.g. Monte-Carlo. By controlling a destabilized version of viscous Burgers and a diffusion equation with unstable reaction term numerical evidences are given.
△ Less
Submitted 18 May, 2021; v1 submitted 1 November, 2019;
originally announced November 2019.
-
Monolithic on-chip integration of semiconductor waveguides, beamsplitters and single-photon sources
Authors:
Klaus D. Jöns,
Ulrich Rengstl,
Markus Oster,
Fabian Hargart,
Matthias Heldmaier,
Samir Bounouar,
Sven M. Ulrich,
Michael Jetter,
Peter Michler
Abstract:
The implementation of a fully integrated Hadamard gate on one single chip is currently one of the major goals in the quantum computation and communication community. Prerequisites for such a chip are the integration of single-photon sources and detectors into waveguide structures such as photonic crystals or slab and ridge waveguide. Here, we present an implementation of a single-photon on-chip ex…
▽ More
The implementation of a fully integrated Hadamard gate on one single chip is currently one of the major goals in the quantum computation and communication community. Prerequisites for such a chip are the integration of single-photon sources and detectors into waveguide structures such as photonic crystals or slab and ridge waveguide. Here, we present an implementation of a single-photon on-chip experiment based on a III-V semiconductor platform. Individual semiconductor quantum dots were used as pulsed single-photon sources integrated in ridge waveguides, and on-chip waveguide-beamsplitter operation is verified on the single-photon level by performing off-chip photon cross-correlation measurements between the two output ports of the beamsplitter. A careful characterization of the waveguide propagation losses (~ 0.0068 dB/um) documents the applicability of such GaAs-based waveguide structures in more complex photonic integrated circuits. The presented work marks an important step towards the realization of fully integrated photonic quantum circuits including on-demand single-photon sources.
△ Less
Submitted 27 March, 2014;
originally announced March 2014.
-
Spectroscopy of the D1-transition of cesium by dressed-state resonance fluorescence from a single (In,Ga)As/GaAs quantum dot
Authors:
S. M. Ulrich,
S. Weiler,
M. Oster,
M. Jetter,
A. Urvoy,
R. Löw,
P. Michler
Abstract:
We use a laser-driven single (In,Ga)As quantum dot (QD) in the dressed state regime of resonance fluorescence ($T = 4$ K) to observe the four $D_1$-transition lines of alkali atomic cesium ($Cs$) vapor at room temperature. We tune the frequency of the dressing continuous-wave laser in the vicinity of the bare QD resonance $\sim 335.116$ THz ($\sim 894.592$ nm) at constant excitation power and ther…
▽ More
We use a laser-driven single (In,Ga)As quantum dot (QD) in the dressed state regime of resonance fluorescence ($T = 4$ K) to observe the four $D_1$-transition lines of alkali atomic cesium ($Cs$) vapor at room temperature. We tune the frequency of the dressing continuous-wave laser in the vicinity of the bare QD resonance $\sim 335.116$ THz ($\sim 894.592$ nm) at constant excitation power and thereby controllably tune the center and side channel frequencies of the probe light, i.e. the Mollow triplet. Resonances between individual QD Mollow triplet lines and the atomic hyperfine-split transitions are clearly identified in the $Cs$ absorption spectrum. Our results show that narrow-band (In,Ga)As QD resonance fluorescence (RF) is suitable to optically address individual transitions of the $D_1$ quadruplet without applying magnetic field or electric field tuning.
△ Less
Submitted 11 February, 2014;
originally announced February 2014.
-
Stability, mobility and power currents in a two-dimensional model for waveguide arrays with nonlinear coupling
Authors:
Michael Oster,
Magnus Johansson
Abstract:
A two-dimensional nonlinear Schrodinger lattice with nonlinear coupling, modelling a square array of weakly coupled linear optical waveguides embedded in a nonlinear Kerr material, is studied. We find that despite a vanishing energy difference (Peierls-Nabarro barrier) of fundamental stationary modes the mobility of localized excitations is very poor. This is attributed to a large separation in…
▽ More
A two-dimensional nonlinear Schrodinger lattice with nonlinear coupling, modelling a square array of weakly coupled linear optical waveguides embedded in a nonlinear Kerr material, is studied. We find that despite a vanishing energy difference (Peierls-Nabarro barrier) of fundamental stationary modes the mobility of localized excitations is very poor. This is attributed to a large separation in parameter space of the bifurcation points of the involved stationary modes. At these points the stability of the fundamental modes is changed and an asymmetric intermediate solution appears that connects the points. The control of the power flow across the array when excited with plane waves is also addressed and shown to exhibit great flexibility that may lead to applications for power-coupling devices. In certain parameter regimes, the direction of a stable propagating plane-wave current is shown to be continuously tunable by amplitude variation (with fixed phase gradient). More exotic effects of the nonlinear coupling terms like compact discrete breathers and vortices, and stationary complex modes with non-trivial phase relations are also briefly discussed. Regimes of dynamical linear stability are found for all these types of solutions.
△ Less
Submitted 26 May, 2008;
originally announced May 2008.