-
Multiple and weak Markov properties in Hilbert spaces with applications to fractional stochastic evolution equations
Authors:
Kristin Kirchner,
Joshua Willems
Abstract:
We define various higher-order Markov properties for stochastic processes $(X(t))_{t\in \mathbb{T}}$, indexed by an interval $\mathbb{T} \subseteq \mathbb{R}$ and taking values in a real and separable Hilbert space $U$. We furthermore investigate the relations between them. In particular, for solutions to the stochastic evolution equation $\mathcal{L} X = \dot W^Q\!$, where $\mathcal{L}$ is a line…
▽ More
We define various higher-order Markov properties for stochastic processes $(X(t))_{t\in \mathbb{T}}$, indexed by an interval $\mathbb{T} \subseteq \mathbb{R}$ and taking values in a real and separable Hilbert space $U$. We furthermore investigate the relations between them. In particular, for solutions to the stochastic evolution equation $\mathcal{L} X = \dot W^Q\!$, where $\mathcal{L}$ is a linear operator acting on functions mapping from $\mathbb{T}$ to $U$ and $(\dot W^Q(t))_{t\in\mathbb{T}}$ is the formal derivative of a $U$-valued (cylindrical) $Q$-Wiener process, we prove necessary and sufficient conditions for the weakest Markov property via locality of the precision operator $\mathcal{L}^*\! \mathcal{L}$.
As an application, we consider the space-time fractional parabolic operator $\mathcal{L} = (\partial_t + A)^γ$ of order $γ\in (1/2,\infty)$, where $-A$ is a linear operator generating a $C_0$-semigroup on $U$. We prove that the resulting solution process satisfies an $N$th order Markov property if $γ= N \in \mathbb{N}$ and show that a necessary condition for the weakest Markov property is generally not satisfied if $γ\notin \mathbb{N}$. The relevance of this class of processes is twofold: Firstly, it can be seen as a spatiotemporal generalization of Whittle-Matérn Gaussian random fields if $U = L^2(\mathcal{D})$ for a spatial domain $\mathcal{D}\subseteq\mathbb{R}^d\!$. Secondly, we show that a $U$-valued analog to the fractional Brownian motion with Hurst parameter $H \in (0,1)$ can be obtained as the limiting case of $\mathcal{L} = (\partial_t + \varepsilon \, \mathrm{Id}_U)^{H + \frac{1}{2}}$ for $\varepsilon \downarrow 0$.
△ Less
Submitted 20 October, 2023;
originally announced October 2023.
-
Monte Carlo convergence rates for $k$th moments in Banach spaces
Authors:
Kristin Kirchner,
Christoph Schwab
Abstract:
We formulate standard and multilevel Monte Carlo methods for the $k$th moment $\mathbb{M}^k_\varepsilon[ξ]$ of a Banach space valued random variable $ξ\colonΩ\to E$, interpreted as an element of the $k$-fold injective tensor product space $\otimes^k_\varepsilon E$. For the standard Monte Carlo estimator of $\mathbb{M}^k_\varepsilon[ξ]$, we prove the $k$-independent convergence rate…
▽ More
We formulate standard and multilevel Monte Carlo methods for the $k$th moment $\mathbb{M}^k_\varepsilon[ξ]$ of a Banach space valued random variable $ξ\colonΩ\to E$, interpreted as an element of the $k$-fold injective tensor product space $\otimes^k_\varepsilon E$. For the standard Monte Carlo estimator of $\mathbb{M}^k_\varepsilon[ξ]$, we prove the $k$-independent convergence rate $1-\frac{1}{p}$ in the $L_q(Ω;\otimes^k_\varepsilon E)$-norm, provided that (i) $ξ\in L_{kq}(Ω;E)$ and (ii) $q\in[p,\infty)$, where $p\in[1,2]$ is the Rademacher type of $E$. By using the fact that Rademacher averages are dominated by Gaussian sums combined with a version of Slepian's inequality for Gaussian processes due to Fernique, we moreover derive corresponding results for multilevel Monte Carlo methods, including a rigorous error estimate in the $L_q(Ω;\otimes^k_\varepsilon E)$-norm and the optimization of the computational cost for a given accuracy. Whenever the type of the Banach space $E$ is $p=2$, our findings coincide with known results for Hilbert space valued random variables.
We illustrate the abstract results by three model problems: second-order elliptic PDEs with random forcing or random coefficient, and stochastic evolution equations. In these cases, the solution processes naturally take values in non-Hilbertian Banach spaces. Further applications, where physical modeling constraints impose a setting in Banach spaces of type $p<2$, are indicated.
△ Less
Submitted 17 July, 2023; v1 submitted 7 December, 2022;
originally announced December 2022.
-
Regularity theory for a new class of fractional parabolic stochastic evolution equations
Authors:
Kristin Kirchner,
Joshua Willems
Abstract:
A new class of fractional-order stochastic evolution equations of the form $(\partial_t + A)^γX(t) = \dot{W}^Q(t)$, $t\in[0,T]$, $γ\in (0,\infty)$, is introduced, where $-A$ generates a $C_0$-semigroup on a separable Hilbert space $H$ and the spatiotemporal driving noise $\dot{W}^Q$ is the formal time derivative of an $H$-valued cylindrical $Q$-Wiener process. Mild and weak solutions are defined;…
▽ More
A new class of fractional-order stochastic evolution equations of the form $(\partial_t + A)^γX(t) = \dot{W}^Q(t)$, $t\in[0,T]$, $γ\in (0,\infty)$, is introduced, where $-A$ generates a $C_0$-semigroup on a separable Hilbert space $H$ and the spatiotemporal driving noise $\dot{W}^Q$ is the formal time derivative of an $H$-valued cylindrical $Q$-Wiener process. Mild and weak solutions are defined; these concepts are shown to be equivalent and to lead to well-posed problems. Temporal and spatial regularity of the solution process $X$ are investigated, the former being measured by mean-square or pathwise smoothness and the latter by using domains of fractional powers of $A$. In addition, the covariance of $X$ and its long-time behavior are analyzed.
These abstract results are applied to the cases when $A := L^β$ and $Q:=\tilde{L}^{-α}$ are fractional powers of symmetric, strongly elliptic second-order differential operators defined on (i) bounded Euclidean domains or (ii) smooth, compact surfaces. In these cases, the Gaussian solution processes can be seen as generalizations of merely spatial (Whittle-)Matérn fields to space-time.
△ Less
Submitted 2 October, 2023; v1 submitted 30 April, 2022;
originally announced May 2022.
-
Multilevel approximation of Gaussian random fields: Covariance compression, estimation and spatial prediction
Authors:
Helmut Harbrecht,
Lukas Herrmann,
Kristin Kirchner,
Christoph Schwab
Abstract:
Centered Gaussian random fields (GRFs) indexed by compacta such as smooth, bounded Euclidean domains or smooth, compact and orientable manifolds are determined by their covariance operators. We consider centered GRFs given as variational solutions to coloring operator equations driven by spatial white noise, with an elliptic self-adjoint pseudodifferential coloring operator from the Hörmander clas…
▽ More
Centered Gaussian random fields (GRFs) indexed by compacta such as smooth, bounded Euclidean domains or smooth, compact and orientable manifolds are determined by their covariance operators. We consider centered GRFs given as variational solutions to coloring operator equations driven by spatial white noise, with an elliptic self-adjoint pseudodifferential coloring operator from the Hörmander class. This includes the Matérn class of GRFs as a special case. Using biorthogonal multiresolution analyses on the manifold, we prove that the precision and covariance operators, respectively, may be identified with bi-infinite matrices and finite sections may be diagonally preconditioned rendering the condition number independent of the dimension $p$ of this section. We prove that a tapering strategy by thresholding applied on finite sections of the bi-infinite precision and covariance matrices results in optimally numerically sparse approximations. That is, asymptotically only linearly many nonzero matrix entries are sufficient to approximate the original section of the bi-infinite covariance or precision matrix using this tapering strategy to arbitrary precision. The locations of these nonzero matrix entries are known a priori. The tapered covariance or precision matrices may also be optimally diagonally preconditioned. Analysis of the relative size of the entries of the tapered covariance matrices motivates novel, multilevel Monte Carlo (MLMC) oracles for covariance estimation, in sample complexity that scales log-linearly with respect to the number $p$ of parameters. In addition, we propose and analyze a novel compressive algorithm for simulating and kriging of GRFs. The complexity (work and memory vs. accuracy) of these three algorithms scales near-optimally in terms of the number of parameters $p$ of the sample-wise approximation of the GRF in Sobolev scales.
△ Less
Submitted 7 March, 2021;
originally announced March 2021.
-
Equivalence of measures and asymptotically optimal linear prediction for Gaussian random fields with fractional-order covariance operators
Authors:
David Bolin,
Kristin Kirchner
Abstract:
We consider Gaussian measures $μ, \tildeμ$ on a separable Hilbert space, with fractional-order covariance operators $A^{-2β}$ resp. $\tilde{A}^{-2\tildeβ}$, and derive necessary and sufficient conditions on $A, \tilde{A}$ and $β, \tildeβ > 0$ for I. equivalence of the measures $μ$ and $\tildeμ$, and II. uniform asymptotic optimality of linear predictions for $μ$ based on the misspecified measure…
▽ More
We consider Gaussian measures $μ, \tildeμ$ on a separable Hilbert space, with fractional-order covariance operators $A^{-2β}$ resp. $\tilde{A}^{-2\tildeβ}$, and derive necessary and sufficient conditions on $A, \tilde{A}$ and $β, \tildeβ > 0$ for I. equivalence of the measures $μ$ and $\tildeμ$, and II. uniform asymptotic optimality of linear predictions for $μ$ based on the misspecified measure $\tildeμ$. These results hold, e.g., for Gaussian processes on compact metric spaces. As an important special case, we consider the class of generalized Whittle-Matérn Gaussian random fields, where $A$ and $\tilde{A}$ are elliptic second-order differential operators, formulated on a bounded Euclidean domain $\mathcal{D}\subset\mathbb{R}^d$ and augmented with homogeneous Dirichlet boundary conditions. Our outcomes explain why the predictive performances of stationary and non-stationary models in spatial statistics often are comparable, and provide a crucial first step in deriving consistency results for parameter estimation of generalized Whittle-Matérn fields.
△ Less
Submitted 17 February, 2022; v1 submitted 19 January, 2021;
originally announced January 2021.
-
Necessary and sufficient conditions for asymptotically optimal linear prediction of random fields on compact metric spaces
Authors:
Kristin Kirchner,
David Bolin
Abstract:
Optimal linear prediction (aka. kriging) of a random field $\{Z(x)\}_{x\in\mathcal{X}}$ indexed by a compact metric space $(\mathcal{X},d_{\mathcal{X}})$ can be obtained if the mean value function $m\colon\mathcal{X}\to\mathbb{R}$ and the covariance function $\varrho\colon\mathcal{X}\times\mathcal{X}\to\mathbb{R}$ of $Z$ are known. We consider the problem of predicting the value of $Z(x^*)$ at som…
▽ More
Optimal linear prediction (aka. kriging) of a random field $\{Z(x)\}_{x\in\mathcal{X}}$ indexed by a compact metric space $(\mathcal{X},d_{\mathcal{X}})$ can be obtained if the mean value function $m\colon\mathcal{X}\to\mathbb{R}$ and the covariance function $\varrho\colon\mathcal{X}\times\mathcal{X}\to\mathbb{R}$ of $Z$ are known. We consider the problem of predicting the value of $Z(x^*)$ at some location $x^*\in\mathcal{X}$ based on observations at locations $\{x_j\}_{j=1}^n$ which accumulate at $x^*$ as $n\to\infty$ (or, more generally, predicting $\varphi(Z)$ based on $\{\varphi_j(Z)\}_{j=1}^n$ for linear functionals $\varphi,\varphi_1,\ldots,\varphi_n$). Our main result characterizes the asymptotic performance of linear predictors (as $n$ increases) based on an incorrect second order structure $(\tilde{m},\tilde{\varrho})$, without any restrictive assumptions on $\varrho,\tilde{\varrho}$ such as stationarity. We, for the first time, provide necessary and sufficient conditions on $(\tilde{m},\tilde{\varrho})$ for asymptotic optimality of the corresponding linear predictor holding uniformly with respect to $\varphi$. These general results are illustrated by weakly stationary random fields on $\mathcal{X}\subset\mathbb{R}^d$ with Matérn or periodic covariance functions, and on the sphere $\mathcal{X}=\mathbb{S}^2$ for the case of two isotropic covariance functions.
△ Less
Submitted 25 January, 2022; v1 submitted 18 May, 2020;
originally announced May 2020.
-
Regularity and convergence analysis in Sobolev and Hölder spaces for generalized Whittle-Matérn fields
Authors:
Sonja G. Cox,
Kristin Kirchner
Abstract:
We analyze several Galerkin approximations of a Gaussian random field $\mathcal{Z}\colon\mathcal{D}\timesΩ\to\mathbb{R}$ indexed by a Euclidean domain $\mathcal{D}\subset\mathbb{R}^d$ whose covariance structure is determined by a negative fractional power $L^{-2β}$ of a second-order elliptic differential operator $L:= -\nabla\cdot(A\nabla) + κ^2$. Under minimal assumptions on the domain…
▽ More
We analyze several Galerkin approximations of a Gaussian random field $\mathcal{Z}\colon\mathcal{D}\timesΩ\to\mathbb{R}$ indexed by a Euclidean domain $\mathcal{D}\subset\mathbb{R}^d$ whose covariance structure is determined by a negative fractional power $L^{-2β}$ of a second-order elliptic differential operator $L:= -\nabla\cdot(A\nabla) + κ^2$. Under minimal assumptions on the domain $\mathcal{D}$, the coefficients $A\colon\mathcal{D}\to\mathbb{R}^{d\times d}$, $κ\colon\mathcal{D}\to\mathbb{R}$, and the fractional exponent $β>0$, we prove convergence in $L_q(Ω; H^σ(\mathcal{D}))$ and in $L_q(Ω; C^δ(\overline{\mathcal{D}}))$ at (essentially) optimal rates for (i) spectral Galerkin methods and (ii) finite element approximations. Specifically, our analysis is solely based on $H^{1+α}(\mathcal{D})$-regularity of the differential operator $L$, where $0<α\leq 1$. For this setting, we furthermore provide rigorous estimates for the error in the covariance function of these approximations in $L_{\infty}(\mathcal{D}\times\mathcal{D})$ and in the mixed Sobolev space $H^{σ,σ}(\mathcal{D}\times\mathcal{D})$, showing convergence which is more than twice as fast compared to the corresponding $L_q(Ω; H^σ(\mathcal{D}))$-rate. For the well-known example of such Gaussian random fields, the original Whittle-Matérn class, where $L=-Δ+ κ^2$ and $κ\equiv \operatorname{const.}$, we perform several numerical experiments which validate our theoretical results.
△ Less
Submitted 13 April, 2019;
originally announced April 2019.
-
Weak convergence of Galerkin approximations for fractional elliptic stochastic PDEs with spatial white noise
Authors:
David Bolin,
Kristin Kirchner,
Mihály Kovács
Abstract:
The numerical approximation of the solution to a stochastic partial differential equation with additive spatial white noise on a bounded domain is considered. The differential operator is assumed to be a fractional power of an integer order elliptic differential operator. The solution is approximated by means of a finite element discretization in space and a quadrature approximation of an integral…
▽ More
The numerical approximation of the solution to a stochastic partial differential equation with additive spatial white noise on a bounded domain is considered. The differential operator is assumed to be a fractional power of an integer order elliptic differential operator. The solution is approximated by means of a finite element discretization in space and a quadrature approximation of an integral representation of the fractional inverse from the Dunford-Taylor calculus.
For the resulting approximation, a concise analysis of the weak error is performed. Specifically, for the class of twice continuously Fréchet differentiable functionals with second derivatives of polynomial growth, an explicit rate of weak convergence is derived, and it is shown that the component of the convergence rate stemming from the stochasticity is doubled compared to the corresponding strong rate. Numerical experiments for different functionals validate the theoretical results.
△ Less
Submitted 9 August, 2018; v1 submitted 14 November, 2017;
originally announced November 2017.
-
The rational SPDE approach for Gaussian random fields with general smoothness
Authors:
David Bolin,
Kristin Kirchner
Abstract:
A popular approach for modeling and inference in spatial statistics is to represent Gaussian random fields as solutions to stochastic partial differential equations (SPDEs) of the form $L^βu = \mathcal{W}$, where $\mathcal{W}$ is Gaussian white noise, $L$ is a second-order differential operator, and $β>0$ is a parameter that determines the smoothness of $u$. However, this approach has been limited…
▽ More
A popular approach for modeling and inference in spatial statistics is to represent Gaussian random fields as solutions to stochastic partial differential equations (SPDEs) of the form $L^βu = \mathcal{W}$, where $\mathcal{W}$ is Gaussian white noise, $L$ is a second-order differential operator, and $β>0$ is a parameter that determines the smoothness of $u$. However, this approach has been limited to the case $2β\in\mathbb{N}$, which excludes several important models and makes it necessary to keep $β$ fixed during inference.
We propose a new method, the rational SPDE approach, which in spatial dimension $d\in\mathbb{N}$ is applicable for any $β>d/4$, and thus remedies the mentioned limitation. The presented scheme combines a finite element discretization with a rational approximation of the function $x^{-β}$ to approximate $u$. For the resulting approximation, an explicit rate of convergence to $u$ in mean-square sense is derived. Furthermore, we show that our method has the same computational benefits as in the restricted case $2β\in\mathbb{N}$. Several numerical experiments and a statistical application are used to illustrate the accuracy of the method, and to show that it facilitates likelihood-based inference for all model parameters including $β$.
△ Less
Submitted 1 December, 2019; v1 submitted 12 November, 2017;
originally announced November 2017.
-
Numerical solution of fractional elliptic stochastic PDEs with spatial white noise
Authors:
David Bolin,
Kristin Kirchner,
Mihály Kovács
Abstract:
The numerical approximation of solutions to stochastic partial differential equations with additive spatial white noise on bounded domains in $\mathbb{R}^d$ is considered. The differential operator is given by the fractional power $L^β$, $β\in(0,1)$, of an integer order elliptic differential operator $L$ and is therefore non-local. Its inverse $L^{-β}$ is represented by a Bochner integral from the…
▽ More
The numerical approximation of solutions to stochastic partial differential equations with additive spatial white noise on bounded domains in $\mathbb{R}^d$ is considered. The differential operator is given by the fractional power $L^β$, $β\in(0,1)$, of an integer order elliptic differential operator $L$ and is therefore non-local. Its inverse $L^{-β}$ is represented by a Bochner integral from the Dunford-Taylor functional calculus. By applying a quadrature formula to this integral representation, the inverse fractional power operator $L^{-β}$ is approximated by a weighted sum of non-fractional resolvents $(I + t_j^2 L)^{-1}$ at certain quadrature nodes $t_j>0$. The resolvents are then discretized in space by a standard finite element method.
This approach is combined with an approximation of the white noise, which is based only on the mass matrix of the finite element discretization. In this way, an efficient numerical algorithm for computing samples of the approximate solution is obtained. For the resulting approximation, the strong mean-square error is analyzed and an explicit rate of convergence is derived. Numerical experiments for $L=κ^2-Δ$, $κ> 0$, with homogeneous Dirichlet boundary conditions on the unit cube $(0,1)^d$ in $d=1,2,3$ spatial dimensions for varying $β\in(0,1)$ attest the theoretical results.
△ Less
Submitted 11 January, 2018; v1 submitted 18 May, 2017;
originally announced May 2017.
-
Numerical methods for the deterministic second moment equation of parabolic stochastic PDEs
Authors:
Kristin Kirchner
Abstract:
Numerical methods for stochastic partial differential equations typically estimate moments of the solution from sampled paths. Instead, we shall directly target the deterministic equations satisfied by the first and second moments, as well as the covariance.
In the first part, we focus on stochastic ordinary differential equations. For the canonical examples with additive noise (Ornstein-Uhlenbe…
▽ More
Numerical methods for stochastic partial differential equations typically estimate moments of the solution from sampled paths. Instead, we shall directly target the deterministic equations satisfied by the first and second moments, as well as the covariance.
In the first part, we focus on stochastic ordinary differential equations. For the canonical examples with additive noise (Ornstein-Uhlenbeck process) or multiplicative noise (geometric Brownian motion) we derive these deterministic equations in variational form and discuss their well-posedness in detail. Notably, the second moment equation in the multiplicative case is naturally posed on projective-injective tensor product spaces as trial-test spaces. We construct Petrov-Galerkin discretizations based on tensor product piecewise polynomials and analyze their stability and convergence in these natural norms.
In the second part, we proceed with parabolic stochastic partial differential equations with affine multiplicative noise. We prove well-posedness of the deterministic variational problem for the second moment, improving an earlier result. We then propose conforming space-time Petrov-Galerkin discretizations, which we show to be stable and quasi-optimal.
In both parts, the outcomes are illustrated by numerical examples.
△ Less
Submitted 19 April, 2018; v1 submitted 7 November, 2016;
originally announced November 2016.
-
Covariance structure of parabolic stochastic partial differential equations with multiplicative Lévy noise
Authors:
Kristin Kirchner,
Annika Lang,
Stig Larsson
Abstract:
The characterization of the covariance function of the solution process to a stochastic partial differential equation is considered in the parabolic case with multiplicative Lévy noise of affine type. For the second moment of the mild solution, a well-posed deterministic space-time variational problem posed on projective and injective tensor product spaces is derived, which subsequently leads to a…
▽ More
The characterization of the covariance function of the solution process to a stochastic partial differential equation is considered in the parabolic case with multiplicative Lévy noise of affine type. For the second moment of the mild solution, a well-posed deterministic space-time variational problem posed on projective and injective tensor product spaces is derived, which subsequently leads to a deterministic equation for the covariance function.
△ Less
Submitted 16 April, 2016; v1 submitted 1 June, 2015;
originally announced June 2015.
