Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
\addbibresource

biblio.bib

Dynamical Low-Rank Approximation for
Stochastic Differential Equations

Yoshihito Kazashi Department of Mathematics & Statistics, University of Strathclyde, 26 Richmond St., Glasgow, G1 1XH, UK. email: y.kazashi@strath.ac.uk Fabio Nobile Institut de Mathématiques, École Polytechnique Fédérale de Lausanne, 1015 Lausanne, Switzerland. email: fabio.nobile@epfl.ch Fabio Zoccolan Institut de Mathématiques, École Polytechnique Fédérale de Lausanne, 1015 Lausanne, Switzerland. email: fabio.zoccolan@epfl.ch
Abstract

In this paper, we set the mathematical foundations of the Dynamical Low-Rank Approximation (DLRA) method for stochastic differential equations (SDEs). DLRA aims at approximating the solution as a linear combination of a small number of basis vectors with random coefficients (low rank format) with the peculiarity that both the basis vectors and the random coefficients vary in time.

While the formulation and properties of DLRA are now well understood for random/parametric equations, the same cannot be said for SDEs and this work aims to fill this gap. We start by rigorously formulating a Dynamically Orthogonal (DO) approximation (an instance of DLRA successfully used in applications) for SDEs, which we then generalize to define a parametrization independent DLRA for SDEs. We show local well-posedness of the DO equations and their equivalence with the DLRA formulation. We also characterize the explosion time of the DO solution by a loss of linear independence of the random coefficients defining the solution expansion and give sufficient conditions for global existence.

1 Introduction

This paper is concerned with the theoretical foundation of dynamical low-rank methods for stochastic differential equations (SDEs). Low-rank methods aim to approximate solutions of high-dimensional differential equations in a well chosen low dimensional subspace. Such methods are widely used in computational science and industrial applications [Bachmayr.M_2023_LowrankTensorMethods, lubich2008quantum, quarteroni2014reduced, schilders2008model]. Our focus here is on low-rank methods for high-dimensional SDEs, which is a case of primary interest, for instance in finance [redmann2021low, redmann2022solving], or in various applications such as biology [adamer2020coloured] or machine learning [muzellec2022dimension] where SDEs often appear as discretizations of Stochastic Partial Differential Equations (SPDEs).

Among such low-rank methods, the so-called Dynamical Low-Rank Approximation (DLRA) has gained notable attention and has been successfully applied in many applications in recent years [koch2007dynamical, kieri2016discretized, nonnenmacher2008dynamical]. Unlike traditional reduced basis methods, however, DLRA allows the low-dimensional subspace to evolve over time, enabling it to adapt to possibly rapid temporal variations of the solution. Thus DLRA evolves in a low-rank manifold, not in a fixed linear space of low dimension. In its original form [koch2007dynamical], such evolution in a manifold is achieved by enforcing the temporal derivative of the DLRA to be in the corresponding tangent space, which requires the differentiability of the approximate solution in time.

An equivalent formulation of the DLRA is the Dynamically Orthogonal (DO) approximation [sapsis2009dynamically]. This strategy can approximate random time-dependent equations by using a sum of a small number of products between spatial and stochastic basis functions, thus leading to a low-rank approximation with explicit parametrization of the low-rank factors. In the context of random partial differential equations (RPDEs), the DO/DLRA methodology has been successfully applied in several problems, showing promising computational results [choi2014equivalence, cheng2013dynamically, cheng2013dynamicallyII, feppon2018dynamically, musharbash2015error, musharbash2018dual, musharbash2020symplectic, kazashi2021stability, sapsis2009dynamically].

The goal of this work is to set a theoretical framework of DLRA for SDEs. This is a challenging task, because, unlike the RPDEs setting, the differentiability in time of the solution cannot be exploited due to the presence of the rough diffusion term. Our approach is to first define DO dynamics for a general SDE, specifying conditions for the well-posedness of this framework. From this DO system, we derive an equation that is independent of the parametrization. We define DLRA for SDEs as the solution to this parameter-independent equation, and show that these DO and DLRA methodologies are equivalent.

The DO approximation is given by the solution of a system of equations, which provide the evolution of the deterministic and stochastic basis functions. This system is however highly nonlinear, even if the original dynamics was linear. In addition, its well-posedness is not obvious due to the presence of the inverse of a Gramian, which is not guaranteed to exist at all times. Moreover, in the specific case of SDEs, the DO solution depends on the law of the whole process at every instant of time. These features make the well-posedness study challenging and not-standard, questioning also whether the existence of solutions is global or only local and, in the latter case, what happens to the solution at the explosion time. Besides being of interest in itself, a well-posedness study of the DO equations is also important to derive consistent and stable time discretization schemes, which are eventually needed to apply these techniques in real-life problems.

For RPDEs, theoretical results on the existence and uniqueness of the solution of the DO equations [kazashi2021existence], as well as stability and error estimates of time discretization schemes [kazashi2021stability, musharbash2015error, vidlickova2022dynamical] are available. An existence and uniqueness result is also available for the DLR approximation of two-dimensional deterministic PDEs [bachmayr2021existence], where the sum involves products of basis functions for the different spatial variables. In contrast, for SDEs well-posedness results remain largely unexplored. This lack of theory for SDEs is unfortunate, since DO approximations are very appealing and, despite no results on its well-posedness, have been also used in several problems modeled by SDEs (see e.g. [sapsis2009dynamically, sapsis2013blended, sapsis2013blending, ueckermann2013numerical]). The reader can find other approaches of initiating a DLRA framework starting from the Fokker-Plank equation in [sapsis2009dynamically, cao2018stochastic].

This paper aims at filling this gap between application and theory by:

  • (Re-)deriving the DO equations for SDEs. We also derive the corresponding parametrization independent DLRA equation for SDEs.

  • Showing the equivalence between DO approximation and DLRA. By exploiting this equivalence, we show that the DO equations and the DLRA equation are well-posed.

  • Characterising the finite explosion time in terms of the linear independence of the stochastic DO basis.

  • Discussing the extension of DLRA beyond the explosion time. We also provide a sufficient condition under which the DO/DLRA solution exists globally.

More precisely, we start by revisiting the DO equations for SDEs, which were originally derived in [sapsis2009dynamically] relying on the formal assumption that the DO solution is time differentiable, a property that SDE solutions do not possess. Deriving DO equations without using the time derivatives is a fundamental challenge, since the essence of the usual DLRA methodology consists in projecting the time derivative onto the tangent space of the low-rank manifold. We overcome this challenge by pushing the differentiability to the spatial basis, while the stochastic basis remains non-differentiable. It turns out that this alternative approach leads to the same DO equations as in [sapsis2009dynamically], supporting their validity as a correct dynamical low-rank approximation.

In the DLRA literature [koch2007dynamical, kieri2016discretized], it is well known by now that, when applied to RPDEs, the DO formulation is just a specific parametrization of the DLRA, the parameters being the deterministic and stochastic time-dependent bases defining the DO solution [musharbash2015error, kazashi2021existence]. In this paper, we derive an analogous result for SDEs. In particular, starting from the DO equations, we derive a parameter independent low-rank approximation which we name DLRA for SDEs, and show its equivalence with the DO formulation. The main result of this work is to prove local existence and uniqueness to both DO and DLRA equations. As a part of our existence result, we give a characterisation of the interval [0,Te)0subscript𝑇𝑒[0,T_{e})[ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) on which the solution exists. More specifically, we show that, if the explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT is finite, then the stochastic DO basis must become linearly dependent at Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT.

Although the characterisation of the explosion time provides us a valuable insight into the DO solution, it is not satisfactory from the practical point of view; if the true solution still exists at Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT and beyond, we expect any sensible approximation to exist as well. Under some mild integrability condition on the initial datum, we show that, while the DO solution ceases to exist at the explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT, the DLRA can be continuously extended up to Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT and beyond. Thus, our findings offer insights on how to continue a DO approximation beyond the explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT. As a final result, we show that a sufficient condition for global existence of a DO solution (i.e. Te=+subscript𝑇𝑒T_{e}=+\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT = + ∞) is that the noise in the SDE is non-degenerate.

In passing, we point out that the DO/DLRA equation derived in this work cannot be regarded as a trivial application of the standard theory of SDEs on manifolds (see e.g. [gliklikh2010global, hsu2002stochastic]). Indeed, the projection operator employed in the DO decomposition is not standard, as it also involves a purely stochastic term that depends on the average of all paths.

The rest of the paper is organised as follows. Section 2 introduces the DO equations, together with theoretical justifications for why they are sensible. Furthermore, it introduces a DLRA formulation that does not depend on the parametrization. Section 3 concerns the local well-posedness of the DO equations, where we also show the continuity of the solution with respect to the initial data. In Section 4, we study the behaviour of the solution up to and beyond the explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT. In Section 5 we draw some conclusions and perspectives.

2 The DO equations

Let (Ω,,;(t)t0)Ωsubscriptsubscript𝑡𝑡0(\Omega,\mathscr{F},\mathbb{P};(\mathscr{F}_{t})_{t\geq 0})( roman_Ω , script_F , blackboard_P ; ( script_F start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ≥ 0 end_POSTSUBSCRIPT ) be a filtered complete probability space with the usual conditions; see for example [schilling2021brownian, Remark 6.24]. Consider the stochastic differential equation (SDE)

Xtrue(t)=X0true+0ta(s,Xtrue(s))𝑑s+0tb(s,Xtrue(s))𝑑Ws,superscript𝑋true𝑡superscriptsubscript𝑋0truesuperscriptsubscript0𝑡𝑎𝑠superscript𝑋true𝑠differential-d𝑠superscriptsubscript0𝑡𝑏𝑠superscript𝑋true𝑠differential-dsubscript𝑊𝑠X^{\mathrm{true}}(t)=X_{0}^{\mathrm{true}}+\int_{0}^{t}a(s,X^{\mathrm{true}}(s% ))\,ds+\int_{0}^{t}b(s,X^{\mathrm{true}}(s))\,dW_{s},italic_X start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT ( italic_t ) = italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT italic_a ( italic_s , italic_X start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT ( italic_s ) ) italic_d italic_s + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT italic_b ( italic_s , italic_X start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT ( italic_s ) ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT , (2.1)

where Wt=(Wt1,,Wtm)subscript𝑊𝑡superscriptsubscriptsuperscript𝑊1𝑡subscriptsuperscript𝑊𝑚𝑡topW_{t}=(W^{1}_{t},\dots,W^{m}_{t})^{\top}italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = ( italic_W start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , … , italic_W start_POSTSUPERSCRIPT italic_m end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT is a standard m𝑚mitalic_m-dimensional (t)subscript𝑡(\mathscr{F}_{t})( script_F start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT )-Brownian motion. Here, we used the notation Xtrue(t,ω)=(X1true(t,ω),,Xdtrue(t,ω))dsuperscript𝑋true𝑡𝜔superscriptsuperscriptsubscript𝑋1true𝑡𝜔superscriptsubscript𝑋𝑑true𝑡𝜔topsuperscript𝑑X^{\mathrm{true}}(t,\omega)=(X_{1}^{\mathrm{true}}(t,\omega),\dots,X_{d}^{% \mathrm{true}}(t,\omega))^{\top}\in\mathbb{R}^{d}italic_X start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT ( italic_t , italic_ω ) = ( italic_X start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT ( italic_t , italic_ω ) , … , italic_X start_POSTSUBSCRIPT italic_d end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT ( italic_t , italic_ω ) ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT for t0𝑡0t\geq 0italic_t ≥ 0 and ωΩ𝜔Ω\omega\in\Omegaitalic_ω ∈ roman_Ω. Let |||\cdot|| ⋅ | and F\|\cdot\|_{\mathrm{F}}∥ ⋅ ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT denote the Euclidean norm and the Frobenius norm, respectively. We work with the following general assumptions on the coefficients of the SDE (2.1).

Assumption 0.

The drift coefficient a:[0,)×dd:𝑎0superscript𝑑superscript𝑑a\colon[0,\infty)\times\mathbb{R}^{d}\to\mathbb{R}^{d}italic_a : [ 0 , ∞ ) × blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT → blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT and the diffusion coefficient b:[0,)×dd×m:𝑏0superscript𝑑superscript𝑑𝑚b\colon[0,\infty)\times\mathbb{R}^{d}\to\mathbb{R}^{d\times m}italic_b : [ 0 , ∞ ) × blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT → blackboard_R start_POSTSUPERSCRIPT italic_d × italic_m end_POSTSUPERSCRIPT are jointly measurable and Lipschitz continuous with respect to the second variable, uniformly in time, i.e.

{|a(s,x)a(s,y)|CLip|xy|b(s,x)b(s,y)FCLip|xy|,casesotherwise𝑎𝑠𝑥𝑎𝑠𝑦subscript𝐶Lip𝑥𝑦otherwisesubscriptnorm𝑏𝑠𝑥𝑏𝑠𝑦Fsubscript𝐶Lip𝑥𝑦\begin{cases}\!\!\!\!&|a(s,x)-a(s,y)|\leq C_{\mathrm{Lip}}|x-y|\\ \!\!\!\!&\|b(s,x)-b(s,y)\|_{\mathrm{F}}\leq C_{\mathrm{Lip}}|x-y|,\end{cases}{ start_ROW start_CELL end_CELL start_CELL | italic_a ( italic_s , italic_x ) - italic_a ( italic_s , italic_y ) | ≤ italic_C start_POSTSUBSCRIPT roman_Lip end_POSTSUBSCRIPT | italic_x - italic_y | end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL ∥ italic_b ( italic_s , italic_x ) - italic_b ( italic_s , italic_y ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ italic_C start_POSTSUBSCRIPT roman_Lip end_POSTSUBSCRIPT | italic_x - italic_y | , end_CELL end_ROW (2.2)

for some constant CLip>0subscript𝐶Lip0C_{\mathrm{Lip}}>0italic_C start_POSTSUBSCRIPT roman_Lip end_POSTSUBSCRIPT > 0.

Assumption 0.

The drift a𝑎aitalic_a and the diffusion b𝑏bitalic_b satisfy the following linear-growth bound condition uniformly in time:

|a(s,x)|2+b(s,x)F2Clgb(1+|x|2)superscript𝑎𝑠𝑥2superscriptsubscriptnorm𝑏𝑠𝑥F2subscript𝐶lgb1superscript𝑥2|a(s,x)|^{2}+\|b(s,x)\|_{\mathrm{F}}^{2}\leq C_{\mathrm{lgb}}(1+|x|^{2})| italic_a ( italic_s , italic_x ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ∥ italic_b ( italic_s , italic_x ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + | italic_x | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) (2.3)

for some constant Clgb>0subscript𝐶lgb0C_{\mathrm{lgb}}>0italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT > 0.

The choice of the Frobenius norm in Assumption 2 is made primarily for convenience when utilizing Ito’s isometry; this is standard practice. Since we are in a finite-dimensional setting, the results presented in this work remain valid under Lipschitz continuity with respect to other norms, with a modified constant. It is also worth mentioning that in the infinite-dimensional case, Lipschitz continuity is typically considered with respect to the Hilbert–Schmidt norm between appropriate spaces; see for example [da2014stochastic]; hence our choice of the Frobenius norm is a first step in this direction. Furthermore, we assume that the initial condition X0truesuperscriptsubscript𝑋0trueX_{0}^{\mathrm{true}}italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT in (2.1) satisfies the following:

Assumption 0.
X0true is 0-measurable and satisfies 𝔼[|X0true|2]<+.subscriptsuperscript𝑋true0 is subscript0-measurable and satisfies 𝔼delimited-[]superscriptsubscriptsuperscript𝑋true02X^{\mathrm{true}}_{0}\mbox{ is }\mathcal{F}_{0}\mbox{-measurable and satisfies% }\mathbb{E}[|X^{\mathrm{true}}_{0}|^{2}]<+\infty.italic_X start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT is caligraphic_F start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT -measurable and satisfies blackboard_E [ | italic_X start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] < + ∞ . (2.4)

Under these assumptions, equation (2.1) has a unique strong solution; see for example [schilling2021brownian, Theorem 21.13].

Let us consider a positive integer R𝑅Ritalic_R such that Rd𝑅𝑑R\leq ditalic_R ≤ italic_d. To numerically approximate (2.1), in this work we consider dynamically orthogonal approximations of the form

XtrueX:=𝑼𝒀:=j=1RUjYjd,superscript𝑋true𝑋assignsuperscript𝑼top𝒀assignsuperscriptsubscript𝑗1𝑅superscript𝑈𝑗superscript𝑌𝑗superscript𝑑X^{\mathrm{true}}\approx X:=\boldsymbol{U}^{\top}\boldsymbol{Y}:=\sum_{j=1}^{R% }U^{j}Y^{j}\in\mathbb{R}^{d},italic_X start_POSTSUPERSCRIPT roman_true end_POSTSUPERSCRIPT ≈ italic_X := bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y := ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_U start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT italic_Y start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT , (2.5)

where 𝑼=(𝑼t)t[0,T]𝑼subscriptsubscript𝑼𝑡𝑡0𝑇\boldsymbol{U}=\left(\boldsymbol{U}_{t}\right)_{t\in[0,T]}bold_italic_U = ( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT is a deterministic absolutely continuous matrix-valued function that gives a matrix in R×dsuperscript𝑅𝑑\mathbb{R}^{R\times d}blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT with orthogonal rows for all t𝑡titalic_t, whereas 𝒀=(𝒀t)t[0,T]𝒀subscriptsubscript𝒀𝑡𝑡0𝑇\boldsymbol{Y}=(\boldsymbol{Y}_{t})_{t\in[0,T]}bold_italic_Y = ( bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT is an Itô process with values in Rsuperscript𝑅\mathbb{R}^{R}blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT with linearly independent components for all t𝑡titalic_t. It is worth pointing out that for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ] and ωΩ𝜔Ω\omega\in\Omegaitalic_ω ∈ roman_Ω, the approximate process Xt(ω)subscript𝑋𝑡𝜔X_{t}(\omega)italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( italic_ω ) belongs to an R𝑅Ritalic_R dimensional vector space span{Ut1,,UtR}spansubscriptsuperscript𝑈1𝑡subscriptsuperscript𝑈𝑅𝑡\mathrm{span}\{U^{1}_{t},\dots,U^{R}_{t}\}roman_span { italic_U start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , … , italic_U start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT } spanned by the rows Ut1,,UtRsubscriptsuperscript𝑈1𝑡subscriptsuperscript𝑈𝑅𝑡U^{1}_{t},\dots,U^{R}_{t}italic_U start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , … , italic_U start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT of 𝑼tsubscript𝑼𝑡\boldsymbol{U}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, whereas each component Xtj,j=1,,dformulae-sequencesubscriptsuperscript𝑋𝑗𝑡𝑗1𝑑X^{j}_{t},j=1,\dots,ditalic_X start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , italic_j = 1 , … , italic_d, belongs to span{Yt1,,YtR}spansuperscriptsubscript𝑌𝑡1superscriptsubscript𝑌𝑡𝑅\mathrm{span}\{Y_{t}^{1},\dots,Y_{t}^{R}\}roman_span { italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT , … , italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT }.

Approximations of the form (2.5) for SDEs have been considered already in [sapsis2009dynamically], where the following evolution equations, hereafter called DO equations were derived for the factors (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) by using the same formal procedure as for ODEs via treating the process 𝒀𝒀\boldsymbol{Y}bold_italic_Y as differentiable in time:

C𝒀t𝑼˙tsubscript𝐶subscript𝒀𝑡subscript˙𝑼𝑡\displaystyle{C}_{\boldsymbol{Y}_{t}}\dot{\boldsymbol{U}}_{t}italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT =𝔼[𝒀ta(t,𝑼t𝒀t)](Id×dP𝑼trow),absent𝔼delimited-[]subscript𝒀𝑡𝑎superscript𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡topsubscript𝐼𝑑𝑑superscriptsubscript𝑃subscript𝑼𝑡row\displaystyle=\mathbb{E}[\boldsymbol{Y}_{t}a(t,\boldsymbol{U}_{t}^{\top}% \boldsymbol{Y}_{t})^{\top}](I_{d\times d}-P_{\boldsymbol{U}_{t}}^{\mathrm{row}% }),= blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT ) , (2.6)
d𝒀t𝑑subscript𝒀𝑡\displaystyle d\boldsymbol{Y}_{t}italic_d bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT =𝑼ta(t,𝑼t𝒀t)dt+𝑼tb(t,𝑼t𝒀t)dWt.absentsubscript𝑼𝑡𝑎𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡𝑑𝑡subscript𝑼𝑡𝑏𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡𝑑subscript𝑊𝑡\displaystyle=\boldsymbol{U}_{t}a(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t% })\,dt+\boldsymbol{U}_{t}b(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t})dW_{t}.= bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_t + bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT . (2.7)

Here, we let C𝒀t:=𝔼[𝒀t𝒀t]{C}_{\boldsymbol{Y}_{t}}:=\mathbb{E}[\boldsymbol{Y}_{t}\boldsymbol{Y}_{t}{}^{% \top}]italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT := blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_FLOATSUPERSCRIPT ⊤ end_FLOATSUPERSCRIPT ] whereas P𝑼trowd×dsuperscriptsubscript𝑃subscript𝑼𝑡rowsuperscript𝑑𝑑P_{\boldsymbol{U}_{t}}^{\mathrm{row}}\in\mathbb{R}^{d\times d}italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d × italic_d end_POSTSUPERSCRIPT denotes the projection-matrix onto the row space span{Ut1,,UtR}dspansuperscriptsubscript𝑈𝑡1superscriptsubscript𝑈𝑡𝑅superscript𝑑\mathrm{span}\{U_{t}^{1},\dots,U_{t}^{R}\}\subset\mathbb{R}^{d}roman_span { italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT , … , italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT } ⊂ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT of 𝑼tsubscript𝑼𝑡\boldsymbol{U}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT; when 𝑼tsubscript𝑼𝑡\boldsymbol{U}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT has orthonormal rows, one has P𝑼trow=𝑼t𝑼tsuperscriptsubscript𝑃subscript𝑼𝑡rowsuperscriptsubscript𝑼𝑡topsubscript𝑼𝑡P_{\boldsymbol{U}_{t}}^{\mathrm{row}}=\boldsymbol{U}_{t}^{\top}\boldsymbol{U}_% {t}italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT = bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT. In Section 2.1, we will give a rigorous justification for (2.6) and (2.7).

Having stated these equations, we now define our notion of strong DO solution and DO approximation for an SDE problem of the type (2.1).

{defn}

[Strong DO solution] A function (𝑼,𝒀):[0,T]R×d×L2(Ω;R):𝑼𝒀0𝑇superscript𝑅𝑑superscript𝐿2Ωsuperscript𝑅(\boldsymbol{U},\boldsymbol{Y}):[0,T]\to\mathbb{R}^{R\times d}\times L^{2}(% \Omega;\mathbb{R}^{R})( bold_italic_U , bold_italic_Y ) : [ 0 , italic_T ] → blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT × italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) is called a strong DO solution for (2.1) if the following conditions are satisfied:

  1. 1.

    the initial conditions (𝑼0,𝒀0)subscript𝑼0subscript𝒀0(\boldsymbol{U}_{0},\boldsymbol{Y}_{0})( bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT , bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ) are such that 𝑼0R×dsubscript𝑼0superscript𝑅𝑑\boldsymbol{U}_{0}\in\mathbb{R}^{R\times d}bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT is a matrix with orthonormal rows and 𝒀0L2(Ω;R)subscript𝒀0superscript𝐿2Ωsuperscript𝑅\boldsymbol{Y}_{0}\in L^{2}(\Omega;\mathbb{R}^{R})bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) has linearly independent components;

  2. 2.

    the curve t𝑼tR×d𝑡subscript𝑼𝑡superscript𝑅𝑑t\to\boldsymbol{U}_{t}\in\mathbb{R}^{R\times d}italic_t → bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT is absolutely continuous on [0,T]0𝑇[0,T][ 0 , italic_T ] and 𝑼t𝑼˙t=0R×Rsubscript𝑼𝑡subscriptsuperscript˙𝑼top𝑡0superscript𝑅𝑅\boldsymbol{U}_{t}\dot{\boldsymbol{U}}^{\top}_{t}=0\in\mathbb{R}^{R\times R}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over˙ start_ARG bold_italic_U end_ARG start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = 0 ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT for a.e. t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ];

  3. 3.

    the curve t𝒀t(ω)R𝑡subscript𝒀𝑡𝜔superscript𝑅t\to\boldsymbol{Y}_{t}(\omega)\in\mathbb{R}^{R}italic_t → bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( italic_ω ) ∈ blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT has almost surely continuous paths on [0,T]0𝑇[0,T][ 0 , italic_T ] and it is tsubscript𝑡\mathscr{F}_{t}script_F start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT-measurable for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ]. Moreover, for any t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ] the components Yt1,,YtRsubscriptsuperscript𝑌1𝑡subscriptsuperscript𝑌𝑅𝑡Y^{1}_{t},\dots,Y^{R}_{t}italic_Y start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , … , italic_Y start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT are linearly independent in L2(Ω)superscript𝐿2ΩL^{2}(\Omega)italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω );

  4. 4.

    𝑼𝑼\boldsymbol{U}bold_italic_U satisfies equation (2.6) for a.e. t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ] and 𝒀𝒀\boldsymbol{Y}bold_italic_Y is a strong solution of (2.7) on [0,T]0𝑇[0,T][ 0 , italic_T ].

We remark that points (1) and (2) in Definition 2 imply that 𝑼𝑼\boldsymbol{U}bold_italic_U has orthonormal rows for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ], i.e.  𝑼t𝑼t=IR×Rsubscript𝑼𝑡subscriptsuperscript𝑼top𝑡𝐼superscript𝑅𝑅\boldsymbol{U}_{t}\boldsymbol{U}^{\top}_{t}=I\in\mathbb{R}^{R\times R}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_I ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ]. Furthermore, the term “strong” in Definition 2 follows the standard terminology for the solution of SDEs: we seek a solution on the given probability space and Brownian motion. See for example [karatzas2012brownian] for more details. For convenience, given a DO solution (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) we call the product 𝑼𝒀superscript𝑼top𝒀\boldsymbol{U}^{\top}\boldsymbol{Y}bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y a DO approximation. {defn}[DO approximation] We call a process X:[0,T]L2(Ω;d):𝑋0𝑇superscript𝐿2Ωsuperscript𝑑X:[0,T]\to L^{2}(\Omega;\mathbb{R}^{d})italic_X : [ 0 , italic_T ] → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) a DO approximation of (2.1) if there exists a strong DO solution (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) such that Xt:=𝑼t𝒀tassignsubscript𝑋𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡X_{t}:=\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t}italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT := bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ]. Given a DO approximation X𝑋Xitalic_X, the corresponding DO solution (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) is determined only up to a (process of) rotation matrix. Indeed, let (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) and (𝑼~,𝒀~)~𝑼~𝒀(\tilde{\boldsymbol{U}},\tilde{\boldsymbol{Y}})( over~ start_ARG bold_italic_U end_ARG , over~ start_ARG bold_italic_Y end_ARG ) be two strong DO solutions such that 𝑼t𝒀t=𝑼~t𝒀~t=Xtsuperscriptsubscript𝑼𝑡topsubscript𝒀𝑡subscriptsuperscript~𝑼top𝑡subscript~𝒀𝑡subscript𝑋𝑡\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t}=\tilde{\boldsymbol{U}}^{\top}_{t}% \tilde{\boldsymbol{Y}}_{t}=X_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = over~ start_ARG bold_italic_U end_ARG start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT for all t0𝑡0t\geq 0italic_t ≥ 0. Then the orthogonality of the rows of 𝑼tsubscript𝑼𝑡\boldsymbol{U}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT implies 𝒀~t=Ot𝒀tsubscript~𝒀𝑡subscript𝑂𝑡subscript𝒀𝑡\tilde{\boldsymbol{Y}}_{t}=O_{t}\boldsymbol{Y}_{t}over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_O start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT with Ot=𝑼~t𝑼tsubscript𝑂𝑡subscript~𝑼𝑡superscriptsubscript𝑼𝑡topO_{t}=\tilde{\boldsymbol{U}}_{t}\boldsymbol{U}_{t}^{\top}italic_O start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT. The matrix Otsubscript𝑂𝑡O_{t}italic_O start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT is orthogonal for every t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ], but not necessarily an identity. See Section 2.3, in particular Proposition 2.7, for more details.

2.1 Consistency of the DO equations

In this section, we rigorously show the consistency of the DO equations (2.6) and (2.7) in the sense described hereafter. Assume that the exact solution of (2.1) is of the form X=j=1RUjYj𝑋superscriptsubscript𝑗1𝑅superscript𝑈𝑗superscript𝑌𝑗X=\sum_{j=1}^{R}U^{j}Y^{j}italic_X = ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_U start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT italic_Y start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT with deterministic function 𝑼t=(Ut1,,UtR)R×dsubscript𝑼𝑡superscriptsuperscriptsubscript𝑈𝑡1superscriptsubscript𝑈𝑡𝑅topsuperscript𝑅𝑑\boldsymbol{U}_{t}=(U_{t}^{1},\dots,U_{t}^{R})^{\top}\in\mathbb{R}^{R\times d}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = ( italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT , … , italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT and an Itô process 𝒀t(ω)=(Yt1(ω),,YtR(ω))[L2(Ω)]Rsubscript𝒀𝑡𝜔superscriptsuperscriptsubscript𝑌𝑡1𝜔superscriptsubscript𝑌𝑡𝑅𝜔topsuperscriptdelimited-[]superscript𝐿2Ω𝑅\boldsymbol{Y}_{t}(\omega)=(Y_{t}^{1}(\omega),\dots,Y_{t}^{R}(\omega))^{\top}% \in[L^{2}(\Omega)]^{R}bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( italic_ω ) = ( italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT ( italic_ω ) , … , italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ( italic_ω ) ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT for some Rd𝑅𝑑R\leq ditalic_R ≤ italic_d that fulfil the following properties:

  1. 1.

    the function [0,T]t𝑼tR×dcontains0𝑇𝑡maps-tosubscript𝑼𝑡superscript𝑅𝑑[0,T]\ni t\mapsto\boldsymbol{U}_{t}\in\mathbb{R}^{R\times d}[ 0 , italic_T ] ∋ italic_t ↦ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT, dR𝑑𝑅d\geq Ritalic_d ≥ italic_R, is absolutely continuous on [0,T]0𝑇[0,T][ 0 , italic_T ] and satisfies 𝑼t𝑼˙t=0R×Rsubscript𝑼𝑡superscriptsubscript˙𝑼𝑡top0superscript𝑅𝑅\boldsymbol{U}_{t}\dot{\boldsymbol{U}}_{t}^{\top}=0\in\mathbb{R}^{R\times R}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = 0 ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT for almost every t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ]; moreover, 𝑼t𝑼t=IR×Rsubscript𝑼𝑡superscriptsubscript𝑼𝑡top𝐼superscript𝑅𝑅\boldsymbol{U}_{t}\boldsymbol{U}_{t}^{\top}=I\in\mathbb{R}^{R\times R}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = italic_I ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT for almost every t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ], where I𝐼Iitalic_I is the identity matrix;

  2. 2.

    𝒀=(𝒀t)t[0,T]𝒀subscriptsubscript𝒀𝑡𝑡0𝑇\boldsymbol{Y}=(\boldsymbol{Y}_{t})_{t\in[0,T]}bold_italic_Y = ( bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT is an Itô process

    d𝒀t=αtdt+βtdWt,𝑑subscript𝒀𝑡subscript𝛼𝑡𝑑𝑡subscript𝛽𝑡𝑑subscript𝑊𝑡d\boldsymbol{Y}_{t}=\alpha_{t}dt+\beta_{t}dW_{t},italic_d bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_α start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_d italic_t + italic_β start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , (2.8)

    with coefficients αtRsubscript𝛼𝑡superscript𝑅\alpha_{t}\in\mathbb{R}^{R}italic_α start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT and βtR×msubscript𝛽𝑡superscript𝑅𝑚\beta_{t}\in\mathbb{R}^{R\times m}italic_β start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_m end_POSTSUPERSCRIPT, where αtsubscript𝛼𝑡\alpha_{t}italic_α start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and βtsubscript𝛽𝑡\beta_{t}italic_β start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT are progressively measurable and have a continuous path almost surely.

Then (𝑼t,𝒀t)subscript𝑼𝑡subscript𝒀𝑡(\boldsymbol{U}_{t},\boldsymbol{Y}_{t})( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) must satisfy equations (2.6) and (2.7).

Indeed, since αtsubscript𝛼𝑡\alpha_{t}italic_α start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and βtsubscript𝛽𝑡\beta_{t}italic_β start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT in (2.8) are progressively measurable, by applying Itô’s formula [ito1951formula, kunita1967square] we have

dXt𝑑subscript𝑋𝑡\displaystyle dX_{t}italic_d italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT =(d𝑼t)𝒀t+𝑼td𝒀t+j=1RdUj,Yj(t)absent𝑑superscriptsubscript𝑼𝑡topsubscript𝒀𝑡superscriptsubscript𝑼𝑡top𝑑subscript𝒀𝑡superscriptsubscript𝑗1𝑅𝑑superscript𝑈𝑗superscript𝑌𝑗𝑡\displaystyle=(d\boldsymbol{U}_{t}^{\top})\boldsymbol{Y}_{t}+\boldsymbol{U}_{t% }^{\top}d\boldsymbol{Y}_{t}+\sum_{j=1}^{R}d\langle U^{j},Y^{j}\rangle(t)= ( italic_d bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT + bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_d bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT + ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_d ⟨ italic_U start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT , italic_Y start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT ⟩ ( italic_t ) (2.9)
=𝑼˙t𝒀tdt+𝑼t(αtdt+βtdWt)+0βtdtabsentsuperscriptsubscript˙𝑼𝑡topsubscript𝒀𝑡𝑑𝑡superscriptsubscript𝑼𝑡topsubscript𝛼𝑡𝑑𝑡subscript𝛽𝑡𝑑subscript𝑊𝑡0subscript𝛽𝑡𝑑𝑡\displaystyle=\dot{\boldsymbol{U}}_{t}^{\top}\boldsymbol{Y}_{t}\,dt+% \boldsymbol{U}_{t}^{\top}\bigl{(}\alpha_{t}dt+\beta_{t}dW_{t}\bigr{)}+0\cdot% \beta_{t}dt= over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_d italic_t + bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_α start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_d italic_t + italic_β start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) + 0 ⋅ italic_β start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_d italic_t (2.10)
=(𝑼˙t𝒀t+𝑼tαt)dt+𝑼tβtdWt,absentsuperscriptsubscript˙𝑼𝑡topsubscript𝒀𝑡superscriptsubscript𝑼𝑡topsubscript𝛼𝑡𝑑𝑡superscriptsubscript𝑼𝑡topsubscript𝛽𝑡𝑑subscript𝑊𝑡\displaystyle=\bigl{(}\dot{\boldsymbol{U}}_{t}^{\top}\boldsymbol{Y}_{t}+% \boldsymbol{U}_{t}^{\top}\alpha_{t}\bigr{)}\,dt+\boldsymbol{U}_{t}^{\top}\beta% _{t}\,dW_{t},= ( over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT + bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_α start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_t + bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_β start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , (2.11)

where Uj,Yjsuperscript𝑈𝑗superscript𝑌𝑗\langle U^{j},Y^{j}\rangle⟨ italic_U start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT , italic_Y start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT ⟩, j=1,,R𝑗1𝑅j=1,\dots,Ritalic_j = 1 , … , italic_R is the quadratic covariation of Ujsuperscript𝑈𝑗U^{j}italic_U start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT and Yjsuperscript𝑌𝑗Y^{j}italic_Y start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT. Since X𝑋Xitalic_X is assumed to satisfy (2.1), the uniqueness of the representation of Itô processes implies

𝑼˙t𝒀t+𝑼tαtsubscript˙𝑼𝑡superscriptsubscript𝒀𝑡topsuperscriptsubscript𝑼𝑡topsubscript𝛼𝑡\displaystyle\dot{\boldsymbol{U}}_{t}{}^{\top}\boldsymbol{Y}_{t}+\boldsymbol{U% }_{t}^{\top}\alpha_{t}over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_FLOATSUPERSCRIPT ⊤ end_FLOATSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT + bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_α start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT =a(t,𝑼t𝒀t)absent𝑎𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡\displaystyle=a(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t})= italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) (2.12)
𝑼tβtsuperscriptsubscript𝑼𝑡topsubscript𝛽𝑡\displaystyle\boldsymbol{U}_{t}^{\top}\beta_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_β start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT =b(t,𝑼t𝒀t).absent𝑏𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡\displaystyle=b(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t}).= italic_b ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) . (2.13)

Now, using 𝑼t𝑼˙t=0R×Rsubscript𝑼𝑡superscriptsubscript˙𝑼𝑡top0superscript𝑅𝑅\boldsymbol{U}_{t}\dot{\boldsymbol{U}}_{t}^{\top}=0\in\mathbb{R}^{R\times R}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = 0 ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT and 𝑼t𝑼t=IR×Rsubscript𝑼𝑡superscriptsubscript𝑼𝑡top𝐼superscript𝑅𝑅\boldsymbol{U}_{t}\boldsymbol{U}_{t}^{\top}=I\in\mathbb{R}^{R\times R}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = italic_I ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT for almost every t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ], these equalities imply

αt=𝑼ta(t,𝑼t𝒀t)andβt=𝑼tb(t,𝑼t𝒀t).formulae-sequencesubscript𝛼𝑡subscript𝑼𝑡𝑎𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡andsubscript𝛽𝑡subscript𝑼𝑡𝑏𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡\alpha_{t}=\boldsymbol{U}_{t}a(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t})% \quad\text{and}\quad\beta_{t}=\boldsymbol{U}_{t}b(t,\boldsymbol{U}_{t}^{\top}% \boldsymbol{Y}_{t}).italic_α start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) and italic_β start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) . (2.14)

Moreover, 𝑼tsubscript𝑼𝑡\boldsymbol{U}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT is absolutely continuous and by assumption 𝒀tsubscript𝒀𝑡\boldsymbol{Y}_{t}bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT is a.s. continuous. This implies that αtsubscript𝛼𝑡\alpha_{t}italic_α start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and βtsubscript𝛽𝑡\beta_{t}italic_β start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT have a continuous path almost surely, and hence (2.7) follows. In turn, from (2.12) we find

C𝒀t𝑼˙tsubscript𝐶subscript𝒀𝑡subscript˙𝑼𝑡\displaystyle{C}_{\boldsymbol{Y}_{t}}\dot{\boldsymbol{U}}_{t}italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT =𝔼[𝒀ta(t,𝑼t𝒀t)]𝔼[𝒀ta(t,𝑼t𝒀t)]𝑼t𝑼tabsent𝔼delimited-[]subscript𝒀𝑡𝑎superscript𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡top𝔼delimited-[]subscript𝒀𝑡𝑎superscript𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡topsuperscriptsubscript𝑼𝑡topsubscript𝑼𝑡\displaystyle=\mathbb{E}[\boldsymbol{Y}_{t}a(t,\boldsymbol{U}_{t}^{\top}% \boldsymbol{Y}_{t})^{\top}]-\mathbb{E}[\boldsymbol{Y}_{t}a(t,\boldsymbol{U}_{t% }^{\top}\boldsymbol{Y}_{t})^{\top}]\boldsymbol{U}_{t}^{\top}\boldsymbol{U}_{t}= blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] - blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT
=𝔼[𝒀ta(t,𝑼t𝒀t)](Id×d𝑼t𝑼t),absent𝔼delimited-[]subscript𝒀𝑡𝑎superscript𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡topsubscript𝐼𝑑𝑑superscriptsubscript𝑼𝑡topsubscript𝑼𝑡\displaystyle=\mathbb{E}[\boldsymbol{Y}_{t}a(t,\boldsymbol{U}_{t}^{\top}% \boldsymbol{Y}_{t})^{\top}](I_{d\times d}-\boldsymbol{U}_{t}^{\top}\boldsymbol% {U}_{t}),= blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ,

with C𝒀t:=𝔼[𝒀t𝒀t]{C}_{\boldsymbol{Y}_{t}}:=\mathbb{E}[\boldsymbol{Y}_{t}\boldsymbol{Y}_{t}{}^{% \top}]italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT := blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_FLOATSUPERSCRIPT ⊤ end_FLOATSUPERSCRIPT ]. Hence, from the orthogonality assumption for the rows of 𝑼𝑼\boldsymbol{U}bold_italic_U we have

C𝒀t𝑼˙t=𝔼[𝒀ta(t,𝑼t𝒀t)](Id×dP𝑼trow).subscript𝐶subscript𝒀𝑡subscript˙𝑼𝑡𝔼delimited-[]subscript𝒀𝑡𝑎superscript𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡topsubscript𝐼𝑑𝑑superscriptsubscript𝑃subscript𝑼𝑡row{C}_{\boldsymbol{Y}_{t}}\dot{\boldsymbol{U}}_{t}=\mathbb{E}[\boldsymbol{Y}_{t}% a(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t})^{\top}](I_{d\times d}-P_{% \boldsymbol{U}_{t}}^{\mathrm{row}}).italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT ) .

This completes our consistency argument.

2.2 DO equations interpreted as a projected dynamics

The DO equations (2.6)–(2.7) are posed as a system of equations for the separate factors 𝑼𝑼\boldsymbol{U}bold_italic_U and 𝒀𝒀\boldsymbol{Y}bold_italic_Y. We now discuss what equation the DO approximation X=j=1RUjYj𝑋superscriptsubscript𝑗1𝑅superscript𝑈𝑗superscript𝑌𝑗X=\sum_{j=1}^{R}U^{j}Y^{j}italic_X = ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_U start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT italic_Y start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT should satisfy. In other words, we aim to derive an equation for X𝑋Xitalic_X in the ambient space, independent of the parametrization (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ).

For this purpose, we substitute (2.6) and (2.7) into (2.9); we obtain

dXt=𝑑subscript𝑋𝑡absent\displaystyle dX_{t}=italic_d italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = ((Id×dP𝑼trow)𝔼[a(t,𝑼t𝒀t)𝒀t]C𝒀t1𝒀t+P𝑼trowa(t,𝑼t𝒀t))dtsubscript𝐼𝑑𝑑superscriptsubscript𝑃subscript𝑼𝑡row𝔼delimited-[]𝑎𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡superscriptsubscript𝒀𝑡topsuperscriptsubscript𝐶subscript𝒀𝑡1subscript𝒀𝑡superscriptsubscript𝑃subscript𝑼𝑡row𝑎𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡𝑑𝑡\displaystyle\bigl{(}\bigl{(}I_{d\times d}-P_{\boldsymbol{U}_{t}}^{\mathrm{row% }}\bigr{)}\mathbb{E}[a(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t})% \boldsymbol{Y}_{t}^{\top}]{C}_{\boldsymbol{Y}_{t}}^{-1}\boldsymbol{Y}_{t}+P_{% \boldsymbol{U}_{t}}^{\mathrm{row}}a(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_% {t})\bigr{)}\,dt( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT ) blackboard_E [ italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT + italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ) italic_d italic_t (2.15)
+P𝑼trowb(t,𝑼t𝒀t)dWtsuperscriptsubscript𝑃subscript𝑼𝑡row𝑏𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡𝑑subscript𝑊𝑡\displaystyle+P_{\boldsymbol{U}_{t}}^{\mathrm{row}}b(t,\boldsymbol{U}_{t}^{% \top}\boldsymbol{Y}_{t})\,dW_{t}+ italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT italic_b ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT
=\displaystyle== ((Id×dP𝑼trow)[P𝒀ta(t,𝑼t𝒀t)]+P𝑼trowa(t,𝑼t𝒀t))dtsubscript𝐼𝑑𝑑superscriptsubscript𝑃subscript𝑼𝑡rowdelimited-[]subscript𝑃subscript𝒀𝑡𝑎𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡superscriptsubscript𝑃subscript𝑼𝑡row𝑎𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡𝑑𝑡\displaystyle\bigl{(}\bigl{(}I_{d\times d}-P_{\boldsymbol{U}_{t}}^{\mathrm{row% }}\bigr{)}[P_{\boldsymbol{Y}_{t}}a(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{% t})]+P_{\boldsymbol{U}_{t}}^{\mathrm{row}}a(t,\boldsymbol{U}_{t}^{\top}% \boldsymbol{Y}_{t})\bigr{)}\,dt( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT ) [ italic_P start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ] + italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ) italic_d italic_t
+P𝑼trowb(t,𝑼t𝒀t)dWt,superscriptsubscript𝑃subscript𝑼𝑡row𝑏𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡𝑑subscript𝑊𝑡\displaystyle+P_{\boldsymbol{U}_{t}}^{\mathrm{row}}b(t,\boldsymbol{U}_{t}^{% \top}\boldsymbol{Y}_{t})\,dW_{t},+ italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT italic_b ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ,

where P𝒀ta(t,Xt)dsubscript𝑃subscript𝒀𝑡𝑎𝑡subscript𝑋𝑡superscript𝑑P_{\boldsymbol{Y}_{t}}a(t,X_{t})\in\mathbb{R}^{d}italic_P start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_a ( italic_t , italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT is the application of the L2(Ω)superscript𝐿2ΩL^{2}(\Omega)italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω )-orthogonal projection P𝒀t:L2(Ω):subscript𝑃subscript𝒀𝑡superscript𝐿2ΩP_{\boldsymbol{Y}_{t}}\colon L^{2}(\Omega)italic_P start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT : italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) span{Yt1,,YtR}absentspansuperscriptsubscript𝑌𝑡1superscriptsubscript𝑌𝑡𝑅\to\text{span}\{Y_{t}^{1},\dots,Y_{t}^{R}\}→ span { italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT , … , italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT } to each component of a(t,Xt)d𝑎𝑡subscript𝑋𝑡superscript𝑑a(t,X_{t})\in\mathbb{R}^{d}italic_a ( italic_t , italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT. To derive a parameter-independent equation, we seek a parameter-free expression of the projections P𝑼tsubscript𝑃subscript𝑼𝑡P_{\boldsymbol{U}_{t}}italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT and P𝒀tsubscript𝑃subscript𝒀𝑡P_{\boldsymbol{Y}_{t}}italic_P start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT. Given 𝒳tL2(Ω;d)subscript𝒳𝑡superscript𝐿2Ωsuperscript𝑑\mathcal{X}_{t}\in L^{2}(\Omega;\mathbb{R}^{d})caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ), t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ], let 𝒫𝒰(𝒳t):dIm(𝔼[𝒳t])d\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}\colon\mathbb{R}^{d}\to\mathrm{Im}(% \mathbb{E}[\mathcal{X}_{t}\,\cdot\,])\subset\mathbb{R}^{d}script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT : blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT → roman_Im ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ] ) ⊂ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT be the orthogonal projection matrix to the image of the mapping 𝔼[𝒳t]:L2(Ω)d\mathbb{E}[\mathcal{X}_{t}\,\cdot\,]\colon L^{2}(\Omega)\to\mathbb{R}^{d}blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ] : italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) → blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT, and let 𝒫𝒴(𝒳t):L2(Ω)Im((𝒳t))L2(Ω)\mathscr{P}_{\mathcal{Y}(\mathcal{X}_{t})}\colon L^{2}(\Omega)\to\mathrm{Im}% \bigl{(}(\mathcal{X}^{\top}_{t}\cdot\,)\bigr{)}\subset L^{2}(\Omega)script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT : italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) → roman_Im ( ( caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ) ) ⊂ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) be the L2(Ω)superscript𝐿2ΩL^{2}(\Omega)italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω )-orthogonal projection to the image of the mapping 𝒳t:dL2(Ω):subscriptsuperscript𝒳top𝑡superscript𝑑superscript𝐿2Ω\mathcal{X}^{\top}_{t}\colon\mathbb{R}^{d}\to L^{2}(\Omega)caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT : blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ). In Lemma 2.1 we will show dim(Im((𝒳t))=dim(Im(𝔼[𝒳t]))\mathrm{dim}(\mathrm{Im}\bigl{(}(\mathcal{X}^{\top}_{t}\cdot\,))=\mathrm{dim}(% \mathrm{Im}(\mathbb{E}[\mathcal{X}_{t}\,\cdot\,]))roman_dim ( roman_Im ( ( caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ) ) = roman_dim ( roman_Im ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ] ) ), i.e., Im((𝒳t)\mathrm{Im}\bigl{(}(\mathcal{X}^{\top}_{t}\cdot\,)roman_Im ( ( caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ) is a finite-dimensional linear subspace of L2(Ω)superscript𝐿2ΩL^{2}(\Omega)italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ), and thus 𝒫𝒴(𝒳t)subscript𝒫𝒴subscript𝒳𝑡\mathscr{P}_{\mathcal{Y}(\mathcal{X}_{t})}script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT is well defined.

In the case of DO approximation Xt=𝑼t𝒀tsubscript𝑋𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡X_{t}=\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t}italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, we have Im(𝔼[Xt])=span{Ut1,,UtR}\mathrm{Im}(\mathbb{E}[X_{t}\,\cdot\,])=\mathrm{span}\{U^{1}_{t},\dots,U^{R}_{% t}\}roman_Im ( blackboard_E [ italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ] ) = roman_span { italic_U start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , … , italic_U start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT } and Im((Xt))=span{Yt1,,YtR}\mathrm{Im}\bigl{(}(X_{t}^{\top}\cdot\,)\bigr{)}=\mathrm{span}\{Y^{1}_{t},% \dots,Y^{R}_{t}\}roman_Im ( ( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ⋅ ) ) = roman_span { italic_Y start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , … , italic_Y start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT }, we conclude that 𝒫𝒰(Xt)v=𝑼t𝑼tv=P𝑼trowvsubscript𝒫𝒰subscript𝑋𝑡𝑣superscriptsubscript𝑼𝑡topsubscript𝑼𝑡𝑣superscriptsubscript𝑃subscript𝑼𝑡row𝑣\mathscr{P}_{\mathcal{U}(X_{t})}v=\boldsymbol{U}_{t}^{\top}\boldsymbol{U}_{t}v% =P_{\boldsymbol{U}_{t}}^{\mathrm{row}}vscript_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_v = bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_v = italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT italic_v, vd𝑣superscript𝑑v\in\mathbb{R}^{d}italic_v ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT and 𝒫𝒴(Xt)w=𝔼[w𝒀t]C𝒀t1𝒀t=P𝒀twsubscript𝒫𝒴subscript𝑋𝑡𝑤𝔼delimited-[]𝑤subscriptsuperscript𝒀top𝑡subscriptsuperscript𝐶1subscript𝒀𝑡subscript𝒀𝑡subscript𝑃subscript𝒀𝑡𝑤\mathscr{P}_{\mathcal{Y}(X_{t})}w=\mathbb{E}[w\boldsymbol{Y}^{\top}_{t}]C^{-1}% _{\boldsymbol{Y}_{t}}\boldsymbol{Y}_{t}=P_{\boldsymbol{Y}_{t}}wscript_P start_POSTSUBSCRIPT caligraphic_Y ( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_w = blackboard_E [ italic_w bold_italic_Y start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ] italic_C start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_P start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_w, wL2(Ω)𝑤superscript𝐿2Ωw\in L^{2}(\Omega)italic_w ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ), so that (2.15) can be rewritten as

dXt=𝑑subscript𝑋𝑡absent\displaystyle dX_{t}=italic_d italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = ((Id×d𝒫𝒰(Xt))[𝒫𝒴(Xt)a(t,𝑼t𝒀t)]+𝒫𝒰(Xt)a(t,𝑼t𝒀t))dtsubscript𝐼𝑑𝑑subscript𝒫𝒰subscript𝑋𝑡delimited-[]subscript𝒫𝒴subscript𝑋𝑡𝑎𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡subscript𝒫𝒰subscript𝑋𝑡𝑎𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡𝑑𝑡\displaystyle\bigl{(}\bigl{(}I_{d\times d}-\mathscr{P}_{\mathcal{U}(X_{t})}% \bigr{)}[\mathscr{P}_{\mathcal{Y}(X_{t})}a(t,\boldsymbol{U}_{t}^{\top}% \boldsymbol{Y}_{t})]+\mathscr{P}_{\mathcal{U}(X_{t})}a(t,\boldsymbol{U}_{t}^{% \top}\boldsymbol{Y}_{t})\bigr{)}\,dt( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) [ script_P start_POSTSUBSCRIPT caligraphic_Y ( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ] + script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ) italic_d italic_t (2.16)
+𝒫𝒰(Xt)b(t,𝑼t𝒀t)dWt.subscript𝒫𝒰subscript𝑋𝑡𝑏𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡𝑑subscript𝑊𝑡\displaystyle+\mathscr{P}_{\mathcal{U}(X_{t})}b(t,\boldsymbol{U}_{t}^{\top}% \boldsymbol{Y}_{t})\,dW_{t}.+ script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT .

This equation, derived from (2.6) and (2.7), does not depend on the parametrization of the pair (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) and could be taken as an alternative definition of DO approximation. More precisely, given any process 𝒳=(𝒳t)t[0,T]𝒳subscriptsubscript𝒳𝑡𝑡0𝑇\mathcal{X}=(\mathcal{X}_{t})_{t\in[0,T]}caligraphic_X = ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT with 𝒳tL2(Ω;d)subscript𝒳𝑡superscript𝐿2Ωsuperscript𝑑\mathcal{X}_{t}\in L^{2}(\Omega;\mathbb{R}^{d})caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) for t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ], we can define the following stochastic process:

d𝒳t=((Id×d𝒫𝒰(𝒳t))[𝒫𝒴(𝒳t)a(t,𝒳t)]+𝒫𝒰(𝒳t)a(t,𝒳t))dt+𝒫𝒰(𝒳t)b(t,𝒳t)dWt.𝑑subscript𝒳𝑡subscript𝐼𝑑𝑑subscript𝒫𝒰subscript𝒳𝑡delimited-[]subscript𝒫𝒴subscript𝒳𝑡𝑎𝑡subscript𝒳𝑡subscript𝒫𝒰subscript𝒳𝑡𝑎𝑡subscript𝒳𝑡𝑑𝑡subscript𝒫𝒰subscript𝒳𝑡𝑏𝑡subscript𝒳𝑡𝑑subscript𝑊𝑡d\mathcal{\mathcal{X}}_{t}=\bigl{(}\bigl{(}I_{d\times d}-\mathscr{P}_{\mathcal% {U}(\mathcal{X}_{t})}\bigr{)}[\mathscr{P}_{\mathcal{Y}(\mathcal{X}_{t})}a(t,% \mathcal{\mathcal{X}}_{t})]+\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}a(t,% \mathcal{X}_{t})\bigr{)}\,dt+\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}b(t,% \mathcal{X}_{t})\,dW_{t}.italic_d caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = ( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) [ script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ] + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ) italic_d italic_t + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT . (2.17)

It is worth noticing that (2.17) is a McKean-Vlasov-type SDE since the evolution of 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT depends on the law of the process.

Finally, to speak of the rank of the solution 𝒳𝒳\mathcal{X}caligraphic_X to (2.17) we note the following.

Given 𝒳~L2(Ω;d)~𝒳superscript𝐿2Ωsuperscript𝑑\tilde{\mathcal{X}}\in L^{2}(\Omega;\mathbb{R}^{d})over~ start_ARG caligraphic_X end_ARG ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) the mapping K𝒳~:dL2(Ω):subscript𝐾~𝒳superscript𝑑superscript𝐿2ΩK_{\tilde{\mathcal{X}}}\colon\mathbb{R}^{d}\to L^{2}(\Omega)italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT : blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) defined by K𝒳~𝒗:=𝒳~𝒗assignsubscript𝐾~𝒳𝒗superscript~𝒳top𝒗K_{\tilde{\mathcal{X}}}\boldsymbol{v}:=\tilde{\mathcal{X}}^{\top}\boldsymbol{v}italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT bold_italic_v := over~ start_ARG caligraphic_X end_ARG start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_v for 𝒗d𝒗superscript𝑑\boldsymbol{v}\in\mathbb{R}^{d}bold_italic_v ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT is by definition finite rank. Moreover, the operator K𝒳~:=𝔼[𝒳~]:L2(Ω)dK_{\tilde{\mathcal{X}}}^{*}:=\mathbb{E}[\tilde{\mathcal{X}}\cdot]\colon L^{2}(% \Omega)\to\mathbb{R}^{d}italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT := blackboard_E [ over~ start_ARG caligraphic_X end_ARG ⋅ ] : italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) → blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT is the adjoint of K𝒳~subscript𝐾~𝒳K_{\tilde{\mathcal{X}}}italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT:

𝔼[y(K𝒳~𝒗)]=𝔼[y(𝒳~𝒗)]=𝔼[𝒗𝒳~y]=𝒗K𝒳~y,yL2(Ω),vdformulae-sequence𝔼delimited-[]𝑦subscript𝐾~𝒳𝒗𝔼delimited-[]𝑦superscript~𝒳top𝒗𝔼delimited-[]superscript𝒗top~𝒳𝑦superscript𝒗topsuperscriptsubscript𝐾~𝒳𝑦formulae-sequencefor-all𝑦superscript𝐿2Ωfor-all𝑣superscript𝑑\mathbb{E}[y(K_{\tilde{\mathcal{X}}}\boldsymbol{v})]=\mathbb{E}[y(\tilde{% \mathcal{X}}^{\top}\boldsymbol{v})]=\mathbb{E}[\boldsymbol{v}^{\top}\tilde{% \mathcal{X}}y]=\boldsymbol{v}^{\top}K_{\tilde{\mathcal{X}}}^{*}y,\quad\forall y% \in L^{2}(\Omega),\ \forall v\in\mathbb{R}^{d}blackboard_E [ italic_y ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT bold_italic_v ) ] = blackboard_E [ italic_y ( over~ start_ARG caligraphic_X end_ARG start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_v ) ] = blackboard_E [ bold_italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT over~ start_ARG caligraphic_X end_ARG italic_y ] = bold_italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT italic_y , ∀ italic_y ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) , ∀ italic_v ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT

The operator K𝒳~K𝒳~:dd:superscriptsubscript𝐾~𝒳subscript𝐾~𝒳superscript𝑑superscript𝑑K_{\tilde{\mathcal{X}}}^{*}K_{\tilde{\mathcal{X}}}\colon\mathbb{R}^{d}\to% \mathbb{R}^{d}italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT : blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT → blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT is given by K𝒳~K𝒳~𝒗=𝔼[𝒳~𝒳~]𝒗superscriptsubscript𝐾~𝒳subscript𝐾~𝒳𝒗𝔼delimited-[]~𝒳superscript~𝒳top𝒗K_{\tilde{\mathcal{X}}}^{*}K_{\tilde{\mathcal{X}}}\boldsymbol{v}=\mathbb{E}[% \tilde{\mathcal{X}}\tilde{\mathcal{X}}^{\top}]\boldsymbol{v}italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT bold_italic_v = blackboard_E [ over~ start_ARG caligraphic_X end_ARG over~ start_ARG caligraphic_X end_ARG start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] bold_italic_v for 𝒗d𝒗superscript𝑑\boldsymbol{v}\in\mathbb{R}^{d}bold_italic_v ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT. The following lemma characterises the rank of these operators.

Lemma 2.1.

Given 𝒳~L2(Ω;d)~𝒳superscript𝐿2Ωsuperscript𝑑\tilde{\mathcal{X}}\in L^{2}(\Omega;\mathbb{R}^{d})over~ start_ARG caligraphic_X end_ARG ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ), we have rank(K𝒳~K𝒳~)=rank(K𝒳~)=rank(K𝒳~)ranksuperscriptsubscript𝐾~𝒳subscript𝐾~𝒳ranksubscript𝐾~𝒳ranksuperscriptsubscript𝐾~𝒳\mathrm{rank}(K_{\tilde{\mathcal{X}}}^{*}K_{\tilde{\mathcal{X}}})=\mathrm{rank% }(K_{\tilde{\mathcal{X}}})=\mathrm{rank}(K_{\tilde{\mathcal{X}}}^{*})roman_rank ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT ) = roman_rank ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT ) = roman_rank ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT ).

Proof.

First, notice that we have ker(K𝒳~)=Im(K𝒳~)kersuperscriptsubscript𝐾~𝒳Imsuperscriptsubscript𝐾~𝒳perpendicular-to\mathrm{ker}(K_{\tilde{\mathcal{X}}}^{*})=\mathrm{Im}(K_{\tilde{\mathcal{X}}})% ^{\perp}roman_ker ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT ) = roman_Im ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT, where perpendicular-to\perp is the orthogonal complement with respect to the Euclidean inner product. Hence, we have ker(K𝒳~|Im(K𝒳~))={0}kerevaluated-atsuperscriptsubscript𝐾~𝒳Imsubscript𝐾~𝒳0\mathrm{ker}(K_{\tilde{\mathcal{X}}}^{*}|_{\mathrm{Im}(K_{\tilde{\mathcal{X}}}% )})=\{0\}roman_ker ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT | start_POSTSUBSCRIPT roman_Im ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) = { 0 }. Thus, the rank-nullity theorem implies

dim(Im(K𝒳~|Im(K𝒳~)))=dim(Im(K𝒳~)).dimImevaluated-atsuperscriptsubscript𝐾~𝒳Imsubscript𝐾~𝒳dimImsubscript𝐾~𝒳\mathrm{dim}(\mathrm{Im}(K_{\tilde{\mathcal{X}}}^{*}|_{\mathrm{Im}(K_{\tilde{% \mathcal{X}}})}))=\mathrm{dim}(\mathrm{Im}(K_{\tilde{\mathcal{X}}})).roman_dim ( roman_Im ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT | start_POSTSUBSCRIPT roman_Im ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) ) = roman_dim ( roman_Im ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT ) ) .

Therefore rank(K𝒳~K𝒳~)=rank(K𝒳~)ranksuperscriptsubscript𝐾~𝒳subscript𝐾~𝒳ranksubscript𝐾~𝒳\mathrm{rank}(K_{\tilde{\mathcal{X}}}^{*}K_{\tilde{\mathcal{X}}})=\mathrm{rank% }(K_{\tilde{\mathcal{X}}})roman_rank ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT ) = roman_rank ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT ). Moreover, from rank(K𝒳~)=rank(K𝒳~)ranksubscript𝐾~𝒳ranksuperscriptsubscript𝐾~𝒳\mathrm{rank}(K_{\tilde{\mathcal{X}}})=\mathrm{rank}(K_{\tilde{\mathcal{X}}}^{% *})roman_rank ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT ) = roman_rank ( italic_K start_POSTSUBSCRIPT over~ start_ARG caligraphic_X end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT ) (see for example [Kato.T_book_1995_reprint, Theorem III.4.13]), the proof is complete. ∎

In view of the lemma above, we call dim(Im(𝔼[𝒳t]))\mathrm{dim}(\mathrm{Im}(\mathbb{E}[\mathcal{X}_{t}\,\cdot\,]))roman_dim ( roman_Im ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ] ) ), equivalently dim(Im((𝒳t)))\mathrm{dim}(\mathrm{Im}((\mathcal{X}_{t}^{\top}\cdot\,)))roman_dim ( roman_Im ( ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ⋅ ) ) ) and rank(𝔼[𝒳t𝒳t]])\mathrm{rank}(\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}]])roman_rank ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ] ), rank of 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT. {defn}[DLR solution of rank R𝑅Ritalic_R] A process 𝒳:[0,T]L2(Ω;d):𝒳0𝑇superscript𝐿2Ωsuperscript𝑑\mathcal{X}:[0,T]\to L^{2}(\Omega;\mathbb{R}^{d})caligraphic_X : [ 0 , italic_T ] → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) is called a DLR solution of rank R𝑅Ritalic_R to (2.1) for an initial datum 𝒳0L2(Ω;d)subscript𝒳0superscript𝐿2Ωsuperscript𝑑\mathcal{X}_{0}\in L^{2}(\Omega;\mathbb{R}^{d})caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) if it satisfies (2.17), dim(Im(𝔼[𝒳t]))=R\mathrm{dim}(\mathrm{Im}(\mathbb{E}[\mathcal{X}_{t}\,\cdot\,]))=Rroman_dim ( roman_Im ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ] ) ) = italic_R for some R𝑅R\in\mathbb{N}italic_R ∈ blackboard_N for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ], and 𝒳𝒳\mathcal{X}caligraphic_X has almost surely continuous paths.

The parameter-independent formulation (2.17) corresponds to the projected dynamics in the DLRA literature; see [koch2007dynamical], also [kazashi2021stability, Proposition2]. Notice however that in our formulation, only the projector 𝒫𝒰(𝒳t)subscript𝒫𝒰subscript𝒳𝑡\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT is applied to the diffusion term b(t,𝒳t)dWt𝑏𝑡subscript𝒳𝑡𝑑subscript𝑊𝑡b(t,\mathcal{X}_{t})\,dW_{t}italic_b ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, instead of the full projector

𝒫𝒰(𝒳t)+𝒫𝒴(𝒳t)𝒫𝒰(𝒳t)𝒫𝒴(𝒳t).subscript𝒫𝒰subscript𝒳𝑡subscript𝒫𝒴subscript𝒳𝑡subscript𝒫𝒰subscript𝒳𝑡subscript𝒫𝒴subscript𝒳𝑡\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}+\mathscr{P}_{\mathcal{Y}(\mathcal{X% }_{t})}-\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}\mathscr{P}_{\mathcal{Y}(% \mathcal{X}_{t})}.script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT + script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT .

If we naively wrote the projected dynamics following the standard DLRA approach, we would end up with the alternative formal expression

d𝒳t=(𝒫𝒰(𝒳t)+𝒫𝒴(𝒳t)𝒫𝒰(𝒳t)𝒫𝒴(𝒳t))[a(t,𝒳t)dt+b(t,𝒳t)dWt],𝑑subscript𝒳𝑡subscript𝒫𝒰subscript𝒳𝑡subscript𝒫𝒴subscript𝒳𝑡subscript𝒫𝒰subscript𝒳𝑡subscript𝒫𝒴subscript𝒳𝑡delimited-[]𝑎𝑡subscript𝒳𝑡𝑑𝑡𝑏𝑡subscript𝒳𝑡𝑑subscript𝑊𝑡d\mathcal{\mathcal{X}}_{t}=\left(\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}+% \mathscr{P}_{\mathcal{Y}(\mathcal{X}_{t})}-\mathscr{P}_{\mathcal{U}(\mathcal{X% }_{t})}\mathscr{P}_{\mathcal{Y}(\mathcal{X}_{t})}\right)\left[a(t,\mathcal{% \mathcal{X}}_{t})\,dt+b(t,\mathcal{X}_{t})\,dW_{t}\right],italic_d caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = ( script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT + script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) [ italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_t + italic_b ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ] , (2.18)

which would coincide with (2.17) if one could prove that “𝒫𝒴(𝒳t)[b(t,𝒳t)dWt]=0subscript𝒫𝒴subscript𝒳𝑡delimited-[]𝑏𝑡subscript𝒳𝑡𝑑subscript𝑊𝑡0\mathscr{P}_{\mathcal{Y}(\mathcal{X}_{t})}[b(t,\mathcal{X}_{t})\,dW_{t}]=0script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT [ italic_b ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ] = 0” for a.e. t>0𝑡0t>0italic_t > 0. However, it is not obvious how to give a rigorous meaning to the term 𝒫𝒴(𝒳t)[b(t,𝒳t)dWt]subscript𝒫𝒴subscript𝒳𝑡delimited-[]𝑏𝑡subscript𝒳𝑡𝑑subscript𝑊𝑡\mathscr{P}_{\mathcal{Y}(\mathcal{X}_{t})}[b(t,\mathcal{X}_{t})\,dW_{t}]script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT [ italic_b ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ] as an Itô integral and for this reason we do not pursue the formulation (2.18) further.

To confirm that (2.17) is nevertheless a sensible projected dynamics, let us ask ourselves the following question: if the solution 𝒳𝒳\mathcal{\mathcal{X}}caligraphic_X of (2.17) satisfies

dim(Im((𝒳t)))=dim(Im(𝔼[𝒳t]))=R around t,\mathrm{dim}(\mathrm{Im}((\mathcal{X}_{t}^{\top}\cdot\,)))=\mathrm{dim}(% \mathrm{Im}(\mathbb{E}[\mathcal{X}_{t}\,\cdot\,]))=R\text{ around }t,roman_dim ( roman_Im ( ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ⋅ ) ) ) = roman_dim ( roman_Im ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ] ) ) = italic_R around italic_t ,

is the right hand side of (2.17) consistent with this structure of 𝒳𝒳\mathcal{\mathcal{X}}caligraphic_X? In the following, we will see that the answer is affirmative, which supports the validity of (2.17), and thus (2.6) and (2.7), as a correct DLRA formulation for SDEs.

In view of Lemma 2.1, we study the rank of the matrix 𝔼[𝒳t𝒳t]𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡top\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}]blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ], where 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT is given by (2.17). To do this, we will show that ddt(𝔼[𝒳t𝒳t])𝑑𝑑𝑡𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡top\frac{d}{dt}\big{(}\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}]\big{)}divide start_ARG italic_d end_ARG start_ARG italic_d italic_t end_ARG ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ) is in a tangent space of the rank-R𝑅Ritalic_R manifold, i.e., the manifold of d×d𝑑𝑑d\times ditalic_d × italic_d matrices with rank equal to R𝑅Ritalic_R, at 𝔼[𝒳t𝒳t]𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡top\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}]blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ]. For j,k=1,,dformulae-sequence𝑗𝑘1𝑑j,k=1,\dots,ditalic_j , italic_k = 1 , … , italic_d, Itô’s formula implies

d(𝒳tj𝒳tk)=𝑑superscriptsubscript𝒳𝑡𝑗superscriptsubscript𝒳𝑡𝑘absent\displaystyle d(\mathcal{X}_{t}^{j}\mathcal{X}_{t}^{k})=italic_d ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ) = 𝒳tj[μtkdt+=1mΣtkdWt]superscriptsubscript𝒳𝑡𝑗delimited-[]superscriptsubscript𝜇𝑡𝑘𝑑𝑡superscriptsubscript1𝑚superscriptsubscriptΣ𝑡𝑘𝑑superscriptsubscript𝑊𝑡\displaystyle\mathcal{X}_{t}^{j}\bigl{[}\mu_{t}^{k}\,dt+\sum_{\ell=1}^{m}% \Sigma_{t}^{k\ell}\,dW_{t}^{\ell}\bigr{]}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT [ italic_μ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT italic_d italic_t + ∑ start_POSTSUBSCRIPT roman_ℓ = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m end_POSTSUPERSCRIPT roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k roman_ℓ end_POSTSUPERSCRIPT italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_ℓ end_POSTSUPERSCRIPT ]
+[μtjdt+=1mΣtjdWt]𝒳tk+=1mΣtjΣtkdt,delimited-[]superscriptsubscript𝜇𝑡𝑗𝑑𝑡superscriptsubscript1𝑚superscriptsubscriptΣ𝑡𝑗𝑑superscriptsubscript𝑊𝑡superscriptsubscript𝒳𝑡𝑘superscriptsubscript1𝑚superscriptsubscriptΣ𝑡𝑗superscriptsubscriptΣ𝑡𝑘𝑑𝑡\displaystyle+\bigl{[}\mu_{t}^{j}\,dt+\sum_{\ell=1}^{m}\Sigma_{t}^{j\ell}\,dW_% {t}^{\ell}\bigr{]}\mathcal{X}_{t}^{k}+\sum_{\ell=1}^{m}\Sigma_{t}^{j\ell}% \Sigma_{t}^{k\ell}\,dt,+ [ italic_μ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT italic_d italic_t + ∑ start_POSTSUBSCRIPT roman_ℓ = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m end_POSTSUPERSCRIPT roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j roman_ℓ end_POSTSUPERSCRIPT italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_ℓ end_POSTSUPERSCRIPT ] caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT + ∑ start_POSTSUBSCRIPT roman_ℓ = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m end_POSTSUPERSCRIPT roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j roman_ℓ end_POSTSUPERSCRIPT roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k roman_ℓ end_POSTSUPERSCRIPT italic_d italic_t ,

where μtk:=[(Id×d𝒫𝒰(𝒳t))[𝒫𝒴(𝒳t)a(t,𝒳t)]+𝒫𝒰(𝒳t)a(t,𝒳t)]kassignsuperscriptsubscript𝜇𝑡𝑘subscriptdelimited-[]subscript𝐼𝑑𝑑subscript𝒫𝒰subscript𝒳𝑡delimited-[]subscript𝒫𝒴subscript𝒳𝑡𝑎𝑡subscript𝒳𝑡subscript𝒫𝒰subscript𝒳𝑡𝑎𝑡subscript𝒳𝑡𝑘\mu_{t}^{k}:=[(I_{d\times d}-\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})})[% \mathscr{P}_{\mathcal{Y}(\mathcal{X}_{t})}a(t,\mathcal{X}_{t})]+\mathscr{P}_{% \mathcal{U}(\mathcal{X}_{t})}a(t,\mathcal{X}_{t})]_{k}italic_μ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT := [ ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) [ script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ] + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ] start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT and Σtk:=[𝒫𝒰(𝒳t)b(t,𝒳t)]kassignsuperscriptsubscriptΣ𝑡𝑘subscriptdelimited-[]subscript𝒫𝒰subscript𝒳𝑡𝑏𝑡subscript𝒳𝑡𝑘\Sigma_{t}^{k\ell}:=[\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}b(t,\mathcal{X}% _{t})]_{k\ell}roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k roman_ℓ end_POSTSUPERSCRIPT := [ script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ] start_POSTSUBSCRIPT italic_k roman_ℓ end_POSTSUBSCRIPT. Thus, we have

ddt(𝔼[𝒳t𝒳t])=𝔼[𝒳tμt+μt𝒳t+ΣtΣt]for almost every t[0,T],formulae-sequence𝑑𝑑𝑡𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡top𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝜇𝑡topsubscript𝜇𝑡superscriptsubscript𝒳𝑡topsubscriptΣ𝑡superscriptsubscriptΣ𝑡topfor almost every 𝑡0𝑇\displaystyle\frac{d}{dt}\Bigl{(}\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{% \top}]\Bigr{)}=\mathbb{E}\bigl{[}\mathcal{X}_{t}\mu_{t}^{\top}+\mu_{t}\mathcal% {X}_{t}^{\top}+\Sigma_{t}\Sigma_{t}^{\top}\bigr{]}\quad\text{for almost every % }t\in[0,T],divide start_ARG italic_d end_ARG start_ARG italic_d italic_t end_ARG ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ) = blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT + italic_μ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT + roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] for almost every italic_t ∈ [ 0 , italic_T ] , (2.19)

with μt:=[μtk]k=1,,ddassignsubscript𝜇𝑡subscriptdelimited-[]superscriptsubscript𝜇𝑡𝑘𝑘1𝑑superscript𝑑\mu_{t}:=[\mu_{t}^{k}]_{k=1,\dots,d}\in\mathbb{R}^{d}italic_μ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT := [ italic_μ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ] start_POSTSUBSCRIPT italic_k = 1 , … , italic_d end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT and Σt:=[Σtk]k=1,,d=1,md×massignsubscriptΣ𝑡subscriptdelimited-[]superscriptsubscriptΣ𝑡𝑘𝑘1𝑑1𝑚superscript𝑑𝑚\Sigma_{t}:=\big{[}\Sigma_{t}^{k\ell}\big{]}_{\begin{subarray}{c}k=1,\dots,d\\ \ell=1,\dots m\end{subarray}}\in\mathbb{R}^{d\times m}roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT := [ roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k roman_ℓ end_POSTSUPERSCRIPT ] start_POSTSUBSCRIPT start_ARG start_ROW start_CELL italic_k = 1 , … , italic_d end_CELL end_ROW start_ROW start_CELL roman_ℓ = 1 , … italic_m end_CELL end_ROW end_ARG end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d × italic_m end_POSTSUPERSCRIPT.

On the other hand, from [vandereycken2013low, Proposition 2.1] we know that the tangent space of a rank R𝑅Ritalic_R manifold at 𝔼[𝒳𝒳]=Qdiag(γ1,,γR)Q𝔼delimited-[]𝒳superscript𝒳top𝑄diagsubscript𝛾1subscript𝛾𝑅superscript𝑄top\mathbb{E}[\mathcal{X}\mathcal{X}^{\top}]=Q\mathrm{diag}(\gamma_{1},\dots,% \gamma_{R})Q^{\top}blackboard_E [ caligraphic_X caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] = italic_Q roman_diag ( italic_γ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_γ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ) italic_Q start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT can be characterized as

T𝔼[𝒳𝒳]:={QV1+V2Q+QAQ|V1Q=0,V1d×R,V2Q=0,V2d×R, and Ad×d}.T_{\mathbb{E}[\mathcal{X}\mathcal{X}^{\top}]}\mathcal{M}:=\left\{QV_{1}{}^{% \top}+V_{2}Q^{\top}+QAQ^{\top}\,\left|\,\begin{array}[]{l}V_{\mathrm{1}}^{\top% }Q=0,V_{\mathrm{1}}\in\mathbb{R}^{d\times R},\\ V_{2}^{\top}Q=0,V_{\mathrm{2}}\in\mathbb{R}^{d\times R},\\ \text{ and }A\in\mathbb{\mathbb{R}}^{d\times d}\end{array}\right\}\right..italic_T start_POSTSUBSCRIPT blackboard_E [ caligraphic_X caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] end_POSTSUBSCRIPT caligraphic_M := { italic_Q italic_V start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT start_FLOATSUPERSCRIPT ⊤ end_FLOATSUPERSCRIPT + italic_V start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT italic_Q start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT + italic_Q italic_A italic_Q start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT | start_ARRAY start_ROW start_CELL italic_V start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_Q = 0 , italic_V start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d × italic_R end_POSTSUPERSCRIPT , end_CELL end_ROW start_ROW start_CELL italic_V start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_Q = 0 , italic_V start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d × italic_R end_POSTSUPERSCRIPT , end_CELL end_ROW start_ROW start_CELL and italic_A ∈ blackboard_R start_POSTSUPERSCRIPT italic_d × italic_d end_POSTSUPERSCRIPT end_CELL end_ROW end_ARRAY } .

To conclude ddt(𝔼[𝒳t𝒳t])T𝔼[𝒳t𝒳t]𝑑𝑑𝑡𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡topsubscript𝑇𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡top\frac{d}{dt}(\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}])\in T_{\mathbb{% E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}]}\mathcal{M}divide start_ARG italic_d end_ARG start_ARG italic_d italic_t end_ARG ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ) ∈ italic_T start_POSTSUBSCRIPT blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] end_POSTSUBSCRIPT caligraphic_M we will use the following result.

Lemma 2.2.

Let the singular value decomposition 𝔼[𝒳𝒳]=Qdiag(γ1,,γR)Q𝔼delimited-[]𝒳superscript𝒳top𝑄diagsubscript𝛾1subscript𝛾𝑅superscript𝑄top\mathbb{E}[\mathcal{X}\mathcal{X}^{\top}]=Q\mathrm{diag}(\gamma_{1},\dots,% \gamma_{R})Q^{\top}blackboard_E [ caligraphic_X caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] = italic_Q roman_diag ( italic_γ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_γ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ) italic_Q start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT, with γ1,,γR>0subscript𝛾1subscript𝛾𝑅0\gamma_{1},\dots,\gamma_{R}>0italic_γ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_γ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT > 0 be given, where Qd×R𝑄superscript𝑑𝑅Q\in\mathbb{R}^{d\times R}italic_Q ∈ blackboard_R start_POSTSUPERSCRIPT italic_d × italic_R end_POSTSUPERSCRIPT is a matrix consisting of R𝑅Ritalic_R orthogonal columns 𝐪1,,𝐪Rdsubscript𝐪1subscript𝐪𝑅superscript𝑑\boldsymbol{q}_{1},\dots,\boldsymbol{q}_{R}\in\mathbb{R}^{d}bold_italic_q start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , bold_italic_q start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT. Then, the canonical expansion of the finite rank operator 𝔼[𝒳]:L2(Ω)d\mathbb{E}[\mathcal{X}\,\cdot\,]\colon L^{2}(\Omega)\to\mathbb{R}^{d}blackboard_E [ caligraphic_X ⋅ ] : italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) → blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT is given by

𝔼[𝒳y]=k=1Rγk1/2𝔼[yφk]𝒒k=Q[γ11/2𝔼[yφ1]γR1/2𝔼[yφR]], for yL2(Ω),formulae-sequence𝔼delimited-[]𝒳𝑦superscriptsubscript𝑘1𝑅superscriptsubscript𝛾𝑘12𝔼delimited-[]𝑦subscript𝜑𝑘subscript𝒒𝑘𝑄matrixsuperscriptsubscript𝛾112𝔼delimited-[]𝑦subscript𝜑1superscriptsubscript𝛾𝑅12𝔼delimited-[]𝑦subscript𝜑𝑅 for 𝑦superscript𝐿2Ω\mathbb{E}[\mathcal{X}y]=\sum_{k=1}^{R}\gamma_{k}^{1/2}\mathbb{E}\bigl{[}y\,% \varphi_{k}\bigr{]}\boldsymbol{q}_{k}=Q\begin{bmatrix}\gamma_{1}^{1/2}\mathbb{% E}[y\,\varphi_{1}]\\ \vdots\\ \gamma_{R}^{1/2}\mathbb{E}[y\,\varphi_{R}]\end{bmatrix},\text{ for }y\in L^{2}% (\Omega),blackboard_E [ caligraphic_X italic_y ] = ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 / 2 end_POSTSUPERSCRIPT blackboard_E [ italic_y italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT = italic_Q [ start_ARG start_ROW start_CELL italic_γ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 / 2 end_POSTSUPERSCRIPT blackboard_E [ italic_y italic_φ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ] end_CELL end_ROW start_ROW start_CELL ⋮ end_CELL end_ROW start_ROW start_CELL italic_γ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 / 2 end_POSTSUPERSCRIPT blackboard_E [ italic_y italic_φ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ] end_CELL end_ROW end_ARG ] , for italic_y ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ,

where φk:=γk1/2𝒳𝐪kassignsubscript𝜑𝑘superscriptsubscript𝛾𝑘12superscript𝒳topsubscript𝐪𝑘\varphi_{k}:=\gamma_{k}^{-1/2}\mathcal{X}^{\top}\boldsymbol{q}_{k}italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT := italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 / 2 end_POSTSUPERSCRIPT caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT, k=1,,R𝑘1𝑅k=1,\dots,Ritalic_k = 1 , … , italic_R is an orthonormal basis of Im((𝒳))L2(Ω)\mathrm{Im}\bigl{(}(\mathcal{X}^{\top}\cdot\,)\bigr{)}\subset L^{2}(\Omega)roman_Im ( ( caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ⋅ ) ) ⊂ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ).

Proof.

From

𝔼[𝒳𝒳γk1𝒒k]=γk1Qdiag(γ1,,γR)Q𝒒k=𝒒k,𝔼delimited-[]𝒳superscript𝒳topsuperscriptsubscript𝛾𝑘1subscript𝒒𝑘superscriptsubscript𝛾𝑘1𝑄diagsubscript𝛾1subscript𝛾𝑅superscript𝑄topsubscript𝒒𝑘subscript𝒒𝑘\mathbb{E}[\mathcal{X}\mathcal{X}^{\top}\gamma_{k}^{-1}\boldsymbol{q}_{k}]=% \gamma_{k}^{-1}Q\mathrm{diag}(\gamma_{1},\dots,\gamma_{R})Q^{\top}\boldsymbol{% q}_{k}=\boldsymbol{q}_{k},blackboard_E [ caligraphic_X caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] = italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT italic_Q roman_diag ( italic_γ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_γ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ) italic_Q start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT = bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ,

we have {𝒒k}k=1RIm(𝔼[𝒳])\{\boldsymbol{q}_{k}\}_{k=1}^{R}\subset\mathrm{Im}(\mathbb{E}[\mathcal{X}\,% \cdot\,]){ bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT } start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ⊂ roman_Im ( blackboard_E [ caligraphic_X ⋅ ] ), and thus {𝒒k}k=1Rsuperscriptsubscriptsubscript𝒒𝑘𝑘1𝑅\{\boldsymbol{q}_{k}\}_{k=1}^{R}{ bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT } start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT is an orthonormal basis of Im(𝔼[𝒳])d\mathrm{Im}(\mathbb{E}[\mathcal{X}\,\cdot\,])\subset\mathbb{R}^{d}roman_Im ( blackboard_E [ caligraphic_X ⋅ ] ) ⊂ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT.

Thus, with some coefficients {ck}k=1Rsuperscriptsubscriptsubscript𝑐𝑘𝑘1𝑅\{c_{k}\}_{k=1}^{R}\subset\mathbb{R}{ italic_c start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT } start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ⊂ blackboard_R we have for any yL2(Ω)𝑦superscript𝐿2Ωy\in L^{2}(\Omega)italic_y ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) a representation k=1Rck𝒒k=𝔼[𝒳y]superscriptsubscript𝑘1𝑅subscript𝑐𝑘subscript𝒒𝑘𝔼delimited-[]𝒳𝑦\sum_{k=1}^{R}c_{k}\boldsymbol{q}_{k}=\mathbb{E}[\mathcal{X}y]∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_c start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT = blackboard_E [ caligraphic_X italic_y ], which implies

ck=𝒒k𝔼[𝒳y]=𝔼[𝒳𝒒ky]=γk1/2𝔼[γk1/2𝒳𝒒ky]=γk1/2𝔼[φky].subscript𝑐𝑘superscriptsubscript𝒒𝑘top𝔼delimited-[]𝒳𝑦𝔼delimited-[]superscript𝒳topsubscript𝒒𝑘𝑦superscriptsubscript𝛾𝑘12𝔼delimited-[]superscriptsubscript𝛾𝑘12superscript𝒳topsubscript𝒒𝑘𝑦superscriptsubscript𝛾𝑘12𝔼delimited-[]subscript𝜑𝑘𝑦c_{k}=\boldsymbol{q}_{k}^{\top}\mathbb{E}[\mathcal{X}y]=\mathbb{E}[\mathcal{X}% ^{\top}\boldsymbol{q}_{k}y]=\gamma_{k}^{1/2}\mathbb{E}[\gamma_{k}^{-1/2}% \mathcal{X}^{\top}\boldsymbol{q}_{k}y]=\gamma_{k}^{1/2}\mathbb{E}[\varphi_{k}y].italic_c start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT = bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ caligraphic_X italic_y ] = blackboard_E [ caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT italic_y ] = italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 / 2 end_POSTSUPERSCRIPT blackboard_E [ italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 / 2 end_POSTSUPERSCRIPT caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT italic_y ] = italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 / 2 end_POSTSUPERSCRIPT blackboard_E [ italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT italic_y ] .

The functions φk=γk1/2𝒳𝒒ksubscript𝜑𝑘superscriptsubscript𝛾𝑘12superscript𝒳topsubscript𝒒𝑘\varphi_{k}=\gamma_{k}^{-1/2}\mathcal{X}^{\top}\boldsymbol{q}_{k}italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT = italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 / 2 end_POSTSUPERSCRIPT caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT, k=1,,R𝑘1𝑅k=1,\dots,Ritalic_k = 1 , … , italic_R are orthonormal in L2(Ω)superscript𝐿2ΩL^{2}(\Omega)italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ), and thus form an orthonormal basis in the R𝑅Ritalic_R-dimensional subspace Im((𝒳))\mathrm{Im}\bigl{(}(\mathcal{X}^{\top}\cdot\,)\bigr{)}roman_Im ( ( caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ⋅ ) ). ∎

Remark 2.3.

Lemmata 2.1 and 2.2 imply rank(𝒳)=dim(span(𝒳))rank𝒳dimspan𝒳\mathrm{rank}\left(\mathcal{X}\right)=\mathrm{dim}(\mathrm{span}(\mathcal{X}))roman_rank ( caligraphic_X ) = roman_dim ( roman_span ( caligraphic_X ) ), where

span(𝒳):=span({𝒳(ω)dωΩ})={j=1ncj𝒳(ωj)d|n,cj,ωjΩ}d,assignspan𝒳spanconditional-set𝒳𝜔superscript𝑑𝜔Ωconditional-setsuperscriptsubscript𝑗1𝑛subscript𝑐𝑗𝒳subscript𝜔𝑗superscript𝑑formulae-sequence𝑛formulae-sequencesubscript𝑐𝑗subscript𝜔𝑗Ωsuperscript𝑑\mathrm{span}(\mathcal{X}):=\mathrm{span}(\{\mathcal{X}(\omega)\in\mathbb{R}^{% d}\mid\omega\in\Omega\})=\biggl{\{}\sum_{j=1}^{n}c_{j}\mathcal{X}(\omega_{j})% \in\mathbb{R}^{d}\,\bigg{|}\,n\in\mathbb{N},\,c_{j}\in\mathbb{R},\,\omega_{j}% \in\Omega\biggr{\}}\subset\mathbb{R}^{d},roman_span ( caligraphic_X ) := roman_span ( { caligraphic_X ( italic_ω ) ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ∣ italic_ω ∈ roman_Ω } ) = { ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_n end_POSTSUPERSCRIPT italic_c start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT caligraphic_X ( italic_ω start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ) ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT | italic_n ∈ blackboard_N , italic_c start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∈ blackboard_R , italic_ω start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∈ roman_Ω } ⊂ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ,

i.e. the rank of 𝒳L2(Ω;d)𝒳superscript𝐿2Ωsuperscript𝑑\mathcal{X}\in L^{2}(\Omega;\mathbb{R}^{d})caligraphic_X ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) as in Definition 2.1 gives the dimension of the space spanned by all the realizations of 𝒳𝒳\mathcal{X}caligraphic_X. To see this, take 𝒳L2(Ω;d)𝒳superscript𝐿2Ωsuperscript𝑑\mathcal{X}\in L^{2}(\Omega;\mathbb{R}^{d})caligraphic_X ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) such that dim(Im(𝔼[𝒳]))=R\mathrm{dim}(\mathrm{Im}(\mathbb{E}[\mathcal{X}\,\cdot\,]))=Rroman_dim ( roman_Im ( blackboard_E [ caligraphic_X ⋅ ] ) ) = italic_R. Lemma 2.1 implies that 𝔼[𝒳𝒳]=Qdiag(γ1,,γR)Q𝔼delimited-[]𝒳superscript𝒳top𝑄diagsubscript𝛾1subscript𝛾𝑅superscript𝑄top\mathbb{E}[\mathcal{X}\mathcal{X}^{\top}]=Q\mathrm{diag}(\gamma_{1},\dots,% \gamma_{R})Q^{\top}blackboard_E [ caligraphic_X caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] = italic_Q roman_diag ( italic_γ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_γ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ) italic_Q start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT holds, where γ1,,γR>0subscript𝛾1subscript𝛾𝑅0\gamma_{1},\dots,\gamma_{R}>0italic_γ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_γ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT > 0 and Qd×R𝑄superscript𝑑𝑅Q\in\mathbb{R}^{d\times R}italic_Q ∈ blackboard_R start_POSTSUPERSCRIPT italic_d × italic_R end_POSTSUPERSCRIPT is a matrix consisting of R𝑅Ritalic_R orthogonal columns 𝒒1,,𝒒Rdsubscript𝒒1subscript𝒒𝑅superscript𝑑\boldsymbol{q}_{1},\dots,\boldsymbol{q}_{R}\in\mathbb{R}^{d}bold_italic_q start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , bold_italic_q start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT, while Lemma 2.2 tells us that φk:=γk1/2𝒳𝒒kassignsubscript𝜑𝑘superscriptsubscript𝛾𝑘12superscript𝒳topsubscript𝒒𝑘\varphi_{k}:=\gamma_{k}^{-1/2}\mathcal{X}^{\top}\boldsymbol{q}_{k}italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT := italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 / 2 end_POSTSUPERSCRIPT caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT, for k=1,,R𝑘1𝑅k=1,\dots,Ritalic_k = 1 , … , italic_R, is an orthonormal basis of Im((𝒳))L2(Ω)\mathrm{Im}\bigl{(}(\mathcal{X}^{\top}\cdot\,)\bigr{)}\subset L^{2}(\Omega)roman_Im ( ( caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ⋅ ) ) ⊂ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ). Therefore, 𝒳𝒳\mathcal{X}caligraphic_X admits the expansion

𝒳(ω)=k=1R𝔼[𝒳φk]φk(ω),𝒳𝜔superscriptsubscript𝑘1𝑅𝔼delimited-[]𝒳subscript𝜑𝑘subscript𝜑𝑘𝜔\mathcal{X}(\omega)=\sum_{k=1}^{R}\mathbb{E}[\mathcal{X}\varphi_{k}]\varphi_{k% }(\omega),caligraphic_X ( italic_ω ) = ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ caligraphic_X italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ( italic_ω ) , (2.20)

where 𝔼[𝒳φk]:=(𝔼[𝒳φk])=1,,dassign𝔼delimited-[]𝒳subscript𝜑𝑘subscript𝔼delimited-[]subscript𝒳subscript𝜑𝑘1𝑑\mathbb{E}[\mathcal{X}\varphi_{k}]:=(\mathbb{E}[\mathcal{X}_{\ell}\varphi_{k}]% )_{\ell=1,\dots,d}blackboard_E [ caligraphic_X italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] := ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT roman_ℓ end_POSTSUBSCRIPT italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] ) start_POSTSUBSCRIPT roman_ℓ = 1 , … , italic_d end_POSTSUBSCRIPT is the component-wise L2(Ω)superscript𝐿2ΩL^{2}(\Omega)italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω )-inner product. From φk=γk1/2𝒒k𝒳subscript𝜑𝑘superscriptsubscript𝛾𝑘12superscriptsubscript𝒒𝑘top𝒳\varphi_{k}=\gamma_{k}^{-1/2}\boldsymbol{q}_{k}^{\top}\mathcal{X}italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT = italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 / 2 end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT caligraphic_X we have

𝔼[𝒳φk]=γk1/2𝔼[𝒳𝒳𝒒k]=γk1/2Qdiag(γ1,,γR)Q𝒒k=γk1/2𝒒k.𝔼delimited-[]𝒳subscript𝜑𝑘superscriptsubscript𝛾𝑘12𝔼delimited-[]𝒳superscript𝒳topsubscript𝒒𝑘superscriptsubscript𝛾𝑘12𝑄diagsubscript𝛾1subscript𝛾𝑅superscript𝑄topsubscript𝒒𝑘superscriptsubscript𝛾𝑘12subscript𝒒𝑘\mathbb{E}[\mathcal{X}\varphi_{k}]=\gamma_{k}^{-1/2}\mathbb{E}[\mathcal{X}% \mathcal{X}^{\top}\boldsymbol{q}_{k}]=\gamma_{k}^{-1/2}Q\mathrm{diag}(\gamma_{% 1},\dots,\gamma_{R})Q^{\top}\boldsymbol{q}_{k}=\gamma_{k}^{1/2}\boldsymbol{q}_% {k}.blackboard_E [ caligraphic_X italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] = italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 / 2 end_POSTSUPERSCRIPT blackboard_E [ caligraphic_X caligraphic_X start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] = italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 / 2 end_POSTSUPERSCRIPT italic_Q roman_diag ( italic_γ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_γ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ) italic_Q start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT = italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 / 2 end_POSTSUPERSCRIPT bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT . (2.21)

By substituting (2.21) into (2.20), we obtain 𝒳(ω)=k=1Rγk1/2φk(ω)𝒒k𝒳𝜔superscriptsubscript𝑘1𝑅superscriptsubscript𝛾𝑘12subscript𝜑𝑘𝜔subscript𝒒𝑘\mathcal{X}(\omega)=\sum_{k=1}^{R}\gamma_{k}^{1/2}\varphi_{k}(\omega)% \boldsymbol{q}_{k}caligraphic_X ( italic_ω ) = ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 / 2 end_POSTSUPERSCRIPT italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ( italic_ω ) bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT for any ωΩ𝜔Ω\omega\in\Omegaitalic_ω ∈ roman_Ω,. This implies that j=1ncj𝒳(ωj)=k=1Rγk1/2cjφk(ωj)𝒒ksuperscriptsubscript𝑗1𝑛subscript𝑐𝑗𝒳subscript𝜔𝑗superscriptsubscript𝑘1𝑅superscriptsubscript𝛾𝑘12subscript𝑐𝑗subscript𝜑𝑘subscript𝜔𝑗subscript𝒒𝑘\sum_{j=1}^{n}c_{j}\mathcal{X}(\omega_{j})=\sum_{k=1}^{R}\gamma_{k}^{1/2}c_{j}% \varphi_{k}(\omega_{j})\boldsymbol{q}_{k}∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_n end_POSTSUPERSCRIPT italic_c start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT caligraphic_X ( italic_ω start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ) = ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_γ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 / 2 end_POSTSUPERSCRIPT italic_c start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_φ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ( italic_ω start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ) bold_italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT for any n𝑛n\in\mathbb{N}italic_n ∈ blackboard_N, cj,subscript𝑐𝑗c_{j}\in\mathbb{R},italic_c start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∈ blackboard_R , and ωjΩsubscript𝜔𝑗Ω\omega_{j}\in\Omegaitalic_ω start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∈ roman_Ω, i.e. the space spanned by all the realizations of 𝒳(ω)𝒳𝜔\mathcal{X}(\omega)caligraphic_X ( italic_ω ) is spanned by 𝒒1,,𝒒Rsubscript𝒒1subscript𝒒𝑅\boldsymbol{q}_{1},\dots,\boldsymbol{q}_{R}bold_italic_q start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , bold_italic_q start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT. Therefore, dim(span(𝒳))=Rdimspan𝒳𝑅\mathrm{dim}(\mathrm{span}(\mathcal{X}))=Rroman_dim ( roman_span ( caligraphic_X ) ) = italic_R.

The equation (2.19) together with Lemma 2.2 shows ddt(𝔼[𝒳t𝒳t])T𝔼[𝒳t𝒳t]𝑑𝑑𝑡𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡topsubscript𝑇𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡top\frac{d}{dt}(\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}])\in T_{\mathbb{% E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}]}\mathcal{M}divide start_ARG italic_d end_ARG start_ARG italic_d italic_t end_ARG ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ) ∈ italic_T start_POSTSUBSCRIPT blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] end_POSTSUBSCRIPT caligraphic_M. Indeed, the first term of the right hand side of (2.19) can be written as

𝔼[𝒳tμt]𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝜇𝑡top\displaystyle\mathbb{E}\bigl{[}\mathcal{X}_{t}\mu_{t}^{\top}\bigr{]}blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] =𝔼[𝒳t(𝒫𝒴(𝒳t)a(t,𝒳t))](Id×d𝒫𝒰(𝒳t))+𝔼[𝒳ta(t,𝒳t)]𝒫𝒰(𝒳t)absent𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒫𝒴subscript𝒳𝑡𝑎𝑡subscript𝒳𝑡topsubscript𝐼𝑑𝑑subscript𝒫𝒰subscript𝒳𝑡𝔼delimited-[]subscript𝒳𝑡𝑎superscript𝑡subscript𝒳𝑡topsubscript𝒫𝒰subscript𝒳𝑡\displaystyle=\mathbb{E}\bigl{[}\mathcal{X}_{t}(\mathscr{P}_{\mathcal{Y}(% \mathcal{X}_{t})}a(t,\mathcal{X}_{t}))^{\top}\bigr{]}(I_{d\times d}-\mathscr{P% }_{\mathcal{U}(\mathcal{X}_{t})})+\mathbb{E}\bigl{[}\mathcal{X}_{t}a(t,% \mathcal{X}_{t})^{\top}\bigr{]}\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}= blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) + blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT
=QtBt(Id×dQtQt)+QtCtQtQt,absentsubscript𝑄𝑡subscript𝐵𝑡subscript𝐼𝑑𝑑subscript𝑄𝑡superscriptsubscript𝑄𝑡topsubscript𝑄𝑡subscript𝐶𝑡subscript𝑄𝑡superscriptsubscript𝑄𝑡top\displaystyle=Q_{t}B_{t}(I_{d\times d}-Q_{t}Q_{t}^{\top})+Q_{t}C_{t}Q_{t}Q_{t}% ^{\top},= italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_B start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) + italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_C start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ,

where, using Lemma 2.2, we may write QtBt:=𝔼[𝒳t(𝒫𝒴(𝒳t)a(t,𝒳t))]assignsubscript𝑄𝑡subscript𝐵𝑡𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒫𝒴subscript𝒳𝑡𝑎𝑡subscript𝒳𝑡topQ_{t}B_{t}:=\mathbb{E}\bigl{[}\mathcal{X}_{t}(\mathscr{P}_{\mathcal{Y}(% \mathcal{X}_{t})}a(t,\mathcal{X}_{t}))^{\top}\bigr{]}italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_B start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT := blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] and QtCt:=𝔼[𝒳ta(t,𝒳t)]assignsubscript𝑄𝑡subscript𝐶𝑡𝔼delimited-[]subscript𝒳𝑡𝑎superscript𝑡subscript𝒳𝑡topQ_{t}C_{t}:=\mathbb{E}\bigl{[}\mathcal{X}_{t}a(t,\mathcal{X}_{t})^{\top}\bigr{]}italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_C start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT := blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] with some Bt,Ctd×dsubscript𝐵𝑡subscript𝐶𝑡superscript𝑑𝑑B_{t},C_{t}\in\mathbb{R}^{d\times d}italic_B start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , italic_C start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d × italic_d end_POSTSUPERSCRIPT. Then, with V~t:=(Bt(Id×dQtQt))assignsubscript~𝑉𝑡superscriptsubscript𝐵𝑡subscript𝐼𝑑𝑑subscript𝑄𝑡superscriptsubscript𝑄𝑡toptop\tilde{V}_{t}:=(B_{t}(I_{d\times d}-Q_{t}Q_{t}^{\top}))^{\top}over~ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT := ( italic_B start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT and A~t:=CtQtassignsubscript~𝐴𝑡subscript𝐶𝑡subscript𝑄𝑡\tilde{A}_{t}:=C_{t}Q_{t}over~ start_ARG italic_A end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT := italic_C start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT we have

𝔼[𝒳tμt]=QtV~t+QtA~tQt.𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝜇𝑡topsubscript𝑄𝑡superscriptsubscript~𝑉𝑡topsubscript𝑄𝑡subscript~𝐴𝑡superscriptsubscript𝑄𝑡top\mathbb{E}\bigl{[}\mathcal{X}_{t}\mu_{t}^{\top}\bigr{]}=Q_{t}\tilde{V}_{t}^{% \top}+Q_{t}\tilde{A}_{t}Q_{t}^{\top}.blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] = italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over~ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT + italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over~ start_ARG italic_A end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT .

Similarly, we have 𝔼[μt𝒳t]=V~tQt+QtA~tQt𝔼delimited-[]subscript𝜇𝑡superscriptsubscript𝒳𝑡topsubscript~𝑉𝑡superscriptsubscript𝑄𝑡topsubscript𝑄𝑡superscriptsubscript~𝐴𝑡topsuperscriptsubscript𝑄𝑡top\mathbb{E}[\mu_{t}\mathcal{X}_{t}^{\top}]=\tilde{V}_{t}Q_{t}^{\top}+Q_{t}% \tilde{A}_{t}^{\top}Q_{t}^{\top}blackboard_E [ italic_μ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] = over~ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT + italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over~ start_ARG italic_A end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT and 𝔼[ΣtΣt]=QtQt𝔼[b(t,𝒳t)b(t,𝒳t)]QtQt𝔼delimited-[]subscriptΣ𝑡superscriptsubscriptΣ𝑡topsubscript𝑄𝑡superscriptsubscript𝑄𝑡top𝔼delimited-[]𝑏𝑡subscript𝒳𝑡𝑏superscript𝑡subscript𝒳𝑡topsubscript𝑄𝑡superscriptsubscript𝑄𝑡top\mathbb{E}[\Sigma_{t}\Sigma_{t}^{\top}]=Q_{t}Q_{t}^{\top}\mathbb{E}[b(t,% \mathcal{X}_{t})b(t,\mathcal{X}_{t})^{\top}]Q_{t}Q_{t}^{\top}blackboard_E [ roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT roman_Σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] = italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ italic_b ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_b ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_Q start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT. Hence, if 𝔼[𝒳t𝒳t]𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡top\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}]blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] is of rank R𝑅Ritalic_R around t𝑡titalic_t, then its derivative (2.19), which was derived from the projected dynamics (2.17), lies indeed in T𝔼[𝒳t𝒳t]subscript𝑇𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡topT_{\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}]}\mathcal{M}italic_T start_POSTSUBSCRIPT blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] end_POSTSUBSCRIPT caligraphic_M. This consistency supports the validity of the formulation (2.17), and in turn that of the DO equations (2.6) and (2.7).

2.3 Equivalence of DO and DLR formulations

In the previous section, we showed that if there exists a strong DO solution (𝑼t,𝒀t)subscript𝑼𝑡subscript𝒀𝑡(\boldsymbol{U}_{t},\boldsymbol{Y}_{t})( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) to (2.1), then the corresponding DO approximation Xt=𝑼t𝒀tsubscript𝑋𝑡subscriptsuperscript𝑼top𝑡subscript𝒀𝑡X_{t}=\boldsymbol{U}^{\top}_{t}\boldsymbol{Y}_{t}italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT satisfies (2.17). We now investigate the reverse question: if 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT is a rank-R𝑅Ritalic_R solution of (2.17) (DLR solution of rank R𝑅Ritalic_R of (2.1)) does there exist a DO solution (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) such that 𝒳=𝑼𝒀𝒳superscript𝑼top𝒀\mathcal{X}=\boldsymbol{U}^{\top}\boldsymbol{Y}caligraphic_X = bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y?

First, we need the following bound for the DLR solution.

Lemma 2.4.

Let a rank-R𝑅Ritalic_R DLR solution 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ], to (2.1) with 𝒳0L2(Ω;d)subscript𝒳0superscript𝐿2Ωsuperscript𝑑\mathcal{X}_{0}\in L^{2}(\Omega;\mathbb{R}^{d})caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) be given. For all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ], 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT satisfies

𝔼[|𝒳t|2]3(𝔼[|𝒳0|2]+ClgbT(T+1))exp(3ClgbT(T+1))=:M(T)\mathbb{E}[|\mathcal{X}_{t}|^{2}]\leq 3\big{(}\mathbb{E}[|\mathcal{X}_{0}|^{2}% ]+C_{\mathrm{lgb}}T(T+1)\big{)}\mathrm{exp}\big{(}3C_{\mathrm{lgb}}T(T+1)\big{% )}=:M(T)blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ 3 ( blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT italic_T ( italic_T + 1 ) ) roman_exp ( 3 italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT italic_T ( italic_T + 1 ) ) = : italic_M ( italic_T ) (2.22)
Proof.

Taking the squared L2(Ω)superscript𝐿2ΩL^{2}(\Omega)italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω )-norm of 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and using (2.17) in integral form, together with Itô’s isometry, Jensen’s inequality, and Assumption 2, we have

𝔼[|𝒳t|2]=𝔼delimited-[]superscriptsubscript𝒳𝑡2absent\displaystyle\mathbb{E}[|\mathcal{X}_{t}|^{2}]=blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] = 𝔼[|𝒳0+0t((Id×d𝒫𝒰(𝒳s))[𝒫𝒴(𝒳s)a(s,𝒳s)]+𝒫𝒰(Xs)a(s,𝒳s))ds\displaystyle\mathbb{E}[|\mathcal{X}_{0}+\int^{t}_{0}\bigl{(}\bigl{(}I_{d% \times d}-\mathscr{P}_{\mathcal{U}(\mathcal{X}_{s})}\bigr{)}[\mathscr{P}_{% \mathcal{Y}(\mathcal{X}_{s})}a(s,\mathcal{X}_{s})]+\mathscr{P}_{\mathcal{U}(X_% {s})}a(s,\mathcal{X}_{s})\bigr{)}\,dsblackboard_E [ | caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT + ∫ start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) [ script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ] + script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) italic_d italic_s
+𝒫𝒰(𝒳s)b(s,𝒳s)dWs|2]\displaystyle+\mathscr{P}_{\mathcal{U}(\mathcal{X}_{s})}b(s,\mathcal{X}_{s})\,% dW_{s}|^{2}]+ script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
\displaystyle\leq 3𝔼[|𝒳0|2]+3𝔼[|0t((Id×d𝒫𝒰(𝒳s))𝒫𝒴(𝒳s)+𝒫𝒰(𝒳s))a(s,𝒳s)𝑑s|2]3𝔼delimited-[]superscriptsubscript𝒳023𝔼delimited-[]superscriptsubscriptsuperscript𝑡0subscript𝐼𝑑𝑑subscript𝒫𝒰subscript𝒳𝑠subscript𝒫𝒴subscript𝒳𝑠subscript𝒫𝒰subscript𝒳𝑠𝑎𝑠subscript𝒳𝑠differential-d𝑠2\displaystyle 3\mathbb{E}[|\mathcal{X}_{0}|^{2}]+3\mathbb{E}[|\int^{t}_{0}% \left(\bigl{(}I_{d\times d}-\mathscr{P}_{\mathcal{U}(\mathcal{X}_{s})}\bigr{)}% \mathscr{P}_{\mathcal{Y}(\mathcal{X}_{s})}+\mathscr{P}_{\mathcal{U}(\mathcal{X% }_{s})}\right)a(s,\mathcal{X}_{s})\,ds|^{2}]3 blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + 3 blackboard_E [ | ∫ start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) italic_a ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_s | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
+3𝔼[|0t𝒫𝒰(𝒳s)b(s,𝒳s)𝑑Ws|2]3𝔼delimited-[]superscriptsubscriptsuperscript𝑡0subscript𝒫𝒰subscript𝒳𝑠𝑏𝑠subscript𝒳𝑠differential-dsubscript𝑊𝑠2\displaystyle+3\mathbb{E}[|\int^{t}_{0}\mathscr{P}_{\mathcal{U}(\mathcal{X}_{s% })}b(s,\mathcal{X}_{s})\,dW_{s}|^{2}]+ 3 blackboard_E [ | ∫ start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
\displaystyle\leq 3𝔼[|𝒳0|2]+3T0t𝔼[|((Id×d𝒫𝒰(𝒳s))𝒫𝒴(𝒳s)+𝒫𝒰(𝒳s))a(s,𝒳s)|2]𝑑s3𝔼delimited-[]superscriptsubscript𝒳023𝑇subscriptsuperscript𝑡0𝔼delimited-[]superscriptsubscript𝐼𝑑𝑑subscript𝒫𝒰subscript𝒳𝑠subscript𝒫𝒴subscript𝒳𝑠subscript𝒫𝒰subscript𝒳𝑠𝑎𝑠subscript𝒳𝑠2differential-d𝑠\displaystyle 3\mathbb{E}[|\mathcal{X}_{0}|^{2}]+3T\int^{t}_{0}\mathbb{E}[|% \left(\bigl{(}I_{d\times d}-\mathscr{P}_{\mathcal{U}(\mathcal{X}_{s})}\bigr{)}% \mathscr{P}_{\mathcal{Y}(\mathcal{X}_{s})}+\mathscr{P}_{\mathcal{U}(\mathcal{X% }_{s})}\right)a(s,\mathcal{X}_{s})\,|^{2}]ds3 blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + 3 italic_T ∫ start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT blackboard_E [ | ( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) italic_a ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_s
+30t𝔼[|𝒫𝒰(𝒳s)b(s,𝒳s)|2]𝑑s3subscriptsuperscript𝑡0𝔼delimited-[]superscriptsubscript𝒫𝒰subscript𝒳𝑠𝑏𝑠subscript𝒳𝑠2differential-d𝑠\displaystyle+3\int^{t}_{0}\mathbb{E}[|\mathscr{P}_{\mathcal{U}(\mathcal{X}_{s% })}b(s,\mathcal{X}_{s})\,|^{2}]ds+ 3 ∫ start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT blackboard_E [ | script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_s
\displaystyle\leq 3𝔼[|𝒳0|2]+3Clgb(T+1)0t(1+𝔼[|𝒳s|2])𝑑s.3𝔼delimited-[]superscriptsubscript𝒳023subscript𝐶lgb𝑇1subscriptsuperscript𝑡01𝔼delimited-[]superscriptsubscript𝒳𝑠2differential-d𝑠\displaystyle 3\mathbb{E}[|\mathcal{X}_{0}|^{2}]+3C_{\mathrm{lgb}}(T+1)\int^{t% }_{0}(1+\mathbb{E}[|\mathcal{X}_{s}|^{2}])ds.3 blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + 3 italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( italic_T + 1 ) ∫ start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ( 1 + blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_d italic_s .

Hence, Gronwall’s lemma implies the statement. ∎

The following theorem gives the uniqueness of the DLR solution.

Theorem 2.5.

Let 𝒳0L2(Ω;d)subscript𝒳0superscript𝐿2Ωsuperscript𝑑\mathcal{X}_{0}\in L^{2}(\Omega;\mathbb{R}^{d})caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) be such that dim(Im(𝔼[𝒳0]))=R\mathrm{dim}(\mathrm{Im}(\mathbb{E}[\mathcal{X}_{0}\,\cdot\,]))=Rroman_dim ( roman_Im ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ⋅ ] ) ) = italic_R. Suppose that two DLR solutions 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and 𝒵tsubscript𝒵𝑡\mathcal{Z}_{t}caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT of rank R𝑅Ritalic_R to (2.1) with initial datum 𝒳0subscript𝒳0\mathcal{X}_{0}caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT exist on [0,T]0𝑇[0,T][ 0 , italic_T ]. Then 𝒳𝒳\mathcal{X}caligraphic_X and 𝒵𝒵\mathcal{Z}caligraphic_Z are indistinguishable.

Proof.

The processes 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and 𝒵tsubscript𝒵𝑡\mathcal{Z}_{t}caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT are assumed to satisfy

d𝒳t=((Id×d𝒫𝒰(𝒳t))[𝒫𝒴(𝒳t)a(t,𝒳t)]+𝒫𝒰(𝒳t)a(t,𝒳t))=:𝔓𝒳ta(t,𝒳t)dt+𝒫𝒰(𝒳t)b(t,𝒳t)dWt𝑑subscript𝒳𝑡subscriptsubscript𝐼𝑑𝑑subscript𝒫𝒰subscript𝒳𝑡delimited-[]subscript𝒫𝒴subscript𝒳𝑡𝑎𝑡subscript𝒳𝑡subscript𝒫𝒰subscript𝒳𝑡𝑎𝑡subscript𝒳𝑡:absentsubscript𝔓subscript𝒳𝑡𝑎𝑡subscript𝒳𝑡𝑑𝑡subscript𝒫𝒰subscript𝒳𝑡𝑏𝑡subscript𝒳𝑡𝑑subscript𝑊𝑡d\mathcal{X}_{t}=\underbrace{\bigl{(}\bigl{(}I_{d\times d}-\mathscr{P}_{% \mathcal{U}(\mathcal{X}_{t})}\bigr{)}[\mathscr{P}_{\mathcal{Y}(\mathcal{X}_{t}% )}a(t,\mathcal{\mathcal{X}}_{t})]+\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}a(% t,\mathcal{X}_{t})\bigr{)}}_{=:\mathfrak{P}_{\mathcal{X}_{t}}a(t,\mathcal{% \mathcal{X}}_{t})}\,dt+\mathscr{P}_{\mathcal{U}(\mathcal{X}_{t})}b(t,\mathcal{% X}_{t})\,dW_{t}italic_d caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = under⏟ start_ARG ( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) [ script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ] + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ) end_ARG start_POSTSUBSCRIPT = : fraktur_P start_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_d italic_t + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT

and

d𝒵t=((Id×d𝒫𝒰(𝒵t))[𝒫𝒴(𝒵t)a(t,𝒵t)]+𝒫𝒰(𝒵t)a(t,𝒵t))=:𝔓𝒵ta(t,𝒵t)dt+𝒫𝒰(𝒵t)b(t,𝒵t)dWt,𝑑subscript𝒵𝑡subscriptsubscript𝐼𝑑𝑑subscript𝒫𝒰subscript𝒵𝑡delimited-[]subscript𝒫𝒴subscript𝒵𝑡𝑎𝑡subscript𝒵𝑡subscript𝒫𝒰subscript𝒵𝑡𝑎𝑡subscript𝒵𝑡:absentsubscript𝔓subscript𝒵𝑡𝑎𝑡subscript𝒵𝑡𝑑𝑡subscript𝒫𝒰subscript𝒵𝑡𝑏𝑡subscript𝒵𝑡𝑑subscript𝑊𝑡d\mathcal{Z}_{t}=\underbrace{\bigl{(}\bigl{(}I_{d\times d}-\mathscr{P}_{% \mathcal{U}(\mathcal{Z}_{t})}\bigr{)}[\mathscr{P}_{\mathcal{Y}(\mathcal{Z}_{t}% )}a(t,\mathcal{Z}_{t})]+\mathscr{P}_{\mathcal{U}(\mathcal{Z}_{t})}a(t,\mathcal% {Z}_{t})\bigr{)}}_{=:\mathfrak{P}_{\mathcal{Z}_{t}}a(t,\mathcal{Z}_{t})}\,dt+% \mathscr{P}_{\mathcal{U}(\mathcal{Z}_{t})}b(t,\mathcal{Z}_{t})\,dW_{t},italic_d caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = under⏟ start_ARG ( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) [ script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ] + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ) end_ARG start_POSTSUBSCRIPT = : fraktur_P start_POSTSUBSCRIPT caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_a ( italic_t , caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_d italic_t + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_t , caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ,

respectively, for the same initial datum 𝒳0subscript𝒳0\mathcal{X}_{0}caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT. This implies that

𝔼[|𝒳t𝒵t|2]𝔼delimited-[]superscriptsubscript𝒳𝑡subscript𝒵𝑡2\displaystyle\mathbb{E}\left[\left|\mathcal{X}_{t}-\mathcal{Z}_{t}\right|^{2}\right]blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] 𝔼[|0t((Id×d𝒫𝒰(𝒳s))𝒫𝒴(𝒳s)+𝒫𝒰(𝒳s))a(s,𝒳s)\displaystyle\leq\mathbb{E}\Bigg{[}\Bigg{|}\int_{0}^{t}\bigl{(}\bigl{(}I_{d% \times d}-\mathscr{P}_{\mathcal{U}(\mathcal{X}_{s})}\bigr{)}\mathscr{P}_{% \mathcal{Y}(\mathcal{X}_{s})}+\mathscr{P}_{\mathcal{U}(\mathcal{X}_{s})}\bigr{% )}a(s,\mathcal{X}_{s})≤ blackboard_E [ | ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) italic_a ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) (2.23)
((Id×d𝒫𝒰(𝒵s))𝒫𝒴(𝒵s)+𝒫𝒰(𝒵s))a(s,𝒵s)dssubscript𝐼𝑑𝑑subscript𝒫𝒰subscript𝒵𝑠subscript𝒫𝒴subscript𝒵𝑠subscript𝒫𝒰subscript𝒵𝑠𝑎𝑠subscript𝒵𝑠𝑑𝑠\displaystyle-\bigl{(}\bigl{(}I_{d\times d}-\mathscr{P}_{\mathcal{U}(\mathcal{% Z}_{s})}\bigr{)}\mathscr{P}_{\mathcal{Y}(\mathcal{Z}_{s})}+\mathscr{P}_{% \mathcal{U}(\mathcal{Z}_{s})}\bigr{)}a(s,\mathcal{Z}_{s})ds- ( ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT + script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) italic_a ( italic_s , caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_s
+0t𝒫𝒰(𝒳s)b(s,𝒳s)𝒫𝒰(𝒵s)b(s,𝒵s)dWs|2]\displaystyle+\int_{0}^{t}\mathscr{P}_{\mathcal{U}(\mathcal{X}_{s})}b(s,% \mathcal{X}_{s})-\mathscr{P}_{\mathcal{U}(\mathcal{Z}_{s})}b(s,\mathcal{Z}_{s}% )dW_{s}\Bigg{|}^{2}\Bigg{]}+ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
4𝔼[|0t(𝔓𝒳s𝔓𝒵s)a(s,𝒳s)𝑑s|2]+4𝔼[|0t𝔓𝒵s(a(s,𝒵s)a(s,𝒳s))𝑑s|2]absent4𝔼delimited-[]superscriptsuperscriptsubscript0𝑡subscript𝔓subscript𝒳𝑠subscript𝔓subscript𝒵𝑠𝑎𝑠subscript𝒳𝑠differential-d𝑠24𝔼delimited-[]superscriptsuperscriptsubscript0𝑡subscript𝔓subscript𝒵𝑠𝑎𝑠subscript𝒵𝑠𝑎𝑠subscript𝒳𝑠differential-d𝑠2\displaystyle\leq 4\mathbb{E}\left[\left|\int_{0}^{t}\bigl{(}\mathfrak{P}_{% \mathcal{X}_{s}}-\mathfrak{P}_{\mathcal{Z}_{s}}\bigr{)}a(s,\mathcal{X}_{s})ds% \right|^{2}\right]+4\mathbb{E}\left[\left|\int_{0}^{t}\mathfrak{P}_{\mathcal{Z% }_{s}}\bigl{(}a(s,\mathcal{Z}_{s})-a(s,\mathcal{X}_{s})\bigr{)}ds\right|^{2}\right]≤ 4 blackboard_E [ | ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( fraktur_P start_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT - fraktur_P start_POSTSUBSCRIPT caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT ) italic_a ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_s | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + 4 blackboard_E [ | ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT fraktur_P start_POSTSUBSCRIPT caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_a ( italic_s , caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) - italic_a ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) italic_d italic_s | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
+4𝔼[|0t(𝒫𝒰(𝒳s)𝒫𝒰(𝒵s))b(s,𝒳s)𝑑Ws|2]4𝔼delimited-[]superscriptsuperscriptsubscript0𝑡subscript𝒫𝒰subscript𝒳𝑠subscript𝒫𝒰subscript𝒵𝑠𝑏𝑠subscript𝒳𝑠differential-dsubscript𝑊𝑠2\displaystyle+4\mathbb{E}\left[\left|\int_{0}^{t}\bigl{(}\mathscr{P}_{\mathcal% {U}(\mathcal{X}_{s})}-\mathscr{P}_{\mathcal{U}(\mathcal{Z}_{s})}\bigr{)}b(s,% \mathcal{X}_{s})dW_{s}\right|^{2}\right]+ 4 blackboard_E [ | ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) italic_b ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
+4𝔼[|0t𝒫𝒰(𝒵s)(b(s,𝒳s)b(s,𝒵s))𝑑Ws|2]4𝔼delimited-[]superscriptsuperscriptsubscript0𝑡subscript𝒫𝒰subscript𝒵𝑠𝑏𝑠subscript𝒳𝑠𝑏𝑠subscript𝒵𝑠differential-dsubscript𝑊𝑠2\displaystyle+4\mathbb{E}\left[\left|\int_{0}^{t}\mathscr{P}_{\mathcal{U}(% \mathcal{Z}_{s})}\bigl{(}b(s,\mathcal{X}_{s})-b(s,\mathcal{Z}_{s})\bigr{)}dW_{% s}\right|^{2}\right]+ 4 blackboard_E [ | ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ( italic_b ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) - italic_b ( italic_s , caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]

Denote by

γ~:=inft[0,T]max{σR(𝔼[𝒳t𝒳t]),σR(𝔼[𝒵t𝒵t])}assign~𝛾subscriptinfimum𝑡0𝑇subscript𝜎𝑅𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡topsubscript𝜎𝑅𝔼delimited-[]subscript𝒵𝑡superscriptsubscript𝒵𝑡top\tilde{\gamma}:=\inf_{t\in[0,T]}\max\{\sigma_{R}\!\!\;\bigl{(}\mathbb{E}[% \mathcal{X}_{t}\mathcal{X}_{t}^{\top}]\bigr{)},\sigma_{R}\!\!\;\bigl{(}\mathbb% {E}[\mathcal{Z}_{t}\mathcal{Z}_{t}^{\top}]\bigr{)}\}over~ start_ARG italic_γ end_ARG := roman_inf start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT roman_max { italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ) , italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( blackboard_E [ caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ) }

the infimum over time of the maximum between the R𝑅Ritalic_R-th singular value of the matrices 𝔼[𝒳t𝒳t]R×R𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡topsuperscript𝑅𝑅\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}]\in\mathbb{R}^{R\times R}blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT and 𝔼[𝒵t𝒵t]R×R𝔼delimited-[]subscript𝒵𝑡superscriptsubscript𝒵𝑡topsuperscript𝑅𝑅\mathbb{E}[\mathcal{Z}_{t}\mathcal{Z}_{t}^{\top}]\in\mathbb{R}^{R\times R}blackboard_E [ caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT , where for all t𝑡titalic_t we are considering the singular values in a decreasing order. We have γ~>0~𝛾0\tilde{\gamma}>0over~ start_ARG italic_γ end_ARG > 0. To see this, first note that, from Lemma 2.1 the rank of 𝔼[𝒳t𝒳t]𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡top\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}]blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] is the same as the rank of 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT. But from the definition of DLR solution, 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT has always rank R𝑅Ritalic_R, and moreover, the continuity of 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT implies continuity of σR(𝔼[𝒳t𝒳t])subscript𝜎𝑅𝔼delimited-[]subscript𝒳𝑡superscriptsubscript𝒳𝑡top\sigma_{R}\!\!\;\bigl{(}\!\>\mathbb{E}[\mathcal{X}_{t}\mathcal{X}_{t}^{\top}])italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ) on [0,T]0𝑇[0,T][ 0 , italic_T ]. Hence γ~>0~𝛾0\tilde{\gamma}>0over~ start_ARG italic_γ end_ARG > 0 follows; see also [kazashi2021existence, Lemma 2.1]. Then, Proposition A.3 gives us the following Lipschitz bounds for the projectors for any s[0,T]𝑠0𝑇s\in[0,T]italic_s ∈ [ 0 , italic_T ]:

𝔼[|(𝔓𝒳s𝔓𝒵s)v|2](2γ~)2𝔼[|𝒳s𝒵s|2]vL2(Ω;d)2 for any vL2(Ω;d),formulae-sequence𝔼delimited-[]superscriptsubscript𝔓subscript𝒳𝑠subscript𝔓subscript𝒵𝑠𝑣2superscript2~𝛾2𝔼delimited-[]superscriptsubscript𝒳𝑠subscript𝒵𝑠2subscriptsuperscriptnorm𝑣2superscript𝐿2Ωsuperscript𝑑 for any 𝑣superscript𝐿2Ωsuperscript𝑑\displaystyle\mathbb{E}[|\bigl{(}\mathfrak{P}_{\mathcal{X}_{s}}-\mathfrak{P}_{% \mathcal{Z}_{s}}\bigr{)}v|^{2}]\leq\left(\frac{2}{\tilde{\gamma}}\right)^{2}% \mathbb{E}[|\mathcal{X}_{s}-\mathcal{Z}_{s}|^{2}]\|v\|^{2}_{L^{2}(\Omega;% \mathbb{R}^{d})}\quad\text{ for any }\ v\in L^{2}(\Omega;\mathbb{R}^{d}),blackboard_E [ | ( fraktur_P start_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT - fraktur_P start_POSTSUBSCRIPT caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT ) italic_v | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ ( divide start_ARG 2 end_ARG start_ARG over~ start_ARG italic_γ end_ARG end_ARG ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ∥ italic_v ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) end_POSTSUBSCRIPT for any italic_v ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) , (2.24)
𝒫𝒰(𝒳s)𝒫𝒰(𝒵s)22𝔼[|𝒳s𝒵s|2]γ~2.subscriptsuperscriptnormsubscript𝒫𝒰subscript𝒳𝑠subscript𝒫𝒰subscript𝒵𝑠22𝔼delimited-[]superscriptsubscript𝒳𝑠subscript𝒵𝑠2superscript~𝛾2\displaystyle\|\mathscr{P}_{\mathcal{U}(\mathcal{X}_{s})}-\mathscr{P}_{% \mathcal{U}(\mathcal{Z}_{s})}\|^{2}_{2}\leq\frac{\mathbb{E}[|\mathcal{X}_{s}-% \mathcal{Z}_{s}|^{2}]}{\tilde{\gamma}^{2}}.∥ script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ≤ divide start_ARG blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] end_ARG start_ARG over~ start_ARG italic_γ end_ARG start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG .

Hence (2.23), Itô’s isometry and Jensen’s inequality lead to

𝔼[|𝒳t𝒵t|2]𝔼delimited-[]superscriptsubscript𝒳𝑡subscript𝒵𝑡2absent\displaystyle\mathbb{E}[|\mathcal{X}_{t}-\mathcal{Z}_{t}|^{2}]\leqblackboard_E [ | caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ 4T0t𝔼[|(𝔓𝒳s𝔓𝒵s)a(s,𝒳s)|2]𝑑s4𝑇superscriptsubscript0𝑡𝔼delimited-[]superscriptsubscript𝔓subscript𝒳𝑠subscript𝔓subscript𝒵𝑠𝑎𝑠subscript𝒳𝑠2differential-d𝑠\displaystyle 4T\int_{0}^{t}\mathbb{E}[|\bigl{(}\mathfrak{P}_{\mathcal{X}_{s}}% -\mathfrak{P}_{\mathcal{Z}_{s}}\bigr{)}a(s,\mathcal{X}_{s})|^{2}]ds4 italic_T ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ | ( fraktur_P start_POSTSUBSCRIPT caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT - fraktur_P start_POSTSUBSCRIPT caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT ) italic_a ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_s (2.25)
+4T0t𝔼[|𝔓𝒵s(a(s,𝒵s)a(s,𝒳s))|2]𝑑s4𝑇superscriptsubscript0𝑡𝔼delimited-[]superscriptsubscript𝔓subscript𝒵𝑠𝑎𝑠subscript𝒵𝑠𝑎𝑠subscript𝒳𝑠2differential-d𝑠\displaystyle+4T\int_{0}^{t}\mathbb{E}[|\mathfrak{P}_{\mathcal{Z}_{s}}\bigl{(}% a(s,\mathcal{Z}_{s})-a(s,\mathcal{X}_{s})\bigr{)}|^{2}]ds+ 4 italic_T ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ | fraktur_P start_POSTSUBSCRIPT caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_a ( italic_s , caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) - italic_a ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_s
+40t𝔼[|(𝒫𝒰(𝒳s)𝒫𝒰(𝒵s))b(s,𝒳s)|2]𝑑s4superscriptsubscript0𝑡𝔼delimited-[]superscriptsubscript𝒫𝒰subscript𝒳𝑠subscript𝒫𝒰subscript𝒵𝑠𝑏𝑠subscript𝒳𝑠2differential-d𝑠\displaystyle+4\int_{0}^{t}\mathbb{E}[|\bigl{(}\mathscr{P}_{\mathcal{U}(% \mathcal{X}_{s})}-\mathscr{P}_{\mathcal{U}(\mathcal{Z}_{s})}\bigr{)}b(s,% \mathcal{X}_{s})|^{2}]ds+ 4 ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ | ( script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) italic_b ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_s
+40t𝔼[|𝒫𝒰(𝒵s)(b(s,𝒳s)b(s,𝒵s))|2]𝑑s4superscriptsubscript0𝑡𝔼delimited-[]superscriptsubscript𝒫𝒰subscript𝒵𝑠𝑏𝑠subscript𝒳𝑠𝑏𝑠subscript𝒵𝑠2differential-d𝑠\displaystyle+4\int_{0}^{t}\mathbb{E}[|\mathscr{P}_{\mathcal{U}(\mathcal{Z}_{s% })}\bigl{(}b(s,\mathcal{X}_{s})-b(s,\mathcal{Z}_{s})\bigr{)}|^{2}]d{s}+ 4 ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ | script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ( italic_b ( italic_s , caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) - italic_b ( italic_s , caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_s
\displaystyle\leq C¯0t𝔼[|𝒳s𝒵s|2]𝑑s,¯𝐶superscriptsubscript0𝑡𝔼delimited-[]superscriptsubscript𝒳𝑠subscript𝒵𝑠2differential-d𝑠\displaystyle\overline{C}\int_{0}^{t}\mathbb{E}[|\mathcal{X}_{s}-\mathcal{Z}_{% s}|^{2}]ds,over¯ start_ARG italic_C end_ARG ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - caligraphic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_s ,

for all t𝑡titalic_t in [0,T]0𝑇[0,T][ 0 , italic_T ] with C¯:=4((4T+1)γ~2Clgb(1+M(T))+CLip2(T+1))assign¯𝐶44𝑇1superscript~𝛾2subscript𝐶lgb1𝑀𝑇subscriptsuperscript𝐶2Lip𝑇1\overline{C}:=4\left(\left(4T+1\right)\tilde{\gamma}^{-2}C_{\mathrm{lgb}}(1+M(% T))+C^{2}_{\mathrm{Lip}}(T+1)\right)over¯ start_ARG italic_C end_ARG := 4 ( ( 4 italic_T + 1 ) over~ start_ARG italic_γ end_ARG start_POSTSUPERSCRIPT - 2 end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + italic_M ( italic_T ) ) + italic_C start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_Lip end_POSTSUBSCRIPT ( italic_T + 1 ) ) and M(T)𝑀𝑇M(T)italic_M ( italic_T ) as in (2.22). Gronwall’s lemma yields 𝔼[|𝒳t𝒵t|2]=0𝔼delimited-[]superscriptsubscript𝒳𝑡subscript𝒵𝑡20\mathbb{E}[|\mathcal{X}_{t}-\mathcal{Z}_{t}|^{2}]=0blackboard_E [ | caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] = 0 for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ] and therefore (𝒵t)t[0,T]subscriptsubscript𝒵𝑡𝑡0𝑇(\mathcal{Z}_{t})_{t\in[0,T]}( caligraphic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT and (𝒳t)t[0,T]subscriptsubscript𝒳𝑡𝑡0𝑇(\mathcal{X}_{t})_{t\in[0,T]}( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT are versions of each other. Moreover, because they both have a.s. continuous paths, they are indistinguishable; see for example [Protter.P.E_2005_book_StochasticIntegral_2nd, Theorem 2]. ∎

Given a strong DO solution (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) to (2.1), the corresponding DO approximation Xtsubscript𝑋𝑡X_{t}italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT satisfies the equation (2.16), and thus (2.17). Hence, Theorem 2.5 gives the sought equivalence between the DLR equation (2.17) and the DO equation (2.6)–(2.7), which we state as a corollary.

Corollary 2.6.

Let 𝒳0L2(Ω;d)subscript𝒳0superscript𝐿2Ωsuperscript𝑑\mathcal{X}_{0}\in L^{2}(\Omega;\mathbb{R}^{d})caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) with dim(Im(𝔼[𝒳0]))=R\mathrm{dim}(\mathrm{Im}(\mathbb{E}[\mathcal{X}_{0}\,\cdot\,]))=Rroman_dim ( roman_Im ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ⋅ ] ) ) = italic_R. Suppose that a DLR solution 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT of rank R𝑅Ritalic_R to (2.1) and a strong DO solution (𝐔,𝐘)𝐔𝐘(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) exist on [0,T]0𝑇[0,T][ 0 , italic_T ], both with initial datum 𝒳0subscript𝒳0\mathcal{X}_{0}caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT. Then, 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and the DO approximation Xt=𝐔t𝐘tsubscript𝑋𝑡subscriptsuperscript𝐔top𝑡subscript𝐘𝑡X_{t}=\boldsymbol{U}^{\top}_{t}\boldsymbol{Y}_{t}italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT are indistinguishable on [0,T]0𝑇[0,T][ 0 , italic_T ].

Moreover, the DO solution giving the same DLR solution is unique up to a rotation matrix. See also [kazashi2021existence, Section 2.2] for a similar result.

Proposition 2.7.

Assume that a DLR solution 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT of rank R𝑅Ritalic_R to (2.1) with initial datum 𝒳0[L2(Ω)]dsubscript𝒳0superscriptdelimited-[]superscript𝐿2Ω𝑑\mathcal{X}_{0}\in[L^{2}(\Omega)]^{d}caligraphic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT exists for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ]. Suppose there exist two strong DO solutions (𝐔t,𝐘t)subscript𝐔𝑡subscript𝐘𝑡(\boldsymbol{U}_{t},\boldsymbol{Y}_{t})( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) and (𝐕t,𝐙t)subscript𝐕𝑡subscript𝐙𝑡(\boldsymbol{V}_{t},\boldsymbol{Z}_{t})( bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ). Then there exists a unique orthogonal matrix ΘR×RΘsuperscript𝑅𝑅\Theta\in\mathbb{R}^{R\times R}roman_Θ ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT such that (𝐕t,𝐙t)=(Θ𝐔t,Θ𝐘t)subscript𝐕𝑡subscript𝐙𝑡Θsubscript𝐔𝑡Θsubscript𝐘𝑡(\boldsymbol{V}_{t},\boldsymbol{Z}_{t})=(\Theta\boldsymbol{U}_{t},\Theta% \boldsymbol{Y}_{t})( bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) = ( roman_Θ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , roman_Θ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ).

Proof.

The proof follows closely the arguments in [kazashi2021existence, Lemma 2.3, Corollary 2.4, and Lemma 2.5]. We will show that there exists a unique absolutely continuous curve tΘ(t)𝑡Θ𝑡t\to\Theta(t)italic_t → roman_Θ ( italic_t ) with orthogonal matrix Θ(t)R×RΘ𝑡superscript𝑅𝑅\Theta(t)\in\mathbb{R}^{R\times R}roman_Θ ( italic_t ) ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT for all t𝑡titalic_t such that (𝑽t,𝒁t)=(Θ(t)𝑼t,Θ(t)𝒀t)subscript𝑽𝑡subscript𝒁𝑡Θ𝑡subscript𝑼𝑡Θ𝑡subscript𝒀𝑡(\boldsymbol{V}_{t},\boldsymbol{Z}_{t})=(\Theta(t)\boldsymbol{U}_{t},\Theta(t)% \boldsymbol{Y}_{t})( bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) = ( roman_Θ ( italic_t ) bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , roman_Θ ( italic_t ) bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ), and that such Θ(t)Θ𝑡\Theta(t)roman_Θ ( italic_t ) is a constant in t𝑡titalic_t. First, we will derive an equation that Θ(t)Θ𝑡\Theta(t)roman_Θ ( italic_t ) must satisfy. Suppose that sought Θ(t)Θ𝑡\Theta(t)roman_Θ ( italic_t ) exists. Note that, since both 𝑼t𝒀tsuperscriptsubscript𝑼𝑡topsubscript𝒀𝑡\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and 𝑽t𝒁tsuperscriptsubscript𝑽𝑡topsubscript𝒁𝑡\boldsymbol{V}_{t}^{\top}\boldsymbol{Z}_{t}bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT satisfy (2.16), Theorem 2.5 implies 𝒳t=𝑼t𝒀t=𝑽t𝒁tsubscript𝒳𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡superscriptsubscript𝑽𝑡topsubscript𝒁𝑡\mathcal{X}_{t}=\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t}=\boldsymbol{V}_{t}% ^{\top}\boldsymbol{Z}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT for all t𝑡titalic_t and a.s. Then since (𝑽t,𝒁t)subscript𝑽𝑡subscript𝒁𝑡(\boldsymbol{V}_{t},\boldsymbol{Z}_{t})( bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) is a strong DO solution, one must have

𝑼˙t=(Θ(t)𝑽t)˙=Θ˙(t)𝑽t+Θ(t)𝑽˙t for a.e. t[0,T].formulae-sequencesubscript˙𝑼𝑡˙Θ𝑡subscript𝑽𝑡superscript˙Θtop𝑡subscript𝑽𝑡superscriptΘtop𝑡subscript˙𝑽𝑡 for a.e. 𝑡0𝑇\dot{\boldsymbol{U}}_{t}=\dot{(\Theta(t)\boldsymbol{V}_{t})}=\dot{\Theta}^{% \top}(t)\boldsymbol{V}_{t}+\Theta^{\top}(t)\dot{\boldsymbol{V}}_{t}\quad\text{% for a.e. }\quad t\in[0,T].over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = over˙ start_ARG ( roman_Θ ( italic_t ) bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_ARG = over˙ start_ARG roman_Θ end_ARG start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_t ) bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT + roman_Θ start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_t ) over˙ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT for a.e. italic_t ∈ [ 0 , italic_T ] . (2.26)

As 𝑼t𝑼˙t=0subscript𝑼𝑡superscriptsubscript˙𝑼𝑡top0\boldsymbol{U}_{t}\dot{\boldsymbol{U}}_{t}^{\top}=0bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = 0 and 𝑼t𝑼t=IR×Rsubscript𝑼𝑡superscriptsubscript𝑼𝑡topsubscript𝐼𝑅𝑅\boldsymbol{U}_{t}\boldsymbol{U}_{t}^{\top}=I_{R\times R}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = italic_I start_POSTSUBSCRIPT italic_R × italic_R end_POSTSUBSCRIPT, from 𝑼t=Θ(t)𝑽tsubscript𝑼𝑡superscriptΘtop𝑡subscript𝑽𝑡\boldsymbol{U}_{t}=\Theta^{\top}(t)\boldsymbol{V}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = roman_Θ start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_t ) bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT it follows

0=Θ(t)𝑽t(Θ˙(t)𝑽t+Θ(t)𝑽˙t)=Θ(t)(Θ˙(t)+𝑽t𝑽˙tΘ(t)).0superscriptΘtop𝑡subscript𝑽𝑡superscriptsuperscript˙Θtop𝑡subscript𝑽𝑡superscriptΘtop𝑡subscript˙𝑽𝑡topsuperscriptΘtop𝑡˙Θ𝑡subscript𝑽𝑡superscriptsubscript˙𝑽𝑡topΘ𝑡0=\Theta^{\top}(t)\boldsymbol{V}_{t}\left(\dot{\Theta}^{\top}(t)\boldsymbol{V}% _{t}+\Theta^{\top}(t)\dot{\boldsymbol{V}}_{t}\right)^{\top}=\Theta^{\top}(t)% \left(\dot{\Theta}(t)+\boldsymbol{V}_{t}\dot{\boldsymbol{V}}_{t}^{\top}\Theta(% t)\right).0 = roman_Θ start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_t ) bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( over˙ start_ARG roman_Θ end_ARG start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_t ) bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT + roman_Θ start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_t ) over˙ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = roman_Θ start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_t ) ( over˙ start_ARG roman_Θ end_ARG ( italic_t ) + bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over˙ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT roman_Θ ( italic_t ) ) . (2.27)

Using orthogonality of Θ(t)Θ𝑡\Theta(t)roman_Θ ( italic_t ) and 𝑽t𝑽˙t=0subscript𝑽𝑡superscriptsubscript˙𝑽𝑡top0\boldsymbol{V}_{t}\dot{\boldsymbol{V}}_{t}^{\top}=0bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over˙ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = 0, we obtain the following differential equation that Θ(t)Θ𝑡\Theta(t)roman_Θ ( italic_t ) has to satisfy:

Θ˙(t)=0 for a.e. t[0,T] with Θ(0)=Θ,formulae-sequence˙Θ𝑡0 for a.e. t[0,T] with Θ0subscriptΘ\dot{\Theta}(t)=0\ \ \text{ for a.e.~{}$t\in[0,T]$ with }\Theta(0)=\Theta_{*},over˙ start_ARG roman_Θ end_ARG ( italic_t ) = 0 for a.e. italic_t ∈ [ 0 , italic_T ] with roman_Θ ( 0 ) = roman_Θ start_POSTSUBSCRIPT ∗ end_POSTSUBSCRIPT , (2.28)

where ΘsubscriptΘ\Theta_{*}roman_Θ start_POSTSUBSCRIPT ∗ end_POSTSUBSCRIPT is an orthogonal matrix. But this equation has a unique solution Θ(t)ΘΘ𝑡subscriptΘ\Theta(t)\equiv\Theta_{*}roman_Θ ( italic_t ) ≡ roman_Θ start_POSTSUBSCRIPT ∗ end_POSTSUBSCRIPT, which is an orthogonal matrix. Hence, going back the argument above, ΘΘ\Thetaroman_Θ satisfies (2.26). The absolute continuity of 𝑼𝑼\boldsymbol{U}bold_italic_U and Θ𝑽Θ𝑽\Theta\boldsymbol{V}roman_Θ bold_italic_V yields 𝑼t=Θ(t)𝑽t+Csubscript𝑼𝑡Θ𝑡subscript𝑽𝑡𝐶\boldsymbol{U}_{t}=\Theta(t)\boldsymbol{V}_{t}+Cbold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = roman_Θ ( italic_t ) bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT + italic_C for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ], with some matrix CR×R𝐶superscript𝑅𝑅C\in\mathbb{R}^{R\times R}italic_C ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT.

Such ΘsubscriptΘ\Theta_{*}roman_Θ start_POSTSUBSCRIPT ∗ end_POSTSUBSCRIPT that makes C=0𝐶0C=0italic_C = 0 can be constructed explicitly. Since 𝑼tsubscript𝑼𝑡\boldsymbol{U}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, 𝑽tsubscript𝑽𝑡\boldsymbol{V}_{t}bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT are deterministic, from 𝑼0𝒀0=𝑽0𝒁0superscriptsubscript𝑼0topsubscript𝒀0superscriptsubscript𝑽0topsubscript𝒁0\boldsymbol{U}_{0}^{\top}\boldsymbol{Y}_{0}=\boldsymbol{V}_{0}^{\top}% \boldsymbol{Z}_{0}bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT = bold_italic_V start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Z start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT we must have

𝑼0=𝑽0𝔼[𝒁0𝒀0T]C𝒀01.superscriptsubscript𝑼0topsuperscriptsubscript𝑽0top𝔼delimited-[]subscript𝒁0superscriptsubscript𝒀0𝑇superscriptsubscript𝐶subscript𝒀01\boldsymbol{U}_{0}^{\top}=\boldsymbol{V}_{0}^{\top}\mathbb{E}[\boldsymbol{Z}_{% 0}\boldsymbol{Y}_{0}^{T}]{C}_{\boldsymbol{Y}_{0}}^{-1}.bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = bold_italic_V start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Z start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT ] italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT .

Take Θ=𝔼[𝒁0𝒀0T]C𝒀01subscriptΘ𝔼delimited-[]subscript𝒁0superscriptsubscript𝒀0𝑇superscriptsubscript𝐶subscript𝒀01\Theta_{*}=\mathbb{E}[\boldsymbol{Z}_{0}\boldsymbol{Y}_{0}^{T}]{C}_{% \boldsymbol{Y}_{0}}^{-1}roman_Θ start_POSTSUBSCRIPT ∗ end_POSTSUBSCRIPT = blackboard_E [ bold_italic_Z start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT ] italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT. Then, from the argument above 𝑼t=Θ𝑽tsubscript𝑼𝑡Θsubscript𝑽𝑡\boldsymbol{U}_{t}=\Theta\boldsymbol{V}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = roman_Θ bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT holds for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ]. We conclude the proof by noting the orthogonality of ΘsubscriptΘ\Theta_{*}roman_Θ start_POSTSUBSCRIPT ∗ end_POSTSUBSCRIPT:

IR×R=𝑼0𝑼0=Θ𝑽0𝑽0Θ=ΘΘ.subscript𝐼𝑅𝑅subscript𝑼0superscriptsubscript𝑼0topsuperscriptsubscriptΘtopsubscript𝑽0superscriptsubscript𝑽0topsubscriptΘsuperscriptsubscriptΘtopsubscriptΘI_{R\times R}=\boldsymbol{U}_{0}\boldsymbol{U}_{0}^{\top}=\Theta_{*}^{\top}% \boldsymbol{V}_{0}\boldsymbol{V}_{0}^{\top}\Theta_{*}=\Theta_{*}^{\top}\Theta_% {*}.italic_I start_POSTSUBSCRIPT italic_R × italic_R end_POSTSUBSCRIPT = bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = roman_Θ start_POSTSUBSCRIPT ∗ end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_V start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT bold_italic_V start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT roman_Θ start_POSTSUBSCRIPT ∗ end_POSTSUBSCRIPT = roman_Θ start_POSTSUBSCRIPT ∗ end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT roman_Θ start_POSTSUBSCRIPT ∗ end_POSTSUBSCRIPT .

Remark 2.8.

In Section 3, under Assumptions 1–3 we will show that there exists a unique strong DO solution (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) in a certain interval [0,T]0𝑇[0,T][ 0 , italic_T ]. Hence, in view of Theorem 2.5 and Corollary 2.6, a unique DLR solution 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT exists on [0,T]0𝑇[0,T][ 0 , italic_T ] and moreover, given 𝒳tsubscript𝒳𝑡\mathcal{X}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, we can always find a strong DO solution (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) such that 𝒳t=𝑼t𝒀tsubscript𝒳𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡\mathcal{X}_{t}=\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t}caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT.

3 Local existence and uniqueness

The equations (2.6) and (2.7) define a non-standard system of stochastic differential equations. Notice that in (2.6), the matrix-valued function [L2(Ω)]R𝒀tC𝒀t1R×Rcontainssuperscriptdelimited-[]superscript𝐿2Ω𝑅subscript𝒀𝑡maps-tosuperscriptsubscript𝐶subscript𝒀𝑡1superscript𝑅𝑅[L^{2}(\Omega)]^{R}\ni\boldsymbol{Y}_{t}\mapsto{C}_{\boldsymbol{Y}_{t}}^{-1}% \in\mathbb{R}^{R\times R}[ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∋ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ↦ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT is not defined everywhere in [L2(Ω)]Rsuperscriptdelimited-[]superscript𝐿2Ω𝑅[L^{2}(\Omega)]^{R}[ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT. Moreover, the vector field 𝔼[𝒀ta(t,Xt)]𝔼delimited-[]subscript𝒀𝑡𝑎superscript𝑡subscript𝑋𝑡top\mathbb{E}[\boldsymbol{Y}_{t}\,a(t,X_{t})^{\top}]blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] requires taking the expectation, and thus depends on the knowledge of all the paths of 𝒀tsubscript𝒀𝑡\boldsymbol{Y}_{t}bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT. Hence, the vector fields that define the DO equation are not defined path-wise a priori. This setting makes the existence and uniqueness result of DLR solutions non-trivial.

To establish existence and uniqueness of solutions of (2.6) and (2.7) given an initial datum (𝝋,𝝃)𝝋𝝃(\boldsymbol{\varphi},\boldsymbol{\xi})( bold_italic_φ , bold_italic_ξ ), we follow a fixed-point argument. We will define a sequence of Picard iterates, which belongs to a specific set of functions, where the first element of the sequence is made of a pair of constant-in-time functions (𝝋,𝝃)𝝋𝝃(\boldsymbol{\varphi},\boldsymbol{\xi})( bold_italic_φ , bold_italic_ξ ). Then we will show that this sequence converges in this set.

Let 𝑼C([0,t];R×d)𝑼𝐶0𝑡superscript𝑅𝑑\boldsymbol{U}\in C([0,t];\mathbb{R}^{R\times d})bold_italic_U ∈ italic_C ( [ 0 , italic_t ] ; blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT ) be such that the rows Us1,,UsRdsubscriptsuperscript𝑈1𝑠subscriptsuperscript𝑈𝑅𝑠superscript𝑑U^{1}_{s},\dots,U^{R}_{s}\in\mathbb{R}^{d}italic_U start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT , … , italic_U start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT of 𝑼ssubscript𝑼𝑠\boldsymbol{U}_{s}bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT are linearly independent for every s[0,t]𝑠0𝑡s\in[0,t]italic_s ∈ [ 0 , italic_t ] (but not necessarily orthonormal), and let 𝒀L2(Ω;C([0,t];R))𝒀superscript𝐿2Ω𝐶0𝑡superscript𝑅\boldsymbol{Y}\in L^{2}(\Omega;C([0,t];\mathbb{R}^{R}))bold_italic_Y ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_C ( [ 0 , italic_t ] ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) ) be an (t)subscript𝑡(\mathscr{F}_{t})( script_F start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT )-adapted process such that 𝒀s=(Y1(s),,YR(s))[L2(Ω)]Rsubscript𝒀𝑠superscript𝑌1𝑠superscript𝑌𝑅𝑠superscriptdelimited-[]superscript𝐿2Ω𝑅\boldsymbol{Y}_{s}=(Y^{1}(s),\dots,Y^{R}(s))\in[L^{2}(\Omega)]^{R}bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT = ( italic_Y start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT ( italic_s ) , … , italic_Y start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ( italic_s ) ) ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT has linearly independent components for every s[0,t]𝑠0𝑡s\in[0,t]italic_s ∈ [ 0 , italic_t ]. For 𝝋R×d𝝋superscript𝑅𝑑\boldsymbol{\varphi}\in\mathbb{R}^{R\times d}bold_italic_φ ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT with dR𝑑𝑅d\geq Ritalic_d ≥ italic_R and 𝝃[L2(Ω)]R𝝃superscriptdelimited-[]superscript𝐿2Ω𝑅\boldsymbol{\xi}\in[L^{2}(\Omega)]^{R}bold_italic_ξ ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT, define

F1(𝑼,𝒀)(t):=𝝋+0tC𝒀s1𝔼[𝒀sa(s,𝑼s𝒀s)](Id×dP𝑼srow)𝑑sR×d,assignsubscript𝐹1𝑼𝒀𝑡𝝋superscriptsubscript0𝑡superscriptsubscript𝐶subscript𝒀𝑠1𝔼delimited-[]subscript𝒀𝑠𝑎superscript𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠topsubscript𝐼𝑑𝑑superscriptsubscript𝑃subscript𝑼𝑠rowdifferential-d𝑠superscript𝑅𝑑F_{1}(\boldsymbol{U},\boldsymbol{Y})(t):=\boldsymbol{\varphi}+\int_{0}^{t}{C}_% {\boldsymbol{Y}_{s}}^{-1}\mathbb{E}[\boldsymbol{Y}_{s}a(s,\boldsymbol{U}_{s}^{% \top}\boldsymbol{Y}_{s})^{\top}](I_{d\times d}-P_{\boldsymbol{U}_{s}}^{\mathrm% {row}})\,ds\in\mathbb{R}^{R\times d},italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) ( italic_t ) := bold_italic_φ + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_a ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT ) italic_d italic_s ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT , (3.1)
F2(𝑼,𝒀)(t):=𝝃+0t𝑼sa(s,𝑼s𝒀s)𝑑s+0t𝑼sb(s,𝑼s𝒀s)𝑑Ws[L2(Ω)]R,assignsubscript𝐹2𝑼𝒀𝑡𝝃superscriptsubscript0𝑡subscript𝑼𝑠𝑎𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠differential-d𝑠superscriptsubscript0𝑡subscript𝑼𝑠𝑏𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠differential-dsubscript𝑊𝑠superscriptdelimited-[]superscript𝐿2Ω𝑅F_{2}(\boldsymbol{U},\boldsymbol{Y})(t):=\boldsymbol{\xi}+\int_{0}^{t}% \boldsymbol{U}_{s}a(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s})\,ds+\int_{0% }^{t}\boldsymbol{U}_{s}b(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s})dW_{s}% \in[L^{2}(\Omega)]^{R},italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) ( italic_t ) := bold_italic_ξ + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_a ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_s + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , (3.2)

where we recall that P𝑼srowsuperscriptsubscript𝑃subscript𝑼𝑠rowP_{\boldsymbol{U}_{s}}^{\mathrm{row}}italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT is the projection-matrix onto the row space span{Us1,,UsR}dspansuperscriptsubscript𝑈𝑠1superscriptsubscript𝑈𝑠𝑅superscript𝑑\mathrm{span}\{U_{s}^{1},\dots,U_{s}^{R}\}\subset\mathbb{R}^{d}roman_span { italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT , … , italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT } ⊂ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT of 𝑼ssubscript𝑼𝑠\boldsymbol{U}_{s}bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT. Note that the stochastic integral 0t𝑼sb(s,𝑼s𝒀s)𝑑Wssuperscriptsubscript0𝑡subscript𝑼𝑠𝑏𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠differential-dsubscript𝑊𝑠\int_{0}^{t}\boldsymbol{U}_{s}b(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s})% dW_{s}∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT is well defined, since 𝒀L2(Ω;C([0,t];R))𝒀superscript𝐿2Ω𝐶0𝑡superscript𝑅\boldsymbol{Y}\in L^{2}(\Omega;C([0,t];\mathbb{R}^{R}))bold_italic_Y ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_C ( [ 0 , italic_t ] ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) ) is (indistinguishable from) a progressively measurable process.

We will construct a unique fixed point of F1subscript𝐹1F_{1}italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT and F2subscript𝐹2F_{2}italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT. Because of the aforementioned difficulties, defining a suitable sequence of Picard iterates requires some care. Let us consider 𝝋R×d𝝋superscript𝑅𝑑\boldsymbol{\varphi}\in\mathbb{R}^{R\times d}bold_italic_φ ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT with dR𝑑𝑅d\geq Ritalic_d ≥ italic_R having orthogonal row vectors, and 𝝃=(ξ1,,ξR)[L2(Ω)]R𝝃subscript𝜉1subscript𝜉𝑅superscriptdelimited-[]superscript𝐿2Ω𝑅\boldsymbol{\xi}=(\xi_{1},\dots,\xi_{R})\in[L^{2}(\Omega)]^{R}bold_italic_ξ = ( italic_ξ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_ξ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ) ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT, having linearly independent components, 0subscript0\mathcal{F}_{0}caligraphic_F start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT-measurable with ρ2:=𝝃[L2(Ω)]R2assignsuperscript𝜌2superscriptsubscriptnorm𝝃superscriptdelimited-[]superscript𝐿2Ω𝑅2\rho^{2}:=\|\boldsymbol{\xi}\|_{[L^{2}(\Omega)]^{R}}^{2}italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT := ∥ bold_italic_ξ ∥ start_POSTSUBSCRIPT [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT and γ:=C𝝃1Fassign𝛾subscriptnormsuperscriptsubscript𝐶𝝃1F\gamma:=\|{C}_{\boldsymbol{\xi}}^{-1}\|_{\mathrm{F}}italic_γ := ∥ italic_C start_POSTSUBSCRIPT bold_italic_ξ end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT. We force iterations to belong to balls in R×dsuperscript𝑅𝑑\mathbb{R}^{R\times d}blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT and [L2(Ω)]Rsuperscriptdelimited-[]superscript𝐿2Ω𝑅[L^{2}(\Omega)]^{R}[ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT around 𝝋𝝋\boldsymbol{\varphi}bold_italic_φ and 𝝃𝝃\boldsymbol{\xi}bold_italic_ξ, respectively, of a suitable radius η𝜂\etaitalic_η.

For the ball in R×dsuperscript𝑅𝑑\mathbb{R}^{R\times d}blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT, to invoke Proposition A.1 in the appendix, we equip R×d=[d]Rsuperscript𝑅𝑑superscriptdelimited-[]superscript𝑑𝑅\mathbb{R}^{R\times d}=[\mathbb{R}^{d}]^{R}blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT = [ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT with the norm 𝑼[d]R2=j=1R|Uj|2superscriptsubscriptnorm𝑼superscriptdelimited-[]superscript𝑑𝑅2superscriptsubscript𝑗1𝑅superscriptsuperscript𝑈𝑗2\|\boldsymbol{U}\|_{[\mathbb{R}^{d}]^{R}}^{2}=\sum_{j=1}^{R}|U^{j}|^{2}∥ bold_italic_U ∥ start_POSTSUBSCRIPT [ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT | italic_U start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT. For 𝝋=(φ1,,φR)𝝋superscriptsuperscript𝜑1superscript𝜑𝑅top\boldsymbol{\varphi}=(\varphi^{1},\dots,\varphi^{R})^{\top}bold_italic_φ = ( italic_φ start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT , … , italic_φ start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT orthogonal, we have 𝝋[d]R=Rsubscriptnorm𝝋superscriptdelimited-[]superscript𝑑𝑅𝑅\|\boldsymbol{\varphi}\|_{[\mathbb{R}^{d}]^{R}}=\sqrt{R}∥ bold_italic_φ ∥ start_POSTSUBSCRIPT [ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = square-root start_ARG italic_R end_ARG, and

Z𝝋:=(φj(φk))j,k=1,,R=𝝋𝝋=IR×R,assignsubscript𝑍𝝋subscriptsuperscript𝜑𝑗superscriptsuperscript𝜑𝑘topformulae-sequence𝑗𝑘1𝑅𝝋superscript𝝋topsubscript𝐼𝑅𝑅Z_{\boldsymbol{\varphi}}:=(\varphi^{j}(\varphi^{k})^{\top})_{j,k=1,\dots,R}=% \boldsymbol{\varphi}\boldsymbol{\varphi}^{\top}=I_{R\times R},italic_Z start_POSTSUBSCRIPT bold_italic_φ end_POSTSUBSCRIPT := ( italic_φ start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT ( italic_φ start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) start_POSTSUBSCRIPT italic_j , italic_k = 1 , … , italic_R end_POSTSUBSCRIPT = bold_italic_φ bold_italic_φ start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = italic_I start_POSTSUBSCRIPT italic_R × italic_R end_POSTSUBSCRIPT ,

so with η1:=η(R,R)assignsubscript𝜂1𝜂𝑅𝑅\eta_{1}:=\eta(\sqrt{R},\sqrt{R})italic_η start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT := italic_η ( square-root start_ARG italic_R end_ARG , square-root start_ARG italic_R end_ARG ) as in (A.1), 𝒗Bη1(𝝋)𝒗subscript𝐵subscript𝜂1𝝋\boldsymbol{v}\in B_{\eta_{1}}(\boldsymbol{\varphi})bold_italic_v ∈ italic_B start_POSTSUBSCRIPT italic_η start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_φ ) implies (𝒗𝒗)1F2Rsubscriptnormsuperscript𝒗superscript𝒗top1F2𝑅\|(\boldsymbol{v}\boldsymbol{v}^{\top})^{-1}\|_{\mathrm{F}}\leq 2{\sqrt{R}}∥ ( bold_italic_v bold_italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ 2 square-root start_ARG italic_R end_ARG. Hence, the projection (Id×dP𝑼trow)subscript𝐼𝑑𝑑superscriptsubscript𝑃subscript𝑼𝑡row(I_{d\times d}-P_{\boldsymbol{U}_{t}}^{\mathrm{row}})( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT ) is Lipschitz continuous on Bη1(𝝋)subscript𝐵subscript𝜂1𝝋B_{\eta_{1}}(\boldsymbol{\varphi})italic_B start_POSTSUBSCRIPT italic_η start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_φ ); see Lemma A.4.

For the ball in [L2(Ω)]Rsuperscriptdelimited-[]superscript𝐿2Ω𝑅[L^{2}(\Omega)]^{R}[ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT, first note that, since [L2(Ω)]R𝒁𝔼[𝒁𝒁]1R×Rcontainssuperscriptdelimited-[]superscript𝐿2Ω𝑅𝒁maps-to𝔼superscriptdelimited-[]𝒁superscript𝒁top1superscript𝑅𝑅[L^{2}(\Omega)]^{R}\ni\boldsymbol{Z}\mapsto\mathbb{E}[\boldsymbol{Z}% \boldsymbol{Z}^{\top}]^{-1}\in\mathbb{R}^{R\times R}[ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∋ bold_italic_Z ↦ blackboard_E [ bold_italic_Z bold_italic_Z start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT is continuous in the open set Γ={𝒁[L2(Ω)]Rdet(𝔼[𝒁𝒁])0}Γconditional-set𝒁superscriptdelimited-[]superscript𝐿2Ω𝑅det𝔼delimited-[]𝒁superscript𝒁top0\Gamma=\{\boldsymbol{Z}\in[L^{2}(\Omega)]^{R}\mid\mathrm{det}(\mathbb{E}[% \boldsymbol{Z}\boldsymbol{Z}^{\top}])\neq 0\}roman_Γ = { bold_italic_Z ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∣ roman_det ( blackboard_E [ bold_italic_Z bold_italic_Z start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ) ≠ 0 } (cf. [kazashi2021existence, Proof of Lemma 3.5]), and 𝝃Γ𝝃Γ\boldsymbol{\xi}\in\Gammabold_italic_ξ ∈ roman_Γ, via Proposition A.1 there exists a ball Bη2(𝝃)subscript𝐵subscript𝜂2𝝃B_{\eta_{2}}(\boldsymbol{\xi})italic_B start_POSTSUBSCRIPT italic_η start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_ξ ) in [L2(Ω)]Rsuperscriptdelimited-[]superscript𝐿2Ω𝑅[L^{2}(\Omega)]^{R}[ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT around 𝝃𝝃\boldsymbol{\xi}bold_italic_ξ with radius η2:=η(ρ,γ)>0assignsubscript𝜂2𝜂𝜌𝛾0\eta_{2}:=\eta(\rho,\gamma)>0italic_η start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT := italic_η ( italic_ρ , italic_γ ) > 0 such that any 𝒘Bη2(𝝃)𝒘subscript𝐵subscript𝜂2𝝃\boldsymbol{w}\in B_{\eta_{2}}(\boldsymbol{\xi})bold_italic_w ∈ italic_B start_POSTSUBSCRIPT italic_η start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_ξ ) has linearly independent components and C𝒘1F2γsubscriptnormsuperscriptsubscript𝐶𝒘1F2𝛾\|{C}_{\boldsymbol{w}}^{-1}\|_{\mathrm{F}}\leq 2\gamma∥ italic_C start_POSTSUBSCRIPT bold_italic_w end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ 2 italic_γ. Abusing the notation slightly, we let

η=η(R,ρ,γ):=min{η(R,R),η(ρ,γ)}.𝜂𝜂𝑅𝜌𝛾assign𝜂𝑅𝑅𝜂𝜌𝛾\eta=\eta(R,\rho,\gamma):=\min\{\eta(\sqrt{R},\sqrt{R}),\eta(\rho,\gamma)\}.italic_η = italic_η ( italic_R , italic_ρ , italic_γ ) := roman_min { italic_η ( square-root start_ARG italic_R end_ARG , square-root start_ARG italic_R end_ARG ) , italic_η ( italic_ρ , italic_γ ) } . (3.3)

Proposition A.1 tells us that η𝜂\etaitalic_η is non-increasing in both variables ρ𝜌\rhoitalic_ρ and γ𝛾\gammaitalic_γ.

We want to define sequences 𝒀t(n)Bη(𝝃)superscriptsubscript𝒀𝑡𝑛subscript𝐵𝜂𝝃\boldsymbol{Y}_{t}^{(n)}\in B_{\eta}(\boldsymbol{\xi})bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∈ italic_B start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ( bold_italic_ξ ) and 𝑼t(n)Bη(𝝋)superscriptsubscript𝑼𝑡𝑛subscript𝐵𝜂𝝋\boldsymbol{U}_{t}^{(n)}\in B_{\eta}(\boldsymbol{\varphi})bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∈ italic_B start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ( bold_italic_φ ) for t[0,δ]𝑡0𝛿t\in[0,\delta]italic_t ∈ [ 0 , italic_δ ] with a suitable δ=δ(𝝋,𝝃)>0𝛿𝛿𝝋𝝃0\delta=\delta(\boldsymbol{\varphi},\boldsymbol{\xi})>0italic_δ = italic_δ ( bold_italic_φ , bold_italic_ξ ) > 0. To this extent, let (𝑼t(0),𝒀t(0)):=(𝝋,𝝃)assignsuperscriptsubscript𝑼𝑡0superscriptsubscript𝒀𝑡0𝝋𝝃(\boldsymbol{U}_{t}^{(0)},\boldsymbol{Y}_{t}^{(0)}):=(\boldsymbol{\varphi},% \boldsymbol{\xi})( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ) := ( bold_italic_φ , bold_italic_ξ ), 𝑼t(n+1):=F1(𝑼(n),𝒀(n))(t)assignsuperscriptsubscript𝑼𝑡𝑛1subscript𝐹1superscript𝑼𝑛superscript𝒀𝑛𝑡\boldsymbol{U}_{t}^{(n+1)}:=F_{1}(\boldsymbol{U}^{(n)},\boldsymbol{Y}^{(n)})(t)bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT := italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) ( italic_t ), 𝒀t(n+1):=F2(𝑼(n),𝒀(n))(t)assignsuperscriptsubscript𝒀𝑡𝑛1subscript𝐹2superscript𝑼𝑛superscript𝒀𝑛𝑡\boldsymbol{Y}_{t}^{(n+1)}:=F_{2}(\boldsymbol{U}^{(n)},\boldsymbol{Y}^{(n)})(t)bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT := italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) ( italic_t ), and Xt(n):=(𝑼t(n))𝒀t(n)assignsuperscriptsubscript𝑋𝑡𝑛superscriptsuperscriptsubscript𝑼𝑡𝑛topsuperscriptsubscript𝒀𝑡𝑛X_{t}^{(n)}:=\bigl{(}\boldsymbol{U}_{t}^{(n)}\bigr{)}^{\top}\boldsymbol{Y}_{t}% ^{(n)}italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT := ( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT, n=0,1,𝑛01n=0,1,\dotsitalic_n = 0 , 1 , … for t[0,δ]𝑡0𝛿t\in[0,\delta]italic_t ∈ [ 0 , italic_δ ] with

δ:=min{1,min{1,η2}36RClgb(1+3R(3ρ2+1)),min{η2,R}8γ2(3ρ2+1)Clgb(1+3R(3ρ2+1))}.assign𝛿11superscript𝜂236𝑅subscript𝐶lgb13𝑅3superscript𝜌21superscript𝜂2𝑅8superscript𝛾23superscript𝜌21subscript𝐶lgb13𝑅3superscript𝜌21\delta:=\min\{1,\frac{\min\{1,\eta^{2}\}}{36RC_{\mathrm{lgb}}(1+3R(3\rho^{2}+1% ))},\frac{\min\{\eta^{2},R\}}{8\gamma^{2}(3\rho^{2}+1)C_{\mathrm{lgb}}(1+3R(3% \rho^{2}+1))}\}.italic_δ := roman_min { 1 , divide start_ARG roman_min { 1 , italic_η start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT } end_ARG start_ARG 36 italic_R italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + 3 italic_R ( 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) ) end_ARG , divide start_ARG roman_min { italic_η start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT , italic_R } end_ARG start_ARG 8 italic_γ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + 3 italic_R ( 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) ) end_ARG } . (3.4)

Moreover, let

𝔻det:={𝑽C([0,δ];R×d)|sup0tδ𝑽tF23R, and𝑽tBη(𝝋) for t[0,δ]}\mathbb{D}_{\mathrm{det}}:=\left\{\boldsymbol{V}\in C([0,\delta];\mathbb{R}^{R% \times d})\,\left|\,\begin{array}[]{l}\sup\limits_{0\leq t\leq\delta}\|% \boldsymbol{V}_{t}\|_{\mathrm{F}}^{2}\leq 3R\text{, and}\\ \boldsymbol{V}_{t}\in B_{\eta}(\boldsymbol{\varphi})\text{ for }t\in[0,\delta]% \end{array}\right\}\right.blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT := { bold_italic_V ∈ italic_C ( [ 0 , italic_δ ] ; blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT ) | start_ARRAY start_ROW start_CELL roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT ∥ bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ 3 italic_R , and end_CELL end_ROW start_ROW start_CELL bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ italic_B start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ( bold_italic_φ ) for italic_t ∈ [ 0 , italic_δ ] end_CELL end_ROW end_ARRAY }

and

𝔻sto:={𝒁L2(Ω;C([0,δ];R))|𝒁 is t-adapted, 𝔼[sup0tδ|𝒁t|2]3ρ2+1, and𝒁tBη(𝝃) for t[0,δ]}.\mathbb{D}_{\mathrm{sto}}:=\left\{\boldsymbol{Z}\in L^{2}(\Omega;C([0,\delta];% \mathbb{R}^{R}))\,\left|\,\begin{array}[]{l}\boldsymbol{Z}\text{ is $\mathcal{% F}_{t}$-adapted, }\\ \mathbb{E}\bigl{[}\sup\limits_{0\leq t\leq\delta}|\boldsymbol{Z}_{t}|^{2}\bigr% {]}\leq 3\rho^{2}+1\text{, and}\\ \boldsymbol{Z}_{t}\in B_{\eta}(\boldsymbol{\xi})\text{ for }t\in[0,\delta]\end% {array}\right\}\right..blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT := { bold_italic_Z ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_C ( [ 0 , italic_δ ] ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) ) | start_ARRAY start_ROW start_CELL bold_italic_Z is caligraphic_F start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT -adapted, end_CELL end_ROW start_ROW start_CELL blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 , and end_CELL end_ROW start_ROW start_CELL bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ italic_B start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ( bold_italic_ξ ) for italic_t ∈ [ 0 , italic_δ ] end_CELL end_ROW end_ARRAY } .

The following lemma shows that our Picard sequence takes value in 𝔻det×𝔻stosubscript𝔻detsubscript𝔻sto\mathbb{D}_{\mathrm{det}}\times\mathbb{D}_{\mathrm{sto}}blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT.

Lemma 3.1.

Under Assumptions 2–3, the sequence ((𝐔(n),𝐘(n)))n0subscriptsuperscript𝐔𝑛superscript𝐘𝑛𝑛0\bigl{(}(\boldsymbol{U}^{(n)},\boldsymbol{Y}^{(n)})\bigr{)}_{n\geq 0}( ( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) ) start_POSTSUBSCRIPT italic_n ≥ 0 end_POSTSUBSCRIPT defined above satisfies

(𝑼(n),𝒀(n))𝔻det×𝔻sto for all n,formulae-sequencesuperscript𝑼𝑛superscript𝒀𝑛subscript𝔻detsubscript𝔻sto for all 𝑛(\boldsymbol{U}^{(n)},\boldsymbol{Y}^{(n)})\in\mathbb{D}_{\mathrm{det}}\times% \mathbb{D}_{\mathrm{sto}}\quad\text{ for all }\quad n\in\mathbb{N},( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT for all italic_n ∈ blackboard_N ,

where δ=δ(Clgb,d,η,R,ρ)𝛿𝛿subscript𝐶lgb𝑑𝜂𝑅𝜌\delta=\delta(C_{\mathrm{lgb}},d,\eta,R,\rho)italic_δ = italic_δ ( italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT , italic_d , italic_η , italic_R , italic_ρ ) is defined in (3.4).

Proof.

We have 𝝋F2=Rsuperscriptsubscriptnorm𝝋F2𝑅\|\boldsymbol{\varphi}\|_{\mathrm{F}}^{2}=R∥ bold_italic_φ ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = italic_R, 𝝃[L2(Ω)]R2=ρ2superscriptsubscriptnorm𝝃superscriptdelimited-[]superscript𝐿2Ω𝑅2superscript𝜌2\|\boldsymbol{\xi}\|_{[L^{2}(\Omega)]^{R}}^{2}=\rho^{2}∥ bold_italic_ξ ∥ start_POSTSUBSCRIPT [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT, C𝝃1F=γsubscriptnormsuperscriptsubscript𝐶𝝃1F𝛾\|{C}_{\boldsymbol{\xi}}^{-1}\|_{\mathrm{F}}=\gamma∥ italic_C start_POSTSUBSCRIPT bold_italic_ξ end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = italic_γ, so, trivially, 𝝃Bη(𝝃)𝝃subscript𝐵𝜂𝝃\boldsymbol{\xi}\in B_{\eta}(\boldsymbol{\xi})bold_italic_ξ ∈ italic_B start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ( bold_italic_ξ ) and 𝝋Bη(𝝋)𝝋subscript𝐵𝜂𝝋\boldsymbol{\varphi}\in B_{\eta}(\boldsymbol{\varphi})bold_italic_φ ∈ italic_B start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ( bold_italic_φ ), where η=η(R,ρ,γ)𝜂𝜂𝑅𝜌𝛾\eta=\eta(R,\rho,\gamma)italic_η = italic_η ( italic_R , italic_ρ , italic_γ ) is built as in (3.3). Moreover, 𝝃𝝃\boldsymbol{\xi}bold_italic_ξ is tsubscript𝑡\mathcal{F}_{t}caligraphic_F start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT-adapted thanks to Assumption 3. Thus, (𝑼(0),𝒀(0))𝔻det×𝔻stosuperscript𝑼0superscript𝒀0subscript𝔻detsubscript𝔻sto(\boldsymbol{U}^{(0)},\boldsymbol{Y}^{(0)})\in\mathbb{D}_{\mathrm{det}}\times% \mathbb{D}_{\mathrm{sto}}( bold_italic_U start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ) ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT. Assume (𝑼(n),𝒀(n))𝔻det×𝔻stosuperscript𝑼𝑛superscript𝒀𝑛subscript𝔻detsubscript𝔻sto(\boldsymbol{U}^{(n)},\boldsymbol{Y}^{(n)})\in\mathbb{D}_{\mathrm{det}}\times% \mathbb{D}_{\mathrm{sto}}( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT for n𝑛n\in\mathbb{N}italic_n ∈ blackboard_N. Then, from Assumption 2, we see that 𝑼(n+1)superscript𝑼𝑛1\boldsymbol{U}^{(n+1)}bold_italic_U start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT and 𝒀(n+1)superscript𝒀𝑛1\boldsymbol{Y}^{(n+1)}bold_italic_Y start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT are well defined, and that 𝒀(n+1)superscript𝒀𝑛1\boldsymbol{Y}^{(n+1)}bold_italic_Y start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT is tsubscript𝑡\mathcal{F}_{t}caligraphic_F start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT-adapted. Moreover, 𝔼[sup0tδ|𝒀t(n)|2]<𝔼delimited-[]subscriptsupremum0𝑡𝛿superscriptsuperscriptsubscript𝒀𝑡𝑛2\mathbb{E}\bigl{[}\sup\limits_{0\leq t\leq\delta}|\boldsymbol{Y}_{t}^{(n)}|^{2% }\bigr{]}<\inftyblackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] < ∞ and the inequality ABFA2BFsubscriptnorm𝐴𝐵𝐹subscriptnorm𝐴2subscriptnorm𝐵𝐹\|AB\|_{F}\leq\|A\|_{2}\|B\|_{F}∥ italic_A italic_B ∥ start_POSTSUBSCRIPT italic_F end_POSTSUBSCRIPT ≤ ∥ italic_A ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ∥ italic_B ∥ start_POSTSUBSCRIPT italic_F end_POSTSUBSCRIPT for An×m𝐴superscript𝑛𝑚A\in\mathbb{R}^{n\times m}italic_A ∈ blackboard_R start_POSTSUPERSCRIPT italic_n × italic_m end_POSTSUPERSCRIPT, Bm×p𝐵superscript𝑚𝑝B\in\mathbb{R}^{m\times p}italic_B ∈ blackboard_R start_POSTSUPERSCRIPT italic_m × italic_p end_POSTSUPERSCRIPT implies

𝔼[\displaystyle\mathbb{E}\Bigl{[}blackboard_E [ sup0tδ|𝒀t(n+1)|2]\displaystyle\sup_{0\leq t\leq\delta}|\boldsymbol{Y}_{t}^{(n+1)}|^{2}\Bigr{]}roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
3𝔼[|𝝃|2]+3𝔼[sup0tδt0t𝑼s(n)22|a(s,Xs(n))|2𝑑s+sup0tδ|0t𝑼s(n)b(s,Xs(n))𝑑Ws|2]absent3𝔼delimited-[]superscript𝝃23𝔼delimited-[]subscriptsupremum0𝑡𝛿𝑡superscriptsubscript0𝑡superscriptsubscriptnormsuperscriptsubscript𝑼𝑠𝑛22superscript𝑎𝑠superscriptsubscript𝑋𝑠𝑛2differential-d𝑠subscriptsupremum0𝑡𝛿superscriptsuperscriptsubscript0𝑡superscriptsubscript𝑼𝑠𝑛𝑏𝑠superscriptsubscript𝑋𝑠𝑛differential-dsubscript𝑊𝑠2\displaystyle\leq 3\mathbb{E}\bigl{[}|\boldsymbol{\xi}|^{2}\bigr{]}+3\mathbb{E% }\biggl{[}\sup_{0\leq t\leq\delta}t\!\int_{0}^{t}\|\boldsymbol{U}_{s}^{(n)}\|_% {2}^{2}|a(s,X_{s}^{(n)})|^{2}\,ds+\sup_{0\leq t\leq\delta}\Bigl{|}\int_{0}^{t}% \boldsymbol{U}_{s}^{(n)}b(s,X_{s}^{(n)})dW_{s}\Bigr{|}^{2}\biggr{]}≤ 3 blackboard_E [ | bold_italic_ξ | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + 3 blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT italic_t ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s + roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
3𝔼[|𝝃|2]+3𝔼[sup0tδt0t𝑼s(n)22|a(s,Xs(n))|2𝑑s]+12𝔼[|0δ𝑼s(n)b(s,Xs(n))𝑑Ws|2]absent3𝔼delimited-[]superscript𝝃23𝔼delimited-[]subscriptsupremum0𝑡𝛿𝑡superscriptsubscript0𝑡superscriptsubscriptnormsuperscriptsubscript𝑼𝑠𝑛22superscript𝑎𝑠superscriptsubscript𝑋𝑠𝑛2differential-d𝑠12𝔼delimited-[]superscriptsuperscriptsubscript0𝛿superscriptsubscript𝑼𝑠𝑛𝑏𝑠superscriptsubscript𝑋𝑠𝑛differential-dsubscript𝑊𝑠2\displaystyle{\leq 3\mathbb{E}\bigl{[}|\boldsymbol{\xi}|^{2}\bigr{]}+3\mathbb{% E}\biggl{[}\sup_{0\leq t\leq\delta}t\!\int_{0}^{t}\|\boldsymbol{U}_{s}^{(n)}\|% _{2}^{2}|a(s,X_{s}^{(n)})|^{2}\,ds\biggr{]}+12\mathbb{E}\biggl{[}\Bigl{|}\int_% {0}^{\delta}\boldsymbol{U}_{s}^{(n)}b(s,X_{s}^{(n)})dW_{s}\Bigr{|}^{2}\biggr{]}}≤ 3 blackboard_E [ | bold_italic_ξ | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + 3 blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT italic_t ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s ] + 12 blackboard_E [ | ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
3ρ2+3𝔼[3δR0δ|a(s,Xs(n))|2𝑑s]+12𝔼[0δ𝑼s(n)b(s,Xs(n))F2𝑑s]absent3superscript𝜌23𝔼delimited-[]3𝛿𝑅superscriptsubscript0𝛿superscript𝑎𝑠superscriptsubscript𝑋𝑠𝑛2differential-d𝑠12𝔼delimited-[]superscriptsubscript0𝛿superscriptsubscriptnormsuperscriptsubscript𝑼𝑠𝑛𝑏𝑠superscriptsubscript𝑋𝑠𝑛F2differential-d𝑠\displaystyle\leq 3\rho^{2}+3\mathbb{E}\biggl{[}3\delta R\int_{0}^{\delta}|a(s% ,X_{s}^{(n)})|^{2}\,ds\biggr{]}+12\mathbb{E}\Bigl{[}\int_{0}^{\delta}\|% \boldsymbol{U}_{s}^{(n)}b(s,X_{s}^{(n)})\|_{\mathrm{F}}^{2}\,ds\Bigr{]}≤ 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 3 blackboard_E [ 3 italic_δ italic_R ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT | italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s ] + 12 blackboard_E [ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s ]
3ρ2+36RClgb(1+𝔼[sup0sδ|Xs(n)|2])δabsent3superscript𝜌236𝑅subscript𝐶lgb1𝔼delimited-[]subscriptsupremum0𝑠𝛿superscriptsuperscriptsubscript𝑋𝑠𝑛2𝛿\displaystyle\leq 3\rho^{2}+36RC_{\mathrm{lgb}}(1+\mathbb{E}[\sup_{0\leq s\leq% \delta}|X_{s}^{(n)}|^{2}])\delta≤ 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 36 italic_R italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_s ≤ italic_δ end_POSTSUBSCRIPT | italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_δ
3ρ2+36RClgb(1+3R(3ρ2+1))δ3ρ2+1,absent3superscript𝜌236𝑅subscript𝐶lgb13𝑅3superscript𝜌21𝛿3superscript𝜌21\displaystyle\leq 3\rho^{2}+36RC_{\mathrm{lgb}}(1+3R(3\rho^{2}+1))\delta\leq 3% \rho^{2}+1,≤ 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 36 italic_R italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + 3 italic_R ( 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) ) italic_δ ≤ 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ,

where in the second and in the third lines we employ the Doob’s martingale inequality and Itô’s isometry, respectively, in the penultimate line we used δ1𝛿1\delta\leq 1italic_δ ≤ 1, and in the last line |a(s,x)|2+b(s,x)F2Clgb(1+|x|2)superscript𝑎𝑠𝑥2superscriptsubscriptnorm𝑏𝑠𝑥F2subscript𝐶lgb1superscript𝑥2|a(s,x)|^{2}+\|b(s,x)\|_{\mathrm{F}}^{2}\leq C_{\mathrm{lgb}}(1+|x|^{2})| italic_a ( italic_s , italic_x ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ∥ italic_b ( italic_s , italic_x ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + | italic_x | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) together with the definition of δ𝛿\deltaitalic_δ. Similarly, we have

𝔼[sup0tδ|𝒀t(n+1)𝝃|2]𝔼delimited-[]subscriptsupremum0𝑡𝛿superscriptsuperscriptsubscript𝒀𝑡𝑛1𝝃2\displaystyle\mathbb{E}\Bigl{[}\sup_{0\leq t\leq\delta}|\boldsymbol{Y}_{t}^{(n% +1)}-\boldsymbol{\xi}|^{2}\Bigr{]}blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT - bold_italic_ξ | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] 2𝔼[sup0tδt0t𝑼s(n)22|a(s,Xs(n))|2𝑑s+sup0tδ|0t𝑼s(n)b(s,Xs(n))𝑑Ws|2]absent2𝔼delimited-[]subscriptsupremum0𝑡𝛿𝑡superscriptsubscript0𝑡superscriptsubscriptnormsuperscriptsubscript𝑼𝑠𝑛22superscript𝑎𝑠superscriptsubscript𝑋𝑠𝑛2differential-d𝑠subscriptsupremum0𝑡𝛿superscriptsuperscriptsubscript0𝑡superscriptsubscript𝑼𝑠𝑛𝑏𝑠superscriptsubscript𝑋𝑠𝑛differential-dsubscript𝑊𝑠2\displaystyle\leq 2\mathbb{E}\biggl{[}\sup_{0\leq t\leq\delta}t\int_{0}^{t}\|% \boldsymbol{U}_{s}^{(n)}\|_{2}^{2}|a(s,X_{s}^{(n)})|^{2}\,ds+\sup_{0\leq t\leq% \delta}\Bigl{|}\int_{0}^{t}\boldsymbol{U}_{s}^{(n)}b(s,X_{s}^{(n)})dW_{s}\Bigr% {|}^{2}\biggr{]}≤ 2 blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT italic_t ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s + roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
24ClgbR(1+3R(3ρ2+1))δη2.absent24subscript𝐶lgb𝑅13𝑅3superscript𝜌21𝛿superscript𝜂2\displaystyle\leq 24C_{\mathrm{lgb}}R(1+3R(3\rho^{2}+1))\delta\leq\eta^{2}.≤ 24 italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT italic_R ( 1 + 3 italic_R ( 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) ) italic_δ ≤ italic_η start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT .

We readily have 𝒀(n+1)L2(Ω;C([0,δ];R))superscript𝒀𝑛1superscript𝐿2Ω𝐶0𝛿superscript𝑅\boldsymbol{Y}^{(n+1)}\in L^{2}(\Omega;C([0,\delta];\mathbb{R}^{R}))bold_italic_Y start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_C ( [ 0 , italic_δ ] ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) ) and hence 𝒀(n+1)𝔻stosuperscript𝒀𝑛1subscript𝔻sto\boldsymbol{Y}^{(n+1)}\in\mathbb{D}_{\mathrm{sto}}bold_italic_Y start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT ∈ blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT. Likewise, we have 𝑼(n+1)𝔻detsuperscript𝑼𝑛1subscript𝔻det\boldsymbol{U}^{(n+1)}\in\mathbb{D}_{\mathrm{det}}bold_italic_U start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT, since

sup0tδ𝑼t(n+1)F2subscriptsupremum0𝑡𝛿superscriptsubscriptnormsuperscriptsubscript𝑼𝑡𝑛1F2\displaystyle\sup_{0\leq t\leq\delta}\|\boldsymbol{U}_{t}^{(n+1)}\|_{\mathrm{F% }}^{2}roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT 2R+2sup0tδt0tC𝒀s(n)1𝔼[𝒀s(n)a(s,Xs(n))](Id×dP𝑼s(n)row)F2𝑑sabsent2𝑅2subscriptsupremum0𝑡𝛿𝑡superscriptsubscript0𝑡superscriptsubscriptnormsuperscriptsubscript𝐶superscriptsubscript𝒀𝑠𝑛1𝔼delimited-[]superscriptsubscript𝒀𝑠𝑛𝑎superscript𝑠superscriptsubscript𝑋𝑠𝑛topsubscript𝐼𝑑𝑑superscriptsubscript𝑃subscriptsuperscript𝑼𝑛𝑠rowF2differential-d𝑠\displaystyle\leq 2R+2\sup_{0\leq t\leq\delta}t\int_{0}^{t}\|{C}_{\boldsymbol{% Y}_{s}^{(n)}}^{-1}\mathbb{E}[\boldsymbol{Y}_{s}^{(n)}a(s,X_{s}^{(n)})^{\top}](% I_{d\times d}-P_{\boldsymbol{U}^{(n)}_{s}}^{\mathrm{row}})\|_{\mathrm{F}}^{2}% \,ds≤ 2 italic_R + 2 roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT italic_t ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s
2R+8δγ20δ𝔼[sup0sδ|𝒀s(n)|2]𝔼[sup0sδ|a(s,Xs(n))|2]𝑑sabsent2𝑅8𝛿superscript𝛾2superscriptsubscript0𝛿𝔼delimited-[]subscriptsupremum0𝑠𝛿superscriptsuperscriptsubscript𝒀𝑠𝑛2𝔼delimited-[]subscriptsupremum0𝑠𝛿superscript𝑎𝑠superscriptsubscript𝑋𝑠𝑛2differential-d𝑠\displaystyle{\leq 2R+8\delta\gamma^{2}\int_{0}^{\delta}\mathbb{E}[\sup_{0\leq s% \leq\delta}|\boldsymbol{Y}_{s}^{(n)}|^{2}]\mathbb{E}[\sup_{0\leq s\leq\delta}|% a(s,X_{s}^{(n)})|^{2}]\,ds}≤ 2 italic_R + 8 italic_δ italic_γ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_s ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_s ≤ italic_δ end_POSTSUBSCRIPT | italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_s
2R+8δγ2(3ρ2+1)Clgb(1+3R(3ρ2+1))absent2𝑅8𝛿superscript𝛾23superscript𝜌21subscript𝐶lgb13𝑅3superscript𝜌21\displaystyle\leq 2R+8\delta\gamma^{2}(3\rho^{2}+1)C_{\mathrm{lgb}}(1+3R(3\rho% ^{2}+1))≤ 2 italic_R + 8 italic_δ italic_γ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + 3 italic_R ( 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) )
3R,absent3𝑅\displaystyle\leq 3R,≤ 3 italic_R ,

where in the second inequality we have used the fact that P𝑼s(n)rowsuperscriptsubscript𝑃subscriptsuperscript𝑼𝑛𝑠rowP_{\boldsymbol{U}^{(n)}_{s}}^{\mathrm{row}}italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT is an orthogonal projector. Finally,

sup0tδ𝑼t(n+1)𝝋F24γ2(3ρ2+1)Clgb(1+3R(3ρ2+1))δη2.subscriptsupremum0𝑡𝛿subscriptsuperscriptnormsuperscriptsubscript𝑼𝑡𝑛1𝝋2F4superscript𝛾23superscript𝜌21subscript𝐶lgb13𝑅3superscript𝜌21𝛿superscript𝜂2\sup_{0\leq t\leq\delta}\|\boldsymbol{U}_{t}^{(n+1)}-\boldsymbol{\varphi}\|^{2% }_{\mathrm{F}}\leq 4\gamma^{2}(3\rho^{2}+1)C_{\mathrm{lgb}}(1+3R(3\rho^{2}+1))% \delta\leq\eta^{2}.roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT - bold_italic_φ ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ 4 italic_γ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + 3 italic_R ( 3 italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) ) italic_δ ≤ italic_η start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT .

Thus, by induction we conclude (𝑼(n),𝒀(n))𝔻det×𝔻stosuperscript𝑼𝑛superscript𝒀𝑛subscript𝔻detsubscript𝔻sto(\boldsymbol{U}^{(n)},\boldsymbol{Y}^{(n)})\in\mathbb{D}_{\mathrm{det}}\times% \mathbb{D}_{\mathrm{sto}}( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT for n𝑛n\in\mathbb{N}italic_n ∈ blackboard_N. ∎

We now establish a Lipschitz continuity for F1subscript𝐹1F_{1}italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT and F2subscript𝐹2F_{2}italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT on 𝔻det×𝔻stosubscript𝔻detsubscript𝔻sto\mathbb{D}_{\mathrm{det}}\times\mathbb{D}_{\mathrm{sto}}blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT.

Lemma 3.2.

Take δ>0𝛿0\delta>0italic_δ > 0 as in (3.4). There exists a constant C~:=C~a,b,R,ρ,δ,γ>0assign~𝐶subscript~𝐶𝑎𝑏𝑅𝜌𝛿𝛾0\tilde{C}:=\tilde{C}_{a,b,R,\rho,\delta,\gamma}>0over~ start_ARG italic_C end_ARG := over~ start_ARG italic_C end_ARG start_POSTSUBSCRIPT italic_a , italic_b , italic_R , italic_ρ , italic_δ , italic_γ end_POSTSUBSCRIPT > 0 such that for any (𝐕,𝐙),(𝐕~,𝐙~)𝔻det×𝔻sto𝐕𝐙~𝐕~𝐙subscript𝔻detsubscript𝔻sto(\boldsymbol{V},\boldsymbol{Z}),(\tilde{\boldsymbol{V}},\tilde{\boldsymbol{Z}}% )\in\mathbb{D}_{\mathrm{det}}\times\mathbb{D}_{\mathrm{sto}}( bold_italic_V , bold_italic_Z ) , ( over~ start_ARG bold_italic_V end_ARG , over~ start_ARG bold_italic_Z end_ARG ) ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT it holds

supt[0,δ]F1(𝑽,𝒁)(t)F1(𝑽~\displaystyle\sup_{t\in[0,\delta]}\|F_{1}(\boldsymbol{V},\boldsymbol{Z})(t)-F_% {1}(\tilde{\boldsymbol{V}}roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT ∥ italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( bold_italic_V , bold_italic_Z ) ( italic_t ) - italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_V end_ARG ,𝒁~)(t)2F+𝔼[supt[0,δ]|F2(𝑽,𝒁)(t)F2(𝑽~,𝒁~)(t)|2]\displaystyle,\tilde{\boldsymbol{Z}})(t)\|^{2}_{\mathrm{F}}+\mathbb{E}\biggl{[% }\sup_{t\in[0,\delta]}|F_{2}(\boldsymbol{V},\boldsymbol{Z})(t)-F_{2}(\tilde{% \boldsymbol{V}},\tilde{\boldsymbol{Z}})(t)|^{2}\biggr{]}, over~ start_ARG bold_italic_Z end_ARG ) ( italic_t ) ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT | italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_V , bold_italic_Z ) ( italic_t ) - italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_V end_ARG , over~ start_ARG bold_italic_Z end_ARG ) ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] (3.5)
C~0δ(supt[0,s]𝑽t𝑽~tF2+𝔼[supt[0,s]|𝒁t𝒁~t|2])𝑑sabsent~𝐶superscriptsubscript0𝛿subscriptsupremum𝑡0𝑠subscriptsuperscriptnormsubscript𝑽𝑡subscript~𝑽𝑡2F𝔼delimited-[]subscriptsupremum𝑡0𝑠superscriptsubscript𝒁𝑡subscript~𝒁𝑡2differential-d𝑠\displaystyle\leq\tilde{C}\int_{0}^{\delta}\left(\sup_{t\in[0,s]}\|\boldsymbol% {V}_{t}-\tilde{\boldsymbol{V}}_{t}\|^{2}_{\mathrm{F}}+\mathbb{E}[\sup_{t\in[0,% s]}|\boldsymbol{Z}_{t}-\tilde{\boldsymbol{Z}}_{t}|^{2}]\right)ds≤ over~ start_ARG italic_C end_ARG ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT ( roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_s ] end_POSTSUBSCRIPT ∥ bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_s ] end_POSTSUBSCRIPT | bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Z end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_d italic_s
Proof.

For any (𝑽,𝒁),(𝑽~,𝒁~)𝔻det×𝔻sto𝑽𝒁~𝑽~𝒁subscript𝔻detsubscript𝔻sto(\boldsymbol{V},\boldsymbol{Z}),(\tilde{\boldsymbol{V}},\tilde{\boldsymbol{Z}}% )\in\mathbb{D}_{\mathrm{det}}\times\mathbb{D}_{\mathrm{sto}}( bold_italic_V , bold_italic_Z ) , ( over~ start_ARG bold_italic_V end_ARG , over~ start_ARG bold_italic_Z end_ARG ) ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT, from Doob’s martingale inequality and Itô’s isometry applied similarly as in the proof of Lemma 3.1, we have

𝔼[supt[0,δ]\displaystyle\mathbb{E}\biggl{[}\sup_{t\in[0,\delta]}blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT |F2(𝑽,𝒁)(t)F2(𝑽~,𝒁~)(t)|2]\displaystyle|F_{2}(\boldsymbol{V},\boldsymbol{Z})(t)-F_{2}(\tilde{\boldsymbol% {V}},\tilde{\boldsymbol{Z}})(t)|^{2}\biggr{]}| italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_V , bold_italic_Z ) ( italic_t ) - italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_V end_ARG , over~ start_ARG bold_italic_Z end_ARG ) ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
2𝔼[supt[0,δ]|0t𝑽sa(s,𝑽s𝒁s)𝑑s0t𝑽~sa(s,𝑽~s𝒁~s)𝑑s|2]absent2𝔼delimited-[]subscriptsupremum𝑡0𝛿superscriptsuperscriptsubscript0𝑡subscript𝑽𝑠𝑎𝑠superscriptsubscript𝑽𝑠topsubscript𝒁𝑠differential-d𝑠superscriptsubscript0𝑡subscript~𝑽𝑠𝑎𝑠superscriptsubscript~𝑽𝑠topsubscript~𝒁𝑠differential-d𝑠2\displaystyle\leq 2\mathbb{E}\biggl{[}\sup_{t\in[0,\delta]}|\int_{0}^{t}% \boldsymbol{V}_{s}a(s,\boldsymbol{V}_{s}^{\top}\boldsymbol{Z}_{s})\,ds-\int_{0% }^{t}\tilde{\boldsymbol{V}}_{s}a(s,\tilde{\boldsymbol{V}}_{s}^{\top}\tilde{% \boldsymbol{Z}}_{s})\,ds|^{2}\biggr{]}≤ 2 blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT | ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT bold_italic_V start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_a ( italic_s , bold_italic_V start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_s - ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_a ( italic_s , over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT over~ start_ARG bold_italic_Z end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_s | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
+2𝔼[supt[0,δ]|0t(𝑽sb(s,𝑽s𝒁s)𝑽~sb(s,𝑽~s𝒁~s))𝑑Ws|2]2𝔼delimited-[]subscriptsupremum𝑡0𝛿superscriptsuperscriptsubscript0𝑡subscript𝑽𝑠𝑏𝑠superscriptsubscript𝑽𝑠topsubscript𝒁𝑠subscript~𝑽𝑠𝑏𝑠superscriptsubscript~𝑽𝑠topsubscript~𝒁𝑠differential-dsubscript𝑊𝑠2\displaystyle\ \ \ \ +2\mathbb{E}\biggl{[}\sup_{t\in[0,\delta]}\Bigl{|}\int_{0% }^{t}\bigl{(}\boldsymbol{V}_{s}b(s,\boldsymbol{V}_{s}^{\top}\boldsymbol{Z}_{s}% )-\tilde{\boldsymbol{V}}_{s}b(s,\tilde{\boldsymbol{V}}_{s}^{\top}\tilde{% \boldsymbol{Z}}_{s})\bigr{)}dW_{s}\Bigr{|}^{2}\biggr{]}+ 2 blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT | ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( bold_italic_V start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_V start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) - over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT over~ start_ARG bold_italic_Z end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
2𝔼[supt[0,δ]0t|𝑽sa(s,𝑽s𝒁s)𝑽~sa(s,𝑽~s𝒁~s)|2𝑑s]absent2𝔼delimited-[]subscriptsupremum𝑡0𝛿superscriptsubscript0𝑡superscriptsubscript𝑽𝑠𝑎𝑠superscriptsubscript𝑽𝑠topsubscript𝒁𝑠subscript~𝑽𝑠𝑎𝑠superscriptsubscript~𝑽𝑠topsubscript~𝒁𝑠2differential-d𝑠\displaystyle\leq 2\mathbb{E}\biggl{[}\sup_{t\in[0,\delta]}\int_{0}^{t}|% \boldsymbol{V}_{s}a(s,\boldsymbol{V}_{s}^{\top}\boldsymbol{Z}_{s})-\tilde{% \boldsymbol{V}}_{s}a(s,\tilde{\boldsymbol{V}}_{s}^{\top}\tilde{\boldsymbol{Z}}% _{s})|^{2}\,ds\biggr{]}≤ 2 blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT | bold_italic_V start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_a ( italic_s , bold_italic_V start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) - over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_a ( italic_s , over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT over~ start_ARG bold_italic_Z end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s ]
+8𝔼[0δ𝑽sb(s,𝑽s𝒁s)𝑽~sb(s,𝑽~s𝒁~s)F2𝑑s]8𝔼delimited-[]superscriptsubscript0𝛿superscriptsubscriptnormsubscript𝑽𝑠𝑏𝑠superscriptsubscript𝑽𝑠topsubscript𝒁𝑠subscript~𝑽𝑠𝑏𝑠superscriptsubscript~𝑽𝑠topsubscript~𝒁𝑠F2differential-d𝑠\displaystyle\ \ \ \ +8\mathbb{E}\biggl{[}\int_{0}^{\delta}\|\boldsymbol{V}_{s% }b(s,\boldsymbol{V}_{s}^{\top}\boldsymbol{Z}_{s})-\tilde{\boldsymbol{V}}_{s}b(% s,\tilde{\boldsymbol{V}}_{s}^{\top}\tilde{\boldsymbol{Z}}_{s})\|_{\mathrm{F}}^% {2}\,ds\biggr{]}+ 8 blackboard_E [ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT ∥ bold_italic_V start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_V start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) - over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT over~ start_ARG bold_italic_Z end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s ]
Ca,b,R,ρ,δ0δ(𝑽s𝑽~sF2+𝔼[|𝒁s𝒁~s|2])𝑑sabsentsubscript𝐶𝑎𝑏𝑅𝜌𝛿superscriptsubscript0𝛿subscriptsuperscriptnormsubscript𝑽𝑠subscript~𝑽𝑠2F𝔼delimited-[]superscriptsubscript𝒁𝑠subscript~𝒁𝑠2differential-d𝑠\displaystyle\leq C_{a,b,R,\rho,\delta}\int_{0}^{\delta}\bigl{(}\|\boldsymbol{% V}_{s}-\tilde{\boldsymbol{V}}_{s}\|^{2}_{\mathrm{F}}+\mathbb{E}[|\boldsymbol{Z% }_{s}-\tilde{\boldsymbol{Z}}_{s}|^{2}]\bigr{)}\,ds≤ italic_C start_POSTSUBSCRIPT italic_a , italic_b , italic_R , italic_ρ , italic_δ end_POSTSUBSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT ( ∥ bold_italic_V start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + blackboard_E [ | bold_italic_Z start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Z end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_d italic_s
Ca,b,R,ρ,δ0δ(supr[0,s]𝑽r𝑽~rF2+𝔼[supr[0,s]|𝒁r𝒁~r|2])𝑑s,absentsubscript𝐶𝑎𝑏𝑅𝜌𝛿superscriptsubscript0𝛿subscriptsupremum𝑟0𝑠subscriptsuperscriptnormsubscript𝑽𝑟subscript~𝑽𝑟2F𝔼delimited-[]subscriptsupremum𝑟0𝑠superscriptsubscript𝒁𝑟subscript~𝒁𝑟2differential-d𝑠\displaystyle\leq C_{a,b,R,\rho,\delta}\int_{0}^{\delta}(\sup_{r\in[0,s]}\|% \boldsymbol{V}_{r}-\tilde{\boldsymbol{V}}_{r}\|^{2}_{\mathrm{F}}+\mathbb{E}[% \sup_{r\in[0,s]}|\boldsymbol{Z}_{r}-\tilde{\boldsymbol{Z}}_{r}|^{2}])ds,≤ italic_C start_POSTSUBSCRIPT italic_a , italic_b , italic_R , italic_ρ , italic_δ end_POSTSUBSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT ( roman_sup start_POSTSUBSCRIPT italic_r ∈ [ 0 , italic_s ] end_POSTSUBSCRIPT ∥ bold_italic_V start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT - over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_r ∈ [ 0 , italic_s ] end_POSTSUBSCRIPT | bold_italic_Z start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Z end_ARG start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_d italic_s ,

where Ca,b,R,ρ,δsubscript𝐶𝑎𝑏𝑅𝜌𝛿C_{a,b,R,\rho,\delta}italic_C start_POSTSUBSCRIPT italic_a , italic_b , italic_R , italic_ρ , italic_δ end_POSTSUBSCRIPT is a positive constant. Similarly, we have for a constant Ca,b,R,ρ,δ,γ>0subscript𝐶𝑎𝑏𝑅𝜌𝛿𝛾0C_{a,b,R,\rho,\delta,\gamma}>0italic_C start_POSTSUBSCRIPT italic_a , italic_b , italic_R , italic_ρ , italic_δ , italic_γ end_POSTSUBSCRIPT > 0 that

supt[0,δ]F1(𝑽,𝒁)(t)F1(𝑽~,𝒁~)(t)F2Ca,b,R,ρ,δ,γ0δ(supr[0,s]𝑽r𝑽~rF2+𝔼[supr[0,s]|𝒁r𝒁~r|2])𝑑s,subscriptsupremum𝑡0𝛿subscriptsuperscriptnormsubscript𝐹1𝑽𝒁𝑡subscript𝐹1~𝑽~𝒁𝑡2Fsubscript𝐶𝑎𝑏𝑅𝜌𝛿𝛾superscriptsubscript0𝛿subscriptsupremum𝑟0𝑠subscriptsuperscriptnormsubscript𝑽𝑟subscript~𝑽𝑟2F𝔼delimited-[]subscriptsupremum𝑟0𝑠superscriptsubscript𝒁𝑟subscript~𝒁𝑟2differential-d𝑠\sup_{t\in[0,\delta]}\|F_{1}(\boldsymbol{V},\boldsymbol{Z})(t)-F_{1}(\tilde{% \boldsymbol{V}},\tilde{\boldsymbol{Z}})(t)\|^{2}_{\mathrm{F}}\leq C_{a,b,R,% \rho,\delta,\gamma}\int_{0}^{\delta}(\sup_{r\in[0,s]}\|\boldsymbol{V}_{r}-% \tilde{\boldsymbol{V}}_{r}\|^{2}_{\mathrm{F}}+\mathbb{E}[\sup_{r\in[0,s]}|% \boldsymbol{Z}_{r}-\tilde{\boldsymbol{Z}}_{r}|^{2}])ds,roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT ∥ italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( bold_italic_V , bold_italic_Z ) ( italic_t ) - italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_V end_ARG , over~ start_ARG bold_italic_Z end_ARG ) ( italic_t ) ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ italic_C start_POSTSUBSCRIPT italic_a , italic_b , italic_R , italic_ρ , italic_δ , italic_γ end_POSTSUBSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT ( roman_sup start_POSTSUBSCRIPT italic_r ∈ [ 0 , italic_s ] end_POSTSUBSCRIPT ∥ bold_italic_V start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT - over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_r ∈ [ 0 , italic_s ] end_POSTSUBSCRIPT | bold_italic_Z start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Z end_ARG start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_d italic_s ,

where we used the Lipschitz continuity of C𝒀s1superscriptsubscript𝐶subscript𝒀𝑠1{C}_{\boldsymbol{Y}_{s}}^{-1}italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT and P𝑼srowsubscriptsuperscript𝑃rowsubscript𝑼𝑠P^{\mathrm{row}}_{\boldsymbol{U}_{s}}italic_P start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_POSTSUBSCRIPT; see [kazashi2021existence, Lemma 3.5] and Lemma A.4. ∎

Thanks to the previous results, we have that sequences (𝑼(n))nsubscriptsuperscript𝑼𝑛𝑛(\boldsymbol{U}^{(n)})_{n}( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and (𝒀(n))nsubscriptsuperscript𝒀𝑛𝑛(\boldsymbol{Y}^{(n)})_{n}( bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT not only live in 𝔻detsubscript𝔻det\mathbb{D}_{\mathrm{det}}blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT and 𝔻stosubscript𝔻sto\mathbb{D}_{\mathrm{sto}}blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT, respectively, but also converge therein.

Lemma 3.3.

The sequence (𝐔(n))nsubscriptsuperscript𝐔𝑛𝑛(\boldsymbol{U}^{(n)})_{n}( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT admits a limit 𝐔𝔻detC([0,δ];R×d)𝐔subscript𝔻det𝐶0𝛿superscript𝑅𝑑\boldsymbol{U}\in\mathbb{D}_{\mathrm{det}}\subset C([0,\delta];\mathbb{R}^{R% \times d})bold_italic_U ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT ⊂ italic_C ( [ 0 , italic_δ ] ; blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT ), and the sequence (𝐘(n))nsubscriptsuperscript𝐘𝑛𝑛(\boldsymbol{Y}^{(n)})_{n}( bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT admits a limit 𝐘𝔻stoC([0,δ];R)𝐘subscript𝔻sto𝐶0𝛿superscript𝑅\boldsymbol{Y}\in\mathbb{D}_{\mathrm{sto}}\subset C([0,\delta];\mathbb{R}^{R})bold_italic_Y ∈ blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT ⊂ italic_C ( [ 0 , italic_δ ] ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) almost surely. Moreover, 𝐘𝐘\boldsymbol{Y}bold_italic_Y is also an L2(Ω;C([0,δ];R))superscript𝐿2Ω𝐶0𝛿superscript𝑅L^{2}(\Omega;C([0,\delta];\mathbb{R}^{R}))italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_C ( [ 0 , italic_δ ] ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) )-limit.

Proof.

From Lemma 3.1 we have (𝑼(n),𝒀(n))𝔻det×𝔻stosuperscript𝑼𝑛superscript𝒀𝑛subscript𝔻detsubscript𝔻sto(\boldsymbol{U}^{(n)},\boldsymbol{Y}^{(n)})\in\mathbb{D}_{\mathrm{det}}\times% \mathbb{D}_{\mathrm{sto}}( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT for all n𝑛n\in\mathbb{N}italic_n ∈ blackboard_N. Let ΔU(n)(s):=sup0rs𝑼r(n)𝑼r(n1)F2assignsuperscriptsubscriptΔ𝑈𝑛𝑠subscriptsupremum0𝑟𝑠superscriptsubscriptnormsuperscriptsubscript𝑼𝑟𝑛superscriptsubscript𝑼𝑟𝑛1F2\Delta_{U}^{(n)}(s):=\sup\limits_{0\leq r\leq s}\|\boldsymbol{U}_{r}^{(n)}-% \boldsymbol{U}_{r}^{(n-1)}\|_{\mathrm{F}}^{2}roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ( italic_s ) := roman_sup start_POSTSUBSCRIPT 0 ≤ italic_r ≤ italic_s end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT - bold_italic_U start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n - 1 ) end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT. Then, since 𝑼(n)𝑼(n1)F2superscriptsubscriptnormsuperscript𝑼𝑛superscript𝑼𝑛1F2\|\boldsymbol{U}^{(n)}-\boldsymbol{U}^{(n-1)}\|_{\mathrm{F}}^{2}∥ bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT - bold_italic_U start_POSTSUPERSCRIPT ( italic_n - 1 ) end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT is continuous on [0,δ]0𝛿[0,\delta][ 0 , italic_δ ], so is ΔU(n)superscriptsubscriptΔ𝑈𝑛\Delta_{U}^{(n)}roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT, and thus ΔU(n)superscriptsubscriptΔ𝑈𝑛\Delta_{U}^{(n)}roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT is measurable. Similarly, ΔY(n)(s):=sup0rs|𝒀r(n)𝒀r(n1)|2assignsuperscriptsubscriptΔ𝑌𝑛𝑠subscriptsupremum0𝑟𝑠superscriptsuperscriptsubscript𝒀𝑟𝑛superscriptsubscript𝒀𝑟𝑛12\Delta_{Y}^{(n)}(s):=\sup\limits_{0\leq r\leq s}|\boldsymbol{Y}_{r}^{(n)}-% \boldsymbol{Y}_{r}^{(n-1)}|^{2}roman_Δ start_POSTSUBSCRIPT italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ( italic_s ) := roman_sup start_POSTSUBSCRIPT 0 ≤ italic_r ≤ italic_s end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT - bold_italic_Y start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n - 1 ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT is a.s. continuous on [0,δ]0𝛿[0,\delta][ 0 , italic_δ ]. Noting that 𝒀(n)𝔻stosuperscript𝒀𝑛subscript𝔻sto\boldsymbol{Y}^{(n)}\in\mathbb{D}_{\mathrm{sto}}bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∈ blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT implies C𝒀t(n)1F22γsuperscriptsubscriptnormsuperscriptsubscript𝐶superscriptsubscript𝒀𝑡𝑛1F22𝛾\|{C}_{\boldsymbol{Y}_{t}^{(n)}}^{-1}\|_{\mathrm{F}}^{2}\leq 2\gamma∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ 2 italic_γ, from Lemma 3.2 we have

ΔU(n)(δ)+𝔼[ΔY(n)(δ)]superscriptsubscriptΔ𝑈𝑛𝛿𝔼delimited-[]superscriptsubscriptΔ𝑌𝑛𝛿\displaystyle\Delta_{U}^{(n)}(\delta)+\mathbb{E}[\Delta_{Y}^{(n)}(\delta)]roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ( italic_δ ) + blackboard_E [ roman_Δ start_POSTSUBSCRIPT italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ( italic_δ ) ] C~0δ(ΔU(n1)(s)+𝔼[ΔY(n1)(s)])𝑑sabsent~𝐶superscriptsubscript0𝛿superscriptsubscriptΔ𝑈𝑛1𝑠𝔼delimited-[]superscriptsubscriptΔ𝑌𝑛1𝑠differential-d𝑠\displaystyle\leq\tilde{C}\int_{0}^{\delta}(\Delta_{U}^{(n-1)}(s)+\mathbb{E}[% \Delta_{Y}^{(n-1)}(s)])\,ds≤ over~ start_ARG italic_C end_ARG ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT ( roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n - 1 ) end_POSTSUPERSCRIPT ( italic_s ) + blackboard_E [ roman_Δ start_POSTSUBSCRIPT italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n - 1 ) end_POSTSUPERSCRIPT ( italic_s ) ] ) italic_d italic_s
C~n10δ0sn10s2(ΔU(1)(s1)+𝔼[ΔY(1)(s1)])𝑑s1𝑑sn1absentsuperscript~𝐶𝑛1superscriptsubscript0𝛿superscriptsubscript0subscript𝑠𝑛1superscriptsubscript0subscript𝑠2superscriptsubscriptΔ𝑈1subscript𝑠1𝔼delimited-[]superscriptsubscriptΔ𝑌1subscript𝑠1differential-dsubscript𝑠1differential-dsubscript𝑠𝑛1\displaystyle\leq\tilde{C}^{n-1}\int_{0}^{\delta}\int_{0}^{s_{n-1}}\dotsb\int_% {0}^{s_{2}}(\Delta_{U}^{(1)}(s_{1})+\mathbb{E}[\Delta_{Y}^{(1)}(s_{1})])\,ds_{% 1}\dotsb ds_{n-1}≤ over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT italic_n - 1 end_POSTSUPERSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_s start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT end_POSTSUPERSCRIPT ⋯ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_s start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT end_POSTSUPERSCRIPT ( roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) + blackboard_E [ roman_Δ start_POSTSUBSCRIPT italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) ] ) italic_d italic_s start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ⋯ italic_d italic_s start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT
=(C~δ)n1(n1)!(ΔU(1)(δ)+𝔼[ΔY(1)(δ)]).absentsuperscript~𝐶𝛿𝑛1𝑛1superscriptsubscriptΔ𝑈1𝛿𝔼delimited-[]superscriptsubscriptΔ𝑌1𝛿\displaystyle=\frac{(\tilde{C}\delta)^{n-1}}{(n-1)!}(\Delta_{U}^{(1)}(\delta)+% \mathbb{E}[\Delta_{Y}^{(1)}(\delta)]).= divide start_ARG ( over~ start_ARG italic_C end_ARG italic_δ ) start_POSTSUPERSCRIPT italic_n - 1 end_POSTSUPERSCRIPT end_ARG start_ARG ( italic_n - 1 ) ! end_ARG ( roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ( italic_δ ) + blackboard_E [ roman_Δ start_POSTSUBSCRIPT italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ( italic_δ ) ] ) . (3.6)

Chebyshev’s inequality then implies

n=1(ΔU(n)(δ)+ΔY(n)(δ)12n)(ΔU(1)(δ)+𝔼[ΔY(1)(δ)])2n=1(2C~δ)n1(n1)!<,superscriptsubscript𝑛1superscriptsubscriptΔ𝑈𝑛𝛿superscriptsubscriptΔ𝑌𝑛𝛿1superscript2𝑛superscriptsubscriptΔ𝑈1𝛿𝔼delimited-[]superscriptsubscriptΔ𝑌1𝛿2superscriptsubscript𝑛1superscript2~𝐶𝛿𝑛1𝑛1\sum_{n=1}^{\infty}\mathbb{P}\Bigl{(}\Delta_{U}^{(n)}(\delta)+\Delta_{Y}^{(n)}% (\delta)\geq\frac{1}{2^{n}}\Bigr{)}\leq\left(\Delta_{U}^{(1)}(\delta)+\mathbb{% E}[\Delta_{Y}^{(1)}(\delta)]\right)2\sum_{n=1}^{\infty}\frac{(2\tilde{C}\delta% )^{n-1}}{(n-1)!}<\infty,∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∞ end_POSTSUPERSCRIPT blackboard_P ( roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ( italic_δ ) + roman_Δ start_POSTSUBSCRIPT italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ( italic_δ ) ≥ divide start_ARG 1 end_ARG start_ARG 2 start_POSTSUPERSCRIPT italic_n end_POSTSUPERSCRIPT end_ARG ) ≤ ( roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ( italic_δ ) + blackboard_E [ roman_Δ start_POSTSUBSCRIPT italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ( italic_δ ) ] ) 2 ∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∞ end_POSTSUPERSCRIPT divide start_ARG ( 2 over~ start_ARG italic_C end_ARG italic_δ ) start_POSTSUPERSCRIPT italic_n - 1 end_POSTSUPERSCRIPT end_ARG start_ARG ( italic_n - 1 ) ! end_ARG < ∞ ,

and thus from the Borel-Cantelli lemma we have

({k=k(ω) s.t. nkΔU(n)(δ)+ΔY(n)(δ)<12n})=1.𝑘𝑘𝜔 s.t. 𝑛𝑘superscriptsubscriptΔ𝑈𝑛𝛿superscriptsubscriptΔ𝑌𝑛𝛿1superscript2𝑛1\mathbb{P}\Bigl{(}\Bigl{\{}\exists k=k(\omega)\text{ s.t. }n\geq k\implies% \Delta_{U}^{(n)}(\delta)+\Delta_{Y}^{(n)}(\delta)<\frac{1}{2^{n}}\Bigr{\}}% \Bigr{)}=1.blackboard_P ( { ∃ italic_k = italic_k ( italic_ω ) s.t. italic_n ≥ italic_k ⟹ roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ( italic_δ ) + roman_Δ start_POSTSUBSCRIPT italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ( italic_δ ) < divide start_ARG 1 end_ARG start_ARG 2 start_POSTSUPERSCRIPT italic_n end_POSTSUPERSCRIPT end_ARG } ) = 1 .

Hence, (𝒀(n)(ω))nsubscriptsuperscript𝒀𝑛𝜔𝑛(\boldsymbol{Y}^{(n)}(\omega))_{n}( bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ( italic_ω ) ) start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT has a limit 𝒀(ω)C([0,δ];R)𝒀𝜔𝐶0𝛿superscript𝑅\boldsymbol{Y}(\omega)\in C([0,\delta];\mathbb{R}^{R})bold_italic_Y ( italic_ω ) ∈ italic_C ( [ 0 , italic_δ ] ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ), where the convergence is uniformly in t𝑡titalic_t on [0,δ]0𝛿[0,\delta][ 0 , italic_δ ], a.s. Moreover, from the completeness of the underlying probability space, 𝒀𝒀\boldsymbol{Y}bold_italic_Y is (t)subscript𝑡(\mathcal{F}_{t})( caligraphic_F start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT )-adapted. Also, from 𝒀(n)𝔻stosuperscript𝒀𝑛subscript𝔻sto\boldsymbol{Y}^{(n)}\in\mathbb{D}_{\mathrm{sto}}bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∈ blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT, n𝑛n\in\mathbb{N}italic_n ∈ blackboard_N, Fatou’s lemma implies

𝔼[sup0tδ|𝒀t|2]𝔼delimited-[]subscriptsupremum0𝑡𝛿superscriptsubscript𝒀𝑡2\displaystyle\mathbb{E}\Bigl{[}\sup_{0\leq t\leq\delta}|\boldsymbol{Y}_{t}|^{2% }\Bigr{]}blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] lim infn𝔼[sup0tδ|𝒀t(n)|2]4ρ,absentsubscriptlimit-infimum𝑛𝔼delimited-[]subscriptsupremum0𝑡𝛿superscriptsuperscriptsubscript𝒀𝑡𝑛24𝜌\displaystyle\leq\liminf_{n\to\infty}\mathbb{E}\Bigl{[}\sup_{0\leq t\leq\delta% }|\boldsymbol{Y}_{t}^{(n)}|^{2}\Bigr{]}\leq 4\rho,≤ lim inf start_POSTSUBSCRIPT italic_n → ∞ end_POSTSUBSCRIPT blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ 4 italic_ρ , (3.7)
𝔼[sup0tδ|𝒀t𝝃|2]𝔼delimited-[]subscriptsupremum0𝑡𝛿superscriptsubscript𝒀𝑡𝝃2\displaystyle\mathbb{E}\Bigl{[}\sup_{0\leq t\leq\delta}|\boldsymbol{Y}_{t}-% \boldsymbol{\xi}|^{2}\Bigr{]}blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - bold_italic_ξ | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] η2,absentsuperscript𝜂2\displaystyle\leq\eta^{2},≤ italic_η start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT , (3.8)

and thus 𝒀𝔻sto𝒀subscript𝔻sto\boldsymbol{Y}\in\mathbb{D}_{\mathrm{sto}}bold_italic_Y ∈ blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT. An analogous argument applies to see that (𝑼(n))nsubscriptsuperscript𝑼𝑛𝑛(\boldsymbol{U}^{(n)})_{n}( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT has a limit 𝑼𝑼\boldsymbol{U}bold_italic_U in C([0,δ];R×d)𝐶0𝛿superscript𝑅𝑑C([0,\delta];\mathbb{R}^{R\times d})italic_C ( [ 0 , italic_δ ] ; blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT ) with 𝑼𝔻det𝑼subscript𝔻det\boldsymbol{U}\in\mathbb{D}_{\mathrm{det}}bold_italic_U ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT.

The sequences 𝒀(n)superscript𝒀𝑛\boldsymbol{Y}^{(n)}bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT converge in L2(Ω;C([0,δ];R))superscript𝐿2Ω𝐶0𝛿superscript𝑅L^{2}(\Omega;C([0,\delta];\mathbb{R}^{R}))italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_C ( [ 0 , italic_δ ] ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) ) as well. Indeed, from (3.6), for j>n𝑗𝑛j>nitalic_j > italic_n we have

𝔼[sup0tδ|𝒀t(j)𝒀t(n)|2]𝔼delimited-[]subscriptsupremum0𝑡𝛿superscriptsuperscriptsubscript𝒀𝑡𝑗superscriptsubscript𝒀𝑡𝑛2\displaystyle\sqrt{\mathbb{E}\Bigl{[}\sup_{0\leq t\leq\delta}|\boldsymbol{Y}_{% t}^{(j)}-\boldsymbol{Y}_{t}^{(n)}|^{2}\Bigr{]}}square-root start_ARG blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_j ) end_POSTSUPERSCRIPT - bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] end_ARG k=nj1𝔼[sup0tδ|𝒀t(k+1)𝒀t(k)|2]absentsuperscriptsubscript𝑘𝑛𝑗1𝔼delimited-[]subscriptsupremum0𝑡𝛿superscriptsuperscriptsubscript𝒀𝑡𝑘1superscriptsubscript𝒀𝑡𝑘2\displaystyle\leq\sum_{k=n}^{j-1}\sqrt{\mathbb{E}\Bigl{[}\sup_{0\leq t\leq% \delta}|\boldsymbol{Y}_{t}^{(k+1)}-\boldsymbol{Y}_{t}^{(k)}|^{2}\Bigr{]}}≤ ∑ start_POSTSUBSCRIPT italic_k = italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j - 1 end_POSTSUPERSCRIPT square-root start_ARG blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_k + 1 ) end_POSTSUPERSCRIPT - bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_k ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] end_ARG
ΔU(1)(δ)+𝔼[ΔY(1)(δ)]k=nj1(C~δ)k1(k1)!absentsuperscriptsubscriptΔ𝑈1𝛿𝔼delimited-[]superscriptsubscriptΔ𝑌1𝛿superscriptsubscript𝑘𝑛𝑗1superscript~𝐶𝛿𝑘1𝑘1\displaystyle\leq\sqrt{\Delta_{U}^{(1)}(\delta)+\mathbb{E}[\Delta_{Y}^{(1)}(% \delta)]}\,\sum_{k=n}^{j-1}\sqrt{\frac{(\tilde{C}\delta)^{k-1}}{(k-1)!}}≤ square-root start_ARG roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ( italic_δ ) + blackboard_E [ roman_Δ start_POSTSUBSCRIPT italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ( italic_δ ) ] end_ARG ∑ start_POSTSUBSCRIPT italic_k = italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j - 1 end_POSTSUPERSCRIPT square-root start_ARG divide start_ARG ( over~ start_ARG italic_C end_ARG italic_δ ) start_POSTSUPERSCRIPT italic_k - 1 end_POSTSUPERSCRIPT end_ARG start_ARG ( italic_k - 1 ) ! end_ARG end_ARG

and thus Fatou’s lemma implies

𝔼[sup0tδ|𝒀t𝒀t(n)|2](ΔU(1)(δ)+𝔼[ΔY(1)(δ)])(k=n(C~δ)k1(k1)!)2<,𝔼delimited-[]subscriptsupremum0𝑡𝛿superscriptsubscript𝒀𝑡superscriptsubscript𝒀𝑡𝑛2superscriptsubscriptΔ𝑈1𝛿𝔼delimited-[]superscriptsubscriptΔ𝑌1𝛿superscriptsuperscriptsubscript𝑘𝑛superscript~𝐶𝛿𝑘1𝑘12\mathbb{E}\Bigl{[}\sup_{0\leq t\leq\delta}|\boldsymbol{Y}_{t}-\boldsymbol{Y}_{% t}^{(n)}|^{2}\Bigr{]}\leq(\Delta_{U}^{(1)}(\delta)+\mathbb{E}[\Delta_{Y}^{(1)}% (\delta)])\biggl{(}\sum_{k=n}^{\infty}\sqrt{\frac{(\tilde{C}\delta)^{k-1}}{(k-% 1)!}}\biggr{)}^{2}<\infty,blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ ( roman_Δ start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ( italic_δ ) + blackboard_E [ roman_Δ start_POSTSUBSCRIPT italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ( italic_δ ) ] ) ( ∑ start_POSTSUBSCRIPT italic_k = italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ∞ end_POSTSUPERSCRIPT square-root start_ARG divide start_ARG ( over~ start_ARG italic_C end_ARG italic_δ ) start_POSTSUPERSCRIPT italic_k - 1 end_POSTSUPERSCRIPT end_ARG start_ARG ( italic_k - 1 ) ! end_ARG end_ARG ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT < ∞ ,

hence limn𝔼[sup0tδ|𝒀t𝒀t(n)|2]=0subscript𝑛𝔼delimited-[]subscriptsupremum0𝑡𝛿superscriptsubscript𝒀𝑡superscriptsubscript𝒀𝑡𝑛20\lim\limits_{n\to\infty}\mathbb{E}\Bigl{[}\sup\limits_{0\leq t\leq\delta}|% \boldsymbol{Y}_{t}-\boldsymbol{Y}_{t}^{(n)}|^{2}\Bigr{]}=0roman_lim start_POSTSUBSCRIPT italic_n → ∞ end_POSTSUBSCRIPT blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_δ end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] = 0. ∎

The argument used in Lemmata 3.1-3.3 to show convergence of the Picard iterates resembles the standard one used in establishing well-posedness of SDEs, however containing important differences. First, the map (3.1) to update 𝑼𝑼\boldsymbol{U}bold_italic_U involves a “stochastic projection” introducing a dependence on the law of the 𝒀𝒀\boldsymbol{Y}bold_italic_Y process. Second, the same projection involves the term C𝒀1subscriptsuperscript𝐶1𝒀C^{-1}_{\boldsymbol{Y}}italic_C start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT bold_italic_Y end_POSTSUBSCRIPT (inverse of the Gramian of the stochastic basis), which might not be defined for all iterates or it may fail to be Lipschitz continuous with respect to 𝒀𝒀\boldsymbol{Y}bold_italic_Y. We thus have to restrict to a well-designed set, containing the initial state, in which the inverse of the Gramian is well-defined and Lipschitz continuous. Lemma 3.1 guarantees that the Picard iterates (𝑼(n),𝒀(n))superscript𝑼𝑛superscript𝒀𝑛(\boldsymbol{U}^{(n)},\boldsymbol{Y}^{(n)})( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) are contained in such set for all n𝑛nitalic_n. Lemma 3.2 shows the Lipschitz continuity of the mapping that defines the iterates on this set, and Lemma 3.3 assures that (𝑼(n),𝒀(n))superscript𝑼𝑛superscript𝒀𝑛(\boldsymbol{U}^{(n)},\boldsymbol{Y}^{(n)})( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) admit a limit in the same set. We are now prepared to establish our existence result for the DO system, employing an argument that closely resembles the conventional approach used for SDEs.

Theorem 3.4 (Existence of a DO solution).

For any (𝛗,𝛏)𝛗𝛏(\boldsymbol{\varphi},\boldsymbol{\xi})( bold_italic_φ , bold_italic_ξ ), where 𝛗d×R𝛗superscript𝑑𝑅\boldsymbol{\varphi}\in\mathbb{R}^{d\times R}bold_italic_φ ∈ blackboard_R start_POSTSUPERSCRIPT italic_d × italic_R end_POSTSUPERSCRIPT has orthonormal rows and 𝛏L2(Ω,R)𝛏superscript𝐿2Ωsuperscript𝑅\boldsymbol{\xi}\in L^{2}(\Omega,\mathbb{R}^{R})bold_italic_ξ ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω , blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) satisfies 𝛏[L2(Ω)]R=ρ>0subscriptnorm𝛏superscriptdelimited-[]superscript𝐿2Ω𝑅𝜌0\|\boldsymbol{\xi}\|_{[L^{2}(\Omega)]^{R}}=\rho>0∥ bold_italic_ξ ∥ start_POSTSUBSCRIPT [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = italic_ρ > 0 and C𝛏1F=γ>0subscriptnormsuperscriptsubscript𝐶𝛏1F𝛾0\|{C}_{\boldsymbol{\xi}}^{-1}\|_{\mathrm{F}}=\gamma>0∥ italic_C start_POSTSUBSCRIPT bold_italic_ξ end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = italic_γ > 0, the DO equations (2.6) and (2.7) with the initial condition (𝐔0,𝐘0)=(𝛗,𝛏)subscript𝐔0subscript𝐘0𝛗𝛏(\boldsymbol{U}_{0},\boldsymbol{Y}_{0})=(\boldsymbol{\varphi},\boldsymbol{\xi})( bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT , bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ) = ( bold_italic_φ , bold_italic_ξ ) have a local (in time) strong DO solution (𝐔,𝐘)𝔻det×𝔻sto𝐔𝐘subscript𝔻detsubscript𝔻sto(\boldsymbol{U},\boldsymbol{Y})\in\mathbb{D}_{\mathrm{det}}\times\mathbb{D}_{% \mathrm{sto}}( bold_italic_U , bold_italic_Y ) ∈ blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT with δ𝛿\deltaitalic_δ given by (3.4).

Proof.

We show that the limit (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) in Lemma 3.3 satisfies 𝑼=F1(𝑼,𝒀)𝑼subscript𝐹1𝑼𝒀\boldsymbol{U}=F_{1}(\boldsymbol{U},\boldsymbol{Y})bold_italic_U = italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) and 𝒀=F2(𝑼,𝒀)𝒀subscript𝐹2𝑼𝒀\boldsymbol{Y}=F_{2}(\boldsymbol{U},\boldsymbol{Y})bold_italic_Y = italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ), hence it is a DO solution. From Lemma 3.2, F1subscript𝐹1F_{1}italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT and F2subscript𝐹2F_{2}italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT are (Lipschitz) continuous on 𝔻det×𝔻stosubscript𝔻detsubscript𝔻sto\mathbb{D}_{\mathrm{det}}\times\mathbb{D}_{\mathrm{sto}}blackboard_D start_POSTSUBSCRIPT roman_det end_POSTSUBSCRIPT × blackboard_D start_POSTSUBSCRIPT roman_sto end_POSTSUBSCRIPT:

max{supt[0,δ]F1(𝑽,𝒁)(t)F1(\displaystyle\max\biggl{\{}\sup_{t\in[0,\delta]}\|F_{1}(\boldsymbol{V},% \boldsymbol{Z})(t)-F_{1}(roman_max { roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT ∥ italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( bold_italic_V , bold_italic_Z ) ( italic_t ) - italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( 𝑽~,𝒁~)(t)F2,𝔼[supt[0,δ]|F2(𝑽,𝒁)(t)F2(𝑽~,𝒁~)(t)|2]}\displaystyle\tilde{\boldsymbol{V}},\tilde{\boldsymbol{Z}})(t)\|^{2}_{\mathrm{% F}}\,,\,\mathbb{E}\biggl{[}\sup_{t\in[0,\delta]}|F_{2}(\boldsymbol{V},% \boldsymbol{Z})(t)-F_{2}(\tilde{\boldsymbol{V}},\tilde{\boldsymbol{Z}})(t)|^{2% }\biggr{]}\biggr{\}}over~ start_ARG bold_italic_V end_ARG , over~ start_ARG bold_italic_Z end_ARG ) ( italic_t ) ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT , blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT | italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_V , bold_italic_Z ) ( italic_t ) - italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_V end_ARG , over~ start_ARG bold_italic_Z end_ARG ) ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] }
C~0δ(supt[0,s]𝑽t𝑽~tF2+𝔼[supt[0,s]|𝒁t𝒁~t|2])𝑑sabsent~𝐶superscriptsubscript0𝛿subscriptsupremum𝑡0𝑠subscriptsuperscriptnormsubscript𝑽𝑡subscript~𝑽𝑡2F𝔼delimited-[]subscriptsupremum𝑡0𝑠superscriptsubscript𝒁𝑡subscript~𝒁𝑡2differential-d𝑠\displaystyle\leq\tilde{C}\int_{0}^{\delta}\left(\sup_{t\in[0,s]}\|\boldsymbol% {V}_{t}-\tilde{\boldsymbol{V}}_{t}\|^{2}_{\mathrm{F}}+\mathbb{E}[\sup_{t\in[0,% s]}|\boldsymbol{Z}_{t}-\tilde{\boldsymbol{Z}}_{t}|^{2}]\right)ds≤ over~ start_ARG italic_C end_ARG ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_δ end_POSTSUPERSCRIPT ( roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_s ] end_POSTSUBSCRIPT ∥ bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_s ] end_POSTSUBSCRIPT | bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Z end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_d italic_s
C~δ(supt[0,δ]𝑽t𝑽~tF2+𝔼[supt[0,δ]|𝒁t𝒁~t|2]).absent~𝐶𝛿subscriptsupremum𝑡0𝛿subscriptsuperscriptnormsubscript𝑽𝑡subscript~𝑽𝑡2F𝔼delimited-[]subscriptsupremum𝑡0𝛿superscriptsubscript𝒁𝑡subscript~𝒁𝑡2\displaystyle\leq\tilde{C}\delta\left(\sup_{t\in[0,\delta]}\|\boldsymbol{V}_{t% }-\tilde{\boldsymbol{V}}_{t}\|^{2}_{\mathrm{F}}+\mathbb{E}[\sup_{t\in[0,\delta% ]}|\boldsymbol{Z}_{t}-\tilde{\boldsymbol{Z}}_{t}|^{2}]\right).≤ over~ start_ARG italic_C end_ARG italic_δ ( roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT ∥ bold_italic_V start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_V end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT | bold_italic_Z start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Z end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) .

Thus, we have

𝔼[supt[0,δ]|𝒀tF2(𝑼,𝒀)(t)|2]𝔼delimited-[]subscriptsupremum𝑡0𝛿superscriptsubscript𝒀𝑡subscript𝐹2𝑼𝒀𝑡2\displaystyle\mathbb{E}\biggl{[}\sup_{t\in[0,\delta]}|\boldsymbol{Y}_{t}-F_{2}% (\boldsymbol{U},\boldsymbol{Y})(t)|^{2}\biggr{]}blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] =limn𝔼[supt[0,δ]|𝒀t(n)F2(𝑼(n),𝒀(n))(t)|2]absentsubscript𝑛𝔼delimited-[]subscriptsupremum𝑡0𝛿superscriptsuperscriptsubscript𝒀𝑡𝑛subscript𝐹2superscript𝑼𝑛superscript𝒀𝑛𝑡2\displaystyle=\lim_{n\to\infty}\mathbb{E}\biggl{[}\sup_{t\in[0,\delta]}|% \boldsymbol{Y}_{t}^{(n)}-F_{2}(\boldsymbol{U}^{(n)},\boldsymbol{Y}^{(n)})(t)|^% {2}\biggr{]}= roman_lim start_POSTSUBSCRIPT italic_n → ∞ end_POSTSUBSCRIPT blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT - italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_U start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT , bold_italic_Y start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
=limn𝔼[supt[0,δ]|𝒀t(n)𝒀t(n+1)|2]=0,absentsubscript𝑛𝔼delimited-[]subscriptsupremum𝑡0𝛿superscriptsuperscriptsubscript𝒀𝑡𝑛superscriptsubscript𝒀𝑡𝑛120\displaystyle=\lim_{n\to\infty}\mathbb{E}\biggl{[}\sup_{t\in[0,\delta]}|% \boldsymbol{Y}_{t}^{(n)}-\boldsymbol{Y}_{t}^{(n+1)}|^{2}\biggr{]}=0,= roman_lim start_POSTSUBSCRIPT italic_n → ∞ end_POSTSUBSCRIPT blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_δ ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT - bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_n + 1 ) end_POSTSUPERSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] = 0 ,

and hence 𝒀t=F2(𝑼,𝒀)(t)subscript𝒀𝑡subscript𝐹2𝑼𝒀𝑡\boldsymbol{Y}_{t}=F_{2}(\boldsymbol{U},\boldsymbol{Y})(t)bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) ( italic_t ) for t[0,δ]𝑡0𝛿t\in[0,\delta]italic_t ∈ [ 0 , italic_δ ], a.s. We see 𝑼t=F1(𝑼,𝒀)(t)subscript𝑼𝑡subscript𝐹1𝑼𝒀𝑡\boldsymbol{U}_{t}=F_{1}(\boldsymbol{U},\boldsymbol{Y})(t)bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) ( italic_t ) analogously. ∎

To establish uniqueness, first we will show the following norm bound analogous to Lemma 2.4.

Lemma 3.5.

For T>0𝑇0T>0italic_T > 0, suppose that 𝐔C([0,T];R×d)𝐔𝐶0𝑇superscript𝑅𝑑\boldsymbol{U}\in C([0,T];\mathbb{R}^{R\times d})bold_italic_U ∈ italic_C ( [ 0 , italic_T ] ; blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT ), with 𝐔0subscript𝐔0\boldsymbol{U}_{0}bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT having orthonormal rows, and 𝐘L2(Ω;C([0,T];R))𝐘superscript𝐿2Ω𝐶0𝑇superscript𝑅\boldsymbol{Y}\in L^{2}(\Omega;C([0,T];\mathbb{R}^{R}))bold_italic_Y ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_C ( [ 0 , italic_T ] ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) ), with 𝐘0subscript𝐘0\boldsymbol{Y}_{0}bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT having linearly independent components, satisfy 𝐔t=F1(𝐔,𝐘)(t)subscript𝐔𝑡subscript𝐹1𝐔𝐘𝑡\boldsymbol{U}_{t}=F_{1}(\boldsymbol{U},\boldsymbol{Y})(t)bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) ( italic_t ) and 𝐘t=F2(𝐔,𝐘)(t)subscript𝐘𝑡subscript𝐹2𝐔𝐘𝑡\boldsymbol{Y}_{t}=F_{2}(\boldsymbol{U},\boldsymbol{Y})(t)bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) ( italic_t ) for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ]. Then, for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ] we have

𝑼tFsubscriptnormsubscript𝑼𝑡F\displaystyle\|\boldsymbol{U}_{t}\|_{\mathrm{F}}∥ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT =R;absent𝑅\displaystyle=\sqrt{R};= square-root start_ARG italic_R end_ARG ; (3.9)
𝔼[|𝒀t|2]𝔼delimited-[]superscriptsubscript𝒀𝑡2\displaystyle\mathbb{E}\bigl{[}|\boldsymbol{Y}_{t}|^{2}\bigr{]}blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] 3(𝔼[|𝒀0|2]+(1+T)TClgb)exp(3(1+T)TClgb)=:M(T).\displaystyle\leq 3(\mathbb{E}[|\boldsymbol{Y}_{0}|^{2}]+(1+T)TC_{\mathrm{lgb}% })\mathrm{exp}\bigl{(}3(1+T)TC_{\mathrm{lgb}}\bigr{)}=:M(T).≤ 3 ( blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + ( 1 + italic_T ) italic_T italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) roman_exp ( 3 ( 1 + italic_T ) italic_T italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) = : italic_M ( italic_T ) . (3.10)
Proof.

First, from 𝑼t=F1(𝑼,𝒀)(t)subscript𝑼𝑡subscript𝐹1𝑼𝒀𝑡\boldsymbol{U}_{t}=F_{1}(\boldsymbol{U},\boldsymbol{Y})(t)bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) ( italic_t ), the function 𝑼𝑼\boldsymbol{U}bold_italic_U is absolutely continuous on [0,T]0𝑇[0,T][ 0 , italic_T ], and thus differentiable almost everywhere. The derivative 𝑼˙tsubscript˙𝑼𝑡\dot{\boldsymbol{U}}_{t}over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT satisfies

𝑼˙t𝑼t=C𝒀t1𝔼[𝒀ta(t,𝑼t𝒀)](Id×dP𝑼trow)𝑼t=0,subscript˙𝑼𝑡superscriptsubscript𝑼𝑡topsuperscriptsubscript𝐶subscript𝒀𝑡1𝔼delimited-[]subscript𝒀𝑡𝑎superscript𝑡superscriptsubscript𝑼𝑡top𝒀topsubscript𝐼𝑑𝑑subscriptsuperscript𝑃rowsubscript𝑼𝑡superscriptsubscript𝑼𝑡top0\dot{\boldsymbol{U}}_{t}\boldsymbol{U}_{t}^{\top}={C}_{\boldsymbol{Y}_{t}}^{-1% }\mathbb{E}[\boldsymbol{Y}_{t}a(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y})^{% \top}](I_{d\times d}-P^{\mathrm{row}}_{\boldsymbol{U}_{t}})\boldsymbol{U}_{t}^% {\top}=0,over˙ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ( italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT - italic_P start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT ) bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = 0 ,

and thus ddt(𝑼t𝑼t)=0dd𝑡subscript𝑼𝑡superscriptsubscript𝑼𝑡top0\frac{\mathrm{d}}{\mathrm{d}t}(\boldsymbol{U}_{t}\boldsymbol{U}_{t}^{\top})=0divide start_ARG roman_d end_ARG start_ARG roman_d italic_t end_ARG ( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) = 0 a.e. on [0,T]0𝑇[0,T][ 0 , italic_T ]. Therefore, from the orthonormality of the initial condition 𝝋𝝋=IR×R𝝋superscript𝝋topsubscript𝐼𝑅𝑅\boldsymbol{\varphi}\boldsymbol{\varphi}^{\top}=I_{R\times R}bold_italic_φ bold_italic_φ start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT = italic_I start_POSTSUBSCRIPT italic_R × italic_R end_POSTSUBSCRIPT, for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ] we have

(𝑼t𝑼t)jk=ϵjk+0t0𝑑s=ϵjk,subscriptsubscript𝑼𝑡superscriptsubscript𝑼𝑡top𝑗𝑘subscriptitalic-ϵ𝑗𝑘superscriptsubscript0𝑡0differential-d𝑠subscriptitalic-ϵ𝑗𝑘\bigl{(}\boldsymbol{U}_{t}\boldsymbol{U}_{t}^{\top}\bigr{)}_{jk}=\epsilon_{jk}% +\int_{0}^{t}0\,ds=\epsilon_{jk},( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) start_POSTSUBSCRIPT italic_j italic_k end_POSTSUBSCRIPT = italic_ϵ start_POSTSUBSCRIPT italic_j italic_k end_POSTSUBSCRIPT + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT 0 italic_d italic_s = italic_ϵ start_POSTSUBSCRIPT italic_j italic_k end_POSTSUBSCRIPT ,

where ϵjk=1subscriptitalic-ϵ𝑗𝑘1\epsilon_{jk}=1italic_ϵ start_POSTSUBSCRIPT italic_j italic_k end_POSTSUBSCRIPT = 1 only if j=k𝑗𝑘j=kitalic_j = italic_k, and 00 otherwise. This shows the identity (3.9).

For 𝒀𝒀\boldsymbol{Y}bold_italic_Y, Itô’s isometry implies

𝔼[|𝒀t|2]𝔼delimited-[]superscriptsubscript𝒀𝑡2\displaystyle\mathbb{E}\bigl{[}|\boldsymbol{Y}_{t}|^{2}\bigr{]}blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] 3𝔼[|𝒀0|2+t0t𝑼s22|a(s,𝑼s𝒀s)|2𝑑s]+3𝔼[0t𝑼sb(s,𝑼s𝒀s)F2𝑑s]absent3𝔼delimited-[]superscriptsubscript𝒀02𝑡superscriptsubscript0𝑡superscriptsubscriptnormsubscript𝑼𝑠22superscript𝑎𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠2differential-d𝑠3𝔼delimited-[]superscriptsubscript0𝑡superscriptsubscriptnormsubscript𝑼𝑠𝑏𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠F2differential-d𝑠\displaystyle\leq 3\mathbb{E}\biggl{[}|\boldsymbol{Y}_{0}|^{2}+t\int_{0}^{t}\|% \boldsymbol{U}_{s}\|_{2}^{2}|a(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s})|% ^{2}\,ds\biggr{]}+3\mathbb{E}\Bigl{[}\int_{0}^{t}\|\boldsymbol{U}_{s}b(s,% \boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s})\|_{\mathrm{F}}^{2}\,ds\Bigr{]}≤ 3 blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + italic_t ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | italic_a ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s ] + 3 blackboard_E [ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s ]
3𝔼[|𝒀0|2]+3(1+T)Clgb0t(1+𝔼[|𝒀s|2])𝑑s,absent3𝔼delimited-[]superscriptsubscript𝒀0231𝑇subscript𝐶lgbsuperscriptsubscript0𝑡1𝔼delimited-[]superscriptsubscript𝒀𝑠2differential-d𝑠\displaystyle\leq 3\mathbb{E}[|\boldsymbol{Y}_{0}|^{2}]+3(1+T)C_{\mathrm{lgb}}% \int_{0}^{t}(1+\mathbb{E}[|\boldsymbol{Y}_{s}|^{2}])\,ds,≤ 3 blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + 3 ( 1 + italic_T ) italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( 1 + blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_d italic_s ,

where we used Assumption 2 |a(s,x)|2+b(s,x)F2Clgb(1+|x|2)superscript𝑎𝑠𝑥2superscriptsubscriptnorm𝑏𝑠𝑥F2subscript𝐶lgb1superscript𝑥2|a(s,x)|^{2}+\|b(s,x)\|_{\mathrm{F}}^{2}\leq C_{\mathrm{lgb}}(1+|x|^{2})| italic_a ( italic_s , italic_x ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ∥ italic_b ( italic_s , italic_x ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + | italic_x | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ). Thus, Gronwall’s lemma implies (3.10). ∎

Now the following uniqueness result follows.

Theorem 3.6 (Uniqueness of DO solutions).

Let the assumptions of Lemma 3.5 hold. For T>0𝑇0T>0italic_T > 0, suppose that 𝐔,𝐔~C([0,T];R×d)𝐔~𝐔𝐶0𝑇superscript𝑅𝑑\boldsymbol{U},\tilde{\boldsymbol{U}}\in C([0,T];\mathbb{R}^{R\times d})bold_italic_U , over~ start_ARG bold_italic_U end_ARG ∈ italic_C ( [ 0 , italic_T ] ; blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT ) and 𝐘,𝐘~L2(Ω;C([0,T];R)\boldsymbol{Y},\tilde{\boldsymbol{Y}}\in L^{2}(\Omega;C([0,T];\mathbb{R}^{R})bold_italic_Y , over~ start_ARG bold_italic_Y end_ARG ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_C ( [ 0 , italic_T ] ; blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ) satisfy 𝐔t=F1(𝐔,𝐘)(t)subscript𝐔𝑡subscript𝐹1𝐔𝐘𝑡\boldsymbol{U}_{t}=F_{1}(\boldsymbol{U},\boldsymbol{Y})(t)bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) ( italic_t ) and 𝐔~t=F1(𝐔~,𝐘~)(t)subscript~𝐔𝑡subscript𝐹1~𝐔~𝐘𝑡\tilde{\boldsymbol{U}}_{t}=F_{1}(\tilde{\boldsymbol{U}},\tilde{\boldsymbol{Y}}% )(t)over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_F start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_U end_ARG , over~ start_ARG bold_italic_Y end_ARG ) ( italic_t ); 𝐘t=F2(𝐔,𝐘)(t)subscript𝐘𝑡subscript𝐹2𝐔𝐘𝑡\boldsymbol{Y}_{t}=F_{2}(\boldsymbol{U},\boldsymbol{Y})(t)bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( bold_italic_U , bold_italic_Y ) ( italic_t ) and 𝐘~t=F2(𝐔~,𝐘~)(t)subscript~𝐘𝑡subscript𝐹2~𝐔~𝐘𝑡\tilde{\boldsymbol{Y}}_{t}=F_{2}(\tilde{\boldsymbol{U}},\tilde{\boldsymbol{Y}}% )(t)over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_F start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_U end_ARG , over~ start_ARG bold_italic_Y end_ARG ) ( italic_t ) for t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ]. Then, we have

(sup0tT𝑼t𝑼~tF2+sup0tT|𝒀t𝒀~t|>0)=0.subscriptsupremum0𝑡𝑇superscriptsubscriptnormsubscript𝑼𝑡subscript~𝑼𝑡F2subscriptsupremum0𝑡𝑇subscript𝒀𝑡subscript~𝒀𝑡00\mathbb{P}\Bigl{(}\sup_{0\leq t\leq T}\|\boldsymbol{U}_{t}-\tilde{\boldsymbol{% U}}_{t}\|_{\mathrm{F}}^{2}+\sup_{0\leq t\leq T}|\boldsymbol{Y}_{t}-\tilde{% \boldsymbol{Y}}_{t}|>0\Bigr{)}=0.blackboard_P ( roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_T end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + roman_sup start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_T end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | > 0 ) = 0 .
Proof.

By hypothesis, the solutions 𝑼,𝑼~𝑼~𝑼\boldsymbol{U},\tilde{\boldsymbol{U}}bold_italic_U , over~ start_ARG bold_italic_U end_ARG and 𝒀,𝒀~𝒀~𝒀\boldsymbol{Y},\tilde{\boldsymbol{Y}}bold_italic_Y , over~ start_ARG bold_italic_Y end_ARG satisfy the stability estimates shown in Lemma 3.5. Moreover, from the continuity of t𝔼[𝒀t𝒀t]1𝑡𝔼superscriptdelimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡top1t\to\mathbb{E}[\boldsymbol{Y}_{t}\boldsymbol{Y}_{t}^{\top}]^{-1}italic_t → blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT, we have

max{maxs[0,T]𝔼[𝒀s𝒀s]1F,maxs[0,T]𝔼[𝒀~s𝒀~s]1F}=γ~<subscript𝑠0𝑇subscriptnorm𝔼superscriptdelimited-[]subscript𝒀𝑠superscriptsubscript𝒀𝑠top1Fsubscript𝑠0𝑇subscriptnorm𝔼superscriptdelimited-[]subscript~𝒀𝑠superscriptsubscript~𝒀𝑠top1F~𝛾\max\Big{\{}\max\limits_{s\in[0,T]}\|\mathbb{E}[\boldsymbol{Y}_{s}\boldsymbol{% Y}_{s}^{\top}]^{-1}\|_{\mathrm{F}},\max\limits_{s\in[0,T]}\|\mathbb{E}[\tilde{% \boldsymbol{Y}}_{s}\tilde{\boldsymbol{Y}}_{s}^{\top}]^{-1}\|_{\mathrm{F}}\Big{% \}}=\tilde{\gamma}<\inftyroman_max { roman_max start_POSTSUBSCRIPT italic_s ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT ∥ blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT , roman_max start_POSTSUBSCRIPT italic_s ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT ∥ blackboard_E [ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT } = over~ start_ARG italic_γ end_ARG < ∞

for some γ~>0~𝛾0\tilde{\gamma}>0over~ start_ARG italic_γ end_ARG > 0. Then, noting the norm bounds (3.9) and (3.10), by an argument similar to the proof of Lemma 3.2 (see also [kazashi2021existence, Lemma 3.5] and Lemma A.4), with a constant C~=C~(γ~)>0~𝐶~𝐶~𝛾0\tilde{C}=\tilde{C}(\tilde{\gamma})>0over~ start_ARG italic_C end_ARG = over~ start_ARG italic_C end_ARG ( over~ start_ARG italic_γ end_ARG ) > 0 we have

sup0st𝑼s𝑼sF2+𝔼[sup0st|𝒀s𝒀s|2]subscriptsupremum0𝑠𝑡superscriptsubscriptnormsubscript𝑼𝑠subscriptsuperscript𝑼𝑠F2𝔼delimited-[]subscriptsupremum0𝑠𝑡superscriptsubscript𝒀𝑠subscriptsuperscript𝒀𝑠2\displaystyle\sup_{0\leq s\leq t}\|\boldsymbol{U}_{s}-\boldsymbol{U}^{\prime}_% {s}\|_{\mathrm{F}}^{2}+\mathbb{E}\bigl{[}\sup_{0\leq s\leq t}|\boldsymbol{Y}_{% s}-\boldsymbol{Y}^{\prime}_{s}|^{2}\bigr{]}roman_sup start_POSTSUBSCRIPT 0 ≤ italic_s ≤ italic_t end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - bold_italic_U start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_s ≤ italic_t end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - bold_italic_Y start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] C~0t(sup0sr𝑼s𝑼sF2+𝔼[sup0sr|𝒀s𝒀s|2])𝑑rabsent~𝐶superscriptsubscript0𝑡subscriptsupremum0𝑠𝑟superscriptsubscriptnormsubscript𝑼𝑠subscriptsuperscript𝑼𝑠F2𝔼delimited-[]subscriptsupremum0𝑠𝑟superscriptsubscript𝒀𝑠subscriptsuperscript𝒀𝑠2differential-d𝑟\displaystyle\leq\tilde{C}\int_{0}^{t}\left(\sup_{0\leq s\leq r}\|\boldsymbol{% U}_{s}-\boldsymbol{U}^{\prime}_{s}\|_{\mathrm{F}}^{2}+\mathbb{E}\bigl{[}\sup_{% 0\leq s\leq r}|\boldsymbol{Y}_{s}-\boldsymbol{Y}^{\prime}_{s}|^{2}\bigr{]}% \right)dr≤ over~ start_ARG italic_C end_ARG ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( roman_sup start_POSTSUBSCRIPT 0 ≤ italic_s ≤ italic_r end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - bold_italic_U start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_s ≤ italic_r end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - bold_italic_Y start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_d italic_r (3.11)

for t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ]. Thus, applying the Gronwall’s lemma yields

sup0st𝑼s𝑼sF2+𝔼[sup0st|𝒀s𝒀s|2]=0.subscriptsupremum0𝑠𝑡superscriptsubscriptnormsubscript𝑼𝑠subscriptsuperscript𝑼𝑠F2𝔼delimited-[]subscriptsupremum0𝑠𝑡superscriptsubscript𝒀𝑠subscriptsuperscript𝒀𝑠20\sup_{0\leq s\leq t}\|\boldsymbol{U}_{s}-\boldsymbol{U}^{\prime}_{s}\|_{% \mathrm{F}}^{2}+\mathbb{E}\bigl{[}\sup_{0\leq s\leq t}|\boldsymbol{Y}_{s}-% \boldsymbol{Y}^{\prime}_{s}|^{2}\bigr{]}=0.roman_sup start_POSTSUBSCRIPT 0 ≤ italic_s ≤ italic_t end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - bold_italic_U start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT 0 ≤ italic_s ≤ italic_t end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - bold_italic_Y start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] = 0 .

Now the proof is complete. ∎

Remark 3.7.

The uniqueness of the DO solution can be also deduced from the proof of Proposition 2.7. To see this, let (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) and (𝑼~,𝒀~)~𝑼~𝒀(\tilde{\boldsymbol{U}},\tilde{\boldsymbol{Y}})( over~ start_ARG bold_italic_U end_ARG , over~ start_ARG bold_italic_Y end_ARG ) be two strong DO solutions with the same initial datum (𝑼0,𝒀0)subscript𝑼0subscript𝒀0(\boldsymbol{U}_{0},\boldsymbol{Y}_{0})( bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT , bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ). Then, following the proof of Proposition 2.7, we have (𝑼,𝒀)=(Θ𝑼t,Θ𝒀t)𝑼𝒀Θsubscript𝑼𝑡Θsubscript𝒀𝑡(\boldsymbol{U},\boldsymbol{Y})=(\Theta\boldsymbol{U}_{t},\Theta\boldsymbol{Y}% _{t})( bold_italic_U , bold_italic_Y ) = ( roman_Θ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , roman_Θ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) with Θ=IR×RΘsubscript𝐼𝑅𝑅\Theta=I_{R\times R}roman_Θ = italic_I start_POSTSUBSCRIPT italic_R × italic_R end_POSTSUBSCRIPT.

We conclude this section by showing the continuity of the solution with respect to the initial datum.

Lemma 3.8.

Let (𝐔t,𝐘t)subscript𝐔𝑡subscript𝐘𝑡(\boldsymbol{U}_{t},\boldsymbol{Y}_{t})( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) and (𝐔~t,𝐘~t)subscript~𝐔𝑡subscript~𝐘𝑡(\tilde{\boldsymbol{U}}_{t},\tilde{\boldsymbol{Y}}_{t})( over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) be DO solutions on [0,T]0𝑇[0,T][ 0 , italic_T ] with initial data (𝐔0,𝐘0)subscript𝐔0subscript𝐘0(\boldsymbol{U}_{0},\boldsymbol{Y}_{0})( bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT , bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ) and (𝐔~0,𝐘~0)subscript~𝐔0subscript~𝐘0(\tilde{\boldsymbol{U}}_{0},\tilde{\boldsymbol{Y}}_{0})( over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT , over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ), respectively. Define ρ=max{𝐘0[L2(Ω)]R,𝐘~0[L2(Ω)]R}𝜌subscriptnormsubscript𝐘0superscriptdelimited-[]superscript𝐿2Ω𝑅subscriptnormsubscript~𝐘0superscriptdelimited-[]superscript𝐿2Ω𝑅\rho=\max\{\|\boldsymbol{Y}_{0}\|_{[L^{2}(\Omega)]^{R}},\|\tilde{\boldsymbol{Y% }}_{0}\|_{[L^{2}(\Omega)]^{R}}\}italic_ρ = roman_max { ∥ bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT , ∥ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT } and γ=max{C𝐘01F,C𝐘~01F}𝛾subscriptnormsubscriptsuperscript𝐶1subscript𝐘0Fsubscriptnormsubscriptsuperscript𝐶1subscript~𝐘0F\gamma=\max\{\|C^{-1}_{\boldsymbol{Y}_{0}}\|_{\mathrm{F}},\|C^{-1}_{\tilde{% \boldsymbol{Y}}_{0}}\|_{\mathrm{F}}\}italic_γ = roman_max { ∥ italic_C start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT , ∥ italic_C start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT }. Then, under Assumptions 1111 and 2222,

𝔼[supt[0,T]|𝒀t𝒀~t|2]+supt[0,T]𝑼t𝑼~tF2Ca,b,R,ρ,T,γ(𝔼[|𝒀0𝒀~0|2]+𝑼0𝑼~0F2)𝔼delimited-[]subscriptsupremum𝑡0𝑇superscriptsubscript𝒀𝑡subscript~𝒀𝑡2subscriptsupremum𝑡0𝑇subscriptsuperscriptnormsubscript𝑼𝑡subscript~𝑼𝑡2Fsubscript𝐶𝑎𝑏𝑅𝜌𝑇𝛾𝔼delimited-[]superscriptsubscript𝒀0subscript~𝒀02subscriptsuperscriptnormsubscript𝑼0subscript~𝑼02F\mathbb{E}[\sup_{t\in[0,T]}|\boldsymbol{Y}_{t}-\tilde{\boldsymbol{Y}}_{t}|^{2}% ]+\sup_{t\in[0,T]}\|\boldsymbol{U}_{t}-\tilde{\boldsymbol{U}}_{t}\|^{2}_{% \mathrm{F}}\leq C_{a,b,R,\rho,T,\gamma}\left(\mathbb{E}[|\boldsymbol{Y}_{0}-% \tilde{\boldsymbol{Y}}_{0}|^{2}]+\|\boldsymbol{U}_{0}-\tilde{\boldsymbol{U}}_{% 0}\|^{2}_{\mathrm{F}}\right)blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ italic_C start_POSTSUBSCRIPT italic_a , italic_b , italic_R , italic_ρ , italic_T , italic_γ end_POSTSUBSCRIPT ( blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + ∥ bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT - over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT )

holds. Moreover, let Xtsubscript𝑋𝑡X_{t}italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and Xt~~subscript𝑋𝑡\tilde{X_{t}}over~ start_ARG italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG be DO approximations on [0,T]0𝑇[0,T][ 0 , italic_T ] with initial data X0subscript𝑋0X_{0}italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT and X~0subscript~𝑋0\tilde{X}_{0}over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT, respectively, and let

γ~:=inft[0,T]max{σR(𝔼[XtXt]),σR(𝔼[X~tX~t])}.assign~𝛾subscriptinfimum𝑡0𝑇subscript𝜎𝑅𝔼delimited-[]subscript𝑋𝑡superscriptsubscript𝑋𝑡topsubscript𝜎𝑅𝔼delimited-[]subscript~𝑋𝑡superscriptsubscript~𝑋𝑡top\tilde{\gamma}:=\inf_{t\in[0,T]}\max\{\sigma_{R}\!\!\;\bigl{(}\mathbb{E}[{X}_{% t}{X}_{t}^{\top}]\bigr{)},\sigma_{R}\!\!\;\bigl{(}\mathbb{E}[\tilde{X}_{t}% \tilde{X}_{t}^{\top}]\bigr{)}\}.over~ start_ARG italic_γ end_ARG := roman_inf start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT roman_max { italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( blackboard_E [ italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ) , italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( blackboard_E [ over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ) } .

Then, there exists a positive constant C>0𝐶0{C}>0italic_C > 0 such that

supt[0,T]𝔼[|XtX~t|2]C𝔼[|X0X~0|2].subscriptsupremum𝑡0𝑇𝔼delimited-[]superscriptsubscript𝑋𝑡subscript~𝑋𝑡2𝐶𝔼delimited-[]superscriptsubscript𝑋0subscript~𝑋02\sup_{t\in[0,{T}]}\mathbb{E}[|{X}_{t}-\tilde{X}_{t}|^{2}]\leq{C}\mathbb{E}[|X_% {0}-\tilde{X}_{0}|^{2}].roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ italic_C blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT - over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] . (3.12)
Proof.

Using an argument similar to the proof of Lemma 3.2 and the Lipschitz continuity of the projections as in Lemma A.4, we obtain the following relation for the stochastic basis:

𝔼[supt[0,T]|𝒀t𝒀~t|2]𝔼delimited-[]subscriptsupremum𝑡0𝑇superscriptsubscript𝒀𝑡subscript~𝒀𝑡2absent\displaystyle\mathbb{E}[\sup_{t\in[0,T]}|\boldsymbol{Y}_{t}-\tilde{\boldsymbol% {Y}}_{t}|^{2}]\leqblackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ 2𝔼[|𝒀0𝒀~0|2]2𝔼delimited-[]superscriptsubscript𝒀0subscript~𝒀02\displaystyle 2\mathbb{E}[|\boldsymbol{Y}_{0}-\tilde{\boldsymbol{Y}}_{0}|^{2}]2 blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
+Ca,b,R,ρ,T0T(supr[0,t]𝑼r𝑼~rF2+𝔼[supr[0,t]|𝒀r𝒀~r|2])𝑑t.subscript𝐶𝑎𝑏𝑅𝜌𝑇superscriptsubscript0𝑇subscriptsupremum𝑟0𝑡subscriptsuperscriptnormsubscript𝑼𝑟subscript~𝑼𝑟2F𝔼delimited-[]subscriptsupremum𝑟0𝑡superscriptsubscript𝒀𝑟subscript~𝒀𝑟2differential-d𝑡\displaystyle+C_{a,b,R,\rho,T}\int_{0}^{T}(\sup_{r\in[0,t]}\|\boldsymbol{U}_{r% }-\tilde{\boldsymbol{U}}_{r}\|^{2}_{\mathrm{F}}+\mathbb{E}[\sup_{r\in[0,t]}|% \boldsymbol{Y}_{r}-\tilde{\boldsymbol{Y}}_{r}|^{2}])dt.+ italic_C start_POSTSUBSCRIPT italic_a , italic_b , italic_R , italic_ρ , italic_T end_POSTSUBSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT ( roman_sup start_POSTSUBSCRIPT italic_r ∈ [ 0 , italic_t ] end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT - over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_r ∈ [ 0 , italic_t ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_d italic_t .

Similarly, noting the Lipschitz continuity of the inverse Gram matrix [kazashi2021existence, Lemma 3.5], for the deterministic basis we have

𝑼t𝑼~tF2subscriptsuperscriptnormsubscript𝑼𝑡subscript~𝑼𝑡2F\displaystyle\|\boldsymbol{U}_{t}-\tilde{\boldsymbol{U}}_{t}\|^{2}_{\mathrm{F}}∥ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT 2𝑼0𝑼~0F2+Ca,b,R,ρ,T,γ0T(supr[0,t]𝑼r𝑼~rF2+𝔼[supr[0,t]|𝒀r𝒀~r|2])𝑑t.absent2subscriptsuperscriptnormsubscript𝑼0subscript~𝑼02Fsubscript𝐶𝑎𝑏𝑅𝜌𝑇𝛾superscriptsubscript0𝑇subscriptsupremum𝑟0𝑡subscriptsuperscriptnormsubscript𝑼𝑟subscript~𝑼𝑟2F𝔼delimited-[]subscriptsupremum𝑟0𝑡superscriptsubscript𝒀𝑟subscript~𝒀𝑟2differential-d𝑡\displaystyle\leq 2\|\boldsymbol{U}_{0}-\tilde{\boldsymbol{U}}_{0}\|^{2}_{% \mathrm{F}}+C_{a,b,R,\rho,T,{\gamma}}\int_{0}^{T}(\sup_{r\in[0,t]}\|% \boldsymbol{U}_{r}-\tilde{\boldsymbol{U}}_{r}\|^{2}_{\mathrm{F}}+\mathbb{E}[% \sup_{r\in[0,t]}|\boldsymbol{Y}_{r}-\tilde{\boldsymbol{Y}}_{r}|^{2}])dt.≤ 2 ∥ bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT - over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + italic_C start_POSTSUBSCRIPT italic_a , italic_b , italic_R , italic_ρ , italic_T , italic_γ end_POSTSUBSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT ( roman_sup start_POSTSUBSCRIPT italic_r ∈ [ 0 , italic_t ] end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT - over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_r ∈ [ 0 , italic_t ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) italic_d italic_t .

Then, the Gronwall’s lemma yields the first part of the statement. Finally, to prove (3.12), we proceed as above and as done in Theorem 2.5. Therefore, for all t[0,T]𝑡0𝑇t\in[0,{T}]italic_t ∈ [ 0 , italic_T ] there exists a positive constant C𝐶Citalic_C such that it holds

𝔼[|XtX~t|2]𝔼delimited-[]superscriptsubscript𝑋𝑡subscript~𝑋𝑡2\displaystyle\mathbb{E}[|{X}_{t}-\tilde{X}_{t}|^{2}]blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] 2𝔼[|X0X~0|2]+2C¯a,b,R,T,γ~0T𝔼[|XsX~s|2]𝑑s,absent2𝔼delimited-[]superscriptsubscript𝑋0subscript~𝑋022subscript¯𝐶𝑎𝑏𝑅𝑇~𝛾superscriptsubscript0𝑇𝔼delimited-[]superscriptsubscript𝑋𝑠subscript~𝑋𝑠2differential-d𝑠\displaystyle\leq 2\mathbb{E}[|{X}_{0}-\tilde{X}_{0}|^{2}]+2\overline{C}_{a,b,% R,T,\tilde{\gamma}}\int_{0}^{T}\mathbb{E}[|{X}_{s}-\tilde{X}_{s}|^{2}]ds,≤ 2 blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT - over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + 2 over¯ start_ARG italic_C end_ARG start_POSTSUBSCRIPT italic_a , italic_b , italic_R , italic_T , over~ start_ARG italic_γ end_ARG end_POSTSUBSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_s ,
C𝔼[|X0X~0|2],absent𝐶𝔼delimited-[]superscriptsubscript𝑋0subscript~𝑋02\displaystyle\leq C\mathbb{E}[|{X}_{0}-\tilde{X}_{0}|^{2}],≤ italic_C blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT - over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ,

where in the last line we use the Gronwall’s lemma. ∎

4 Maximality

In the previous section, we established the existence and uniqueness of strong DO solutions locally in time on an interval [0,T]0𝑇[0,T][ 0 , italic_T ]. In this section, we investigate how much such an interval can be extended.

We give a characterisation of the maximal interval of existence of the strong DO solution in terms of C𝒀t1Fsubscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT. It turns out that the DO solution can be extended until C𝒀t1Fsubscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT explodes. If C𝒀t1Fsubscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT stays bounded for all t>0𝑡0t>0italic_t > 0, then the DO solution exists globally. If C𝒀t1Fsubscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT explodes at a finite explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT, the couple (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) inevitably ceases to exist at Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT; we will show nevertheless that the DO approximation X=𝑼𝒀𝑋superscript𝑼top𝒀X=\boldsymbol{U}^{\top}\boldsymbol{Y}italic_X = bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y can be extended beyond Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT.

4.1 Explosion time of the DO solution

Theorem 3.4 guarantees the (unique) existence of a strong DO solution, albeit up to possibly a short time T𝑇Titalic_T. In this section, we show that the solution can be extended until C𝒀t1superscriptsubscript𝐶subscript𝒀𝑡1{C}_{\boldsymbol{Y}_{t}}^{-1}italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT becomes singular.

Analogous maximality results have been considered in the DLRA literature for deterministic and random PDEs [koch2007regularity, kazashi2021existence]. For the SDE case of this paper, we need to proceed with caution. Indeed, adhering to the definition of SDEs, we need the DO solution to be path-wise continuous a.s. As such, we consider extension with countable number of operations, which we describe in the following.

Let [0,T]0𝑇[0,T][ 0 , italic_T ] be the interval on which the DO solution (𝑼,𝒀)𝑼𝒀(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) exists; such existence is guaranteed by Theorem 3.4. Let us choose n𝑛n\in\mathbb{N}italic_n ∈ blackboard_N such that the following two bounds are satisfied

𝔼[𝒀T2]𝔼delimited-[]superscriptnormsubscript𝒀𝑇2\displaystyle\mathbb{E}[\|\boldsymbol{Y}_{T}\|^{2}]blackboard_E [ ∥ bold_italic_Y start_POSTSUBSCRIPT italic_T end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] 𝔼[𝒀02]+n:=ρn2;absent𝔼delimited-[]superscriptnormsubscript𝒀02𝑛assignsubscriptsuperscript𝜌2𝑛\displaystyle\leq\mathbb{E}[\|\boldsymbol{Y}_{0}\|^{2}]+n:=\rho^{2}_{n};≤ blackboard_E [ ∥ bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + italic_n := italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ; (4.1)
C𝒀T1F2subscriptsuperscriptnormsuperscriptsubscript𝐶subscript𝒀𝑇12F\displaystyle\|{C}_{\boldsymbol{Y}_{T}}^{-1}\|^{2}_{\mathrm{F}}∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_T end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT C𝒀01F2+n:=γn2.absentsubscriptsuperscriptnormsuperscriptsubscript𝐶subscript𝒀012F𝑛assignsubscriptsuperscript𝛾2𝑛\displaystyle\leq\|{C}_{\boldsymbol{Y}_{0}}^{-1}\|^{2}_{\mathrm{F}}+n:=\gamma^% {2}_{n}.≤ ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + italic_n := italic_γ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT .

We will show that the solution can be extended at least until 𝔼[𝒀t2]𝔼delimited-[]superscriptnormsubscript𝒀𝑡2\mathbb{E}[\|\boldsymbol{Y}_{t}\|^{2}]blackboard_E [ ∥ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] or C𝒀t1F2subscriptsuperscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡12F\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|^{2}_{\mathrm{F}}∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT hits the bound ρn2subscriptsuperscript𝜌2𝑛\rho^{2}_{n}italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT or γn2subscriptsuperscript𝛾2𝑛\gamma^{2}_{n}italic_γ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT. Define δ(n)𝛿𝑛\delta(n)italic_δ ( italic_n ) by

δ(n):=min{1,min{1,ηn2}36RClgb(1+3R(3ρn2+1)),min{ηn2,R}8γn2(3ρn2+1)Clgb(1+3R(3ρn2+1))},assign𝛿𝑛11subscriptsuperscript𝜂2𝑛36𝑅subscript𝐶lgb13𝑅3superscriptsubscript𝜌𝑛21subscriptsuperscript𝜂2𝑛𝑅8superscriptsubscript𝛾𝑛23superscriptsubscript𝜌𝑛21subscript𝐶lgb13𝑅3superscriptsubscript𝜌𝑛21\delta(n):=\min\biggl{\{}1\,,\,\frac{\min\{1,\eta^{2}_{n}\}}{36RC_{\mathrm{lgb% }}(1+3R(3\rho_{n}^{2}+1))}\,,\,\frac{\min\{\eta^{2}_{n},R\}}{8\gamma_{n}^{2}(3% \rho_{n}^{2}+1)C_{\mathrm{lgb}}(1+3R(3\rho_{n}^{2}+1))}\biggr{\}},italic_δ ( italic_n ) := roman_min { 1 , divide start_ARG roman_min { 1 , italic_η start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT } end_ARG start_ARG 36 italic_R italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + 3 italic_R ( 3 italic_ρ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) ) end_ARG , divide start_ARG roman_min { italic_η start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_R } end_ARG start_ARG 8 italic_γ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( 3 italic_ρ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + 3 italic_R ( 3 italic_ρ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 1 ) ) end_ARG } , (4.2)

where ηn:=min{η(ρn,γn),η(R,R)}assignsubscript𝜂𝑛𝜂subscript𝜌𝑛subscript𝛾𝑛𝜂𝑅𝑅\eta_{n}:=\min\{\eta(\rho_{n},\gamma_{n}),\eta(\sqrt{R},\sqrt{R})\}italic_η start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT := roman_min { italic_η ( italic_ρ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_γ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) , italic_η ( square-root start_ARG italic_R end_ARG , square-root start_ARG italic_R end_ARG ) }, with η(,)𝜂\eta(\cdot,\cdot)italic_η ( ⋅ , ⋅ ) defined in (A.1). Then from the proofs of Lemmata 3.1 and 3.3, and Theorem 3.4, we can construct a convergent Picard-iteration for the interval [T,T+δ(n)]𝑇𝑇𝛿𝑛[T,T+\delta(n)][ italic_T , italic_T + italic_δ ( italic_n ) ], which yields the extension of the DO solution up to [0,T+δ(n)]0𝑇𝛿𝑛[0,T+\delta(n)][ 0 , italic_T + italic_δ ( italic_n ) ]. Set T:=T+δ(n)assign𝑇𝑇𝛿𝑛T:=T+\delta(n)italic_T := italic_T + italic_δ ( italic_n ). By construction δ(n)𝛿𝑛\delta(n)italic_δ ( italic_n ) is independent of T𝑇Titalic_T, and with the same δ(n)𝛿𝑛\delta(n)italic_δ ( italic_n ) we can repeat the same argument as long as the bound (4.1) is satisfied. Hence, the solution can be extended until either 𝔼[𝒀T+δ(n)2]ρn2𝔼delimited-[]superscriptnormsubscript𝒀𝑇𝛿𝑛2subscriptsuperscript𝜌2𝑛\mathbb{E}[\|\boldsymbol{Y}_{T+\delta(n)}\|^{2}]\leq\rho^{2}_{n}blackboard_E [ ∥ bold_italic_Y start_POSTSUBSCRIPT italic_T + italic_δ ( italic_n ) end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT or C𝒀T+δ(n)1F2γn2subscriptsuperscriptnormsubscriptsuperscript𝐶1subscript𝒀𝑇𝛿𝑛2Fsubscriptsuperscript𝛾2𝑛\|{C}^{-1}_{\boldsymbol{Y}_{T+\delta(n)}}\|^{2}_{\mathrm{F}}\leq\gamma^{2}_{n}∥ italic_C start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_T + italic_δ ( italic_n ) end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ italic_γ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT gets violated.

From the argument above, the following quantities are well defined for any n𝑛n\in\mathbb{N}italic_n ∈ blackboard_N:

τn1superscriptsubscript𝜏𝑛1\displaystyle\tau_{n}^{1}italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT :=inf{t>0C𝒀t1F=C𝒀01F+n},assignabsentinfimumconditional-set𝑡0subscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1Fsubscriptnormsuperscriptsubscript𝐶subscript𝒀01F𝑛\displaystyle:=\inf\{t>0\mid\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}=\|{% C}_{\boldsymbol{Y}_{0}}^{-1}\|_{\mathrm{F}}+n\},:= roman_inf { italic_t > 0 ∣ ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + italic_n } ,
τn2superscriptsubscript𝜏𝑛2\displaystyle\tau_{n}^{2}italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT :=inf{t>0𝒀t[L2(Ω)]R=𝒀0[L2(Ω)]R+n}assignabsentinfimumconditional-set𝑡0subscriptnormsubscript𝒀𝑡superscriptdelimited-[]superscript𝐿2Ω𝑅subscriptnormsubscript𝒀0superscriptdelimited-[]superscript𝐿2Ω𝑅𝑛\displaystyle:=\inf\{t>0\mid\|\boldsymbol{Y}_{t}\|_{[L^{2}(\Omega)]^{R}}=\|% \boldsymbol{Y}_{0}\|_{[L^{2}(\Omega)]^{R}}+n\}:= roman_inf { italic_t > 0 ∣ ∥ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = ∥ bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT + italic_n }

with a convention inf=infimum\inf\varnothing=\inftyroman_inf ∅ = ∞. With these, we define the sequence

τn:=τn(𝑼0,𝒀0):=min{τn1,τn2},n,formulae-sequenceassignsubscript𝜏𝑛subscript𝜏𝑛subscript𝑼0subscript𝒀0assignsuperscriptsubscript𝜏𝑛1superscriptsubscript𝜏𝑛2𝑛\displaystyle\tau_{n}:=\tau_{n}(\boldsymbol{U}_{0},\boldsymbol{Y}_{0}):=\min\{% \tau_{n}^{1},\tau_{n}^{2}\},\quad n\in\mathbb{N},italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT := italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT , bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ) := roman_min { italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT , italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT } , italic_n ∈ blackboard_N , (4.3)

which is a sequence of stopping times. By continuity of the paths, (τn)nsubscriptsubscript𝜏𝑛𝑛(\tau_{n})_{n\in\mathbb{N}}( italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_n ∈ blackboard_N end_POSTSUBSCRIPT is a non-decreasing sequence, which allows us to define Te:=limnτnassignsubscript𝑇𝑒subscript𝑛subscript𝜏𝑛T_{e}:=\lim\limits_{n\to\infty}\tau_{n}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT := roman_lim start_POSTSUBSCRIPT italic_n → ∞ end_POSTSUBSCRIPT italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT.

Now we will show that if Te<subscript𝑇𝑒T_{e}<\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT < ∞, then the norm of the inverse of the Gram matrix must blow up.

Proposition 4.1.

We have either Te=limnτn=subscript𝑇𝑒subscript𝑛subscript𝜏𝑛T_{e}=\lim\limits_{n\to\infty}\tau_{n}=\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT = roman_lim start_POSTSUBSCRIPT italic_n → ∞ end_POSTSUBSCRIPT italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT = ∞ or Te<subscript𝑇𝑒T_{e}<\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT < ∞, where τnsubscript𝜏𝑛\tau_{n}italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT is defined in (4.3). If Te<subscript𝑇𝑒T_{e}<\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT < ∞, we necessarily have limtTeC𝐘t1F=subscript𝑡subscript𝑇𝑒subscriptnormsuperscriptsubscript𝐶subscript𝐘𝑡1F\lim\limits_{t\uparrow T_{e}}\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}=\inftyroman_lim start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = ∞.

Proof.

From the norm bound (3.10), for sufficiently large n𝑛nitalic_n we must have

𝒀t[L2(Ω)]R<𝒀0[L2(Ω)]R+nsubscriptnormsubscript𝒀𝑡superscriptdelimited-[]superscript𝐿2Ω𝑅subscriptnormsubscript𝒀0superscriptdelimited-[]superscript𝐿2Ω𝑅𝑛\|\boldsymbol{Y}_{t}\|_{[L^{2}(\Omega)]^{R}}<\|\boldsymbol{Y}_{0}\|_{[L^{2}(% \Omega)]^{R}}+n∥ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT < ∥ bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT + italic_n for any t(0,Te)𝑡0subscript𝑇𝑒t\in(0,T_{e})italic_t ∈ ( 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ), and thus without loss of generality we assume

τn=τn1=inf{t>0C𝒀t1F=C𝒀01F+n},n.formulae-sequencesubscript𝜏𝑛superscriptsubscript𝜏𝑛1infimumconditional-set𝑡0subscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1Fsubscriptnormsuperscriptsubscript𝐶subscript𝒀01F𝑛𝑛\tau_{n}=\tau_{n}^{1}=\inf\{t>0\mid\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{% F}}=\|{C}_{\boldsymbol{Y}_{0}}^{-1}\|_{\mathrm{F}}+n\},\quad n\in\mathbb{N}.italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT = italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 1 end_POSTSUPERSCRIPT = roman_inf { italic_t > 0 ∣ ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + italic_n } , italic_n ∈ blackboard_N .

We will first show that Te<subscript𝑇𝑒T_{e}<\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT < ∞ implies lim suptTeC𝒀t1F=subscriptlimit-supremum𝑡subscript𝑇𝑒subscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F\limsup\limits_{t\uparrow T_{e}}\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}=\inftylim sup start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = ∞. We argue by contradiction, and assume Te<subscript𝑇𝑒T_{e}<\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT < ∞ and lim suptTeC𝒀t1F<subscriptlimit-supremum𝑡subscript𝑇𝑒subscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F\limsup\limits_{t\uparrow T_{e}}\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}<\inftylim sup start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT < ∞. Then, we have supt[Teδ,Te)C𝒀t1F<K<subscriptsupremum𝑡subscript𝑇𝑒𝛿subscript𝑇𝑒subscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F𝐾\sup\limits_{t\in[T_{e}-\delta,T_{e})}\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{% \mathrm{F}}<K<\inftyroman_sup start_POSTSUBSCRIPT italic_t ∈ [ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT - italic_δ , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT < italic_K < ∞ for some K>0𝐾0K>0italic_K > 0 and δ>0𝛿0\delta>0italic_δ > 0. But then since Te<subscript𝑇𝑒T_{e}<\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT < ∞, the continuity of t𝒀tmaps-to𝑡subscript𝒀𝑡t\mapsto\boldsymbol{Y}_{t}italic_t ↦ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT implies C𝒀τn1F=C𝒀01F+nsubscriptnormsuperscriptsubscript𝐶subscript𝒀subscript𝜏𝑛1Fsubscriptnormsuperscriptsubscript𝐶subscript𝒀01F𝑛\|{C}_{\boldsymbol{Y}_{\tau_{n}}}^{-1}\|_{\mathrm{F}}=\|{C}_{\boldsymbol{Y}_{0% }}^{-1}\|_{\mathrm{F}}+n∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + italic_n and thus for any n𝑛nitalic_n sufficiently large we have

C𝒀τn1F=C𝒀01F+n<K,subscriptnormsuperscriptsubscript𝐶subscript𝒀subscript𝜏𝑛1Fsubscriptnormsuperscriptsubscript𝐶subscript𝒀01F𝑛𝐾\|{C}_{\boldsymbol{Y}_{\tau_{n}}}^{-1}\|_{\mathrm{F}}=\|{C}_{\boldsymbol{Y}_{0% }}^{-1}\|_{\mathrm{F}}+n<K,∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_τ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + italic_n < italic_K ,

which is absurd. Hence, Te<subscript𝑇𝑒T_{e}<\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT < ∞ implies lim suptTeC𝒀t1F=subscriptlimit-supremum𝑡subscript𝑇𝑒subscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F\limsup\limits_{t\uparrow T_{e}}\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}=\inftylim sup start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = ∞.

To conclude the proof we will show

limtTeC𝒀t1F=.subscript𝑡subscript𝑇𝑒subscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F\lim_{t\uparrow T_{e}}\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}=\infty.roman_lim start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = ∞ .

If this is false, then there exist a sequence tmTesubscript𝑡𝑚subscript𝑇𝑒t_{m}\uparrow T_{e}italic_t start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT and γ>0𝛾0\gamma>0italic_γ > 0 such that C𝒀tm1Fγsubscriptnormsuperscriptsubscript𝐶subscript𝒀subscript𝑡𝑚1F𝛾\|{C}_{\boldsymbol{Y}_{t_{m}}}^{-1}\|_{\mathrm{F}}\leq\gamma∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ italic_γ for all m0𝑚0m\geq 0italic_m ≥ 0. But since lim suptTeC𝒀t1F=subscriptlimit-supremum𝑡subscript𝑇𝑒subscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F\limsup\limits_{t\uparrow T_{e}}\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}=\inftylim sup start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = ∞ there is a sequence skesubscript𝑠𝑘𝑒s_{k}\uparrow eitalic_s start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ↑ italic_e such that C𝒀sk1Fγ+1subscriptnormsuperscriptsubscript𝐶subscript𝒀subscript𝑠𝑘1F𝛾1\|{C}_{\boldsymbol{Y}_{s_{k}}}^{-1}\|_{\mathrm{F}}\geq\gamma+1∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≥ italic_γ + 1 for all k0𝑘0k\geq 0italic_k ≥ 0. We take a sub-sequence (skm)msubscriptsubscript𝑠subscript𝑘𝑚𝑚(s_{k_{m}})_{m}( italic_s start_POSTSUBSCRIPT italic_k start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT so that tm<skmsubscript𝑡𝑚subscript𝑠subscript𝑘𝑚t_{m}<s_{k_{m}}italic_t start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT < italic_s start_POSTSUBSCRIPT italic_k start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT end_POSTSUBSCRIPT for all m𝑚mitalic_m. From the continuity of tC𝒀t1Fmaps-to𝑡subscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1Ft\mapsto\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}italic_t ↦ ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT on [tm,skm]subscript𝑡𝑚subscript𝑠subscript𝑘𝑚[t_{m},s_{k_{m}}][ italic_t start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_k start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT end_POSTSUBSCRIPT ], there exists hm[0,skmtm]subscript𝑚0subscript𝑠subscript𝑘𝑚subscript𝑡𝑚h_{m}\in[0,s_{k_{m}}-t_{m}]italic_h start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT ∈ [ 0 , italic_s start_POSTSUBSCRIPT italic_k start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT end_POSTSUBSCRIPT - italic_t start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT ] such that C𝒀tm+hm1F=γ+1subscriptnormsuperscriptsubscript𝐶subscript𝒀subscript𝑡𝑚subscript𝑚1F𝛾1\|{C}_{\boldsymbol{Y}_{t_{m}+h_{m}}}^{-1}\|_{\mathrm{F}}=\gamma+1∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT + italic_h start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = italic_γ + 1. Now, from (3.10) and [kazashi2021existence, Lemma 3.5] we have for any m0𝑚0m\geq 0italic_m ≥ 0

1C𝒀tm+hm1FC𝒀tm1FCTe,R,γ𝒀tm+hm𝒀tm[L2(Ω)]R,1subscriptnormsuperscriptsubscript𝐶subscript𝒀subscript𝑡𝑚subscript𝑚1Fsubscriptnormsuperscriptsubscript𝐶subscript𝒀subscript𝑡𝑚1Fsubscript𝐶subscript𝑇𝑒𝑅𝛾subscriptnormsubscript𝒀subscript𝑡𝑚subscript𝑚subscript𝒀subscript𝑡𝑚superscriptdelimited-[]superscript𝐿2Ω𝑅1\leq\|{C}_{\boldsymbol{Y}_{t_{m}+h_{m}}}^{-1}\|_{\mathrm{F}}-\|{C}_{% \boldsymbol{Y}_{t_{m}}}^{-1}\|_{\mathrm{F}}\leq C_{T_{e},R,\gamma}\|% \boldsymbol{Y}_{t_{m}+h_{m}}-\boldsymbol{Y}_{t_{m}}\|_{[L^{2}(\Omega)]^{R}},1 ≤ ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT + italic_h start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT - ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ italic_C start_POSTSUBSCRIPT italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT , italic_R , italic_γ end_POSTSUBSCRIPT ∥ bold_italic_Y start_POSTSUBSCRIPT italic_t start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT + italic_h start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT end_POSTSUBSCRIPT - bold_italic_Y start_POSTSUBSCRIPT italic_t start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ,

which is impossible since hm0subscript𝑚0h_{m}\to 0italic_h start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT → 0 as m𝑚m\to\inftyitalic_m → ∞ and 𝒀𝒀\boldsymbol{Y}bold_italic_Y is continuous on [0,Te)0subscript𝑇𝑒[0,T_{e})[ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ). Hence, the proof is complete. ∎

4.2 Extension up to the explosion time

Even when the explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT for the DO solution is finite, and thus 𝑼𝑼\boldsymbol{U}bold_italic_U and 𝒀𝒀\boldsymbol{Y}bold_italic_Y cease to exist at Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT, we will show that the product X=𝑼𝒀𝑋superscript𝑼top𝒀X=\boldsymbol{U}^{\top}\boldsymbol{Y}italic_X = bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y nevertheless admits a continuous extension up to [0,Te]0subscript𝑇𝑒[0,T_{e}][ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ], and beyond Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT, under suitable assumptions.

For any t<t<Tesuperscript𝑡𝑡subscript𝑇𝑒t^{\prime}<t<T_{e}italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT < italic_t < italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT, from (2.17) we have

XtXt=tt(𝒫𝒰(Xs)+𝒫𝒴(Xs)𝒫𝒰(Xs)𝒫𝒴(Xs))a(s,Xs)𝑑s+tt𝒫𝒰(Xs)b(s,Xs)𝑑Ws,subscript𝑋𝑡subscript𝑋superscript𝑡superscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠subscript𝒫𝒴subscript𝑋𝑠subscript𝒫𝒰subscript𝑋𝑠subscript𝒫𝒴subscript𝑋𝑠𝑎𝑠subscript𝑋𝑠differential-d𝑠superscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠\displaystyle X_{t}-X_{t^{\prime}}=\int_{t^{\prime}}^{t}\bigl{(}\mathscr{P}_{% \mathcal{U}({X}_{s})}+\mathscr{P}_{\mathcal{Y}({X}_{s})}-\mathscr{P}_{\mathcal% {U}({X}_{s})}\mathscr{P}_{\mathcal{Y}({X}_{s})}\bigr{)}a(s,X_{s})\,ds+\int_{t^% {\prime}}^{t}\mathscr{P}_{\mathcal{U}({X}_{s})}b(s,X_{s})\,dW_{s},italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_X start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT + script_P start_POSTSUBSCRIPT caligraphic_Y ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT script_P start_POSTSUBSCRIPT caligraphic_Y ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_s + ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT , (4.4)

and, hence, the Itô’s isometry implies

𝔼[|XtXt|2]2Tett|a(s,Xs)|2𝑑s+2ttb(s,Xs)F2𝑑s.𝔼delimited-[]superscriptsubscript𝑋𝑡subscript𝑋superscript𝑡22subscript𝑇𝑒superscriptsubscriptsuperscript𝑡𝑡superscript𝑎𝑠subscript𝑋𝑠2differential-d𝑠2superscriptsubscriptsuperscript𝑡𝑡superscriptsubscriptnorm𝑏𝑠subscript𝑋𝑠F2differential-d𝑠\mathbb{E}[|X_{t}-X_{t^{\prime}}|^{2}]\leq 2T_{e}\int_{t^{\prime}}^{t}|a(s,X_{% s})|^{2}\,ds+2\int_{t^{\prime}}^{t}\|b(s,X_{s})\|_{\mathrm{F}}^{2}\,ds.blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_X start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ 2 italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT | italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s + 2 ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ∥ italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s .

From Assumption 2, the orthogonality of the rows of 𝑼tsubscript𝑼𝑡\boldsymbol{U}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and the norm bound (3.10) of 𝒀tsubscript𝒀𝑡\boldsymbol{Y}_{t}bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT it follows that

𝔼[|XtXt|2]C(tt)𝔼delimited-[]superscriptsubscript𝑋𝑡subscript𝑋superscript𝑡2𝐶𝑡superscript𝑡\mathbb{E}[|X_{t}-X_{t^{\prime}}|^{2}]\leq C(t-t^{\prime})blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_X start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ italic_C ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT )

with C:=4max{1,Te}Clgb(1+M(Te)).assign𝐶41subscript𝑇𝑒subscript𝐶lgb1𝑀subscript𝑇𝑒C:=4\max\{1,T_{e}\}C_{\mathrm{lgb}}\bigl{(}1+M(T_{e})\bigr{)}.italic_C := 4 roman_max { 1 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT } italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + italic_M ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) . Therefore, (Xt)0t<Tesubscriptsubscript𝑋𝑡0𝑡subscript𝑇𝑒(X_{t})_{0\leq t<T_{e}}( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT 0 ≤ italic_t < italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT admits a unique extension XTe:=limtTeXtL2(Ω;d)assignsubscript𝑋subscript𝑇𝑒subscript𝑡subscript𝑇𝑒subscript𝑋𝑡superscript𝐿2Ωsuperscript𝑑X_{T_{e}}:=\lim_{t\uparrow T_{e}}X_{t}\in L^{2}(\Omega;\mathbb{R}^{d})italic_X start_POSTSUBSCRIPT italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT := roman_lim start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ).

Thus obtained (Xt)0tTesubscriptsubscript𝑋𝑡0𝑡subscript𝑇𝑒(X_{t})_{0\leq t\leq T_{e}}( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT 0 ≤ italic_t ≤ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT is continuous from [0,Te]0subscript𝑇𝑒[0,T_{e}][ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ] to L2(Ω;d)superscript𝐿2Ωsuperscript𝑑L^{2}(\Omega;\mathbb{R}^{d})italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ), but not necessarily path-wise a.s. continuous on [0,Te]0subscript𝑇𝑒[0,T_{e}][ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ]. It turns out that for initial data with suitable integrability, the DO approximation Xtsubscript𝑋𝑡X_{t}italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT actually admits a.s. Hölder continuous paths. Namely, we assume the following \mathbb{P}blackboard_P-integrability condition.

Assumption 0.

The initial condition 𝑿0subscript𝑿0\boldsymbol{X}_{0}bold_italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT satisfies

𝔼[|𝑿0|2k]<+,for somek.formulae-sequence𝔼delimited-[]superscriptsubscript𝑿02𝑘for some𝑘\mathbb{E}[|\boldsymbol{X}_{0}|^{2k}]<+\infty,\qquad\text{for some}\ \ k\in% \mathbb{N}.blackboard_E [ | bold_italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] < + ∞ , for some italic_k ∈ blackboard_N . (4.5)

Notice that this condition is equivalent to

𝔼[|𝒀0|2k]<,for somek,formulae-sequence𝔼delimited-[]superscriptsubscript𝒀02𝑘for some𝑘\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]<\infty,\qquad\text{for some}\ \ k\in% \mathbb{N},blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] < ∞ , for some italic_k ∈ blackboard_N , (4.6)

where 𝒀0[L2(Ω)]Rsubscript𝒀0superscriptdelimited-[]superscript𝐿2Ω𝑅\boldsymbol{Y}_{0}\in[L^{2}(\Omega)]^{R}bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT is arbitrary such that X0=𝑼0𝒀0subscript𝑋0superscriptsubscript𝑼0topsubscript𝒀0X_{0}=\boldsymbol{U}_{0}^{\top}\boldsymbol{Y}_{0}italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT = bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT for 𝑼0R×dsubscript𝑼0superscript𝑅𝑑\boldsymbol{U}_{0}\in\mathbb{R}^{R\times d}bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT orthonormal. Indeed, for any DO initial condition 𝑼0𝒀0=X0superscriptsubscript𝑼0topsubscript𝒀0subscript𝑋0\boldsymbol{U}_{0}^{\top}\boldsymbol{Y}_{0}=X_{0}bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT = italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT, the orthogonality of the rows of 𝑼0subscript𝑼0\boldsymbol{U}_{0}bold_italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT implies

𝔼[|𝒀0|2k]𝔼[(𝑼022|𝑼0𝒀0|2)k]𝔼[|X0|2k]𝔼[(𝑼022|𝒀0|2)k]=𝔼[|𝒀0|2k]<+,𝔼delimited-[]superscriptsubscript𝒀02𝑘𝔼delimited-[]superscriptsubscriptsuperscriptnormsubscriptsuperscript𝑼top022superscriptsubscriptsuperscript𝑼top0subscript𝒀02𝑘𝔼delimited-[]superscriptsubscript𝑋02𝑘𝔼delimited-[]superscriptsubscriptsuperscriptnormsubscriptsuperscript𝑼top022superscriptsubscript𝒀02𝑘𝔼delimited-[]superscriptsubscript𝒀02𝑘\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]\leq\mathbb{E}[\left(\|\boldsymbol{U}^{% \top}_{0}\|^{2}_{2}|\boldsymbol{U}^{\top}_{0}\boldsymbol{Y}_{0}|^{2}\right)^{k% }]\leq\mathbb{E}[|X_{0}|^{2k}]\leq\mathbb{E}[\left(\|\boldsymbol{U}^{\top}_{0}% \|^{2}_{2}|\boldsymbol{Y}_{0}|^{2}\right)^{k}]=\mathbb{E}[|\boldsymbol{Y}_{0}|% ^{2k}]<+\infty,blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] ≤ blackboard_E [ ( ∥ bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT | bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ] ≤ blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] ≤ blackboard_E [ ( ∥ bold_italic_U start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ] = blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] < + ∞ ,

provided that the 2k2𝑘2k2 italic_k-th moment of either 𝒀0subscript𝒀0\boldsymbol{Y}_{0}bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT or X0subscript𝑋0X_{0}italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT (hence both) exists. Thus, 𝔼[|X0|2k]=𝔼[|𝒀0|2k]𝔼delimited-[]superscriptsubscript𝑋02𝑘𝔼delimited-[]superscriptsubscript𝒀02𝑘\mathbb{E}[|X_{0}|^{2k}]=\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] = blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ]. Similarly, for any other DO initial condition 𝑼~0𝒀~0=X0superscriptsubscript~𝑼0topsubscript~𝒀0subscript𝑋0\tilde{\boldsymbol{U}}_{0}^{\top}\tilde{\boldsymbol{Y}}_{0}=X_{0}over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT = italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT we have

𝔼[|𝒀~0|2k]=𝔼[|X0|2k]=𝔼[|𝒀0|2k].𝔼delimited-[]superscriptsubscript~𝒀02𝑘𝔼delimited-[]superscriptsubscript𝑋02𝑘𝔼delimited-[]superscriptsubscript𝒀02𝑘\mathbb{E}[|\tilde{\boldsymbol{Y}}_{0}|^{2k}]=\mathbb{E}[|X_{0}|^{2k}]=\mathbb% {E}[|\boldsymbol{Y}_{0}|^{2k}].blackboard_E [ | over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] = blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] = blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] .

Hence, Assumption 4.2 is equivalent to (4.6), with an arbitrarily fixed stochastic basis.

Analogously, for all t>0𝑡0t>0italic_t > 0 we have

𝔼[|Xt|2k]=𝔼[|𝒀t|2k]<+.𝔼delimited-[]superscriptsubscript𝑋𝑡2𝑘𝔼delimited-[]superscriptsubscript𝒀𝑡2𝑘\mathbb{E}[|X_{t}|^{2k}]=\mathbb{E}[|\boldsymbol{Y}_{t}|^{2k}]<+\infty.blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] = blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] < + ∞ . (4.7)

The DO solution preserves the \mathbb{P}blackboard_P-integrability of the initial datum.

Lemma 4.2 (Even order moments of the solution).

Let a𝑎aitalic_a and b𝑏bitalic_b satisfy Assumptions 2 and 2. Suppose that the DO solution for (2.1) exists on [0,T]0𝑇[0,T][ 0 , italic_T ]. Suppose that Assumption 4.2 is fulfilled for some k𝑘k\in\mathbb{N}italic_k ∈ blackboard_N. Then, for any t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ] we have

𝔼[|𝒀t|2k](𝔼[|𝒀0|2k]+K1(T))K2(T),𝔼delimited-[]superscriptsubscript𝒀𝑡2𝑘𝔼delimited-[]superscriptsubscript𝒀02𝑘subscript𝐾1𝑇subscript𝐾2𝑇\mathbb{E}[|\boldsymbol{Y}_{t}|^{2k}]\leq\bigl{(}\mathbb{E}[|\boldsymbol{Y}_{0% }|^{2k}]+K_{1}(T)\bigr{)}K_{2}(T),blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] ≤ ( blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + italic_K start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( italic_T ) ) italic_K start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( italic_T ) ,

with K1(T):=(3k2ClgbT(1+1/Clgb)k1)assignsubscript𝐾1𝑇3superscript𝑘2subscript𝐶lgb𝑇superscript11subscript𝐶lgb𝑘1K_{1}(T):=\Bigl{(}3k^{2}\frac{C_{\mathrm{lgb}}\,T}{(1+{1}/{C_{\mathrm{lgb}}})^% {k-1}}\Bigr{)}italic_K start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( italic_T ) := ( 3 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT divide start_ARG italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT italic_T end_ARG start_ARG ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT italic_k - 1 end_POSTSUPERSCRIPT end_ARG ) and K2(T):=exp{6k2Clgb(1+1/Clgb)T}assignsubscript𝐾2𝑇6superscript𝑘2subscript𝐶lgb11subscript𝐶lgb𝑇K_{2}(T):=\exp\{6k^{2}C_{\mathrm{lgb}}(1+{1}/{C_{\mathrm{lgb}}})T\}italic_K start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( italic_T ) := roman_exp { 6 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) italic_T }.

Proof.

From the Itô formula, |𝒀t|2ksuperscriptsubscript𝒀𝑡2𝑘|\boldsymbol{Y}_{t}|^{2k}| bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT satisfies the following SDE (see also [kloeden1992stochastic, Theorem 4.5.4]):

|𝒀t|2ksuperscriptsubscript𝒀𝑡2𝑘\displaystyle|\boldsymbol{Y}_{t}|^{2k}| bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT =|𝒀0|2k+0t2k|𝒀s|2k2(𝑼sa(s,𝑼s𝒀s))𝒀s+absentsuperscriptsubscript𝒀02𝑘limit-fromsuperscriptsubscript0𝑡2𝑘superscriptsubscript𝒀𝑠2𝑘2superscriptsubscript𝑼𝑠𝑎𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠topsubscript𝒀𝑠\displaystyle=|\boldsymbol{Y}_{0}|^{2k}+\int_{0}^{t}2k|\boldsymbol{Y}_{s}|^{2k% -2}\left(\boldsymbol{U}_{s}a(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s})% \right)^{\top}\boldsymbol{Y}_{s}+= | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT 2 italic_k | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT ( bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_a ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT +
+k|𝒀s|2k2Tr((𝑼sb(s,𝑼s𝒀s))(𝑼sb(s,𝑼s𝒀s)))𝑘superscriptsubscript𝒀𝑠2𝑘2Trsubscript𝑼𝑠𝑏𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠superscriptsubscript𝑼𝑠𝑏𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠top\displaystyle+k|\boldsymbol{Y}_{s}|^{2k-2}\mathrm{Tr}\left(\left(\boldsymbol{U% }_{s}b(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s})\right)\left(\boldsymbol{% U}_{s}b(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s})\right)^{\top}\right)+ italic_k | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT roman_Tr ( ( bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) ( bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT )
+k(2k1)|𝒀s|2k4|𝒀s𝑼sb(s,𝑼s𝒀s)|2ds𝑘2𝑘1superscriptsubscript𝒀𝑠2𝑘4superscriptsubscriptsuperscript𝒀top𝑠subscript𝑼𝑠𝑏𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠2𝑑𝑠\displaystyle+k(2k-1)|\boldsymbol{Y}_{s}|^{2k-4}|\boldsymbol{Y}^{\top}_{s}% \boldsymbol{U}_{s}b(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s})|^{2}ds+ italic_k ( 2 italic_k - 1 ) | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 4 end_POSTSUPERSCRIPT | bold_italic_Y start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s
+0t2k|𝒀s|2k2(𝒀s)𝑼sb(s,𝑼s𝒀s)𝑑Ws.superscriptsubscript0𝑡2𝑘superscriptsubscript𝒀𝑠2𝑘2superscriptsubscript𝒀𝑠topsubscript𝑼𝑠𝑏𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠differential-dsubscript𝑊𝑠\displaystyle+\int_{0}^{t}2k|\boldsymbol{Y}_{s}|^{2k-2}\left(\boldsymbol{Y}_{s% }\right)^{\top}\boldsymbol{U}_{s}b(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{% s})dW_{s}.+ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT 2 italic_k | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT ( bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT .

We take the expectation of both sides, and, noting the progressive measurability of 𝒀tsubscript𝒀𝑡\boldsymbol{Y}_{t}bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, a(t,𝑼t𝒀t)𝑎𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡a(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t})italic_a ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ), and b(t,𝑼t𝒀t)𝑏𝑡superscriptsubscript𝑼𝑡topsubscript𝒀𝑡b(t,\boldsymbol{U}_{t}^{\top}\boldsymbol{Y}_{t})italic_b ( italic_t , bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ), use Fubini’s theorem to obtain

𝔼[|𝒀t|2k]𝔼delimited-[]superscriptsubscript𝒀𝑡2𝑘\displaystyle\mathbb{E}[|\boldsymbol{Y}_{t}|^{2k}]blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] 𝔼[|𝒀0|2k]+0t𝔼[2k|𝒀s|2k2(𝑼sa(s,𝑼s𝒀s))𝒀s]𝑑s+absent𝔼delimited-[]superscriptsubscript𝒀02𝑘limit-fromsuperscriptsubscript0𝑡𝔼delimited-[]2𝑘superscriptsubscript𝒀𝑠2𝑘2superscriptsubscript𝑼𝑠𝑎𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠topsubscript𝒀𝑠differential-d𝑠\displaystyle\leq\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]+\int_{0}^{t}\mathbb{E}[% 2k|\boldsymbol{Y}_{s}|^{2k-2}\left(\boldsymbol{U}_{s}a(s,\boldsymbol{U}_{s}^{% \top}\boldsymbol{Y}_{s})\right)^{\top}\boldsymbol{Y}_{s}]ds+≤ blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ 2 italic_k | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT ( bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_a ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ] italic_d italic_s +
+0t𝔼[2k2|𝒀s|2k2Tr((𝑼sb(s,𝑼s𝒀s))(𝑼sb(s,𝑼s𝒀s)))]𝑑ssuperscriptsubscript0𝑡𝔼delimited-[]2superscript𝑘2superscriptsubscript𝒀𝑠2𝑘2Trsubscript𝑼𝑠𝑏𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠superscriptsubscript𝑼𝑠𝑏𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠topdifferential-d𝑠\displaystyle+\int_{0}^{t}\mathbb{E}[2k^{2}|\boldsymbol{Y}_{s}|^{2k-2}\mathrm{% Tr}\left(\left(\boldsymbol{U}_{s}b(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{% s})\right)\left(\boldsymbol{U}_{s}b(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_% {s})\right)^{\top}\right)]ds+ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ 2 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT roman_Tr ( ( bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) ( bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT italic_b ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) ] italic_d italic_s
𝔼[|𝒀0|2k]+0t𝔼[k|𝒀s|2k2(|a(s,𝑼s𝒀s)|2+|𝒀s|2)]𝑑sabsent𝔼delimited-[]superscriptsubscript𝒀02𝑘superscriptsubscript0𝑡𝔼delimited-[]𝑘superscriptsubscript𝒀𝑠2𝑘2superscript𝑎𝑠superscriptsubscript𝑼𝑠topsubscript𝒀𝑠2superscriptsubscript𝒀𝑠2differential-d𝑠\displaystyle\leq\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]+\int_{0}^{t}\mathbb{E}[% k|\boldsymbol{Y}_{s}|^{2k-2}\left(|a(s,\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}% _{s})|^{2}+|\boldsymbol{Y}_{s}|^{2}\right)]ds≤ blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ italic_k | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT ( | italic_a ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) ] italic_d italic_s
+0t𝔼[2k2|𝒀s|2k2b(s,𝑼s𝒀s)F2ds\displaystyle+\int_{0}^{t}\mathbb{E}[2k^{2}|\boldsymbol{Y}_{s}|^{2k-2}\|b(s,% \boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s})\|_{\mathrm{F}}^{2}ds+ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ 2 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT ∥ italic_b ( italic_s , bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_s
𝔼[|𝒀0|2k]+0t𝔼[k|𝒀s|2k2Clgb(1+(1+1/Clgb)|𝒀s|2)]𝑑sabsent𝔼delimited-[]superscriptsubscript𝒀02𝑘superscriptsubscript0𝑡𝔼delimited-[]𝑘superscriptsubscript𝒀𝑠2𝑘2subscript𝐶lgb111subscript𝐶lgbsuperscriptsubscript𝒀𝑠2differential-d𝑠\displaystyle\leq\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]+\int_{0}^{t}\mathbb{E}[% k|\boldsymbol{Y}_{s}|^{2k-2}C_{\mathrm{lgb}}\left(1+(1+1/C_{\mathrm{lgb}})|% \boldsymbol{Y}_{s}|^{2}\right)]ds≤ blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ italic_k | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) ] italic_d italic_s
+0t𝔼[2k2|𝒀s|2k2Clgb(1+|𝒀s|2)]𝑑ssuperscriptsubscript0𝑡𝔼delimited-[]2superscript𝑘2superscriptsubscript𝒀𝑠2𝑘2subscript𝐶lgb1superscriptsubscript𝒀𝑠2differential-d𝑠\displaystyle+\int_{0}^{t}\mathbb{E}[2k^{2}|\boldsymbol{Y}_{s}|^{2k-2}C_{% \mathrm{lgb}}(1+|\boldsymbol{Y}_{s}|^{2})]ds+ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ 2 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) ] italic_d italic_s
𝔼[|𝒀0|2k]+0t𝔼[k|𝒀s|2k2Clgb(1+(1+1/Clgb)|𝒀s|2)]𝑑sabsent𝔼delimited-[]superscriptsubscript𝒀02𝑘superscriptsubscript0𝑡𝔼delimited-[]𝑘superscriptsubscript𝒀𝑠2𝑘2subscript𝐶lgb111subscript𝐶lgbsuperscriptsubscript𝒀𝑠2differential-d𝑠\displaystyle\leq\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]+\int_{0}^{t}\mathbb{E}[% k|\boldsymbol{Y}_{s}|^{2k-2}C_{\mathrm{lgb}}\left(1+(1+1/C_{\mathrm{lgb}})|% \boldsymbol{Y}_{s}|^{2}\right)]ds≤ blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ italic_k | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) ] italic_d italic_s
+0t𝔼[2k2|𝒀s|2k2Clgb(1+(1+1/Clgb)|𝒀s|2)]𝑑ssuperscriptsubscript0𝑡𝔼delimited-[]2superscript𝑘2superscriptsubscript𝒀𝑠2𝑘2subscript𝐶lgb111subscript𝐶lgbsuperscriptsubscript𝒀𝑠2differential-d𝑠\displaystyle+\int_{0}^{t}\mathbb{E}[2k^{2}|\boldsymbol{Y}_{s}|^{2k-2}C_{% \mathrm{lgb}}\left(1+(1+1/C_{\mathrm{lgb}})|\boldsymbol{Y}_{s}|^{2}\right)]ds+ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ 2 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) ] italic_d italic_s
𝔼[|𝒀0|2k]+0t𝔼[3k2|𝒀s|2k2Clgb(1+(1+1/Clgb)|𝒀s|2)]𝑑sabsent𝔼delimited-[]superscriptsubscript𝒀02𝑘superscriptsubscript0𝑡𝔼delimited-[]3superscript𝑘2superscriptsubscript𝒀𝑠2𝑘2subscript𝐶lgb111subscript𝐶lgbsuperscriptsubscript𝒀𝑠2differential-d𝑠\displaystyle\leq\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]+\int_{0}^{t}\mathbb{E}[% 3k^{2}|\boldsymbol{Y}_{s}|^{2k-2}C_{\mathrm{lgb}}\left(1+(1+1/C_{\mathrm{lgb}}% )|\boldsymbol{Y}_{s}|^{2}\right)]ds≤ blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ 3 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) ] italic_d italic_s
𝔼[|𝒀0|2k]+3k2Clgb((1+1/Clgb))2k2absent𝔼delimited-[]superscriptsubscript𝒀02𝑘3superscript𝑘2subscript𝐶lgbsuperscript11subscript𝐶lgb2𝑘2\displaystyle\leq\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]+3k^{2}\frac{C_{\mathrm{% lgb}}}{\left(\sqrt{(1+{1}/{C_{\mathrm{lgb}}})}\right)^{2k-2}}≤ blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + 3 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT divide start_ARG italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT end_ARG start_ARG ( square-root start_ARG ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) end_ARG ) start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT end_ARG
0t𝔼[((1+1/Clgb))2k2|𝒀s|2k2(1+((1+1/Clgb))2|𝒀s|2)]ds\displaystyle\cdot\int_{0}^{t}\mathbb{E}[\left(\sqrt{(1+{1}/{C_{\mathrm{lgb}}}% )}\right)^{2k-2}|\boldsymbol{Y}_{s}|^{2k-2}\left(1+\left(\sqrt{(1+1/C_{\mathrm% {lgb}})}\right)^{2}|\boldsymbol{Y}_{s}|^{2}\right)]ds⋅ ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ ( square-root start_ARG ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) end_ARG ) start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT ( 1 + ( square-root start_ARG ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) end_ARG ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) ] italic_d italic_s

Then, by using the relation (1+r2)r2k21+2r2k1superscript𝑟2superscript𝑟2𝑘212superscript𝑟2𝑘(1+r^{2})r^{2k-2}\leq 1+2r^{2k}( 1 + italic_r start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) italic_r start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT ≤ 1 + 2 italic_r start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT for r+𝑟subscriptr\in\mathbb{R}_{+}italic_r ∈ blackboard_R start_POSTSUBSCRIPT + end_POSTSUBSCRIPT, the statement follows by Gronwall’s lemma:

𝔼[|𝒀t|2k]𝔼delimited-[]superscriptsubscript𝒀𝑡2𝑘\displaystyle\mathbb{E}[|\boldsymbol{Y}_{t}|^{2k}]blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] 𝔼[|𝒀0|2k]+3k2Clgb((1+1/Clgb))2k20t𝔼[(1+2((1+1/Clgb))2k|𝒀s|2k]ds\displaystyle\leq\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]+3k^{2}\frac{C_{\mathrm{% lgb}}}{\left(\sqrt{(1+{1}/{C_{\mathrm{lgb}}})}\right)^{2k-2}}\int_{0}^{t}% \mathbb{E}[(1+2(\sqrt{(1+1/C_{\mathrm{lgb}})})^{2k}|\boldsymbol{Y}_{s}|^{2k}]ds≤ blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + 3 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT divide start_ARG italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT end_ARG start_ARG ( square-root start_ARG ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) end_ARG ) start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT end_ARG ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ ( 1 + 2 ( square-root start_ARG ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) end_ARG ) start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] italic_d italic_s
𝔼[|𝒀0|2k]+3k2Clgb((1+1/Clgb))2k2T+6k2Clgb(1+1/Clgb)0t𝔼[|𝒀s|2k]𝑑sabsent𝔼delimited-[]superscriptsubscript𝒀02𝑘3superscript𝑘2subscript𝐶lgbsuperscript11subscript𝐶lgb2𝑘2𝑇6superscript𝑘2subscript𝐶lgb11subscript𝐶lgbsuperscriptsubscript0𝑡𝔼delimited-[]superscriptsubscript𝒀𝑠2𝑘differential-d𝑠\displaystyle\leq\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]+3k^{2}\frac{C_{\mathrm{% lgb}}}{\left(\sqrt{(1+{1}/{C_{\mathrm{lgb}}})}\right)^{2k-2}}T+6k^{2}C_{% \mathrm{lgb}}(1+1/C_{\mathrm{lgb}})\int_{0}^{t}\mathbb{E}[|\boldsymbol{Y}_{s}|% ^{2k}]ds≤ blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + 3 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT divide start_ARG italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT end_ARG start_ARG ( square-root start_ARG ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) end_ARG ) start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT end_ARG italic_T + 6 italic_k start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + 1 / italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] italic_d italic_s

With Lemma 4.2, we can now establish a Hölder-type bound on 𝔼[|XtXt|2k]𝔼delimited-[]superscriptsubscript𝑋𝑡subscript𝑋superscript𝑡2𝑘\mathbb{E}[|X_{t}-X_{t^{\prime}}|^{2k}]blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_X start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] for

0t<t<Te0superscript𝑡𝑡subscript𝑇𝑒0\leq t^{\prime}<t<T_{e}0 ≤ italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT < italic_t < italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT, which by Kolmogorov-Chenstov theorem, implies the existence of an a.s. continuous version of Xtsubscript𝑋𝑡X_{t}italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT.

Proposition 4.3.

Suppose that the DO approximation Xtsubscript𝑋𝑡X_{t}italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT of (2.1) exists on [0,Te)0subscript𝑇𝑒[0,T_{e})[ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ). Suppose that Assumption 4.2 holds for some k𝑘k\in\mathbb{N}italic_k ∈ blackboard_N. If a𝑎aitalic_a and b𝑏bitalic_b satisfy Assumption 2, then there exists a constant C:=C(X0,R,k,Te,Clgb)>0assign𝐶𝐶subscript𝑋0𝑅𝑘subscript𝑇𝑒subscript𝐶lgb0C:=C(X_{0},R,k,T_{e},C_{\mathrm{lgb}})>0italic_C := italic_C ( italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT , italic_R , italic_k , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT , italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ) > 0 such that

𝔼[|XtXt|2k]C(tt)k,0t<t<Te.formulae-sequence𝔼delimited-[]superscriptsubscript𝑋𝑡subscript𝑋superscript𝑡2𝑘𝐶superscript𝑡superscript𝑡𝑘0superscript𝑡𝑡subscript𝑇𝑒\mathbb{E}[|X_{t}-X_{t^{\prime}}|^{2k}]\leq C(t-t^{\prime})^{k},\quad 0\leq t^% {\prime}<t<T_{e}.blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_X start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] ≤ italic_C ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT , 0 ≤ italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT < italic_t < italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT . (4.8)
Proof.

The proof follows closely the one in [kloeden1992stochastic, Theorem 4.5.44.5.44.5.44.5.4]. First, notice that, in the view of (4.7), Lemma 4.2 gives an estimate of the 2k2𝑘2k2 italic_k-moments of the DO approximation X𝑋Xitalic_X for some k𝑘k\in\mathbb{N}italic_k ∈ blackboard_N. Now we use the inequality |r1++rm|pmp1i=1m|ri|psuperscriptsubscript𝑟1subscript𝑟𝑚𝑝superscript𝑚𝑝1superscriptsubscript𝑖1𝑚superscriptsubscript𝑟𝑖𝑝|r_{1}+\dots+r_{m}|^{p}\leq m^{p-1}\sum\limits_{i=1}^{m}|r_{i}|^{p}| italic_r start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT + ⋯ + italic_r start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT italic_p end_POSTSUPERSCRIPT ≤ italic_m start_POSTSUPERSCRIPT italic_p - 1 end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m end_POSTSUPERSCRIPT | italic_r start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT italic_p end_POSTSUPERSCRIPT for r𝑟r\in\mathbb{R}italic_r ∈ blackboard_R twice and Jensen’s inequality to (4.4) to obtain

𝔼[|XtXt|2k]𝔼delimited-[]superscriptsubscript𝑋𝑡subscript𝑋superscript𝑡2𝑘\displaystyle\mathbb{E}[|X_{t}-X_{t^{\prime}}|^{2k}]blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_X start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] =𝔼[|tt(𝒫𝒰(Xs)+𝒫𝒴(Xs)𝒫𝒰(Xs)𝒫𝒴(Xs))a(s,Xs)ds\displaystyle=\mathbb{E}[|\int_{t^{\prime}}^{t}\bigl{(}\mathscr{P}_{\mathcal{U% }({X}_{s})}+\mathscr{P}_{\mathcal{Y}({X}_{s})}-\mathscr{P}_{\mathcal{U}({X}_{s% })}\mathscr{P}_{\mathcal{Y}({X}_{s})}\bigr{)}a(s,X_{s})\,ds= blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT + script_P start_POSTSUBSCRIPT caligraphic_Y ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT script_P start_POSTSUBSCRIPT caligraphic_Y ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_s
+tt𝒫𝒰(Xs)b(s,Xs)dWs|2k]\displaystyle\qquad\qquad+\int_{t^{\prime}}^{t}\mathscr{P}_{\mathcal{U}(X_{s})% }b(s,X_{s})dW_{s}|^{2k}]+ ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ]
22k1𝔼[|tt(𝒫𝒰(Xs)+𝒫𝒴(Xs)𝒫𝒰(Xs)𝒫𝒴(Xs))a(s,Xs)𝑑s|2k]absentsuperscript22𝑘1𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠subscript𝒫𝒴subscript𝑋𝑠subscript𝒫𝒰subscript𝑋𝑠subscript𝒫𝒴subscript𝑋𝑠𝑎𝑠subscript𝑋𝑠differential-d𝑠2𝑘\displaystyle\leq 2^{2k-1}\mathbb{E}[|\int_{t^{\prime}}^{t}\bigl{(}\mathscr{P}% _{\mathcal{U}({X}_{s})}+\mathscr{P}_{\mathcal{Y}({X}_{s})}-\mathscr{P}_{% \mathcal{U}({X}_{s})}\mathscr{P}_{\mathcal{Y}({X}_{s})}\bigr{)}a(s,X_{s})\,ds|% ^{2k}]≤ 2 start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT + script_P start_POSTSUBSCRIPT caligraphic_Y ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT script_P start_POSTSUBSCRIPT caligraphic_Y ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ) italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_s | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ]
+22k1𝔼[|tt𝒫𝒰(Xs)b(s,Xs)𝑑Ws|2k]superscript22𝑘1𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘\displaystyle\qquad\qquad+2^{2k-1}\mathbb{E}[|\int_{t^{\prime}}^{t}\mathscr{P}% _{\mathcal{U}(X_{s})}b(s,X_{s})dW_{s}|^{2k}]+ 2 start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ]
22k1(tt)2k1𝔼[tt(𝒫𝒰(Xs)+𝒫𝒴(Xs)𝒫𝒰(Xs)𝒫𝒴(Xs)22|a(s,Xs)|2)k𝑑s]absentsuperscript22𝑘1superscript𝑡superscript𝑡2𝑘1𝔼delimited-[]superscriptsubscriptsuperscript𝑡𝑡superscriptsubscriptsuperscriptnormsubscript𝒫𝒰subscript𝑋𝑠subscript𝒫𝒴subscript𝑋𝑠subscript𝒫𝒰subscript𝑋𝑠subscript𝒫𝒴subscript𝑋𝑠22superscript𝑎𝑠subscript𝑋𝑠2𝑘differential-d𝑠\displaystyle\leq 2^{2k-1}(t-t^{\prime})^{2k-1}\mathbb{E}[\int_{t^{\prime}}^{t% }\left(\|\mathscr{P}_{\mathcal{U}(X_{s})}+\mathscr{P}_{\mathcal{Y}(X_{s})}-% \mathscr{P}_{\mathcal{U}(X_{s})}\mathscr{P}_{\mathcal{Y}(X_{s})}\|^{2}_{2}|a(s% ,X_{s})|^{2}\right)^{k}ds]≤ 2 start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT blackboard_E [ ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( ∥ script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT + script_P start_POSTSUBSCRIPT caligraphic_Y ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT - script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT script_P start_POSTSUBSCRIPT caligraphic_Y ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT | italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT italic_d italic_s ]
+22k1𝔼[|tt𝒫𝒰(Xs)b(s,Xs)𝑑Ws|2k]superscript22𝑘1𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘\displaystyle\qquad\qquad+2^{2k-1}\mathbb{E}[|\int_{t^{\prime}}^{t}\mathscr{P}% _{\mathcal{U}(X_{s})}b(s,X_{s})dW_{s}|^{2k}]+ 2 start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ]
22k1(tt)2k1𝔼[tt|a(s,Xs)|2k𝑑s]+22k1𝔼[|tt𝒫𝒰(Xs)b(s,Xs)𝑑Ws|2k]absentsuperscript22𝑘1superscript𝑡superscript𝑡2𝑘1𝔼delimited-[]superscriptsubscriptsuperscript𝑡𝑡superscript𝑎𝑠subscript𝑋𝑠2𝑘differential-d𝑠superscript22𝑘1𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘\displaystyle\leq 2^{2k-1}(t-t^{\prime})^{2k-1}\mathbb{E}[\int_{t^{\prime}}^{t% }|a(s,X_{s})|^{2k}ds]+2^{2k-1}\mathbb{E}[|\int_{t^{\prime}}^{t}\mathscr{P}_{% \mathcal{U}(X_{s})}b(s,X_{s})dW_{s}|^{2k}]≤ 2 start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT blackboard_E [ ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT | italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT italic_d italic_s ] + 2 start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ]

For the first term in the last inequality above, using the inequality (1+r2)k2k1(1+r2k)superscript1superscript𝑟2𝑘superscript2𝑘11superscript𝑟2𝑘(1+r^{2})^{k}\leq 2^{k-1}(1+r^{2k})( 1 + italic_r start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ≤ 2 start_POSTSUPERSCRIPT italic_k - 1 end_POSTSUPERSCRIPT ( 1 + italic_r start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ) for r+𝑟subscriptr\in\mathbb{R}_{+}italic_r ∈ blackboard_R start_POSTSUBSCRIPT + end_POSTSUBSCRIPT, Assumption 2 and Lemma 4.2, we get

𝔼[tt|a(s,Xs)|2k𝑑s]𝔼delimited-[]superscriptsubscriptsuperscript𝑡𝑡superscript𝑎𝑠subscript𝑋𝑠2𝑘differential-d𝑠\displaystyle\mathbb{E}[\int_{t^{\prime}}^{t}|a(s,X_{s})|^{2k}ds]blackboard_E [ ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT | italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT italic_d italic_s ] 𝔼[ttClgbk(1+|Xs|2)k𝑑s]absent𝔼delimited-[]superscriptsubscriptsuperscript𝑡𝑡superscriptsubscript𝐶lgb𝑘superscript1superscriptsubscript𝑋𝑠2𝑘differential-d𝑠\displaystyle\leq\mathbb{E}[\int_{t^{\prime}}^{t}C_{\mathrm{lgb}}^{k}(1+|X_{s}% |^{2})^{k}ds]≤ blackboard_E [ ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ( 1 + | italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT italic_d italic_s ] (4.9)
Clgbk2k1tt(1+𝔼[|𝑼s𝒀s|2k])𝑑sabsentsuperscriptsubscript𝐶lgb𝑘superscript2𝑘1superscriptsubscriptsuperscript𝑡𝑡1𝔼delimited-[]superscriptsuperscriptsubscript𝑼𝑠topsubscript𝒀𝑠2𝑘differential-d𝑠\displaystyle\leq C_{\mathrm{lgb}}^{k}2^{k-1}\int_{t^{\prime}}^{t}(1+\mathbb{E% }[|\boldsymbol{U}_{s}^{\top}\boldsymbol{Y}_{s}|^{2k}])ds≤ italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT 2 start_POSTSUPERSCRIPT italic_k - 1 end_POSTSUPERSCRIPT ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( 1 + blackboard_E [ | bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] ) italic_d italic_s
Clgbk2k1tt(1+𝔼[|𝒀s|2k])𝑑sabsentsuperscriptsubscript𝐶lgb𝑘superscript2𝑘1superscriptsubscriptsuperscript𝑡𝑡1𝔼delimited-[]superscriptsubscript𝒀𝑠2𝑘differential-d𝑠\displaystyle\leq C_{\mathrm{lgb}}^{k}2^{k-1}\int_{t^{\prime}}^{t}(1+\mathbb{E% }[|\boldsymbol{Y}_{s}|^{2k}])ds≤ italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT 2 start_POSTSUPERSCRIPT italic_k - 1 end_POSTSUPERSCRIPT ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( 1 + blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] ) italic_d italic_s
Clgbk2k1tt(1+(𝔼[|𝒀0|2k]+K1(Te))K2(Te))𝑑sabsentsuperscriptsubscript𝐶lgb𝑘superscript2𝑘1superscriptsubscriptsuperscript𝑡𝑡1𝔼delimited-[]superscriptsubscript𝒀02𝑘subscript𝐾1subscript𝑇𝑒subscript𝐾2subscript𝑇𝑒differential-d𝑠\displaystyle\leq C_{\mathrm{lgb}}^{k}2^{k-1}\int_{t^{\prime}}^{t}\left(1+% \left(\mathbb{E}[|\boldsymbol{Y}_{0}|^{2k}]+K_{1}(T_{e})\right)K_{2}(T_{e})% \right)ds≤ italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT 2 start_POSTSUPERSCRIPT italic_k - 1 end_POSTSUPERSCRIPT ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT ( 1 + ( blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + italic_K start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) italic_K start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) italic_d italic_s
=Clgbk2k1(1+(𝔼[|X0|2k]+K1(Te))K2(Te))(tt).absentsuperscriptsubscript𝐶lgb𝑘superscript2𝑘11𝔼delimited-[]superscriptsubscript𝑋02𝑘subscript𝐾1subscript𝑇𝑒subscript𝐾2subscript𝑇𝑒𝑡superscript𝑡\displaystyle=C_{\mathrm{lgb}}^{k}2^{k-1}\left(1+\left(\mathbb{E}[|X_{0}|^{2k}% ]+K_{1}(T_{e})\right)K_{2}(T_{e})\right)(t-t^{\prime}).= italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT 2 start_POSTSUPERSCRIPT italic_k - 1 end_POSTSUPERSCRIPT ( 1 + ( blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + italic_K start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) italic_K start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) .

For the second term, we will show

𝔼[|tt𝒫𝒰(Xs)b(s,Xs)𝑑Ws|2k](tt)k1[k(2k1)]ktt𝔼[b(s,Xs)F2k]𝑑s.𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘superscript𝑡superscript𝑡𝑘1superscriptdelimited-[]𝑘2𝑘1𝑘superscriptsubscriptsuperscript𝑡𝑡𝔼delimited-[]superscriptsubscriptnorm𝑏𝑠subscript𝑋𝑠F2𝑘differential-d𝑠\mathbb{E}[|\int_{t^{\prime}}^{t}\mathscr{P}_{\mathcal{U}(X_{s})}b(s,X_{s})dW_% {s}|^{2k}]\leq(t-t^{\prime})^{k-1}[k(2k-1)]^{k}\int_{t^{\prime}}^{t}\mathbb{E}% [\|b(s,X_{s})\|_{\mathrm{F}}^{2k}]ds.blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] ≤ ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k - 1 end_POSTSUPERSCRIPT [ italic_k ( 2 italic_k - 1 ) ] start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ ∥ italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] italic_d italic_s . (4.10)

To see this, let It:=tt𝒫𝒰(Xs)b(s,Xs)𝑑Wsassignsubscript𝐼𝑡superscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠I_{t}:=\int_{t^{\prime}}^{t}\mathscr{P}_{\mathcal{U}(X_{s})}b(s,X_{s})dW_{s}italic_I start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT := ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT. Then the Itô formula implies

d|It|2k=2k|It|2k1sgn(It)𝒫𝒰(Xt)b(t,Xt)dWt+122k(2k1)|It|2k2𝒫𝒰(Xt)b(t,Xt)F2dt.𝑑superscriptsubscript𝐼𝑡2𝑘2𝑘superscriptsubscript𝐼𝑡2𝑘1sgnsubscript𝐼𝑡subscript𝒫𝒰subscript𝑋𝑡𝑏𝑡subscript𝑋𝑡𝑑subscript𝑊𝑡122𝑘2𝑘1superscriptsubscript𝐼𝑡2𝑘2superscriptsubscriptnormsubscript𝒫𝒰subscript𝑋𝑡𝑏𝑡subscript𝑋𝑡F2𝑑𝑡d|I_{t}|^{2k}=2k|I_{t}|^{2k-1}\mathrm{sgn}(I_{t})\mathscr{P}_{\mathcal{U}(X_{t% })}b(t,X_{t})dW_{t}+\frac{1}{2}2k(2k-1)|I_{t}|^{2k-2}\|\mathscr{P}_{\mathcal{U% }(X_{t})}b(t,X_{t})\|_{\mathrm{F}}^{2}dt.italic_d | italic_I start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT = 2 italic_k | italic_I start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT roman_sgn ( italic_I start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_t , italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT + divide start_ARG 1 end_ARG start_ARG 2 end_ARG 2 italic_k ( 2 italic_k - 1 ) | italic_I start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT ∥ script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_t , italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_d italic_t . (4.11)

Taking the expectation of both sides, by Hölder’s inequality we get

𝔼[|tt𝒫𝒰(Xs)b(s,Xs)𝑑Ws|2k]=𝔼[|It|2k]𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘𝔼delimited-[]superscriptsubscript𝐼𝑡2𝑘\displaystyle\mathbb{E}[|\int_{t^{\prime}}^{t}\mathscr{P}_{\mathcal{U}(X_{s})}% b(s,X_{s})dW_{s}|^{2k}]=\mathbb{E}[|I_{t}|^{2k}]blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] = blackboard_E [ | italic_I start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] =0+k(2k1)tt𝔼[|Is|2k2𝒫𝒰(Xs)b(s,Xs)F2]𝑑sabsent0𝑘2𝑘1superscriptsubscriptsuperscript𝑡𝑡𝔼delimited-[]superscriptsubscript𝐼𝑠2𝑘2superscriptsubscriptnormsubscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠F2differential-d𝑠\displaystyle=0+k(2k-1)\int_{t^{\prime}}^{t}\mathbb{E}[|I_{s}|^{2k-2}\|% \mathscr{P}_{\mathcal{U}(X_{s})}b(s,X_{s})\|_{\mathrm{F}}^{2}]ds= 0 + italic_k ( 2 italic_k - 1 ) ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ | italic_I start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k - 2 end_POSTSUPERSCRIPT ∥ script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_s
k(2k1)tt𝔼[|Is|2k]11k𝔼[b(s,Xs)F2k]1k𝑑sabsent𝑘2𝑘1superscriptsubscriptsuperscript𝑡𝑡𝔼superscriptdelimited-[]superscriptsubscript𝐼𝑠2𝑘11𝑘𝔼superscriptdelimited-[]superscriptsubscriptnorm𝑏𝑠subscript𝑋𝑠F2𝑘1𝑘differential-d𝑠\displaystyle\leq k(2k-1)\int_{t^{\prime}}^{t}\mathbb{E}[|I_{s}|^{2k}]^{1-% \frac{1}{k}}\mathbb{E}[\|b(s,X_{s})\|_{\mathrm{F}}^{2k}]^{\frac{1}{k}}ds≤ italic_k ( 2 italic_k - 1 ) ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ | italic_I start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT 1 - divide start_ARG 1 end_ARG start_ARG italic_k end_ARG end_POSTSUPERSCRIPT blackboard_E [ ∥ italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG italic_k end_ARG end_POSTSUPERSCRIPT italic_d italic_s

By Lemma 4.2, we have tt𝔼|Xs|2k𝑑s=tt𝔼|𝒀s|2k𝑑s<superscriptsubscriptsuperscript𝑡𝑡𝔼superscriptsubscript𝑋𝑠2𝑘differential-d𝑠superscriptsubscriptsuperscript𝑡𝑡𝔼superscriptsubscript𝒀𝑠2𝑘differential-d𝑠\int_{t^{\prime}}^{t}\mathbb{E}|X_{s}|^{2k}ds=\int_{t^{\prime}}^{t}\mathbb{E}|% \boldsymbol{Y}_{s}|^{2k}ds<\infty∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E | italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT italic_d italic_s = ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT italic_d italic_s < ∞ and, hence, by ABFA2BFsubscriptnorm𝐴𝐵𝐹subscriptnorm𝐴2subscriptnorm𝐵𝐹\|AB\|_{F}\leq\|A\|_{2}\|B\|_{F}∥ italic_A italic_B ∥ start_POSTSUBSCRIPT italic_F end_POSTSUBSCRIPT ≤ ∥ italic_A ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ∥ italic_B ∥ start_POSTSUBSCRIPT italic_F end_POSTSUBSCRIPT and (2.3), it holds 𝔼[|tt𝒫𝒰(Xs)b(s,Xs)𝑑Ws|2k]<𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘\mathbb{E}[|\int_{t^{\prime}}^{t}\mathscr{P}_{\mathcal{U}(X_{s})}b(s,X_{s})dW_% {s}|^{2k}]<\inftyblackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] < ∞.

This implies that |I|2k=|t𝒫𝒰(Xs)b(s,Xs)𝑑Ws|2ksuperscriptsubscript𝐼2𝑘superscriptsuperscriptsubscriptsuperscript𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘|I_{\cdot}|^{2k}=|\int_{t^{\prime}}^{\cdot}\mathscr{P}_{\mathcal{U}(X_{s})}b(s% ,X_{s})dW_{s}|^{2k}| italic_I start_POSTSUBSCRIPT ⋅ end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT = | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⋅ end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT is a submartingale. Therefore, it follows

𝔼[|tt𝒫𝒰(Xs)b(s,Xs)𝑑Ws|2k]𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘\displaystyle\mathbb{E}[|\int_{t^{\prime}}^{t}\mathscr{P}_{\mathcal{U}(X_{s})}% b(s,X_{s})dW_{s}|^{2k}]blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] k(2k1)𝔼[|It|2k]11ktt𝔼[b(s,Xs)F2k]1k𝑑s.absent𝑘2𝑘1𝔼superscriptdelimited-[]superscriptsubscript𝐼𝑡2𝑘11𝑘superscriptsubscriptsuperscript𝑡𝑡𝔼superscriptdelimited-[]superscriptsubscriptnorm𝑏𝑠subscript𝑋𝑠F2𝑘1𝑘differential-d𝑠\displaystyle\leq k(2k-1)\mathbb{E}[|I_{t}|^{2k}]^{1-\frac{1}{k}}\int_{t^{% \prime}}^{t}\mathbb{E}[\|b(s,X_{s})\|_{\mathrm{F}}^{2k}]^{\frac{1}{k}}ds.≤ italic_k ( 2 italic_k - 1 ) blackboard_E [ | italic_I start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT 1 - divide start_ARG 1 end_ARG start_ARG italic_k end_ARG end_POSTSUPERSCRIPT ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ ∥ italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG italic_k end_ARG end_POSTSUPERSCRIPT italic_d italic_s .

Raising both sides to the k𝑘kitalic_k-th power and dividing them by 𝔼[|It|2k]k1𝔼superscriptdelimited-[]superscriptsubscript𝐼𝑡2𝑘𝑘1\mathbb{E}[|I_{t}|^{2k}]^{k-1}blackboard_E [ | italic_I start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT italic_k - 1 end_POSTSUPERSCRIPT, we get

𝔼[|tt𝒫𝒰(Xs)b(s,Xs)𝑑Ws|2k][k(2k1)]k(tt𝔼[b(s,Xs)F2k]1k𝑑s)k,𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘superscriptdelimited-[]𝑘2𝑘1𝑘superscriptsuperscriptsubscriptsuperscript𝑡𝑡𝔼superscriptdelimited-[]superscriptsubscriptnorm𝑏𝑠subscript𝑋𝑠F2𝑘1𝑘differential-d𝑠𝑘\mathbb{E}[|\int_{t^{\prime}}^{t}\mathscr{P}_{\mathcal{U}(X_{s})}b(s,X_{s})dW_% {s}|^{2k}]\leq[k(2k-1)]^{k}\left(\int_{t^{\prime}}^{t}\mathbb{E}[\|b(s,X_{s})% \|_{\mathrm{F}}^{2k}]^{\frac{1}{k}}ds\right)^{k},blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] ≤ [ italic_k ( 2 italic_k - 1 ) ] start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ( ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ ∥ italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG italic_k end_ARG end_POSTSUPERSCRIPT italic_d italic_s ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ,

and thus (4.10) follows by Jensen’s inequality. Therefore, bounding tt𝔼[b(s,Xs)F2k]𝑑ssuperscriptsubscriptsuperscript𝑡𝑡𝔼delimited-[]superscriptsubscriptnorm𝑏𝑠subscript𝑋𝑠F2𝑘differential-d𝑠\int_{t^{\prime}}^{t}\mathbb{E}[\|b(s,X_{s})\|_{\mathrm{F}}^{2k}]ds∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT blackboard_E [ ∥ italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] italic_d italic_s similarly to (4.9) we obtain

𝔼[|tt𝒫𝒰(Xs)b(s,Xs)𝑑Ws|2k](tt)k[k(2k1)]kClgbk22k1(1+(𝔼[|X0|2k]+K1(Te))K2(Te)).𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝑋𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘superscript𝑡superscript𝑡𝑘superscriptdelimited-[]𝑘2𝑘1𝑘superscriptsubscript𝐶lgb𝑘superscript22𝑘11𝔼delimited-[]superscriptsubscript𝑋02𝑘subscript𝐾1subscript𝑇𝑒subscript𝐾2subscript𝑇𝑒\mathbb{E}[|\int_{t^{\prime}}^{t}\mathscr{P}_{\mathcal{U}(X_{s})}b(s,X_{s})dW_% {s}|^{2k}]\leq(t-t^{\prime})^{k}[k(2k-1)]^{k}C_{\mathrm{lgb}}^{k}2^{2k-1}\left% (1+\left(\mathbb{E}[|X_{0}|^{2k}]+K_{1}(T_{e})\right)K_{2}(T_{e})\right).blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] ≤ ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT [ italic_k ( 2 italic_k - 1 ) ] start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT 2 start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT ( 1 + ( blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + italic_K start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) italic_K start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) .

Putting all together, (4.8) follows:

𝔼[|XtXt|2k]𝔼delimited-[]superscriptsubscript𝑋𝑡subscript𝑋superscript𝑡2𝑘\displaystyle\mathbb{E}[|X_{t}-X_{t^{\prime}}|^{2k}]blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_X start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] 22k1(tt)2k1𝔼[tt|a(s,Xs)|2k𝑑s]+22k1𝔼[|tt𝒫𝒰(𝒳s)b(s,Xs)𝑑Ws|2k]absentsuperscript22𝑘1superscript𝑡superscript𝑡2𝑘1𝔼delimited-[]superscriptsubscriptsuperscript𝑡𝑡superscript𝑎𝑠subscript𝑋𝑠2𝑘differential-d𝑠superscript22𝑘1𝔼delimited-[]superscriptsuperscriptsubscriptsuperscript𝑡𝑡subscript𝒫𝒰subscript𝒳𝑠𝑏𝑠subscript𝑋𝑠differential-dsubscript𝑊𝑠2𝑘\displaystyle\leq 2^{2k-1}(t-t^{\prime})^{2k-1}\mathbb{E}[\int_{t^{\prime}}^{t% }|a(s,X_{s})|^{2k}ds]+2^{2k-1}\mathbb{E}[|\int_{t^{\prime}}^{t}\mathscr{P}_{% \mathcal{U}(\mathcal{X}_{s})}b(s,X_{s})dW_{s}|^{2k}]≤ 2 start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT blackboard_E [ ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT | italic_a ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT italic_d italic_s ] + 2 start_POSTSUPERSCRIPT 2 italic_k - 1 end_POSTSUPERSCRIPT blackboard_E [ | ∫ start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_t end_POSTSUPERSCRIPT script_P start_POSTSUBSCRIPT caligraphic_U ( caligraphic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT italic_b ( italic_s , italic_X start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] (4.12)
24k2(tt)2kClgbk(1+(𝔼[|X0|2k]+K1(Te))K2(Te))absentsuperscript24𝑘2superscript𝑡superscript𝑡2𝑘superscriptsubscript𝐶lgb𝑘1𝔼delimited-[]superscriptsubscript𝑋02𝑘subscript𝐾1subscript𝑇𝑒subscript𝐾2subscript𝑇𝑒\displaystyle\leq 2^{4k-2}(t-t^{\prime})^{2k}C_{\mathrm{lgb}}^{k}\left(1+\left% (\mathbb{E}[|X_{0}|^{2k}]+K_{1}(T_{e})\right)K_{2}(T_{e})\right)≤ 2 start_POSTSUPERSCRIPT 4 italic_k - 2 end_POSTSUPERSCRIPT ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ( 1 + ( blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + italic_K start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) italic_K start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) )
+24k2(tt)k[k(2k1)]kClgbk(1+(𝔼[|X0|2k]+K1(Te))K2(Te))superscript24𝑘2superscript𝑡superscript𝑡𝑘superscriptdelimited-[]𝑘2𝑘1𝑘superscriptsubscript𝐶lgb𝑘1𝔼delimited-[]superscriptsubscript𝑋02𝑘subscript𝐾1subscript𝑇𝑒subscript𝐾2subscript𝑇𝑒\displaystyle+2^{4k-2}(t-t^{\prime})^{k}[k(2k-1)]^{k}C_{\mathrm{lgb}}^{k}\left% (1+\left(\mathbb{E}[|X_{0}|^{2k}]+K_{1}(T_{e})\right)K_{2}(T_{e})\right)+ 2 start_POSTSUPERSCRIPT 4 italic_k - 2 end_POSTSUPERSCRIPT ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT [ italic_k ( 2 italic_k - 1 ) ] start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ( 1 + ( blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + italic_K start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) italic_K start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) )
(tt)k(Tek+[k(2k1)]k)[24k2Clgbk(1+(𝔼[|X0|2k]+K1(Te))K2(Te))].absentsuperscript𝑡superscript𝑡𝑘superscriptsubscript𝑇𝑒𝑘superscriptdelimited-[]𝑘2𝑘1𝑘delimited-[]superscript24𝑘2superscriptsubscript𝐶lgb𝑘1𝔼delimited-[]superscriptsubscript𝑋02𝑘subscript𝐾1subscript𝑇𝑒subscript𝐾2subscript𝑇𝑒\displaystyle\leq(t-t^{\prime})^{k}\left(T_{e}^{k}+[k(2k-1)]^{k}\right)\left[2% ^{4k-2}C_{\mathrm{lgb}}^{k}\left(1+\left(\mathbb{E}[|X_{0}|^{2k}]+K_{1}(T_{e})% \right)K_{2}(T_{e})\right)\right].≤ ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT + [ italic_k ( 2 italic_k - 1 ) ] start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ) [ 2 start_POSTSUPERSCRIPT 4 italic_k - 2 end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ( 1 + ( blackboard_E [ | italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] + italic_K start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) italic_K start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) ] .

Having proved these results concerning boundedness of 2k2𝑘2k2 italic_k-moments of the DO solution, we are now ready to extend it up to the explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT with a.s. continuous paths.

Theorem 4.4.

Let a𝑎aitalic_a and b𝑏bitalic_b satisfy Assumptions 2 and 2. Let an DO approximation X𝑋Xitalic_X on [0,Te)0subscript𝑇𝑒[0,T_{e})[ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) be given. If X0subscript𝑋0X_{0}italic_X start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT satisfies Assumption 4.2 for some integer k>1𝑘1k>1italic_k > 1, then X𝑋Xitalic_X admits a unique continuous extension to [0,Te]0subscript𝑇𝑒[0,T_{e}][ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ], almost surely. This extension is Hölder continuous on [0,Te]0subscript𝑇𝑒[0,T_{e}][ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ], and satisfies 𝔼[|Xt|2k]<𝔼delimited-[]superscriptsubscript𝑋𝑡2𝑘\mathbb{E}[|X_{t}|^{2k}]<\inftyblackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] < ∞ for all t[0,Te]𝑡0subscript𝑇𝑒t\in[0,T_{e}]italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ].

Proof.

By Assumption 4.2, Proposition 4.3 holds and (Xt)0t<Tesubscriptsubscript𝑋𝑡0𝑡subscript𝑇𝑒(X_{t})_{0\leq t<T_{e}}( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT 0 ≤ italic_t < italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT admits an extension XTe:=limtTeXtL2k(Ω;d)assignsubscript𝑋subscript𝑇𝑒subscript𝑡subscript𝑇𝑒subscript𝑋𝑡superscript𝐿2𝑘Ωsuperscript𝑑X_{T_{e}}:=\lim_{t\uparrow T_{e}}X_{t}\in L^{2k}(\Omega;\mathbb{R}^{d})italic_X start_POSTSUBSCRIPT italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT := roman_lim start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) that is unique in L2k(Ω;d)superscript𝐿2𝑘Ωsuperscript𝑑L^{2k}(\Omega;\mathbb{R}^{d})italic_L start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ). From XtXtL2(Ω;d)XtXtL2k(Ω;d)subscriptnormsubscript𝑋𝑡subscript𝑋superscript𝑡superscript𝐿2Ωsuperscript𝑑subscriptnormsubscript𝑋𝑡subscript𝑋superscript𝑡superscript𝐿2𝑘Ωsuperscript𝑑\|X_{t}-X_{t^{\prime}}\|_{L^{2}(\Omega;\mathbb{R}^{d})}\leq\|X_{t}-X_{t^{% \prime}}\|_{L^{2k}(\Omega;\mathbb{R}^{d})}∥ italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_X start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) end_POSTSUBSCRIPT ≤ ∥ italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_X start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) end_POSTSUBSCRIPT for 0t<t<Te0superscript𝑡𝑡subscript𝑇𝑒0\leq t^{\prime}<t<T_{e}0 ≤ italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT < italic_t < italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT, the extension is unique in Lp(Ω;d)superscript𝐿𝑝Ωsuperscript𝑑L^{p}(\Omega;\mathbb{R}^{d})italic_L start_POSTSUPERSCRIPT italic_p end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT ) for p[2,2k]𝑝22𝑘p\in[2,2k]italic_p ∈ [ 2 , 2 italic_k ]. By construction of XTesubscript𝑋subscript𝑇𝑒X_{T_{e}}italic_X start_POSTSUBSCRIPT italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT, we have

𝔼[|XtXt|2k]C(tt)k,0t<tTe.formulae-sequence𝔼delimited-[]superscriptsubscript𝑋𝑡subscript𝑋superscript𝑡2𝑘𝐶superscript𝑡superscript𝑡𝑘0superscript𝑡𝑡subscript𝑇𝑒\mathbb{E}[|X_{t}-X_{t^{\prime}}|^{2k}]\leq C(t-t^{\prime})^{k},\quad 0\leq t^% {\prime}<t\leq T_{e}.blackboard_E [ | italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - italic_X start_POSTSUBSCRIPT italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 italic_k end_POSTSUPERSCRIPT ] ≤ italic_C ( italic_t - italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT , 0 ≤ italic_t start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT < italic_t ≤ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT . (4.13)

Therefore, by Kolmogorov-Chenstov Theorem (see for example [karatzas2012brownian]) there exists a version (X~t)t[0,Te]subscriptsubscript~𝑋𝑡𝑡0subscript𝑇𝑒(\tilde{X}_{t})_{t\in[0,T_{e}]}( over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ] end_POSTSUBSCRIPT of the DO approximation that is q𝑞qitalic_q-Hölder continuous for all 0<q<k12k0𝑞𝑘12𝑘0<q<\frac{k-1}{2k}0 < italic_q < divide start_ARG italic_k - 1 end_ARG start_ARG 2 italic_k end_ARG. By construction, (X~t)t[0,Te]subscriptsubscript~𝑋𝑡𝑡0subscript𝑇𝑒(\tilde{X}_{t})_{t\in[0,T_{e}]}( over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ] end_POSTSUBSCRIPT is a process with bounded 2k2𝑘2k2 italic_k-moments.

Finally, let us see that (Xt)t[0,Te]subscriptsubscript𝑋𝑡𝑡0subscript𝑇𝑒(X_{t})_{t\in[0,T_{e}]}( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ] end_POSTSUBSCRIPT and (X~t)t[0,Te]subscriptsubscript~𝑋𝑡𝑡0subscript𝑇𝑒(\tilde{X}_{t})_{t\in[0,T_{e}]}( over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ] end_POSTSUBSCRIPT are indistinguishable. Indeed, by construction of X~~𝑋\tilde{X}over~ start_ARG italic_X end_ARG we have XTe=X~Tesubscript𝑋subscript𝑇𝑒subscript~𝑋subscript𝑇𝑒X_{T_{e}}=\tilde{X}_{T_{e}}italic_X start_POSTSUBSCRIPT italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT = over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT a.s. Moreover, (Xt)t[0,Te)subscriptsubscript𝑋𝑡𝑡0subscript𝑇𝑒(X_{t})_{t\in[0,T_{e})}( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT and (X~t)t[0,Te)subscriptsubscript~𝑋𝑡𝑡0subscript𝑇𝑒(\tilde{X}_{t})_{t\in[0,T_{e})}( over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT have a.s. continuous paths and are versions of each other, and thus indistinguishable. Hence, (Xt)t[0,Te]subscriptsubscript𝑋𝑡𝑡0subscript𝑇𝑒(X_{t})_{t\in[0,T_{e}]}( italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ] end_POSTSUBSCRIPT and (X~t)t[0,Te]subscriptsubscript~𝑋𝑡𝑡0subscript𝑇𝑒(\tilde{X}_{t})_{t\in[0,T_{e}]}( over~ start_ARG italic_X end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ] end_POSTSUBSCRIPT are indistinguishable. This completes the proof. ∎

Together with Proposition 4.1, Theorem 4.4 gives us an insight into how to continue a DO approximation beyond the explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT. Let a DO approximation X𝑋Xitalic_X of (2.1) with explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT that satisfies (4.5) be given. Suppose dim(Im(𝔼[𝒳t]))=R\mathrm{dim}\left(\mathrm{Im}(\mathbb{E}[\mathcal{X}_{t}\,\cdot\,])\right)=Rroman_dim ( roman_Im ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ] ) ) = italic_R for all t[0,Te)𝑡0subscript𝑇𝑒t\in[0,T_{e})italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ), with a positive integer R𝑅Ritalic_R. By Theorem 4.4, X𝑋Xitalic_X can be continuously extended up to Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT, while from Proposition 4.1 we know limtTeC𝒀t1F=subscript𝑡subscript𝑇𝑒subscriptnormsuperscriptsubscript𝐶subscript𝒀𝑡1F\lim\limits_{t\uparrow T_{e}}\|{C}_{\boldsymbol{Y}_{t}}^{-1}\|_{\mathrm{F}}=\inftyroman_lim start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = ∞. This implies that dim(Im(𝔼[𝒳Te]))=R<R\mathrm{dim}\left(\mathrm{Im}(\mathbb{E}[\mathcal{X}_{T_{e}}\,\cdot\,])\right)% =R^{\prime}<Rroman_dim ( roman_Im ( blackboard_E [ caligraphic_X start_POSTSUBSCRIPT italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT ⋅ ] ) ) = italic_R start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT < italic_R. Therefore, one can extend our DO approximation X𝑋Xitalic_X continuously in t𝑡titalic_t beyond Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT by considering the DO system (2.6)–(2.7) with initial datum XTesubscript𝑋subscript𝑇𝑒X_{T_{e}}italic_X start_POSTSUBSCRIPT italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT. The corresponding DO solution satisfies 𝑼tR×dsubscript𝑼𝑡superscriptsuperscript𝑅𝑑\boldsymbol{U}_{t}\in\mathbb{R}^{R^{\prime}\times d}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT × italic_d end_POSTSUPERSCRIPT and 𝒀t[L2(Ω)]Rsubscript𝒀𝑡superscriptdelimited-[]superscript𝐿2Ωsuperscript𝑅\boldsymbol{Y}_{t}\in[L^{2}(\Omega)]^{R^{\prime}}bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT end_POSTSUPERSCRIPT for t[Te,Te+Te)𝑡subscript𝑇𝑒subscript𝑇𝑒subscriptsuperscript𝑇𝑒t\in[T_{e},T_{e}+T^{\prime}_{e})italic_t ∈ [ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT + italic_T start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ), where Tesubscriptsuperscript𝑇𝑒T^{\prime}_{e}italic_T start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT is the new explosion time for (𝑼t,𝒀t)subscript𝑼𝑡subscript𝒀𝑡(\boldsymbol{U}_{t},\boldsymbol{Y}_{t})( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ).

4.3 The case of uniformly positive-definite diffusion

In the previous section, we have shown that by assuming the boundedness of the 2k2𝑘2k2 italic_k moments of the initial condition of the DO approximation for k>1𝑘1k>1italic_k > 1, the DO approximation can be extended up to the explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT. It turns out that, under the condition that we will introduce in the following, the explosion time Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT is never finite; as a result, rank-R𝑅Ritalic_R DO solution exists globally.

A sufficient condition is that the diffusion matrix b(t,x)b(t,x)𝑏𝑡𝑥𝑏superscript𝑡𝑥topb(t,x)b(t,x)^{\top}italic_b ( italic_t , italic_x ) italic_b ( italic_t , italic_x ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT is positive definite with a lower bound on the smallest eigenvalue, where the bound is uniform in t𝑡titalic_t and x𝑥xitalic_x. This condition turns out to ensure that the smallest eigenvalue of the Gram matrix 𝔼[𝒀t𝒀t]𝔼delimited-[]subscript𝒀𝑡subscriptsuperscript𝒀top𝑡\mathbb{E}[\boldsymbol{Y}_{t}\boldsymbol{Y}^{\top}_{t}]blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ] remains bounded below uniformly in t𝑡titalic_t and x𝑥xitalic_x, which in turn guarantees the global existence of the DO solution. In the following, we use the notation ABsucceeds𝐴𝐵A\succ Bitalic_A ≻ italic_B (respectively ABsucceeds-or-equals𝐴𝐵A\succeq Bitalic_A ⪰ italic_B) with A,B𝐴𝐵A,Bitalic_A , italic_B square matrices to indicate that AB𝐴𝐵A-Bitalic_A - italic_B is positive definite (respectively positive semidefinite).

Proposition 4.5.

Suppose the rank R𝑅Ritalic_R DO solution (𝐔,𝐘)𝐔𝐘(\boldsymbol{U},\boldsymbol{Y})( bold_italic_U , bold_italic_Y ) exists on [0,T]0𝑇[0,T][ 0 , italic_T ]. Assume moreover that there exist σ𝐘0,σB>0subscript𝜎subscript𝐘0subscript𝜎𝐵0\sigma_{\boldsymbol{Y}_{0}},\sigma_{B}>0italic_σ start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT , italic_σ start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT > 0 such that

C𝒀0subscript𝐶subscript𝒀0\displaystyle C_{\boldsymbol{Y}_{0}}italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT :=𝔼[𝒀0𝒀0]σ𝒀0IR×R;assignabsent𝔼delimited-[]subscript𝒀0superscriptsubscript𝒀0topsucceeds-or-equalssubscript𝜎subscript𝒀0subscript𝐼𝑅𝑅\displaystyle:=\mathbb{E}[\boldsymbol{Y}_{0}\boldsymbol{Y}_{0}^{\top}]\succeq% \sigma_{\boldsymbol{Y}_{0}}\,I_{R\times R};:= blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] ⪰ italic_σ start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_I start_POSTSUBSCRIPT italic_R × italic_R end_POSTSUBSCRIPT ; (4.14)
b(t,x)b(t,x)𝑏𝑡𝑥𝑏superscript𝑡𝑥top\displaystyle b(t,x)b(t,x)^{\top}italic_b ( italic_t , italic_x ) italic_b ( italic_t , italic_x ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT σBId×d, for any t[0,T] and for any xd.formulae-sequencesucceeds-or-equalsabsentsubscript𝜎𝐵subscript𝐼𝑑𝑑 for any 𝑡0𝑇 and for any 𝑥superscript𝑑\displaystyle\succeq\sigma_{B}\,I_{d\times d},\ \text{ for any }\ t\in[0,T]% \text{ and for any }\ x\in\mathbb{R}^{d}.⪰ italic_σ start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT italic_I start_POSTSUBSCRIPT italic_d × italic_d end_POSTSUBSCRIPT , for any italic_t ∈ [ 0 , italic_T ] and for any italic_x ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT . (4.15)

Then for all t[0,T]𝑡0𝑇t\in[0,T]italic_t ∈ [ 0 , italic_T ] we have

C𝒀tmin{σ𝒀0;σB24Clgb(1+M)}IR×R,succeeds-or-equalssubscript𝐶subscript𝒀𝑡subscript𝜎subscript𝒀0subscriptsuperscript𝜎2𝐵4subscript𝐶lgb1𝑀subscript𝐼𝑅𝑅C_{\boldsymbol{Y}_{t}}\succeq\min\{\sigma_{\boldsymbol{Y}_{0}};\frac{\sigma^{2% }_{B}}{4C_{\mathrm{lgb}}(1+M)}\}\,I_{R\times R},italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT ⪰ roman_min { italic_σ start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ; divide start_ARG italic_σ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT end_ARG start_ARG 4 italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + italic_M ) end_ARG } italic_I start_POSTSUBSCRIPT italic_R × italic_R end_POSTSUBSCRIPT , (4.16)

where M=M(T)𝑀𝑀𝑇M=M(T)italic_M = italic_M ( italic_T ) is defined in Lemma 3.5.

Proof.

By introducing the shorthand notation at=a(t,Xt)dsubscript𝑎𝑡𝑎𝑡subscript𝑋𝑡superscript𝑑a_{t}=a(t,X_{t})\in\mathbb{R}^{d}italic_a start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_a ( italic_t , italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ∈ blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT and bt=b(t,Xt)d×msubscript𝑏𝑡𝑏𝑡subscript𝑋𝑡superscript𝑑𝑚b_{t}=b(t,X_{t})\in\mathbb{R}^{d\times m}italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_b ( italic_t , italic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) ∈ blackboard_R start_POSTSUPERSCRIPT italic_d × italic_m end_POSTSUPERSCRIPT, the k𝑘kitalic_k-th component Ytksuperscriptsubscript𝑌𝑡𝑘{Y}_{t}^{k}italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT of 𝒀t[L2(Ω)]Rsubscript𝒀𝑡superscriptdelimited-[]superscript𝐿2Ω𝑅\boldsymbol{Y}_{t}\in[L^{2}(\Omega)]^{R}bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT satisfies

dYtk=i=1dUtkiatidt+l=1mr=1dUtkrbtrldWtl𝑑superscriptsubscript𝑌𝑡𝑘superscriptsubscript𝑖1𝑑subscriptsuperscript𝑈𝑘𝑖𝑡subscriptsuperscript𝑎𝑖𝑡𝑑𝑡superscriptsubscript𝑙1𝑚superscriptsubscript𝑟1𝑑superscriptsubscript𝑈𝑡𝑘𝑟superscriptsubscript𝑏𝑡𝑟𝑙𝑑superscriptsubscript𝑊𝑡𝑙d{Y}_{t}^{k}=\sum\limits_{i=1}^{d}U^{ki}_{t}a^{i}_{t}dt+\sum\limits_{l=1}^{m}% \sum\limits_{r=1}^{d}{U}_{t}^{kr}b_{t}^{rl}dW_{t}^{l}italic_d italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT = ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT italic_U start_POSTSUPERSCRIPT italic_k italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_d italic_t + ∑ start_POSTSUBSCRIPT italic_l = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_r = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k italic_r end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_r italic_l end_POSTSUPERSCRIPT italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_l end_POSTSUPERSCRIPT

Hence, using Itô’s formula for 1j,kRformulae-sequence1𝑗𝑘𝑅1\leq j,k\leq R1 ≤ italic_j , italic_k ≤ italic_R, we have

d(YtjYtk)=𝑑superscriptsubscript𝑌𝑡𝑗superscriptsubscript𝑌𝑡𝑘absent\displaystyle d({Y}_{t}^{j}{Y}_{t}^{k})=italic_d ( italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ) = d(Ytj)Ytk+Ytjd(Ytk)+l=1mi=1dUtjibtilr=1dUtkrbtrldt𝑑superscriptsubscript𝑌𝑡𝑗superscriptsubscript𝑌𝑡𝑘superscriptsubscript𝑌𝑡𝑗𝑑superscriptsubscript𝑌𝑡𝑘superscriptsubscript𝑙1𝑚superscriptsubscript𝑖1𝑑superscriptsubscript𝑈𝑡𝑗𝑖superscriptsubscript𝑏𝑡𝑖𝑙superscriptsubscript𝑟1𝑑superscriptsubscript𝑈𝑡𝑘𝑟superscriptsubscript𝑏𝑡𝑟𝑙𝑑𝑡\displaystyle d({Y}_{t}^{j}){Y}_{t}^{k}+{Y}_{t}^{j}d({Y}_{t}^{k})+\sum_{l=1}^{% m}\sum_{i=1}^{d}{U}_{t}^{ji}b_{t}^{il}\sum_{r=1}^{d}{U}_{t}^{kr}b_{t}^{rl}dtitalic_d ( italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT ) italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT + italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT italic_d ( italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ) + ∑ start_POSTSUBSCRIPT italic_l = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j italic_i end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_i italic_l end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_r = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k italic_r end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_r italic_l end_POSTSUPERSCRIPT italic_d italic_t
=\displaystyle== (i=1dUtjiatidt+l=1mi=1dUtjibtildWtl)Ytksuperscriptsubscript𝑖1𝑑subscriptsuperscript𝑈𝑗𝑖𝑡subscriptsuperscript𝑎𝑖𝑡𝑑𝑡superscriptsubscript𝑙1𝑚superscriptsubscript𝑖1𝑑superscriptsubscript𝑈𝑡𝑗𝑖superscriptsubscript𝑏𝑡𝑖𝑙𝑑superscriptsubscript𝑊𝑡𝑙superscriptsubscript𝑌𝑡𝑘\displaystyle(\sum\limits_{i=1}^{d}U^{ji}_{t}a^{i}_{t}dt+\sum\limits_{l=1}^{m}% \sum\limits_{i=1}^{d}{U}_{t}^{ji}b_{t}^{il}dW_{t}^{l}){Y}_{t}^{k}( ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT italic_U start_POSTSUPERSCRIPT italic_j italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_d italic_t + ∑ start_POSTSUBSCRIPT italic_l = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j italic_i end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_i italic_l end_POSTSUPERSCRIPT italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_l end_POSTSUPERSCRIPT ) italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT
+Ytj(i=1dUtkiatidt+l=1mi=1dUtkrbtrldWtl)superscriptsubscript𝑌𝑡𝑗superscriptsubscript𝑖1𝑑subscriptsuperscript𝑈𝑘𝑖𝑡subscriptsuperscript𝑎𝑖𝑡𝑑𝑡superscriptsubscript𝑙1𝑚superscriptsubscript𝑖1𝑑superscriptsubscript𝑈𝑡𝑘𝑟superscriptsubscript𝑏𝑡𝑟𝑙𝑑superscriptsubscript𝑊𝑡𝑙\displaystyle+{Y}_{t}^{j}(\sum\limits_{i=1}^{d}U^{ki}_{t}a^{i}_{t}dt+\sum% \limits_{l=1}^{m}\sum\limits_{i=1}^{d}{U}_{t}^{kr}b_{t}^{rl}dW_{t}^{l})+ italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT ( ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT italic_U start_POSTSUPERSCRIPT italic_k italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_d italic_t + ∑ start_POSTSUBSCRIPT italic_l = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k italic_r end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_r italic_l end_POSTSUPERSCRIPT italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_l end_POSTSUPERSCRIPT )
+l=1mi=1dUtjibtilr=1dUtkrbtrldtsuperscriptsubscript𝑙1𝑚superscriptsubscript𝑖1𝑑superscriptsubscript𝑈𝑡𝑗𝑖superscriptsubscript𝑏𝑡𝑖𝑙superscriptsubscript𝑟1𝑑superscriptsubscript𝑈𝑡𝑘𝑟superscriptsubscript𝑏𝑡𝑟𝑙𝑑𝑡\displaystyle+\sum_{l=1}^{m}\sum_{i=1}^{d}{U}_{t}^{ji}b_{t}^{il}\sum_{r=1}^{d}% {U}_{t}^{kr}b_{t}^{rl}dt+ ∑ start_POSTSUBSCRIPT italic_l = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_j italic_i end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_i italic_l end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_r = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_k italic_r end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_r italic_l end_POSTSUPERSCRIPT italic_d italic_t

Hence,

d(𝒀t𝒀t)=(d𝒀t)𝒀t+𝒀t(d𝒀t)+𝑼tbt(𝑼tbt)dt𝑑subscript𝒀𝑡superscriptsubscript𝒀𝑡top𝑑subscript𝒀𝑡superscriptsubscript𝒀𝑡topsubscript𝒀𝑡superscript𝑑subscript𝒀𝑡topsubscript𝑼𝑡subscript𝑏𝑡superscriptsubscript𝑼𝑡subscript𝑏𝑡top𝑑𝑡d(\boldsymbol{Y}_{t}\boldsymbol{Y}_{t}^{\top})=(d\boldsymbol{Y}_{t})% \boldsymbol{Y}_{t}^{\top}+\boldsymbol{Y}_{t}(d\boldsymbol{Y}_{t})^{\top}+% \boldsymbol{U}_{t}b_{t}(\boldsymbol{U}_{t}b_{t})^{\top}dtitalic_d ( bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) = ( italic_d bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT + bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( italic_d bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT + bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_d italic_t

and taking the expectation of both sides yields

d𝔼[(𝒀t𝒀t)]dt=𝔼[𝑼tat(𝒀t)]+𝔼[𝒀t(𝑼tat)]+𝔼[𝑼tbtbt𝑼t].𝑑𝔼delimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡top𝑑𝑡𝔼delimited-[]subscript𝑼𝑡subscript𝑎𝑡superscriptsubscript𝒀𝑡top𝔼delimited-[]subscript𝒀𝑡superscriptsubscript𝑼𝑡subscript𝑎𝑡top𝔼delimited-[]subscript𝑼𝑡subscript𝑏𝑡superscriptsubscript𝑏𝑡topsuperscriptsubscript𝑼𝑡top\frac{d\mathbb{E}[(\boldsymbol{Y}_{t}\boldsymbol{Y}_{t}^{\top})]}{dt}=\mathbb{% E}[\boldsymbol{U}_{t}a_{t}(\boldsymbol{Y}_{t}^{\top})]+\mathbb{E}[\boldsymbol{% Y}_{t}(\boldsymbol{U}_{t}a_{t})^{\top}]+\mathbb{E}[\boldsymbol{U}_{t}b_{t}b_{t% }^{\top}\boldsymbol{U}_{t}^{\top}].divide start_ARG italic_d blackboard_E [ ( bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) ] end_ARG start_ARG italic_d italic_t end_ARG = blackboard_E [ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) ] + blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] + blackboard_E [ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] .

We now aim at analyzing the smallest eigenvalue of C𝒀t:=𝔼[(𝒀t𝒀t)]assignsubscript𝐶subscript𝒀𝑡𝔼delimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡topC_{\boldsymbol{Y}_{t}}:=\mathbb{E}[(\boldsymbol{Y}_{t}\boldsymbol{Y}_{t}^{\top% })]italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT := blackboard_E [ ( bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) ] through the Rayleigh quotient. For any unit vector vR𝑣superscript𝑅v\in\mathbb{R}^{R}italic_v ∈ blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT, we have

vd𝔼[(𝒀t𝒀t)]dtv=2v𝔼[𝑼tat(𝒀t)]v+v𝔼[𝑼tbtbt𝑼t]v.superscript𝑣top𝑑𝔼delimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡top𝑑𝑡𝑣2superscript𝑣top𝔼delimited-[]subscript𝑼𝑡subscript𝑎𝑡superscriptsubscript𝒀𝑡top𝑣superscript𝑣top𝔼delimited-[]subscript𝑼𝑡subscript𝑏𝑡superscriptsubscript𝑏𝑡topsuperscriptsubscript𝑼𝑡top𝑣v^{\top}\frac{d\mathbb{E}[(\boldsymbol{Y}_{t}\boldsymbol{Y}_{t}^{\top})]}{dt}v% =2v^{\top}\mathbb{E}[\boldsymbol{U}_{t}a_{t}(\boldsymbol{Y}_{t}^{\top})]v+v^{% \top}\mathbb{E}[\boldsymbol{U}_{t}b_{t}b_{t}^{\top}\boldsymbol{U}_{t}^{\top}]v.italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT divide start_ARG italic_d blackboard_E [ ( bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) ] end_ARG start_ARG italic_d italic_t end_ARG italic_v = 2 italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) ] italic_v + italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] italic_v . (4.17)

Thanks to (4.15), the last term can be bounded below as

v𝔼[𝑼tbtbt𝑼t]v=v𝑼t𝔼[btbt]𝑼tvv𝑼tσBIR×R𝑼tvσB.superscript𝑣top𝔼delimited-[]subscript𝑼𝑡subscript𝑏𝑡superscriptsubscript𝑏𝑡topsuperscriptsubscript𝑼𝑡top𝑣superscript𝑣topsubscript𝑼𝑡𝔼delimited-[]subscript𝑏𝑡superscriptsubscript𝑏𝑡topsuperscriptsubscript𝑼𝑡top𝑣superscript𝑣topsubscript𝑼𝑡subscript𝜎𝐵subscript𝐼𝑅𝑅superscriptsubscript𝑼𝑡top𝑣subscript𝜎𝐵v^{\top}\mathbb{E}[\boldsymbol{U}_{t}b_{t}b_{t}^{\top}\boldsymbol{U}_{t}^{\top% }]v=v^{\top}\boldsymbol{U}_{t}\mathbb{E}[b_{t}b_{t}^{\top}]\boldsymbol{U}_{t}^% {\top}v\geq v^{\top}\boldsymbol{U}_{t}\sigma_{B}I_{R\times R}\boldsymbol{U}_{t% }^{\top}v\geq\sigma_{B}.italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] italic_v = italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT blackboard_E [ italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_v ≥ italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_σ start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT italic_I start_POSTSUBSCRIPT italic_R × italic_R end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_v ≥ italic_σ start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT .

The first term can be bounded above as

|v𝔼[𝒀t(𝑼tat)]v|superscript𝑣top𝔼delimited-[]subscript𝒀𝑡superscriptsubscript𝑼𝑡subscript𝑎𝑡top𝑣\displaystyle|v^{\top}\mathbb{E}[\boldsymbol{Y}_{t}(\boldsymbol{U}_{t}a_{t})^{% \top}]v|| italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] italic_v | =|𝔼[v𝒀tat]𝑼tv||𝔼[v𝒀tat]|absent𝔼delimited-[]superscript𝑣topsubscript𝒀𝑡superscriptsubscript𝑎𝑡topsuperscriptsubscript𝑼𝑡top𝑣𝔼delimited-[]superscript𝑣topsubscript𝒀𝑡superscriptsubscript𝑎𝑡top\displaystyle=|\mathbb{E}[v^{\top}\boldsymbol{Y}_{t}a_{t}^{\top}]\boldsymbol{U% }_{t}^{\top}v|\leq|\mathbb{E}[v^{\top}\boldsymbol{Y}_{t}a_{t}^{\top}]|= | blackboard_E [ italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_v | ≤ | blackboard_E [ italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_a start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] |
12ε𝔼[|v𝒀t|2]+ε2𝔼[|at|2]absent12𝜀𝔼delimited-[]superscriptsuperscript𝑣topsubscript𝒀𝑡2𝜀2𝔼delimited-[]superscriptsubscript𝑎𝑡2\displaystyle\leq\frac{1}{2\varepsilon}\mathbb{E}[|v^{\top}\boldsymbol{Y}_{t}|% ^{2}]+\frac{\varepsilon}{2}\mathbb{E}[|a_{t}|^{2}]≤ divide start_ARG 1 end_ARG start_ARG 2 italic_ε end_ARG blackboard_E [ | italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] + divide start_ARG italic_ε end_ARG start_ARG 2 end_ARG blackboard_E [ | italic_a start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ]
12ε𝔼[v𝒀t𝒀tv]+ε2Clgb(1+𝔼[|𝒀t|2])absent12𝜀𝔼delimited-[]superscript𝑣topsubscript𝒀𝑡superscriptsubscript𝒀𝑡top𝑣𝜀2subscript𝐶lgb1𝔼delimited-[]superscriptsubscript𝒀𝑡2\displaystyle\leq\frac{1}{2\varepsilon}\mathbb{E}[v^{\top}\boldsymbol{Y}_{t}% \boldsymbol{Y}_{t}^{\top}v]+\frac{\varepsilon}{2}C_{\mathrm{lgb}}(1+\mathbb{E}% [|\boldsymbol{Y}_{t}|^{2}])≤ divide start_ARG 1 end_ARG start_ARG 2 italic_ε end_ARG blackboard_E [ italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_v ] + divide start_ARG italic_ε end_ARG start_ARG 2 end_ARG italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] )
12εv𝔼[𝒀t𝒀t]v+ε2Clgb(1+M) for any ε>0.absent12𝜀superscript𝑣top𝔼delimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡top𝑣𝜀2subscript𝐶lgb1𝑀 for any 𝜀0\displaystyle\leq\frac{1}{2\varepsilon}v^{\top}\mathbb{E}[\boldsymbol{Y}_{t}% \boldsymbol{Y}_{t}^{\top}]v+\frac{\varepsilon}{2}C_{\mathrm{lgb}}(1+M)\ \text{% for any }\varepsilon>0.≤ divide start_ARG 1 end_ARG start_ARG 2 italic_ε end_ARG italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] italic_v + divide start_ARG italic_ε end_ARG start_ARG 2 end_ARG italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + italic_M ) for any italic_ε > 0 .

Taking ε=σB2Clgb(1+M)𝜀subscript𝜎𝐵2subscript𝐶lgb1𝑀\varepsilon=\frac{\sigma_{B}}{2C_{\mathrm{lgb}}(1+M)}italic_ε = divide start_ARG italic_σ start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT end_ARG start_ARG 2 italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + italic_M ) end_ARG leads to the following estimate on the derivative of At:=vC𝒀tv=v𝔼[(𝒀t𝒀t)]vassignsubscript𝐴𝑡superscript𝑣topsubscript𝐶subscript𝒀𝑡𝑣superscript𝑣top𝔼delimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡top𝑣A_{t}:=v^{\top}C_{\boldsymbol{Y}_{t}}v=v^{\top}\mathbb{E}[(\boldsymbol{Y}_{t}% \boldsymbol{Y}_{t}^{\top})]vitalic_A start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT := italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_v = italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ ( bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) ] italic_v:

ddtAt1εAt+σB2,𝑑𝑑𝑡subscript𝐴𝑡1𝜀subscript𝐴𝑡subscript𝜎𝐵2\frac{d}{dt}A_{t}\geq-\frac{1}{\varepsilon}A_{t}+\frac{\sigma_{B}}{2},divide start_ARG italic_d end_ARG start_ARG italic_d italic_t end_ARG italic_A start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ≥ - divide start_ARG 1 end_ARG start_ARG italic_ε end_ARG italic_A start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT + divide start_ARG italic_σ start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT end_ARG start_ARG 2 end_ARG , (4.18)

from which we deduce

AtεσB2(etε1)etε+A0etε.subscript𝐴𝑡𝜀subscript𝜎𝐵2superscript𝑒𝑡𝜀1superscript𝑒𝑡𝜀subscript𝐴0superscript𝑒𝑡𝜀A_{t}\geq\frac{\varepsilon\sigma_{B}}{2}(e^{\frac{t}{\varepsilon}}-1)e^{-\frac% {t}{\varepsilon}}+A_{0}e^{-\frac{t}{\varepsilon}}.italic_A start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ≥ divide start_ARG italic_ε italic_σ start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT end_ARG start_ARG 2 end_ARG ( italic_e start_POSTSUPERSCRIPT divide start_ARG italic_t end_ARG start_ARG italic_ε end_ARG end_POSTSUPERSCRIPT - 1 ) italic_e start_POSTSUPERSCRIPT - divide start_ARG italic_t end_ARG start_ARG italic_ε end_ARG end_POSTSUPERSCRIPT + italic_A start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT italic_e start_POSTSUPERSCRIPT - divide start_ARG italic_t end_ARG start_ARG italic_ε end_ARG end_POSTSUPERSCRIPT .

Noting that (4.14) implies A0σ𝒀0subscript𝐴0subscript𝜎subscript𝒀0A_{0}\geq\sigma_{\boldsymbol{Y}_{0}}italic_A start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ≥ italic_σ start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT, we conclude

v𝔼[𝒀t𝒀t]vsuperscript𝑣top𝔼delimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡top𝑣\displaystyle v^{\top}\mathbb{E}[\boldsymbol{Y}_{t}\boldsymbol{Y}_{t}^{\top}]vitalic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] italic_v εσB2+(σ𝒀0εσB2)etεabsent𝜀subscript𝜎𝐵2subscript𝜎subscript𝒀0𝜀subscript𝜎𝐵2superscript𝑒𝑡𝜀\displaystyle\geq\frac{\varepsilon\sigma_{B}}{2}+(\sigma_{\boldsymbol{Y}_{0}}-% \frac{\varepsilon\sigma_{B}}{2})e^{-\frac{t}{\varepsilon}}≥ divide start_ARG italic_ε italic_σ start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT end_ARG start_ARG 2 end_ARG + ( italic_σ start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT - divide start_ARG italic_ε italic_σ start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT end_ARG start_ARG 2 end_ARG ) italic_e start_POSTSUPERSCRIPT - divide start_ARG italic_t end_ARG start_ARG italic_ε end_ARG end_POSTSUPERSCRIPT
min{σ𝒀0,σB24Clgb(1+M)}>0 for any t[0,T].formulae-sequenceabsentsubscript𝜎subscript𝒀0subscriptsuperscript𝜎2𝐵4subscript𝐶lgb1𝑀0 for any 𝑡0𝑇\displaystyle\geq\min\{\sigma_{\boldsymbol{Y}_{0}},\frac{\sigma^{2}_{B}}{4C_{% \mathrm{lgb}}(1+M)}\}>0\quad\ \text{ for any }\ t\in[0,T].≥ roman_min { italic_σ start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT , divide start_ARG italic_σ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT end_ARG start_ARG 4 italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + italic_M ) end_ARG } > 0 for any italic_t ∈ [ 0 , italic_T ] .

As a consequence of the proposition above, the following global existence result is obtained.

Theorem 4.6 (Global Existence of DO solution).

Let Assumptions 1–3 hold. Suppose that the assumptions of Proposition 4.5 hold. Then, the DO solution exists for all t0𝑡0t\geq 0italic_t ≥ 0.

Proof.

From Theorems 3.4 and 3.6, the rank R𝑅Ritalic_R solution uniquely exists up to a certain time T>0𝑇0T>0italic_T > 0. Denote by Tesubscript𝑇𝑒T_{e}italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT its explosion time and suppose, to obtain a contradiction, Te<+subscript𝑇𝑒T_{e}<+\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT < + ∞. Then, from Proposition 4.1 we have limtTeC𝒀t1F=+subscript𝑡subscript𝑇𝑒subscriptnormsubscriptsuperscript𝐶1subscript𝒀𝑡F\lim\limits_{t\uparrow T_{e}}\|C^{-1}_{\boldsymbol{Y}_{t}}\|_{\mathrm{F}}=+\inftyroman_lim start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ italic_C start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = + ∞. But by Proposition 4.5 the Rayleigh quotient At=vC𝒀tvsubscript𝐴𝑡superscript𝑣topsubscript𝐶subscript𝒀𝑡𝑣A_{t}=v^{\top}C_{\boldsymbol{Y}_{t}}vitalic_A start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = italic_v start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_C start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_v with vR𝑣superscript𝑅v\in\mathbb{R}^{R}italic_v ∈ blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT satisfies

Atmin{σ𝒀0;σB24Clgb(1+M(Te))}>0,subscript𝐴𝑡subscript𝜎subscript𝒀0subscriptsuperscript𝜎2𝐵4subscript𝐶lgb1𝑀subscript𝑇𝑒0A_{t}\geq\min\{\sigma_{\boldsymbol{Y}_{0}};\frac{\sigma^{2}_{B}}{4C_{\mathrm{% lgb}}(1+M(T_{e}))}\}>0,italic_A start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ≥ roman_min { italic_σ start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ; divide start_ARG italic_σ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT end_ARG start_ARG 4 italic_C start_POSTSUBSCRIPT roman_lgb end_POSTSUBSCRIPT ( 1 + italic_M ( italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) ) end_ARG } > 0 ,

and, hence, for some constant k¯>0¯𝑘0\bar{k}>0over¯ start_ARG italic_k end_ARG > 0 we have C𝒀t1Fk¯subscriptnormsubscriptsuperscript𝐶1subscript𝒀𝑡F¯𝑘\|C^{-1}_{\boldsymbol{Y}_{t}}\|_{\mathrm{F}}\leq\bar{k}∥ italic_C start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ over¯ start_ARG italic_k end_ARG for all t[0,Te)𝑡0subscript𝑇𝑒t\in[0,T_{e})italic_t ∈ [ 0 , italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ). This contradicts limtTeC𝒀t1F=+subscript𝑡subscript𝑇𝑒subscriptnormsubscriptsuperscript𝐶1subscript𝒀𝑡F\lim\limits_{t\uparrow T_{e}}\|C^{-1}_{\boldsymbol{Y}_{t}}\|_{\mathrm{F}}=+\inftyroman_lim start_POSTSUBSCRIPT italic_t ↑ italic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ italic_C start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT = + ∞. Therefore, Te=+subscript𝑇𝑒T_{e}=+\inftyitalic_T start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT = + ∞. ∎

Remark 4.7.

It is worth noticing that (4.15) is satisfied in the case of additive non-degenerate noise.

5 Conclusion

In this work, we achieved to set a rigorous DO setting for SDEs under the conditions that the studied drift and diffusion satisfy a Lipschitz condition and a linear-growth bound. First, we (re-)derived the equations which characterize the evolution of the deterministic and stochastic modes, in a DO formulation, and showed how these can be re-interpreted as a projected dynamics leading to a DLRA formulation. Our derivation makes use of the Itô’s formula and avoids the direct use of time derivatives. We proved local-existence and uniqueness of the DO formulation and analyzed the possibility of extending the solution up to and beyond the explosion time. Finally, we gave a sufficient condition that assures the global existence of the DLR approximation.

One natural development of this work would be to extend this DO framework and well-posedness results to accommodate weaker assumptions on the drift and diffusion (e.g. local lipschitzianity and/or weak monotonicity).

Furthermore, it would be interesting to build a DLR formulation as a fully projecting dynamics as in (2.18) by giving a rigorous meaning to the term 𝒫𝒴(𝒳t)[b(t,𝒳t)dWt]subscript𝒫𝒴subscript𝒳𝑡delimited-[]𝑏𝑡subscript𝒳𝑡𝑑subscript𝑊𝑡\mathscr{P}_{\mathcal{Y}(\mathcal{X}_{t})}[b(t,\mathcal{X}_{t})\,dW_{t}]script_P start_POSTSUBSCRIPT caligraphic_Y ( caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT [ italic_b ( italic_t , caligraphic_X start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) italic_d italic_W start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ], possibly in a distributional sense. In case one manages to achieve this goal, the direct connection to the standard DLRA formulation for deterministic or random equations would allow us to apply numerical projector splitting schemes, which have been shown to perform very well in those contexts [ceruti2022unconventional, lubich2014projector].

Acknowledgements

Yoshihito Kazashi acknowledges the financial support of the University of Strathclyde through a Faculty of Science Starter Grant. This work has also been supported by the Swiss National Science Foundation under the Project n. 200518 “Dynamical low rank methods for uncertainty quantification and data assimilation”.

Appendix A Appendix

For a Hilbert space (H,,)𝐻(H,\langle\cdot,\cdot\rangle)( italic_H , ⟨ ⋅ , ⋅ ⟩ ), denote by [H]Rsuperscriptdelimited-[]𝐻𝑅[H]^{R}[ italic_H ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT the product Hilbert space equipped with the norm 𝒀[H]R=j=1RYjH2subscriptnorm𝒀superscriptdelimited-[]𝐻𝑅superscriptsubscript𝑗1𝑅superscriptsubscriptnormsuperscript𝑌𝑗𝐻2\|\boldsymbol{Y}\|_{[H]^{R}}=\sqrt{\sum_{j=1}^{R}\|Y^{j}\|_{H}^{2}}∥ bold_italic_Y ∥ start_POSTSUBSCRIPT [ italic_H ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = square-root start_ARG ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∥ italic_Y start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG for 𝒀=(Yj)[H]R𝒀superscript𝑌𝑗superscriptdelimited-[]𝐻𝑅\boldsymbol{Y}=(Y^{j})\in[H]^{R}bold_italic_Y = ( italic_Y start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT ) ∈ [ italic_H ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT. For 𝒀[H]R𝒀superscriptdelimited-[]𝐻𝑅\boldsymbol{Y}\in[H]^{R}bold_italic_Y ∈ [ italic_H ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT let Z𝒀subscript𝑍𝒀Z_{\boldsymbol{Y}}italic_Z start_POSTSUBSCRIPT bold_italic_Y end_POSTSUBSCRIPT be the Gram matrix

Z𝒀:=(Yj,Yk)j,k=1,RR×R.assignsubscript𝑍𝒀subscriptsuperscript𝑌𝑗superscript𝑌𝑘formulae-sequence𝑗𝑘1𝑅superscript𝑅𝑅Z_{\boldsymbol{Y}}:=\left(\langle{Y}^{j},{Y}^{k}\rangle\right)_{j,k=1,\dots R}% \in\mathbb{R}^{R\times R}.italic_Z start_POSTSUBSCRIPT bold_italic_Y end_POSTSUBSCRIPT := ( ⟨ italic_Y start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT , italic_Y start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ⟩ ) start_POSTSUBSCRIPT italic_j , italic_k = 1 , … italic_R end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT .

If Z𝒀0subscript𝑍subscript𝒀0Z_{\boldsymbol{Y}_{0}}italic_Z start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT is invertible, then for 𝒀𝒀\boldsymbol{Y}bold_italic_Y close to 𝒀0subscript𝒀0\boldsymbol{Y}_{0}bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT, Z𝒀subscript𝑍𝒀Z_{\boldsymbol{Y}}italic_Z start_POSTSUBSCRIPT bold_italic_Y end_POSTSUBSCRIPT is also invertible. The following result makes this intuition precise.

Proposition A.1.

Suppose that 𝐘0[H]Rsubscript𝐘0superscriptdelimited-[]𝐻𝑅\boldsymbol{Y}_{0}\in[H]^{R}bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∈ [ italic_H ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT has linearly independent components Y0jsubscriptsuperscript𝑌𝑗0Y^{j}_{0}italic_Y start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT, j=1,,R𝑗1𝑅j=1,\dots,Ritalic_j = 1 , … , italic_R in H𝐻Hitalic_H, and that 𝐘0Hρsubscriptnormsubscript𝐘0𝐻𝜌\|\boldsymbol{Y}_{0}\|_{H}\leq\rho∥ bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ≤ italic_ρ and Z𝐘01Fγsubscriptnormsuperscriptsubscript𝑍subscript𝐘01F𝛾\|Z_{\boldsymbol{Y}_{0}}^{-1}\|_{\mathrm{F}}\leq\gamma∥ italic_Z start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ italic_γ hold for ρ,γ>0𝜌𝛾0\rho,\gamma>0italic_ρ , italic_γ > 0. Then, there exists η:=η(ρ,γ)>0assign𝜂𝜂𝜌𝛾0\eta:=\eta(\rho,\gamma)>0italic_η := italic_η ( italic_ρ , italic_γ ) > 0 defined as

η(ρ,γ):=ρ+ρ2+12γassign𝜂𝜌𝛾𝜌superscript𝜌212𝛾\eta(\rho,\gamma):=-\rho+\sqrt{\rho^{2}+\frac{1}{2\gamma}}italic_η ( italic_ρ , italic_γ ) := - italic_ρ + square-root start_ARG italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + divide start_ARG 1 end_ARG start_ARG 2 italic_γ end_ARG end_ARG (A.1)

such that we have

Z𝒀1F2γ,for any 𝒀Bη(𝒀0),formulae-sequencesubscriptnormsuperscriptsubscript𝑍𝒀1F2𝛾for any 𝒀subscript𝐵𝜂subscript𝒀0\|Z_{\boldsymbol{Y}}^{-1}\|_{\mathrm{F}}\leq 2\gamma,\quad\text{for any }% \boldsymbol{Y}\in B_{\eta}(\boldsymbol{Y}_{0}),∥ italic_Z start_POSTSUBSCRIPT bold_italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ 2 italic_γ , for any bold_italic_Y ∈ italic_B start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ( bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ) ,

and η(ρ,γ)𝜂𝜌𝛾\eta(\rho,\gamma)italic_η ( italic_ρ , italic_γ ) is decreasing in both ρ𝜌\rhoitalic_ρ and γ𝛾\gammaitalic_γ. Here, Bη(𝐘0)subscript𝐵𝜂subscript𝐘0B_{\eta}(\boldsymbol{Y}_{0})italic_B start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ( bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ) is the open ball in [H]Rsuperscriptdelimited-[]𝐻𝑅[H]^{R}[ italic_H ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT of radius η𝜂\etaitalic_η around 𝐘0subscript𝐘0\boldsymbol{Y}_{0}bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT.

Proof.

Any 𝒀Bη(𝒀0)𝒀subscript𝐵𝜂subscript𝒀0\boldsymbol{Y}\in B_{\eta}(\boldsymbol{Y}_{0})bold_italic_Y ∈ italic_B start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ( bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ) may be written as 𝒀=𝒀0+r𝜹𝒀subscript𝒀0𝑟𝜹\boldsymbol{Y}=\boldsymbol{Y}_{0}+r\boldsymbol{\delta}bold_italic_Y = bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT + italic_r bold_italic_δ with r<η𝑟𝜂r<\etaitalic_r < italic_η and 𝜹[H]R=1subscriptnorm𝜹superscriptdelimited-[]𝐻𝑅1\|\boldsymbol{\delta}\|_{[H]^{R}}=1∥ bold_italic_δ ∥ start_POSTSUBSCRIPT [ italic_H ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1. We will derive an upper bound η𝜂\etaitalic_η on r𝑟ritalic_r that guarantees Z𝒀1F2γsubscriptnormsuperscriptsubscript𝑍𝒀1F2𝛾\|Z_{\boldsymbol{Y}}^{-1}\|_{\mathrm{F}}\leq 2\gamma∥ italic_Z start_POSTSUBSCRIPT bold_italic_Y end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ 2 italic_γ.

Define 𝒀(s):=𝒀0+s𝜹assign𝒀𝑠subscript𝒀0𝑠𝜹\boldsymbol{Y}(s):=\boldsymbol{Y}_{0}+s\boldsymbol{\delta}bold_italic_Y ( italic_s ) := bold_italic_Y start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT + italic_s bold_italic_δ and let f(s):=Z𝒀(s)1assign𝑓𝑠superscriptsubscript𝑍𝒀𝑠1f(s):=Z_{\boldsymbol{Y}(s)}^{-1}italic_f ( italic_s ) := italic_Z start_POSTSUBSCRIPT bold_italic_Y ( italic_s ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT. Then, we have

ddsf(s)=f(s)((δj,Y(s)k)j,k=1,R:=Z𝜹,𝒀(s)+(Y(s)j,δk)j,k=1,R:=Z𝒀(s),𝜹)f(s).dd𝑠𝑓𝑠𝑓𝑠subscriptsubscriptsuperscript𝛿𝑗𝑌superscript𝑠𝑘formulae-sequence𝑗𝑘1𝑅assignabsentsubscript𝑍𝜹𝒀𝑠subscriptsubscript𝑌superscript𝑠𝑗superscript𝛿𝑘formulae-sequence𝑗𝑘1𝑅assignabsentsubscript𝑍𝒀𝑠𝜹𝑓𝑠\frac{\mathrm{d}}{\mathrm{d}s}f(s)=-f(s)\left(\underbrace{(\langle\delta^{j},{% Y(s)}^{k}\rangle)_{j,k=1,\dots R}}_{:=Z_{\boldsymbol{\delta},\boldsymbol{Y}(s)% }}+\underbrace{(\langle{Y(s)}^{j},\delta^{k}\rangle)_{j,k=1,\dots R}}_{:=Z_{% \boldsymbol{Y}(s),\boldsymbol{\delta}}}\right)f(s).divide start_ARG roman_d end_ARG start_ARG roman_d italic_s end_ARG italic_f ( italic_s ) = - italic_f ( italic_s ) ( under⏟ start_ARG ( ⟨ italic_δ start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT , italic_Y ( italic_s ) start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ⟩ ) start_POSTSUBSCRIPT italic_j , italic_k = 1 , … italic_R end_POSTSUBSCRIPT end_ARG start_POSTSUBSCRIPT := italic_Z start_POSTSUBSCRIPT bold_italic_δ , bold_italic_Y ( italic_s ) end_POSTSUBSCRIPT end_POSTSUBSCRIPT + under⏟ start_ARG ( ⟨ italic_Y ( italic_s ) start_POSTSUPERSCRIPT italic_j end_POSTSUPERSCRIPT , italic_δ start_POSTSUPERSCRIPT italic_k end_POSTSUPERSCRIPT ⟩ ) start_POSTSUBSCRIPT italic_j , italic_k = 1 , … italic_R end_POSTSUBSCRIPT end_ARG start_POSTSUBSCRIPT := italic_Z start_POSTSUBSCRIPT bold_italic_Y ( italic_s ) , bold_italic_δ end_POSTSUBSCRIPT end_POSTSUBSCRIPT ) italic_f ( italic_s ) .

Therefore, it holds

ddsf(s)F2=dd𝑠superscriptsubscriptnorm𝑓𝑠F2absent\displaystyle\frac{\mathrm{d}}{\mathrm{d}s}\|f(s)\|_{\mathrm{F}}^{2}=divide start_ARG roman_d end_ARG start_ARG roman_d italic_s end_ARG ∥ italic_f ( italic_s ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = ddsTr(f(s)f(s))dd𝑠Tr𝑓𝑠superscript𝑓top𝑠\displaystyle\frac{\mathrm{d}}{\mathrm{d}s}\mathrm{Tr}(f(s)f^{\top}(s))divide start_ARG roman_d end_ARG start_ARG roman_d italic_s end_ARG roman_Tr ( italic_f ( italic_s ) italic_f start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_s ) )
=\displaystyle== Tr(f(s)(Z𝜹,𝒀(s)+Z𝒀(s),𝜹)f(s)f(s))Tr(f(s)f(s)(Z𝒀(s),𝜹+Z𝜹,𝒀(s))f(s))Tr𝑓𝑠subscript𝑍𝜹𝒀𝑠subscript𝑍𝒀𝑠𝜹𝑓𝑠superscript𝑓top𝑠Tr𝑓𝑠superscript𝑓top𝑠subscript𝑍𝒀𝑠𝜹subscript𝑍𝜹𝒀𝑠superscript𝑓top𝑠\displaystyle-\mathrm{Tr}\bigl{(}f(s)(Z_{\boldsymbol{\delta},\boldsymbol{Y}(s)% }+Z_{\boldsymbol{Y}(s),\boldsymbol{\delta}})f(s)f^{\top}(s)\bigr{)}-\mathrm{{% Tr}}\bigl{(}f(s)f^{\top}(s)(Z_{\boldsymbol{Y}(s),\boldsymbol{\delta}}+Z_{% \boldsymbol{\delta},\boldsymbol{Y}(s)})f^{\top}(s)\bigr{)}- roman_Tr ( italic_f ( italic_s ) ( italic_Z start_POSTSUBSCRIPT bold_italic_δ , bold_italic_Y ( italic_s ) end_POSTSUBSCRIPT + italic_Z start_POSTSUBSCRIPT bold_italic_Y ( italic_s ) , bold_italic_δ end_POSTSUBSCRIPT ) italic_f ( italic_s ) italic_f start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_s ) ) - roman_Tr ( italic_f ( italic_s ) italic_f start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_s ) ( italic_Z start_POSTSUBSCRIPT bold_italic_Y ( italic_s ) , bold_italic_δ end_POSTSUBSCRIPT + italic_Z start_POSTSUBSCRIPT bold_italic_δ , bold_italic_Y ( italic_s ) end_POSTSUBSCRIPT ) italic_f start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( italic_s ) )
\displaystyle\leq 2Z𝜹,𝒀(s)+Z𝒀(s),𝜹Ff3(s)F2subscriptnormsubscript𝑍𝜹𝒀𝑠subscript𝑍𝒀𝑠𝜹Fsubscriptnormsuperscript𝑓3𝑠F\displaystyle 2\|Z_{\boldsymbol{\delta},\boldsymbol{Y}(s)}+Z_{\boldsymbol{Y}(s% ),\boldsymbol{\delta}}\|_{\mathrm{F}}\|f^{3}(s)\|_{\mathrm{F}}2 ∥ italic_Z start_POSTSUBSCRIPT bold_italic_δ , bold_italic_Y ( italic_s ) end_POSTSUBSCRIPT + italic_Z start_POSTSUBSCRIPT bold_italic_Y ( italic_s ) , bold_italic_δ end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ∥ italic_f start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT ( italic_s ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT
\displaystyle\leq 2(Z𝜹,𝒀(s)F+Z𝒀(s),𝜹F)f3(s)F2subscriptnormsubscript𝑍𝜹𝒀𝑠Fsubscriptnormsubscript𝑍𝒀𝑠𝜹Fsubscriptnormsuperscript𝑓3𝑠F\displaystyle 2(\|Z_{\boldsymbol{\delta},\boldsymbol{Y}(s)}\|_{\mathrm{F}}+\|Z% _{\boldsymbol{Y}(s),\boldsymbol{\delta}}\|_{\mathrm{F}})\|f^{3}(s)\|_{\mathrm{% F}}2 ( ∥ italic_Z start_POSTSUBSCRIPT bold_italic_δ , bold_italic_Y ( italic_s ) end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT + ∥ italic_Z start_POSTSUBSCRIPT bold_italic_Y ( italic_s ) , bold_italic_δ end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ) ∥ italic_f start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT ( italic_s ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT
\displaystyle\leq 4(𝜹[H]R𝒀(s)[H]R)f(s)F34subscriptnorm𝜹superscriptdelimited-[]𝐻𝑅subscriptnorm𝒀𝑠superscriptdelimited-[]𝐻𝑅superscriptsubscriptnorm𝑓𝑠F3\displaystyle 4(\|\boldsymbol{\delta}\|_{[H]^{R}}\|\boldsymbol{Y}(s)\|_{[H]^{R% }})\|f(s)\|_{\mathrm{F}}^{3}4 ( ∥ bold_italic_δ ∥ start_POSTSUBSCRIPT [ italic_H ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∥ bold_italic_Y ( italic_s ) ∥ start_POSTSUBSCRIPT [ italic_H ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ) ∥ italic_f ( italic_s ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT
\displaystyle\leq 4(ρ+s)f(s)F3.4𝜌𝑠superscriptsubscriptnorm𝑓𝑠F3\displaystyle 4(\rho+s)\|f(s)\|_{\mathrm{F}}^{3}.4 ( italic_ρ + italic_s ) ∥ italic_f ( italic_s ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT .

Let Es=f(s)F2subscript𝐸𝑠superscriptsubscriptnorm𝑓𝑠F2E_{s}=\|f(s)\|_{\mathrm{F}}^{2}italic_E start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT = ∥ italic_f ( italic_s ) ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT so that Es32dEsds4(ρ+s)superscriptsubscript𝐸𝑠32dsubscript𝐸𝑠d𝑠4𝜌𝑠E_{s}^{-\frac{3}{2}}\frac{\mathrm{d}E_{s}}{\mathrm{d}s}\leq 4(\rho+s)italic_E start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - divide start_ARG 3 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT divide start_ARG roman_d italic_E start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_ARG start_ARG roman_d italic_s end_ARG ≤ 4 ( italic_ρ + italic_s ) and

0r2d(Es1/2)dsds=0rEs32dEsdsds4ρr+2r2,superscriptsubscript0𝑟2dsuperscriptsubscript𝐸𝑠12d𝑠differential-d𝑠superscriptsubscript0𝑟superscriptsubscript𝐸𝑠32dsubscript𝐸𝑠d𝑠differential-d𝑠4𝜌𝑟2superscript𝑟2\int_{0}^{r}2\frac{\mathrm{d}(-E_{s}^{-1/2})}{\mathrm{d}s}\mathrm{d}s=\int_{0}% ^{r}E_{s}^{-\frac{3}{2}}\frac{\mathrm{d}E_{s}}{\mathrm{d}s}\mathrm{d}s\leq 4% \rho r+2r^{2},∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_r end_POSTSUPERSCRIPT 2 divide start_ARG roman_d ( - italic_E start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 / 2 end_POSTSUPERSCRIPT ) end_ARG start_ARG roman_d italic_s end_ARG roman_d italic_s = ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_r end_POSTSUPERSCRIPT italic_E start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - divide start_ARG 3 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT divide start_ARG roman_d italic_E start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_ARG start_ARG roman_d italic_s end_ARG roman_d italic_s ≤ 4 italic_ρ italic_r + 2 italic_r start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ,

which implies 2Er12+2E0124ρr+2r22superscriptsubscript𝐸𝑟122superscriptsubscript𝐸0124𝜌𝑟2superscript𝑟2-2E_{r}^{-\frac{1}{2}}+2E_{0}^{-\frac{1}{2}}\leq 4\rho r+2r^{2}- 2 italic_E start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - divide start_ARG 1 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT + 2 italic_E start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - divide start_ARG 1 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT ≤ 4 italic_ρ italic_r + 2 italic_r start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT. Now we use E0γ2subscript𝐸0superscript𝛾2E_{0}\leq\gamma^{2}italic_E start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ≤ italic_γ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT to obtain the bound γ12ρrr2Er12superscript𝛾12𝜌𝑟superscript𝑟2superscriptsubscript𝐸𝑟12\gamma^{-1}-2\rho r-r^{2}\leq E_{r}^{-\frac{1}{2}}italic_γ start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT - 2 italic_ρ italic_r - italic_r start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ italic_E start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - divide start_ARG 1 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT. For any 0<r<ρ+ρ2+1γ0𝑟𝜌superscript𝜌21𝛾0<r<-\rho+\sqrt{\rho^{2}+\frac{1}{\gamma}}0 < italic_r < - italic_ρ + square-root start_ARG italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + divide start_ARG 1 end_ARG start_ARG italic_γ end_ARG end_ARG, we have 1γ2ρrr2>01𝛾2𝜌𝑟superscript𝑟20\frac{1}{\gamma}-2\rho r-r^{2}>0divide start_ARG 1 end_ARG start_ARG italic_γ end_ARG - 2 italic_ρ italic_r - italic_r start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT > 0 and thus this bound yields

Z𝒀r1F11γ2ρrr2=11γ+ρ2(ρ+r)2.subscriptnormsuperscriptsubscript𝑍subscript𝒀𝑟1F11𝛾2𝜌𝑟superscript𝑟211𝛾superscript𝜌2superscript𝜌𝑟2\|Z_{\boldsymbol{Y}_{r}}^{-1}\|_{\mathrm{F}}\leq\frac{1}{\frac{1}{\gamma}-2% \rho r-r^{2}}=\frac{1}{\frac{1}{\gamma}+\rho^{2}-(\rho+r)^{2}}.∥ italic_Z start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ divide start_ARG 1 end_ARG start_ARG divide start_ARG 1 end_ARG start_ARG italic_γ end_ARG - 2 italic_ρ italic_r - italic_r start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG = divide start_ARG 1 end_ARG start_ARG divide start_ARG 1 end_ARG start_ARG italic_γ end_ARG + italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - ( italic_ρ + italic_r ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG .

Then, Z𝒀r1F24γ2superscriptsubscriptnormsuperscriptsubscript𝑍subscript𝒀𝑟1F24superscript𝛾2\|Z_{\boldsymbol{Y}_{r}}^{-1}\|_{\mathrm{F}}^{2}\leq 4\gamma^{2}∥ italic_Z start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ 4 italic_γ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT is guaranteed by the condition 0<rρ+ρ2+12γ0𝑟𝜌superscript𝜌212𝛾0<r\leq-\rho+\sqrt{\rho^{2}+\frac{1}{2\gamma}}0 < italic_r ≤ - italic_ρ + square-root start_ARG italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + divide start_ARG 1 end_ARG start_ARG 2 italic_γ end_ARG end_ARG, which also implies 1γ2ρrr2>01𝛾2𝜌𝑟superscript𝑟20\frac{1}{\gamma}-2\rho r-r^{2}>0divide start_ARG 1 end_ARG start_ARG italic_γ end_ARG - 2 italic_ρ italic_r - italic_r start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT > 0 above. Finally, the function η(ρ,γ)𝜂𝜌𝛾\eta(\rho,\gamma)italic_η ( italic_ρ , italic_γ ), defined as in (A.1), is decreasing in ρ𝜌\rhoitalic_ρ and γ𝛾\gammaitalic_γ:

ηρ𝜂𝜌\displaystyle\frac{\partial\eta}{\partial\rho}divide start_ARG ∂ italic_η end_ARG start_ARG ∂ italic_ρ end_ARG =ρρ2+12γ1<0,ρ,γ>0;formulae-sequenceabsent𝜌superscript𝜌212𝛾10for-all𝜌𝛾0\displaystyle=\frac{\rho}{\sqrt{\rho^{2}+\frac{1}{2\gamma}}}-1<0,\quad\forall% \rho,\gamma>0;= divide start_ARG italic_ρ end_ARG start_ARG square-root start_ARG italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + divide start_ARG 1 end_ARG start_ARG 2 italic_γ end_ARG end_ARG end_ARG - 1 < 0 , ∀ italic_ρ , italic_γ > 0 ;
ηγ𝜂𝛾\displaystyle\frac{\partial\eta}{\partial\gamma}divide start_ARG ∂ italic_η end_ARG start_ARG ∂ italic_γ end_ARG =14γ21ρ2+12γ<0,ρ,γ>0.formulae-sequenceabsent14superscript𝛾21superscript𝜌212𝛾0for-all𝜌𝛾0\displaystyle=-\frac{1}{4\gamma^{2}}\frac{1}{\sqrt{\rho^{2}+\frac{1}{2\gamma}}% }<0,\quad\forall\rho,\gamma>0.= - divide start_ARG 1 end_ARG start_ARG 4 italic_γ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG divide start_ARG 1 end_ARG start_ARG square-root start_ARG italic_ρ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + divide start_ARG 1 end_ARG start_ARG 2 italic_γ end_ARG end_ARG end_ARG < 0 , ∀ italic_ρ , italic_γ > 0 .

Recall that a finite rank function XL2(Ω;H)𝑋superscript𝐿2Ω𝐻X\in L^{2}\left(\Omega;H\right)italic_X ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) admits a representation reminiscent of the singular value decomposition as in (A.2) below; see [kazashi2021existence, Lemma 2.1], as well as Lemma 2.2 and Remark 2.3. For this decomposition, in Proposition A.3 we show that projector-valued mappings, where the projection is onto the space spanned by the spatial basis of this decomposition, are Lipschitz continuous. In order to achieve this goal, we need the following Lemma A.2. The proofs of Lemma A.2 and Proposition A.3 follow closely [bachmayr2021existence, Proof of Lemma A.2]; see also [wei2016guarantees, Lemmata 4.1 and 4.2] for a finite dimensional version. However, unlike [bachmayr2021existence, Lemma A.2] we do not assume L2(Ω;H)superscript𝐿2Ω𝐻L^{2}(\Omega;H)italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) to be separable.

Lemma A.2.

Consider X,X^L2(Ω;H)𝑋^𝑋superscript𝐿2Ω𝐻X,\hat{X}\in L^{2}(\Omega;H)italic_X , over^ start_ARG italic_X end_ARG ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) that have the following representations

X=j=1RσjUjVj,X^=j=1Rσ^jU^jV^j,formulae-sequence𝑋superscriptsubscript𝑗1𝑅subscript𝜎𝑗subscript𝑈𝑗subscript𝑉𝑗^𝑋superscriptsubscript𝑗1𝑅subscript^𝜎𝑗subscript^𝑈𝑗subscript^𝑉𝑗X=\sum_{j=1}^{R}\sigma_{j}U_{j}V_{j},\quad\hat{X}=\sum_{j=1}^{R}\hat{\sigma}_{% j}\hat{U}_{j}\hat{V}_{j},italic_X = ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_σ start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_X end_ARG = ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT over^ start_ARG italic_σ end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , (A.2)

with σj,σ^j>0subscript𝜎𝑗subscript^𝜎𝑗0\sigma_{j},\hat{\sigma}_{j}>0italic_σ start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_σ end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT > 0, and Uj,U^jHsubscript𝑈𝑗subscript^𝑈𝑗𝐻U_{j},\hat{U}_{j}\in Hitalic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_U end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∈ italic_H, Vj,V^jL2(Ω;)subscript𝑉𝑗subscript^𝑉𝑗superscript𝐿2ΩV_{j},\hat{V}_{j}\in L^{2}(\Omega;\mathbb{R})italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; blackboard_R ) all orthonormal in their respective Hilbert spaces, for j=1,,R𝑗1𝑅j=1,\dots,Ritalic_j = 1 , … , italic_R. Here, σjsubscript𝜎𝑗\sigma_{j}italic_σ start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT and σ^jsubscript^𝜎𝑗\hat{\sigma}_{j}over^ start_ARG italic_σ end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT, j=1,,R𝑗1𝑅j=1,\dots,Ritalic_j = 1 , … , italic_R, are ordered in the descending order. Define the projections PU=j=1RUj,HUj:L2(Ω;H)L2(Ω;H):subscript𝑃𝑈superscriptsubscript𝑗1𝑅subscriptsubscript𝑈𝑗𝐻subscript𝑈𝑗superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻P_{U}=\sum_{j=1}^{R}\langle U_{j},\cdot\rangle_{H}U_{j}:L^{2}(\Omega;H)\to L^{% 2}(\Omega;H)italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT = ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , ⋅ ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT : italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ), PV=j=1R𝔼[Vj]Vj:L2(Ω;H)L2(Ω;H)P_{V}=\sum_{j=1}^{R}\mathbb{E}[V_{j}\,\cdot\,]V_{j}:L^{2}(\Omega;H)\to L^{2}(% \Omega;H)italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT = ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ⋅ ] italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT : italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ), PU:=idPUassignsubscript𝑃superscript𝑈perpendicular-toidsubscript𝑃𝑈P_{U^{\perp}}:=\mathrm{id}-P_{U}italic_P start_POSTSUBSCRIPT italic_U start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT := roman_id - italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT, and PV:=idPVassignsubscript𝑃superscript𝑉perpendicular-toidsubscript𝑃𝑉P_{V^{\perp}}:=\mathrm{id}-P_{V}italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT := roman_id - italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT; and similarly for PU^subscript𝑃^𝑈P_{\hat{U}}italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT, PU^subscript𝑃superscript^𝑈perpendicular-toP_{\hat{U}^{\perp}}italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT, PV^subscript𝑃^𝑉P_{\hat{V}}italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT, and PV^subscript𝑃superscript^𝑉perpendicular-toP_{\hat{V}^{\perp}}italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT. Then, we have

PUPU^L2(Ω;H)L2(Ω;H)subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle\|P_{U}-P_{\hat{U}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT =PU^PUL2(Ω;H)L2(Ω;H)=PU^PUL2(Ω;H)L2(Ω;H);absentsubscriptnormsubscript𝑃superscript^𝑈perpendicular-tosubscript𝑃𝑈superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻subscriptnormsubscript𝑃^𝑈subscript𝑃superscript𝑈perpendicular-tosuperscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle=\|P_{\hat{U}^{\perp}}P_{U}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)% }=\|P_{\hat{U}}P_{U^{\perp}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)};= ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_U start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT ; (A.3)
PVPV^L2(Ω;H)L2(Ω;H)subscriptnormsubscript𝑃𝑉subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle\|P_{V}-P_{\hat{V}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT =PV^PVL2(Ω;H)L2(Ω;H)=PV^PVL2(Ω;H)L2(Ω;H).absentsubscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻subscriptnormsubscript𝑃^𝑉subscript𝑃superscript𝑉perpendicular-tosuperscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle=\|P_{\hat{V}^{\perp}}P_{V}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)% }=\|P_{\hat{V}}P_{V^{\perp}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}.= ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT .
Proof.

The mappings PUsubscript𝑃𝑈P_{U}italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT and PVsubscript𝑃𝑉P_{V}italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT are orthogonal projections. Indeed, the idempotency of PUsubscript𝑃𝑈P_{U}italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT and PVsubscript𝑃𝑉P_{V}italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT can be easily checked and the L2(Ω;H)superscript𝐿2Ω𝐻L^{2}(\Omega;H)italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H )-orthogonality of PUsubscript𝑃𝑈P_{U}italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT follows from its H𝐻Hitalic_H-orthogonality. To show the orthogonality of PVsubscript𝑃𝑉P_{V}italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT, first consider z,wL2(Ω;H)𝑧𝑤superscript𝐿2Ω𝐻z,w\in L^{2}(\Omega;H)italic_z , italic_w ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ). Noting that 𝔼[Vkw],H:HH:subscript𝔼delimited-[]subscript𝑉𝑘𝑤𝐻𝐻𝐻\langle\mathbb{E}[V_{k}w],\cdot\rangle_{H}\colon H\to H⟨ blackboard_E [ italic_V start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT italic_w ] , ⋅ ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT : italic_H → italic_H is a continuous linear functional on H𝐻Hitalic_H for k=1,,R𝑘1𝑅k=1,\dots,Ritalic_k = 1 , … , italic_R, from [Leoni.G_2017_book_Sobolev_2nd, Theorem 8.13] we have:

z,PVwL2(Ω;H)subscript𝑧subscript𝑃𝑉𝑤superscript𝐿2Ω𝐻\displaystyle\langle z,P_{V}w\rangle_{L^{2}(\Omega;H)}⟨ italic_z , italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_w ⟩ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT =𝔼[z,k=1R𝔼[wVk]VkH]=k=1R𝔼[z,𝔼[wVk]VkH]absent𝔼delimited-[]subscript𝑧superscriptsubscript𝑘1𝑅𝔼delimited-[]𝑤subscript𝑉𝑘subscript𝑉𝑘𝐻superscriptsubscript𝑘1𝑅𝔼delimited-[]subscript𝑧𝔼delimited-[]𝑤subscript𝑉𝑘subscript𝑉𝑘𝐻\displaystyle=\mathbb{E}[\langle z,\sum_{k=1}^{R}\mathbb{E}[wV_{k}]V_{k}% \rangle_{H}]=\sum_{k=1}^{R}\mathbb{E}[\langle z,\mathbb{E}[wV_{k}]V_{k}\rangle% _{H}]= blackboard_E [ ⟨ italic_z , ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ italic_w italic_V start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] italic_V start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ] = ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ ⟨ italic_z , blackboard_E [ italic_w italic_V start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] italic_V start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ]
=k=1R𝔼[zVk],𝔼[wVk]H=k=1R𝔼[𝔼[zVk],wVkH]=PVz,wL2(Ω;H).absentsuperscriptsubscript𝑘1𝑅subscript𝔼delimited-[]𝑧subscript𝑉𝑘𝔼delimited-[]𝑤subscript𝑉𝑘𝐻superscriptsubscript𝑘1𝑅𝔼delimited-[]subscript𝔼delimited-[]𝑧subscript𝑉𝑘𝑤subscript𝑉𝑘𝐻subscriptsubscript𝑃𝑉𝑧𝑤superscript𝐿2Ω𝐻\displaystyle=\sum_{k=1}^{R}\langle\mathbb{E}[zV_{k}],\mathbb{E}[wV_{k}]% \rangle_{H}=\sum_{k=1}^{R}\mathbb{E}[\langle\mathbb{E}[zV_{k}],wV_{k}\rangle_{% H}]=\langle P_{V}z,w\rangle_{L^{2}(\Omega;H)}.= ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ⟨ blackboard_E [ italic_z italic_V start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] , blackboard_E [ italic_w italic_V start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT = ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ ⟨ blackboard_E [ italic_z italic_V start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ] , italic_w italic_V start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ] = ⟨ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_z , italic_w ⟩ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT .

Similarly, PU^subscript𝑃^𝑈P_{\hat{U}}italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT and PV^subscript𝑃^𝑉P_{\hat{V}}italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT are orthogonal projections.

Let us prove the second identity in (A.3). For fL2(Ω;H)𝑓superscript𝐿2Ω𝐻f\in L^{2}(\Omega;H)italic_f ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ), we have

(PVPV^)f=(PV^+PV^)(PVPV^)(PV+PV)f=(PV^PVPV^PV)f,subscript𝑃𝑉subscript𝑃^𝑉𝑓subscript𝑃^𝑉subscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉subscript𝑃^𝑉subscript𝑃𝑉subscript𝑃superscript𝑉perpendicular-to𝑓subscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉subscript𝑃^𝑉subscript𝑃superscript𝑉perpendicular-to𝑓(P_{V}-P_{\hat{V}})f=(P_{\hat{V}}+P_{\hat{V}^{\perp}})(P_{V}-P_{\hat{V}})(P_{V% }+P_{V^{\perp}})f=(P_{\hat{V}^{\perp}}P_{V}-P_{\hat{V}}P_{V^{\perp}})f,( italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) italic_f = ( italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT + italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ) ( italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) ( italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT + italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ) italic_f = ( italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ) italic_f , (A.4)

As PV^subscript𝑃^𝑉P_{\hat{V}}italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT is an orthogonal projector, 𝔼[PV^f,PV^gH]=0𝔼delimited-[]subscriptsubscript𝑃superscript^𝑉perpendicular-to𝑓subscript𝑃^𝑉𝑔𝐻0\mathbb{E}[\langle P_{\hat{V}^{\perp}}f,P_{\hat{V}}g\rangle_{H}]=0blackboard_E [ ⟨ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f , italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_g ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ] = 0 for any f,gL2(Ω;H)𝑓𝑔superscript𝐿2Ω𝐻f,g\in L^{2}(\Omega;H)italic_f , italic_g ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ). Hence, together with (A.4), for all fL2(Ω;H)𝑓superscript𝐿2Ω𝐻f\in L^{2}(\Omega;H)italic_f ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) one has

(PVPV^)fL2(Ω;H)2=PV^PVfL2(Ω;H)2+PV^PVfL2(Ω;H)2.superscriptsubscriptnormsubscript𝑃𝑉subscript𝑃^𝑉𝑓superscript𝐿2Ω𝐻2superscriptsubscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻2superscriptsubscriptnormsubscript𝑃^𝑉subscript𝑃superscript𝑉perpendicular-to𝑓superscript𝐿2Ω𝐻2\|(P_{V}-P_{\hat{V}})f\|_{L^{2}(\Omega;H)}^{2}=\|P_{\hat{V}^{\perp}}P_{V}f\|_{% L^{2}(\Omega;H)}^{2}+\|P_{\hat{V}}P_{V^{\perp}}f\|_{L^{2}(\Omega;H)}^{2}.∥ ( italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT . (A.5)

Moreover, for any fL2(Ω;H)𝑓superscript𝐿2Ω𝐻f\in L^{2}(\Omega;H)italic_f ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) it also holds

fL2(Ω;H)2=PVfL2(Ω;H)2+PVfL2(Ω;H)2,superscriptsubscriptnorm𝑓superscript𝐿2Ω𝐻2superscriptsubscriptnormsubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻2superscriptsubscriptnormsubscript𝑃superscript𝑉perpendicular-to𝑓superscript𝐿2Ω𝐻2\|f\|_{L^{2}(\Omega;H)}^{2}=\|P_{V}f\|_{L^{2}(\Omega;H)}^{2}+\|P_{V^{\perp}}f% \|_{L^{2}(\Omega;H)}^{2},∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = ∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ∥ italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT , (A.6)

and

f=PVfL2(Ω;H)f~1+PVfL2(Ω;H)f~2𝑓subscriptnormsubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻subscript~𝑓1subscriptnormsubscript𝑃superscript𝑉perpendicular-to𝑓superscript𝐿2Ω𝐻subscript~𝑓2f=\|P_{V}f\|_{L^{2}(\Omega;H)}\tilde{f}_{1}+\|P_{V^{\perp}}f\|_{L^{2}(\Omega;H% )}\tilde{f}_{2}italic_f = ∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT over~ start_ARG italic_f end_ARG start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT + ∥ italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT over~ start_ARG italic_f end_ARG start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT (A.7)

with unit vectors f~1:=PVf/PVfL2(Ω;H)assignsubscript~𝑓1subscript𝑃𝑉𝑓subscriptnormsubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻\tilde{f}_{1}:=P_{V}f/\|P_{V}f\|_{L^{2}(\Omega;H)}over~ start_ARG italic_f end_ARG start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT := italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f / ∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT and f~2:=PVf/PVfL2(Ω;H)assignsubscript~𝑓2subscript𝑃superscript𝑉perpendicular-to𝑓subscriptnormsubscript𝑃superscript𝑉perpendicular-to𝑓superscript𝐿2Ω𝐻\tilde{f}_{2}:=P_{V^{\perp}}f/\|P_{V^{\perp}}f\|_{L^{2}(\Omega;H)}over~ start_ARG italic_f end_ARG start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT := italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f / ∥ italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT. From (A.5) , one has

(PVPV^)fL2(Ω;H)2superscriptsubscriptnormsubscript𝑃𝑉subscript𝑃^𝑉𝑓superscript𝐿2Ω𝐻2\displaystyle\|(P_{V}-P_{\hat{V}})f\|_{L^{2}(\Omega;H)}^{2}∥ ( italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT =PVfL2(Ω;H)2PV^PVf~1L2(Ω;H)2+PVfL2(Ω;H)2PV^PVf~2L2(Ω;H)2absentsuperscriptsubscriptnormsubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻2superscriptsubscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉subscript~𝑓1superscript𝐿2Ω𝐻2superscriptsubscriptnormsubscript𝑃superscript𝑉perpendicular-to𝑓superscript𝐿2Ω𝐻2superscriptsubscriptnormsubscript𝑃^𝑉subscript𝑃superscript𝑉perpendicular-tosubscript~𝑓2superscript𝐿2Ω𝐻2\displaystyle=\|P_{V}f\|_{L^{2}(\Omega;H)}^{2}\|P_{\hat{V}^{\perp}}P_{V}\tilde% {f}_{1}\|_{L^{2}(\Omega;H)}^{2}+\|P_{V^{\perp}}f\|_{L^{2}(\Omega;H)}^{2}\|P_{% \hat{V}}P_{V^{\perp}}\tilde{f}_{2}\|_{L^{2}(\Omega;H)}^{2}= ∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT over~ start_ARG italic_f end_ARG start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ∥ italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT over~ start_ARG italic_f end_ARG start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT
(PVfL2(Ω;H)2\displaystyle\leq(\|P_{V}f\|_{L^{2}(\Omega;H)}^{2}≤ ( ∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT +PVfL2(Ω;H)2)max{PV^PVf~1L2(Ω;H)2,PV^PVf~2L2(Ω;H)2}.\displaystyle+\|P_{V^{\perp}}f\|_{L^{2}(\Omega;H)}^{2})\max\big{\{}\|P_{\hat{V% }^{\perp}}P_{V}\tilde{f}_{1}\|_{L^{2}(\Omega;H)}^{2},\|P_{\hat{V}}P_{V^{\perp}% }\tilde{f}_{2}\|_{L^{2}(\Omega;H)}^{2}\big{\}}.+ ∥ italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) roman_max { ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT over~ start_ARG italic_f end_ARG start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT , ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT over~ start_ARG italic_f end_ARG start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT } .

Using (A.6) and f~1L2(Ω;H)=f~2L2(Ω;H)=1subscriptnormsubscript~𝑓1superscript𝐿2Ω𝐻subscriptnormsubscript~𝑓2superscript𝐿2Ω𝐻1\|\tilde{f}_{1}\|_{L^{2}(\Omega;H)}=\|\tilde{f}_{2}\|_{L^{2}(\Omega;H)}=1∥ over~ start_ARG italic_f end_ARG start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = ∥ over~ start_ARG italic_f end_ARG start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = 1, we obtain

PVPV^L2(Ω;H)L2(Ω;H)max{PV^PVL2(Ω;H)L2(Ω;H),PV^PVL2(Ω;H)L2(Ω;H)}.subscriptnormsubscript𝑃𝑉subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻subscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻subscriptnormsubscript𝑃^𝑉subscript𝑃superscript𝑉perpendicular-tosuperscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\|P_{V}-P_{\hat{V}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}\leq\max\big{\{}\|P_% {\hat{V}^{\perp}}P_{V}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)},\|P_{\hat{V}}P_{% V^{\perp}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}\big{\}}.∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT ≤ roman_max { ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT , ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT } .

To show the opposite inequality we first notice that

PV^PVL2(Ω;H)L2(Ω;H)2subscriptsuperscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉2superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle\|P_{\hat{V}^{\perp}}P_{V}\|^{2}_{L^{2}(\Omega;H)\to L^{2}(\Omega% ;H)}∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT =supfL2(Ω;H)=1PV^PVfL2(Ω;H)2absentsubscriptsupremumsubscriptnorm𝑓superscript𝐿2Ω𝐻1superscriptsubscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻2\displaystyle=\sup\limits_{\|f\|_{L^{2}(\Omega;H)}=1}\|P_{\hat{V}^{\perp}}P_{V% }f\|_{L^{2}(\Omega;H)}^{2}= roman_sup start_POSTSUBSCRIPT ∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT
=supfL2(Ω;H)=1,PVf=0PV^PVfL2(Ω;H)2.absentsubscriptsupremumformulae-sequencesubscriptnorm𝑓superscript𝐿2Ω𝐻1subscript𝑃superscript𝑉perpendicular-to𝑓0superscriptsubscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻2\displaystyle=\sup\limits_{\|f\|_{L^{2}(\Omega;H)}=1,\,P_{V^{\perp}}f=0}\|P_{% \hat{V}^{\perp}}P_{V}f\|_{L^{2}(\Omega;H)}^{2}.= roman_sup start_POSTSUBSCRIPT ∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = 1 , italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f = 0 end_POSTSUBSCRIPT ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT .

Therefore, from (A.5) one has

PVPV^L2(Ω;H)L2(Ω;H)2superscriptsubscriptnormsubscript𝑃𝑉subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻2\displaystyle\|P_{V}-P_{\hat{V}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}^{2}∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT supfL2(Ω;H)=1,PVf=0PV^PVfL2(Ω;H)2absentsubscriptsupremumformulae-sequencesubscriptnorm𝑓superscript𝐿2Ω𝐻1subscript𝑃superscript𝑉perpendicular-to𝑓0superscriptsubscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻2\displaystyle\geq\sup_{\|f\|_{L^{2}(\Omega;H)}=1,\,P_{V^{\perp}}f=0}\|P_{\hat{% V}^{\perp}}P_{V}f\|_{L^{2}(\Omega;H)}^{2}≥ roman_sup start_POSTSUBSCRIPT ∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = 1 , italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f = 0 end_POSTSUBSCRIPT ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT
=supfL2(Ω;H)=1PV^PVfL2(Ω;H)2=PV^PVL2(Ω;H)L2(Ω;H)2.absentsubscriptsupremumsubscriptnorm𝑓superscript𝐿2Ω𝐻1superscriptsubscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻2superscriptsubscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻2\displaystyle=\sup_{\|f\|_{L^{2}(\Omega;H)}=1}\|P_{\hat{V}^{\perp}}P_{V}f\|_{L% ^{2}(\Omega;H)}^{2}=\|P_{\hat{V}^{\perp}}P_{V}\|_{L^{2}(\Omega;H)\to L^{2}(% \Omega;H)}^{2}.= roman_sup start_POSTSUBSCRIPT ∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT .

Similarly, PVPV^L2(Ω;H)L2(Ω;H)PV^PVL2(Ω;H)L2(Ω;H).subscriptnormsubscript𝑃𝑉subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻subscriptnormsubscript𝑃^𝑉subscript𝑃superscript𝑉perpendicular-tosuperscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\|P_{V}-P_{\hat{V}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}\geq\|P_{\hat{V}}P_{% V^{\perp}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}.∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT ≥ ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT . Hence,

PVPV^L2(Ω;H)L2(Ω;H)=max{PV^PVL2(Ω;H)L2(Ω;H),PV^PVL2(Ω;H)L2(Ω;H)}.subscriptnormsubscript𝑃𝑉subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻subscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻subscriptnormsubscript𝑃^𝑉subscript𝑃superscript𝑉perpendicular-tosuperscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\|P_{V}-P_{\hat{V}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}=\max\big{\{}\|P_{% \hat{V}^{\perp}}P_{V}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)},\|P_{\hat{V}}P_{V% ^{\perp}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}\big{\}}.∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = roman_max { ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT , ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT } .

Finally, let us prove that PV^PVL2(Ω;H)L2(Ω;H)=PV^PVL2(Ω;H)L2(Ω;H)subscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻subscriptnormsubscript𝑃^𝑉subscript𝑃superscript𝑉perpendicular-tosuperscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\|P_{\hat{V}^{\perp}}P_{V}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}=\|P_{\hat{V}% }P_{V^{\perp}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT. First define the vector space HR:=[H]Rassignsuperscript𝐻𝑅superscriptdelimited-[]𝐻𝑅H^{R}:=[H]^{R}italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT := [ italic_H ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT and endow it with the norm zHR=j=1RzjH2subscriptnorm𝑧superscript𝐻𝑅superscriptsubscript𝑗1𝑅subscriptsuperscriptnormsubscript𝑧𝑗2𝐻\|z\|_{H^{R}}=\sqrt{\sum_{j=1}^{R}\|z_{j}\|^{2}_{H}}∥ italic_z ∥ start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = square-root start_ARG ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∥ italic_z start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT end_ARG for z=(zj)j=1,,RHR𝑧subscriptsubscript𝑧𝑗𝑗1𝑅superscript𝐻𝑅z=(z_{j})_{j=1,\dots,R}\in H^{R}italic_z = ( italic_z start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_j = 1 , … , italic_R end_POSTSUBSCRIPT ∈ italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT. Thanks to the orthogonality of (Vj)jsubscriptsubscript𝑉𝑗𝑗(V_{j})_{j}( italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT and the properties of orthogonal projectors, the following chain of equalities holds:

PV^PVL2(Ω;H)L2(Ω;H)2subscriptsuperscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉2superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle\|P_{\hat{V}^{\perp}}P_{V}\|^{2}_{L^{2}(\Omega;H)\to L^{2}(\Omega% ;H)}∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT =supfL2(Ω;H)=1PV^j=1R𝔼[Vjf]VjL2(Ω;H)2absentsubscriptsupremumsubscriptnorm𝑓superscript𝐿2Ω𝐻1subscriptsuperscriptnormsubscript𝑃superscript^𝑉perpendicular-tosuperscriptsubscript𝑗1𝑅𝔼delimited-[]subscript𝑉𝑗𝑓subscript𝑉𝑗2superscript𝐿2Ω𝐻\displaystyle=\sup\limits_{\|f\|_{L^{2}(\Omega;H)}=1}\Big{\|}P_{\hat{V}^{\perp% }}\sum_{j=1}^{R}\mathbb{E}[V_{j}f]V_{j}\Big{\|}^{2}_{L^{2}(\Omega;H)}= roman_sup start_POSTSUBSCRIPT ∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_f ] italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT (A.8)
=supfL2(Ω;H)=1,PVf=0PV^j=1R𝔼[Vjf]VjL2(Ω;H)2absentsubscriptsupremumformulae-sequencesubscriptnorm𝑓superscript𝐿2Ω𝐻1subscript𝑃superscript𝑉perpendicular-to𝑓0subscriptsuperscriptnormsubscript𝑃superscript^𝑉perpendicular-tosuperscriptsubscript𝑗1𝑅𝔼delimited-[]subscript𝑉𝑗𝑓subscript𝑉𝑗2superscript𝐿2Ω𝐻\displaystyle=\sup\limits_{\|f\|_{L^{2}(\Omega;H)}=1,\,P_{V^{\perp}}f=0}\Big{% \|}P_{\hat{V}^{\perp}}\sum_{j=1}^{R}\mathbb{E}[V_{j}f]V_{j}\Big{\|}^{2}_{L^{2}% (\Omega;H)}= roman_sup start_POSTSUBSCRIPT ∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = 1 , italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f = 0 end_POSTSUBSCRIPT ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_f ] italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT
=supxHR,xHR=1PV^j=1RxjVjL2(Ω;H)2absentsubscriptsupremumformulae-sequence𝑥superscript𝐻𝑅subscriptnorm𝑥superscript𝐻𝑅1subscriptsuperscriptnormsubscript𝑃superscript^𝑉perpendicular-tosuperscriptsubscript𝑗1𝑅subscript𝑥𝑗subscript𝑉𝑗2superscript𝐿2Ω𝐻\displaystyle=\sup\limits_{x\in H^{R},\|x\|_{H^{R}}=1}\Big{\|}P_{\hat{V}^{% \perp}}\sum_{j=1}^{R}x_{j}V_{j}\Big{\|}^{2}_{L^{2}(\Omega;H)}= roman_sup start_POSTSUBSCRIPT italic_x ∈ italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , ∥ italic_x ∥ start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_x start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT
=supxHR,xHR=1(j=1RxjVjL2(Ω;H)2PV^(j=1RxjVj)L2(Ω;H)2)absentsubscriptsupremumformulae-sequence𝑥superscript𝐻𝑅subscriptnorm𝑥superscript𝐻𝑅1subscriptsuperscriptnormsuperscriptsubscript𝑗1𝑅subscript𝑥𝑗subscript𝑉𝑗2superscript𝐿2Ω𝐻subscriptsuperscriptnormsubscript𝑃^𝑉superscriptsubscript𝑗1𝑅subscript𝑥𝑗subscript𝑉𝑗2superscript𝐿2Ω𝐻\displaystyle=\sup\limits_{x\in H^{R},\|x\|_{H^{R}}=1}\Big{(}\Big{\|}\sum_{j=1% }^{R}x_{j}V_{j}\Big{\|}^{2}_{L^{2}(\Omega;H)}-\Big{\|}P_{\hat{V}}\Big{(}\sum_{% j=1}^{R}x_{j}V_{j}\Big{)}\Big{\|}^{2}_{L^{2}(\Omega;H)}\Big{)}= roman_sup start_POSTSUBSCRIPT italic_x ∈ italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , ∥ italic_x ∥ start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ( ∥ ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_x start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT - ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ( ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_x start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ) ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT )
=1infxHR,xHR=1i=1RV^i𝔼[V^i(j=1RxjVj)]L2(Ω;H)2absent1subscriptinfimumformulae-sequence𝑥superscript𝐻𝑅subscriptnorm𝑥superscript𝐻𝑅1subscriptsuperscriptnormsuperscriptsubscript𝑖1𝑅subscript^𝑉𝑖𝔼delimited-[]subscript^𝑉𝑖superscriptsubscript𝑗1𝑅subscript𝑥𝑗subscript𝑉𝑗2superscript𝐿2Ω𝐻\displaystyle=1-\inf\limits_{x\in H^{R},\|x\|_{H^{R}}=1}\Big{\|}\sum_{i=1}^{R}% \hat{V}_{i}\mathbb{E}\Big{[}\hat{V}_{i}\Big{(}\sum_{j=1}^{R}x_{j}V_{j}\Big{)}% \Big{]}\Big{\|}^{2}_{L^{2}(\Omega;H)}= 1 - roman_inf start_POSTSUBSCRIPT italic_x ∈ italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , ∥ italic_x ∥ start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT blackboard_E [ over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ( ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_x start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ) ] ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT
=1infxHR,xHR=1i=1Rj=1Rxj𝔼[V^iVj]=:(G)ijH2absent1subscriptinfimumformulae-sequence𝑥superscript𝐻𝑅subscriptnorm𝑥superscript𝐻𝑅1superscriptsubscript𝑖1𝑅subscriptsuperscriptnormsuperscriptsubscript𝑗1𝑅subscript𝑥𝑗subscript𝔼delimited-[]subscript^𝑉𝑖subscript𝑉𝑗:absentsubscript𝐺𝑖𝑗2𝐻\displaystyle=1-\inf\limits_{x\in H^{R},\|x\|_{H^{R}}=1}\sum_{i=1}^{R}\Big{\|}% \sum_{j=1}^{R}x_{j}\underbrace{\mathbb{E}[\hat{V}_{i}V_{j}]}_{=:(G)_{ij}}\Big{% \|}^{2}_{H}= 1 - roman_inf start_POSTSUBSCRIPT italic_x ∈ italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , ∥ italic_x ∥ start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∥ ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_x start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT under⏟ start_ARG blackboard_E [ over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ] end_ARG start_POSTSUBSCRIPT = : ( italic_G ) start_POSTSUBSCRIPT italic_i italic_j end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT
=1infxHR,xHR=1GxHR2.absent1subscriptinfimumformulae-sequence𝑥superscript𝐻𝑅subscriptnorm𝑥superscript𝐻𝑅1subscriptsuperscriptnorm𝐺𝑥2superscript𝐻𝑅\displaystyle=1-\inf\limits_{x\in H^{R},\|x\|_{H^{R}}=1}\left\|Gx\right\|^{2}_% {H^{R}}.= 1 - roman_inf start_POSTSUBSCRIPT italic_x ∈ italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , ∥ italic_x ∥ start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ italic_G italic_x ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT .

Considering the Stiefel manifold St(H;R)={(q1,,qR):qiH,qi,qjH=δij,i,j=1,,R}St𝐻𝑅conditional-setsubscript𝑞1subscript𝑞𝑅formulae-sequencesubscript𝑞𝑖𝐻formulae-sequencesubscriptsubscript𝑞𝑖subscript𝑞𝑗𝐻subscript𝛿𝑖𝑗for-all𝑖𝑗1𝑅\mathrm{St}(H;R)=\{(q_{1},\dots,q_{R}):q_{i}\in H,\ \langle q_{i},q_{j}\rangle% _{H}=\delta_{ij},\ \forall i,j=1,\dots,R\}roman_St ( italic_H ; italic_R ) = { ( italic_q start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_q start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ) : italic_q start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ∈ italic_H , ⟨ italic_q start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT , italic_q start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT = italic_δ start_POSTSUBSCRIPT italic_i italic_j end_POSTSUBSCRIPT , ∀ italic_i , italic_j = 1 , … , italic_R } the following equality holds

infxHR,xHR=1GxHR2subscriptinfimumformulae-sequence𝑥superscript𝐻𝑅subscriptnorm𝑥superscript𝐻𝑅1subscriptsuperscriptnorm𝐺𝑥2superscript𝐻𝑅\displaystyle\inf\limits_{x\in H^{R},\|x\|_{H^{R}}=1}\|Gx\|^{2}_{H^{R}}roman_inf start_POSTSUBSCRIPT italic_x ∈ italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , ∥ italic_x ∥ start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ italic_G italic_x ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT =infxHR,xHR=1i=1Rj=1RxjGijH2absentsubscriptinfimumformulae-sequence𝑥superscript𝐻𝑅subscriptnorm𝑥superscript𝐻𝑅1superscriptsubscript𝑖1𝑅subscriptsuperscriptnormsuperscriptsubscript𝑗1𝑅subscript𝑥𝑗subscript𝐺𝑖𝑗2𝐻\displaystyle=\inf\limits_{x\in H^{R},\|x\|_{H^{R}}=1}\sum_{i=1}^{R}\Big{\|}% \sum_{j=1}^{R}x_{j}G_{ij}\Big{\|}^{2}_{H}= roman_inf start_POSTSUBSCRIPT italic_x ∈ italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , ∥ italic_x ∥ start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∥ ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_x start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_G start_POSTSUBSCRIPT italic_i italic_j end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT (A.9)
=inf(q1,qR)St(H;R)infb1,,bRRi=1Rbi22=1i=1Rj=1Rk=1Rbj(k)qkGijH2absentsubscriptinfimumsubscript𝑞1subscript𝑞𝑅St𝐻𝑅subscriptinfimumsubscript𝑏1subscript𝑏𝑅superscript𝑅superscriptsubscript𝑖1𝑅subscriptsuperscriptnormsubscript𝑏𝑖221superscriptsubscript𝑖1𝑅subscriptsuperscriptnormsuperscriptsubscript𝑗1𝑅superscriptsubscript𝑘1𝑅subscriptsuperscript𝑏𝑘𝑗subscript𝑞𝑘subscript𝐺𝑖𝑗2𝐻\displaystyle=\inf\limits_{(q_{1},\dots q_{R})\in\mathrm{St}(H;R)}\inf\limits_% {\begin{subarray}{c}b_{1},\dots,b_{R}\in\mathbb{R}^{R}\\ \sum_{i=1}^{R}\|b_{i}\|^{2}_{2}=1\end{subarray}}\sum_{i=1}^{R}\Big{\|}\sum_{j=% 1}^{R}\sum_{k=1}^{R}b^{(k)}_{j}q_{k}G_{ij}\Big{\|}^{2}_{H}= roman_inf start_POSTSUBSCRIPT ( italic_q start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … italic_q start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ) ∈ roman_St ( italic_H ; italic_R ) end_POSTSUBSCRIPT roman_inf start_POSTSUBSCRIPT start_ARG start_ROW start_CELL italic_b start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_b start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_CELL end_ROW start_ROW start_CELL ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∥ italic_b start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT = 1 end_CELL end_ROW end_ARG end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∥ ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_b start_POSTSUPERSCRIPT ( italic_k ) end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_q start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT italic_G start_POSTSUBSCRIPT italic_i italic_j end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT
=inf(q1,qR)St(H;R)infb1,,bRRi=1Rbi22=1i=1Rj=1Rl=1Rk=1Rbl(k)GilGijbj(k)absentsubscriptinfimumsubscript𝑞1subscript𝑞𝑅St𝐻𝑅subscriptinfimumsubscript𝑏1subscript𝑏𝑅superscript𝑅superscriptsubscript𝑖1𝑅subscriptsuperscriptnormsubscript𝑏𝑖221superscriptsubscript𝑖1𝑅superscriptsubscript𝑗1𝑅superscriptsubscript𝑙1𝑅superscriptsubscript𝑘1𝑅subscriptsuperscript𝑏𝑘𝑙subscript𝐺𝑖𝑙subscript𝐺𝑖𝑗subscriptsuperscript𝑏𝑘𝑗\displaystyle=\inf\limits_{(q_{1},\dots q_{R})\in\mathrm{St}(H;R)}\inf\limits_% {\begin{subarray}{c}b_{1},\dots,b_{R}\in\mathbb{R}^{R}\\ \sum_{i=1}^{R}\|b_{i}\|^{2}_{2}=1\end{subarray}}\sum_{i=1}^{R}\sum_{j=1}^{R}% \sum_{l=1}^{R}\sum_{k=1}^{R}b^{(k)}_{l}G_{il}G_{ij}b^{(k)}_{j}= roman_inf start_POSTSUBSCRIPT ( italic_q start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … italic_q start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ) ∈ roman_St ( italic_H ; italic_R ) end_POSTSUBSCRIPT roman_inf start_POSTSUBSCRIPT start_ARG start_ROW start_CELL italic_b start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_b start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_CELL end_ROW start_ROW start_CELL ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∥ italic_b start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT = 1 end_CELL end_ROW end_ARG end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_i = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_l = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_b start_POSTSUPERSCRIPT ( italic_k ) end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l end_POSTSUBSCRIPT italic_G start_POSTSUBSCRIPT italic_i italic_l end_POSTSUBSCRIPT italic_G start_POSTSUBSCRIPT italic_i italic_j end_POSTSUBSCRIPT italic_b start_POSTSUPERSCRIPT ( italic_k ) end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT
=infBR×RBF=1l=1Rj=1Rk=1RBkl(GG)ljBkjabsentsubscriptinfimum𝐵superscript𝑅𝑅subscriptnorm𝐵𝐹1superscriptsubscript𝑙1𝑅superscriptsubscript𝑗1𝑅superscriptsubscript𝑘1𝑅subscript𝐵𝑘𝑙subscriptsuperscript𝐺top𝐺𝑙𝑗subscript𝐵𝑘𝑗\displaystyle=\inf\limits_{\begin{subarray}{c}B\in\mathbb{R}^{R\times R}\\ \|B\|_{F}=1\end{subarray}}\sum_{l=1}^{R}\sum_{j=1}^{R}\sum_{k=1}^{R}B_{kl}(G^{% \top}G)_{lj}B_{kj}= roman_inf start_POSTSUBSCRIPT start_ARG start_ROW start_CELL italic_B ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT end_CELL end_ROW start_ROW start_CELL ∥ italic_B ∥ start_POSTSUBSCRIPT italic_F end_POSTSUBSCRIPT = 1 end_CELL end_ROW end_ARG end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_l = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_B start_POSTSUBSCRIPT italic_k italic_l end_POSTSUBSCRIPT ( italic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_G ) start_POSTSUBSCRIPT italic_l italic_j end_POSTSUBSCRIPT italic_B start_POSTSUBSCRIPT italic_k italic_j end_POSTSUBSCRIPT
=infBR×RBF=1k=1RBk,:GGBk,:absentsubscriptinfimum𝐵superscript𝑅𝑅subscriptnorm𝐵𝐹1superscriptsubscript𝑘1𝑅subscript𝐵𝑘:superscript𝐺top𝐺superscriptsubscript𝐵𝑘:top\displaystyle=\inf\limits_{\begin{subarray}{c}B\in\mathbb{R}^{R\times R}\\ \|B\|_{F}=1\end{subarray}}\sum_{k=1}^{R}B_{k,:}G^{\top}GB_{k,:}^{\top}= roman_inf start_POSTSUBSCRIPT start_ARG start_ROW start_CELL italic_B ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT end_CELL end_ROW start_ROW start_CELL ∥ italic_B ∥ start_POSTSUBSCRIPT italic_F end_POSTSUBSCRIPT = 1 end_CELL end_ROW end_ARG end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_B start_POSTSUBSCRIPT italic_k , : end_POSTSUBSCRIPT italic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_G italic_B start_POSTSUBSCRIPT italic_k , : end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT
infBR×RBF=1k=1RλR(GG)j=1RBk,j2=λR(GG),absentsubscriptinfimum𝐵superscript𝑅𝑅subscriptnorm𝐵𝐹1superscriptsubscript𝑘1𝑅subscript𝜆𝑅superscript𝐺top𝐺superscriptsubscript𝑗1𝑅superscriptsubscript𝐵𝑘𝑗2subscript𝜆𝑅superscript𝐺top𝐺\displaystyle\geq\inf\limits_{\begin{subarray}{c}B\in\mathbb{R}^{R\times R}\\ \|B\|_{F}=1\end{subarray}}\sum_{k=1}^{R}\lambda_{R}(G^{\top}G)\sum_{j=1}^{R}B_% {k,j}^{2}=\lambda_{R}(G^{\top}G),≥ roman_inf start_POSTSUBSCRIPT start_ARG start_ROW start_CELL italic_B ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT end_CELL end_ROW start_ROW start_CELL ∥ italic_B ∥ start_POSTSUBSCRIPT italic_F end_POSTSUBSCRIPT = 1 end_CELL end_ROW end_ARG end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_λ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( italic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_G ) ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT italic_B start_POSTSUBSCRIPT italic_k , italic_j end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = italic_λ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( italic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_G ) ,

where in the fourth line we defined B=(Bij)ij=(bj(i))ijR×R𝐵subscriptsubscript𝐵𝑖𝑗𝑖𝑗subscriptsubscriptsuperscript𝑏𝑖𝑗𝑖𝑗superscript𝑅𝑅B=(B_{ij})_{ij}=(b^{(i)}_{j})_{ij}\in\mathbb{R}^{R\times R}italic_B = ( italic_B start_POSTSUBSCRIPT italic_i italic_j end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_i italic_j end_POSTSUBSCRIPT = ( italic_b start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ) start_POSTSUBSCRIPT italic_i italic_j end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT, in the second-to-last line Bk,:Rsubscript𝐵𝑘:superscript𝑅B_{k,:}\in\mathbb{R}^{R}italic_B start_POSTSUBSCRIPT italic_k , : end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT indicates the k𝑘kitalic_k-th row of B𝐵Bitalic_B, and in the last line λR(GG)subscript𝜆𝑅superscript𝐺top𝐺\lambda_{R}(G^{\top}G)italic_λ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( italic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_G ) indicates the R𝑅Ritalic_R-th eigenvalue of GGsuperscript𝐺top𝐺G^{\top}Gitalic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_G. The infimum above can be attained by taking BR×R𝐵superscript𝑅𝑅B\in\mathbb{R}^{R\times R}italic_B ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_R end_POSTSUPERSCRIPT in (A.9) such that B1,:subscriptsuperscript𝐵top1:B^{\top}_{1,:}italic_B start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 1 , : end_POSTSUBSCRIPT is the unit-norm eigenvector of GGsuperscript𝐺top𝐺G^{\top}Gitalic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_G associated with λR(GG)subscript𝜆𝑅superscript𝐺top𝐺\lambda_{R}(G^{\top}G)italic_λ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( italic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_G ), and Bj,:=0Rsubscriptsuperscript𝐵top𝑗:0superscript𝑅B^{\top}_{j,:}=0\in\mathbb{R}^{R}italic_B start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_j , : end_POSTSUBSCRIPT = 0 ∈ blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT for j>1𝑗1j>1italic_j > 1. Then, infxHR,xHR=1GxHR2=λR(GG)subscriptinfimumformulae-sequence𝑥superscript𝐻𝑅subscriptnorm𝑥superscript𝐻𝑅1subscriptsuperscriptnorm𝐺𝑥2superscript𝐻𝑅subscript𝜆𝑅superscript𝐺top𝐺\inf\limits_{x\in H^{R},\|x\|_{H^{R}}=1}\|Gx\|^{2}_{H^{R}}=\lambda_{R}(G^{\top% }G)roman_inf start_POSTSUBSCRIPT italic_x ∈ italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , ∥ italic_x ∥ start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ italic_G italic_x ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = italic_λ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( italic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_G ) independently of (q1,,qR)St(H;R)subscript𝑞1subscript𝑞𝑅St𝐻𝑅(q_{1},\dots,q_{R})\in\mathrm{St}(H;R)( italic_q start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_q start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ) ∈ roman_St ( italic_H ; italic_R ). Coming back to (A.8), we get

PV^PVL2(Ω;H)L2(Ω;H)2subscriptsuperscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉2superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle\|P_{\hat{V}^{\perp}}P_{V}\|^{2}_{L^{2}(\Omega;H)\to L^{2}(\Omega% ;H)}∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT =1infxHR,xHR=1GxHR2=1λR(GG)absent1subscriptinfimumformulae-sequence𝑥superscript𝐻𝑅subscriptnorm𝑥superscript𝐻𝑅1subscriptsuperscriptnorm𝐺𝑥2superscript𝐻𝑅1subscript𝜆𝑅superscript𝐺top𝐺\displaystyle=1-\inf\limits_{x\in H^{R},\|x\|_{H^{R}}=1}\|Gx\|^{2}_{H^{R}}=1-% \lambda_{R}(G^{\top}G)= 1 - roman_inf start_POSTSUBSCRIPT italic_x ∈ italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , ∥ italic_x ∥ start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ italic_G italic_x ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_H start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT end_POSTSUBSCRIPT = 1 - italic_λ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( italic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_G )
=1λR(GG)=1infbR,b2=1Gb22absent1subscript𝜆𝑅𝐺superscript𝐺top1subscriptinfimumformulae-sequence𝑏superscript𝑅subscriptnorm𝑏21subscriptsuperscriptnormsuperscript𝐺top𝑏22\displaystyle=1-\lambda_{R}(GG^{\top})=1-\inf\limits_{b\in\mathbb{R}^{R},\|b\|% _{2}=1}\|G^{\top}b\|^{2}_{2}= 1 - italic_λ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT ( italic_G italic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) = 1 - roman_inf start_POSTSUBSCRIPT italic_b ∈ blackboard_R start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT , ∥ italic_b ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ italic_G start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT italic_b ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT
=supfL2(Ω;H)=1PVPV^fL2(Ω;H)2=PVPV^L2(Ω;H)L2(Ω;H)2,absentsubscriptsupremumsubscriptnorm𝑓superscript𝐿2Ω𝐻1subscriptsuperscriptnormsubscript𝑃superscript𝑉perpendicular-tosubscript𝑃^𝑉𝑓2superscript𝐿2Ω𝐻subscriptsuperscriptnormsubscript𝑃superscript𝑉perpendicular-tosubscript𝑃^𝑉2superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle=\sup\limits_{\|f\|_{L^{2}(\Omega;H)}=1}\|P_{V^{\perp}}P_{\hat{V}% }f\|^{2}_{L^{2}(\Omega;H)}=\|P_{V^{\perp}}P_{\hat{V}}\|^{2}_{L^{2}(\Omega;H)% \to L^{2}(\Omega;H)},= roman_sup start_POSTSUBSCRIPT ∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_f ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = ∥ italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT ,

where in the last line we just follow the same discussion of (A.8) and (A.9) in a reverse order. Since PVsubscript𝑃superscript𝑉perpendicular-toP_{V^{\perp}}italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT and PV^subscript𝑃^𝑉P_{\hat{V}}italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT are orthogonal projections and thus self-adjoint, we get PV^PVL2(Ω;H)L2(Ω;H)=PV^PVL2(Ω;H)L2(Ω;H).subscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻subscriptnormsubscript𝑃^𝑉subscript𝑃superscript𝑉perpendicular-tosuperscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\|P_{\hat{V}^{\perp}}P_{V}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}=\|P_{\hat{V}% }P_{V^{\perp}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}.∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = ∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT . The first equality in (A.2) follows similarly. ∎

We now come back to the following Lipschitz continuity of projector-valued mappings of finite rank functions.

Proposition A.3.

Suppose that X,X^L2(Ω;H)𝑋^𝑋superscript𝐿2Ω𝐻X,\hat{X}\in L^{2}(\Omega;H)italic_X , over^ start_ARG italic_X end_ARG ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) have the representation (A.2) with σj,σ^j>0subscript𝜎𝑗subscript^𝜎𝑗0\sigma_{j},\hat{\sigma}_{j}>0italic_σ start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_σ end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT > 0, and Uj,U^jHsubscript𝑈𝑗subscript^𝑈𝑗𝐻U_{j},\hat{U}_{j}\in Hitalic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_U end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∈ italic_H, Vj,V^jL2(Ω)subscript𝑉𝑗subscript^𝑉𝑗superscript𝐿2ΩV_{j},\hat{V}_{j}\in L^{2}(\Omega)italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) all orthonormal in their respective Hilbert spaces, for j=1,,R𝑗1𝑅j=1,\dots,Ritalic_j = 1 , … , italic_R. Here, σjsubscript𝜎𝑗\sigma_{j}italic_σ start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT and σ^jsubscript^𝜎𝑗\hat{\sigma}_{j}over^ start_ARG italic_σ end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT, j=1,,R𝑗1𝑅j=1,\dots,Ritalic_j = 1 , … , italic_R, are ordered in the descending order. Then, the projections PU=j=1RUj,HUj:HH:subscript𝑃𝑈superscriptsubscript𝑗1𝑅subscriptsubscript𝑈𝑗𝐻subscript𝑈𝑗𝐻𝐻P_{U}=\sum_{j=1}^{R}\langle U_{j},\cdot\rangle_{H}U_{j}\colon H\to Hitalic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT = ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , ⋅ ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT : italic_H → italic_H and PV=j=1R𝔼[Vj]Vj:L2(Ω;H)L2(Ω;H)P_{V}=\sum_{j=1}^{R}\mathbb{E}[V_{j}\,\cdot\,]V_{j}\colon L^{2}(\Omega;H)\to L% ^{2}(\Omega;H)italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT = ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ⋅ ] italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT : italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) satisfy

PUPU^HH=PUPU^L2(Ω;H)L2(Ω;H)subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈𝐻𝐻subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle\|P_{U}-P_{\hat{U}}\|_{H\to H}=\|P_{U}-P_{\hat{U}}\|_{L^{2}(% \Omega;H)\to L^{2}(\Omega;H)}∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_H → italic_H end_POSTSUBSCRIPT = ∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT min{1σR,1σ^R}XX^L2(Ω;H);absent1subscript𝜎𝑅1subscript^𝜎𝑅subscriptnorm𝑋^𝑋superscript𝐿2Ω𝐻\displaystyle\leq\min\{\frac{1}{\sigma_{R}},\frac{1}{\hat{\sigma}_{R}}\}\|X-% \hat{X}\|_{L^{2}(\Omega;H)};≤ roman_min { divide start_ARG 1 end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG , divide start_ARG 1 end_ARG start_ARG over^ start_ARG italic_σ end_ARG start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG } ∥ italic_X - over^ start_ARG italic_X end_ARG ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT ; (A.10)
PVPV^L2(Ω;H)L2(Ω;H)subscriptnormsubscript𝑃𝑉subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle\|P_{V}-P_{\hat{V}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT min{1σR,1σ^R}XX^L2(Ω;H).absent1subscript𝜎𝑅1subscript^𝜎𝑅subscriptnorm𝑋^𝑋superscript𝐿2Ω𝐻\displaystyle\leq\min\{\frac{1}{\sigma_{R}},\frac{1}{\hat{\sigma}_{R}}\}\|X-% \hat{X}\|_{L^{2}(\Omega;H)}.≤ roman_min { divide start_ARG 1 end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG , divide start_ARG 1 end_ARG start_ARG over^ start_ARG italic_σ end_ARG start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG } ∥ italic_X - over^ start_ARG italic_X end_ARG ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT .

Moreover, we have

PU+PVPUPV(PU^+PV^PU^PV^)L2(Ω;H)L2(Ω;H)2min{1σR,1σ^R}XX^L2(Ω;H).subscriptnormsubscript𝑃𝑈subscript𝑃𝑉subscript𝑃𝑈subscript𝑃𝑉subscript𝑃^𝑈subscript𝑃^𝑉subscript𝑃^𝑈subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻21subscript𝜎𝑅1subscript^𝜎𝑅subscriptnorm𝑋^𝑋superscript𝐿2Ω𝐻\|P_{U}+P_{V}-P_{U}P_{V}-(P_{\hat{U}}+P_{\hat{V}}-P_{\hat{U}}P_{\hat{V}})\|_{L% ^{2}(\Omega;H)\to L^{2}(\Omega;H)}\leq 2\min\{\frac{1}{\sigma_{R}},\frac{1}{% \hat{\sigma}_{R}}\}\|X-\hat{X}\|_{L^{2}(\Omega;H)}.∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT + italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - ( italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT + italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT ≤ 2 roman_min { divide start_ARG 1 end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG , divide start_ARG 1 end_ARG start_ARG over^ start_ARG italic_σ end_ARG start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG } ∥ italic_X - over^ start_ARG italic_X end_ARG ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT . (A.11)
Proof.

First, let us prove that PUPU^HH=PUPU^L2(Ω;H)L2(Ω;H)subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈𝐻𝐻subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\|P_{U}-P_{\hat{U}}\|_{H\to H}=\|P_{U}-P_{\hat{U}}\|_{L^{2}(\Omega;H)\to L^{2}% (\Omega;H)}∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_H → italic_H end_POSTSUBSCRIPT = ∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT. On the one hand, it holds for all vL2(Ω;H)𝑣superscript𝐿2Ω𝐻v\in L^{2}(\Omega;H)italic_v ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) that

(PUPU^)vL2(Ω;H)2=𝔼[(PUPU^)v(ω)H2]PUPU^HH2vL2(Ω;H)2.subscriptsuperscriptnormsubscript𝑃𝑈subscript𝑃^𝑈𝑣2superscript𝐿2Ω𝐻𝔼delimited-[]subscriptsuperscriptnormsubscript𝑃𝑈subscript𝑃^𝑈𝑣𝜔2𝐻subscriptsuperscriptnormsubscript𝑃𝑈subscript𝑃^𝑈2𝐻𝐻subscriptsuperscriptnorm𝑣2superscript𝐿2Ω𝐻\displaystyle\|(P_{U}-P_{\hat{U}})v\|^{2}_{L^{2}(\Omega;H)}=\mathbb{E}[\|(P_{U% }-P_{\hat{U}})v(\omega)\|^{2}_{H}]\leq\|P_{U}-P_{\hat{U}}\|^{2}_{H\to H}\|v\|^% {2}_{L^{2}(\Omega;H)}.∥ ( italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ) italic_v ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = blackboard_E [ ∥ ( italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ) italic_v ( italic_ω ) ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ] ≤ ∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_H → italic_H end_POSTSUBSCRIPT ∥ italic_v ∥ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT .

On the other hand, since vH𝑣𝐻v\in Hitalic_v ∈ italic_H with vH=1subscriptnorm𝑣𝐻1\|v\|_{H}=1∥ italic_v ∥ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT = 1 is trivially in L2(Ω;H)superscript𝐿2Ω𝐻L^{2}(\Omega;H)italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) with vL2(Ω;H)=1subscriptnorm𝑣superscript𝐿2Ω𝐻1\|v\|_{L^{2}(\Omega;H)}=1∥ italic_v ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = 1 we have

PUPU^HH=supvH,vH=1(PUPU^)vL2(Ω;H)subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈𝐻𝐻subscriptsupremumformulae-sequence𝑣𝐻subscriptnorm𝑣𝐻1subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈𝑣superscript𝐿2Ω𝐻\displaystyle\|P_{U}-P_{\hat{U}}\|_{H\to H}=\sup\limits_{v\in H,\|v\|_{H}=1}\|% (P_{U}-P_{\hat{U}})v\|_{L^{2}(\Omega;H)}∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_H → italic_H end_POSTSUBSCRIPT = roman_sup start_POSTSUBSCRIPT italic_v ∈ italic_H , ∥ italic_v ∥ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ ( italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ) italic_v ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT supfL2(Ω;H),fL2(Ω;H)=1(PUPU^)fL2(Ω;H)absentsubscriptsupremumformulae-sequence𝑓superscript𝐿2Ω𝐻subscriptnorm𝑓superscript𝐿2Ω𝐻1subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈𝑓superscript𝐿2Ω𝐻\displaystyle\leq\sup\limits_{f\in L^{2}(\Omega;H),\|f\|_{L^{2}(\Omega;H)}=1}% \|(P_{U}-P_{\hat{U}})f\|_{L^{2}(\Omega;H)}≤ roman_sup start_POSTSUBSCRIPT italic_f ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) , ∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = 1 end_POSTSUBSCRIPT ∥ ( italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ) italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT
=PUPU^L2(Ω;H)L2(Ω;H).absentsubscriptnormsubscript𝑃𝑈subscript𝑃^𝑈superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle=\|P_{U}-P_{\hat{U}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}.= ∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT .

Fix fL2(Ω;H)𝑓superscript𝐿2Ω𝐻f\in L^{2}(\Omega;H)italic_f ∈ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ). Using Uj,XH=σjVjsubscriptsubscript𝑈𝑗𝑋𝐻subscript𝜎𝑗subscript𝑉𝑗\langle U_{j},X\rangle_{H}=\sigma_{j}V_{j}⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , italic_X ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT = italic_σ start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT in PV^PVfL2(Ω;H)=(idPV^)j=1R𝔼[Vjf]VjL2(Ω;H)subscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻subscriptdelimited-∥∥idsubscript𝑃^𝑉superscriptsubscript𝑗1𝑅𝔼delimited-[]subscript𝑉𝑗𝑓subscript𝑉𝑗superscript𝐿2Ω𝐻\|P_{\hat{V}^{\perp}}P_{V}f\|_{L^{2}(\Omega;H)}=\bigl{\|}(\mathrm{id}-P_{\hat{% V}})\sum_{j=1}^{R}\mathbb{E}[V_{j}f]V_{j}\bigr{\|}_{L^{2}(\Omega;H)}∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = ∥ ( roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_f ] italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT yields

PV^PVfL2(Ω;H)subscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻\displaystyle\|P_{\hat{V}^{\perp}}P_{V}f\|_{L^{2}(\Omega;H)}∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT =(idPV^)j=1R1σj𝔼[Vjf]Uj,XHL2(Ω;H).absentsubscriptdelimited-∥∥idsubscript𝑃^𝑉superscriptsubscript𝑗1𝑅1subscript𝜎𝑗𝔼delimited-[]subscript𝑉𝑗𝑓subscriptsubscript𝑈𝑗𝑋𝐻superscript𝐿2Ω𝐻\displaystyle=\Bigl{\|}(\mathrm{id}-P_{\hat{V}})\sum_{j=1}^{R}\frac{1}{\sigma_% {j}}\mathbb{E}[V_{j}f]\langle U_{j},X\rangle_{H}\Bigr{\|}_{L^{2}(\Omega;H)}.= ∥ ( roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT end_ARG blackboard_E [ italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_f ] ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , italic_X ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT .

We have σj1𝔼[Vjf](idPV^)Uj,X^H=0superscriptsubscript𝜎𝑗1𝔼delimited-[]subscript𝑉𝑗𝑓idsubscript𝑃^𝑉subscriptsubscript𝑈𝑗^𝑋𝐻0\sigma_{j}^{-1}\mathbb{E}[V_{j}f](\mathrm{id}-P_{\hat{V}})\langle U_{j},\hat{X% }\rangle_{H}=0italic_σ start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT blackboard_E [ italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_f ] ( roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_X end_ARG ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT = 0 for j1,,R𝑗1𝑅j\in 1,\dots,Ritalic_j ∈ 1 , … , italic_R; indeed,

0=Uj,(idPV^)X^H=Uj,X^HUj,PV^X^H0subscriptsubscript𝑈𝑗idsubscript𝑃^𝑉^𝑋𝐻subscriptsubscript𝑈𝑗^𝑋𝐻subscriptsubscript𝑈𝑗subscript𝑃^𝑉^𝑋𝐻0=\langle U_{j},(\mathrm{id}-P_{\hat{V}})\hat{X}\rangle_{H}=\langle U_{j},\hat% {X}\rangle_{H}-\langle U_{j},P_{\hat{V}}\hat{X}\rangle_{H}0 = ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , ( roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) over^ start_ARG italic_X end_ARG ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT = ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_X end_ARG ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT - ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT over^ start_ARG italic_X end_ARG ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT

holds because (idPV^)X^=0idsubscript𝑃^𝑉^𝑋0(\mathrm{id}-P_{\hat{V}})\hat{X}=0( roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) over^ start_ARG italic_X end_ARG = 0, but [Leoni.G_2017_book_Sobolev_2nd, Theorem 8.13] implies

Uj,PV^X^Hsubscriptsubscript𝑈𝑗subscript𝑃^𝑉^𝑋𝐻\displaystyle\langle U_{j},P_{\hat{V}}\hat{X}\rangle_{H}⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT over^ start_ARG italic_X end_ARG ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT =j=1RUj,𝔼[V^jX^]HV^jabsentsuperscriptsubscript𝑗1𝑅subscriptsubscript𝑈𝑗𝔼delimited-[]subscript^𝑉𝑗^𝑋𝐻subscript^𝑉𝑗\displaystyle=\sum_{j=1}^{R}\langle U_{j},\mathbb{E}[\hat{V}_{j}\hat{X}]% \rangle_{H}\hat{V}_{j}= ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , blackboard_E [ over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT over^ start_ARG italic_X end_ARG ] ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT
=j=1R𝔼[Uj,V^jX^H]V^j=j=1R𝔼[V^jUj,X^H]V^j=PV^(Uj,X^H),absentsuperscriptsubscript𝑗1𝑅𝔼delimited-[]subscriptsubscript𝑈𝑗subscript^𝑉𝑗^𝑋𝐻subscript^𝑉𝑗superscriptsubscript𝑗1𝑅𝔼delimited-[]subscript^𝑉𝑗subscriptsubscript𝑈𝑗^𝑋𝐻subscript^𝑉𝑗subscript𝑃^𝑉subscriptsubscript𝑈𝑗^𝑋𝐻\displaystyle=\sum_{j=1}^{R}\mathbb{E}[\langle U_{j},\hat{V}_{j}\hat{X}\rangle% _{H}]\hat{V}_{j}=\sum_{j=1}^{R}\mathbb{E}[\hat{V}_{j}\langle U_{j},\hat{X}% \rangle_{H}]\hat{V}_{j}=P_{\hat{V}}(\langle U_{j},\hat{X}\rangle_{H}),= ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT over^ start_ARG italic_X end_ARG ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ] over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT = ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_X end_ARG ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ] over^ start_ARG italic_V end_ARG start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT = italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ( ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_X end_ARG ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ) ,

and thus (idPV^)Uj,X^H=0idsubscript𝑃^𝑉subscriptsubscript𝑈𝑗^𝑋𝐻0(\mathrm{id}-P_{\hat{V}})\langle U_{j},\hat{X}\rangle_{H}=0( roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , over^ start_ARG italic_X end_ARG ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT = 0 for j1,,R𝑗1𝑅j\in 1,\dots,Ritalic_j ∈ 1 , … , italic_R. Hence, the Cauchy–Schwarz inequality implies

PV^PVfL2(Ω;H)=subscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻absent\displaystyle\|P_{\hat{V}^{\perp}}P_{V}f\|_{L^{2}(\Omega;H)}=∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT = (idPV^)j=1R1σj𝔼[Vjf]Uj,(XX^)HL2(Ω;H)subscriptdelimited-∥∥idsubscript𝑃^𝑉superscriptsubscript𝑗1𝑅1subscript𝜎𝑗𝔼delimited-[]subscript𝑉𝑗𝑓subscriptsubscript𝑈𝑗𝑋^𝑋𝐻superscript𝐿2Ω𝐻\displaystyle\Bigl{\|}(\mathrm{id}-P_{\hat{V}})\sum_{j=1}^{R}\frac{1}{\sigma_{% j}}\mathbb{E}[V_{j}f]\langle U_{j},(X-\hat{X})\rangle_{H}\Bigr{\|}_{L^{2}(% \Omega;H)}∥ ( roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT end_ARG blackboard_E [ italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_f ] ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , ( italic_X - over^ start_ARG italic_X end_ARG ) ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT
\displaystyle\leq idPV^L2(Ω;H)L2(Ω;H)(j=1R1σj𝔼[Vjf]H2𝔼[|Uj,(XX^)H|2])subscriptnormidsubscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻superscriptsubscript𝑗1𝑅1subscript𝜎𝑗superscriptsubscriptdelimited-∥∥𝔼delimited-[]subscript𝑉𝑗𝑓𝐻2𝔼delimited-[]superscriptsubscriptsubscript𝑈𝑗𝑋^𝑋𝐻2\displaystyle\|\mathrm{id}-P_{\hat{V}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}% \cdot\left(\sum_{j=1}^{R}\frac{1}{\sigma_{j}}\sqrt{\bigl{\|}\mathbb{E}[V_{j}f]% \bigr{\|}_{H}^{2}\mathbb{E}\bigl{[}|\langle U_{j},(X-\hat{X})\rangle_{H}|^{2}% \bigr{]}}\right)∥ roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT ⋅ ( ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT end_ARG square-root start_ARG ∥ blackboard_E [ italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_f ] ∥ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT blackboard_E [ | ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , ( italic_X - over^ start_ARG italic_X end_ARG ) ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] end_ARG )
\displaystyle\leq 1σR(j=1R𝔼[Vjf]H2)1/2(j=1R𝔼[|Uj,(XX^)H|2])1/2.1subscript𝜎𝑅superscriptsuperscriptsubscript𝑗1𝑅superscriptsubscriptdelimited-∥∥𝔼delimited-[]subscript𝑉𝑗𝑓𝐻212superscriptsuperscriptsubscript𝑗1𝑅𝔼delimited-[]superscriptsubscriptsubscript𝑈𝑗𝑋^𝑋𝐻212\displaystyle\frac{1}{\sigma_{R}}\left(\sum_{j=1}^{R}\bigl{\|}\mathbb{E}[V_{j}% f]\bigr{\|}_{H}^{2}\right)^{1/2}\left(\sum_{j=1}^{R}\mathbb{E}\bigl{[}|\langle U% _{j},(X-\hat{X})\rangle_{H}|^{2}\bigr{]}\right)^{1/2}.divide start_ARG 1 end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG ( ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∥ blackboard_E [ italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT italic_f ] ∥ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 1 / 2 end_POSTSUPERSCRIPT ( ∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ | ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , ( italic_X - over^ start_ARG italic_X end_ARG ) ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ) start_POSTSUPERSCRIPT 1 / 2 end_POSTSUPERSCRIPT .

Recalling the orthonormality assumptions on Ujsubscript𝑈𝑗U_{j}italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT and Vjsubscript𝑉𝑗V_{j}italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT, we use Bessel’s inequality to obtain j=1R𝔼[|Uj,(XX^)H|2]XX^L2(Ω;H)2superscriptsubscript𝑗1𝑅𝔼delimited-[]superscriptsubscriptsubscript𝑈𝑗𝑋^𝑋𝐻2superscriptsubscriptnorm𝑋^𝑋superscript𝐿2Ω𝐻2\sum_{j=1}^{R}\mathbb{E}\bigl{[}|\langle U_{j},(X-\hat{X})\rangle_{H}|^{2}% \bigr{]}\leq\|X-\hat{X}\|_{L^{2}(\Omega;H)}^{2}∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT blackboard_E [ | ⟨ italic_U start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT , ( italic_X - over^ start_ARG italic_X end_ARG ) ⟩ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] ≤ ∥ italic_X - over^ start_ARG italic_X end_ARG ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT, Moreover, one can also prove that j=1R𝔼[fVj]H2fL2(Ω;H)2superscriptsubscript𝑗1𝑅superscriptsubscriptnorm𝔼delimited-[]𝑓subscript𝑉𝑗𝐻2superscriptsubscriptnorm𝑓superscript𝐿2Ω𝐻2\sum_{j=1}^{R}\|\mathbb{E}[fV_{j}]\|_{H}^{2}\leq\|f\|_{L^{2}(\Omega;H)}^{2}∑ start_POSTSUBSCRIPT italic_j = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∥ blackboard_E [ italic_f italic_V start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ] ∥ start_POSTSUBSCRIPT italic_H end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ ∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT following a similar argument to show Bessel’s inequality. It follows PV^PVfL2(Ω;H)fL2(Ω;H)σRXX^L2(Ω;H)subscriptnormsubscript𝑃superscript^𝑉perpendicular-tosubscript𝑃𝑉𝑓superscript𝐿2Ω𝐻subscriptnorm𝑓superscript𝐿2Ω𝐻subscript𝜎𝑅subscriptnorm𝑋^𝑋superscript𝐿2Ω𝐻\|P_{\hat{V}^{\perp}}P_{V}f\|_{L^{2}(\Omega;H)}\leq\frac{\|f\|_{L^{2}(\Omega;H% )}}{\sigma_{R}}\|X-\hat{X}\|_{L^{2}(\Omega;H)}∥ italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG start_POSTSUPERSCRIPT ⟂ end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT ≤ divide start_ARG ∥ italic_f ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG ∥ italic_X - over^ start_ARG italic_X end_ARG ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT. Therefore, via using Lemma A.2 we conclude that

PVPV^L2(Ω;H)L2(Ω;H)1σRXX^L2(Ω;H).subscriptnormsubscript𝑃𝑉subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻1subscript𝜎𝑅subscriptnorm𝑋^𝑋superscript𝐿2Ω𝐻\|P_{V}-P_{\hat{V}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}\leq\frac{1}{\sigma_% {R}}\|X-\hat{X}\|_{L^{2}(\Omega;H)}.∥ italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT ≤ divide start_ARG 1 end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG ∥ italic_X - over^ start_ARG italic_X end_ARG ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT .

Likewise, PUPU^L2(Ω;H)L2(Ω;H)1σRXX^L2(Ω;H)subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻1subscript𝜎𝑅subscriptnorm𝑋^𝑋superscript𝐿2Ω𝐻\|P_{U}-P_{\hat{U}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}\leq\frac{1}{\sigma_% {R}}\|X-\hat{X}\|_{L^{2}(\Omega;H)}∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT ≤ divide start_ARG 1 end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG ∥ italic_X - over^ start_ARG italic_X end_ARG ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT holds. By exchanging the roles of U𝑈Uitalic_U,V𝑉Vitalic_V with U^^𝑈\hat{U}over^ start_ARG italic_U end_ARG,V^^𝑉\hat{V}over^ start_ARG italic_V end_ARG, respectively, using the homogeneity property of the norm and (A.3), then the inequalities (A.10) follow. Finally, the last claim (A.11) comes from

PU+PVPUPV\displaystyle\|P_{U}+P_{V}-P_{U}P_{V}∥ italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT + italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT (PU^+PV^PU^PV^)L2(Ω;H)L2(Ω;H)evaluated-atsubscript𝑃^𝑈subscript𝑃^𝑉subscript𝑃^𝑈subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle-(P_{\hat{U}}+P_{\hat{V}}-P_{\hat{U}}P_{\hat{V}})\|_{L^{2}(\Omega% ;H)\to L^{2}(\Omega;H)}- ( italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT + italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT
=\displaystyle== (PUPU^)+(idPU)PV(idPU^)PV^L2(Ω;H)L2(Ω;H)subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈idsubscript𝑃𝑈subscript𝑃𝑉idsubscript𝑃^𝑈subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle\|(P_{U}-P_{\hat{U}})+(\mathrm{id}-P_{U})P_{V}-(\mathrm{id}-P_{% \hat{U}})P_{\hat{V}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}∥ ( italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ) + ( roman_id - italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT ) italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - ( roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ) italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT
=\displaystyle== (PUPU^)+(idPU)PV(idPU)PV^\displaystyle\|(P_{U}-P_{\hat{U}})+(\mathrm{id}-P_{U})P_{V}-(\mathrm{id}-P_{U}% )P_{\hat{V}}∥ ( italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ) + ( roman_id - italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT ) italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - ( roman_id - italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT ) italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT
+(idPU)PV^(idPU^)PV^L2(Ω;H)L2(Ω;H)idsubscript𝑃𝑈subscript𝑃^𝑉evaluated-atidsubscript𝑃^𝑈subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle\qquad\qquad\qquad+(\mathrm{id}-P_{U})P_{\hat{V}}-(\mathrm{id}-P_% {\hat{U}})P_{\hat{V}}\|_{L^{2}(\Omega;H)\to L^{2}(\Omega;H)}+ ( roman_id - italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT ) italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT - ( roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ) italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT
\displaystyle\leq (PUPU^)(idPV^)L2(Ω;H)L2(Ω;H)+(idPU)(PVPV^)L2(Ω;H)L2(Ω;H)subscriptnormsubscript𝑃𝑈subscript𝑃^𝑈idsubscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻subscriptnormidsubscript𝑃𝑈subscript𝑃𝑉subscript𝑃^𝑉superscript𝐿2Ω𝐻superscript𝐿2Ω𝐻\displaystyle\|(P_{U}-P_{\hat{U}})(\mathrm{id}-P_{\hat{V}})\|_{L^{2}(\Omega;H)% \to L^{2}(\Omega;H)}+\|(\mathrm{id}-P_{U})(P_{V}-P_{\hat{V}})\|_{L^{2}(\Omega;% H)\to L^{2}(\Omega;H)}∥ ( italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_U end_ARG end_POSTSUBSCRIPT ) ( roman_id - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT + ∥ ( roman_id - italic_P start_POSTSUBSCRIPT italic_U end_POSTSUBSCRIPT ) ( italic_P start_POSTSUBSCRIPT italic_V end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over^ start_ARG italic_V end_ARG end_POSTSUBSCRIPT ) ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT
\displaystyle\leq 2min{1σR,1σ^R}XX^L2(Ω;H).21subscript𝜎𝑅1subscript^𝜎𝑅subscriptnorm𝑋^𝑋superscript𝐿2Ω𝐻\displaystyle 2\min\{\frac{1}{\sigma_{R}},\frac{1}{\hat{\sigma}_{R}}\}\|X-\hat% {X}\|_{L^{2}(\Omega;H)}.2 roman_min { divide start_ARG 1 end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG , divide start_ARG 1 end_ARG start_ARG over^ start_ARG italic_σ end_ARG start_POSTSUBSCRIPT italic_R end_POSTSUBSCRIPT end_ARG } ∥ italic_X - over^ start_ARG italic_X end_ARG ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ; italic_H ) end_POSTSUBSCRIPT .

We conclude this section giving another useful result inherent to orthogonal projections.

Lemma A.4.

Given γ,N>0𝛾𝑁0\gamma,{N}>0italic_γ , italic_N > 0 two positive constants, let

𝔹γ,N:={t[0,T]𝑼tR×dsups[0,T](𝑼s𝑼s)1Fγ and sups[0,T]𝑼sF<N},assignsubscript𝔹𝛾𝑁conditional-set𝑡0𝑇subscript𝑼𝑡superscript𝑅𝑑subscriptsupremum𝑠0𝑇subscriptnormsuperscriptsubscript𝑼𝑠superscriptsubscript𝑼𝑠top1F𝛾 and subscriptsupremum𝑠0𝑇subscriptnormsubscript𝑼𝑠F𝑁\mathbb{B}_{\gamma,N}:=\{t\in[0,T]\to\boldsymbol{U}_{t}\in\mathbb{R}^{R\times d% }\mid\sup\limits_{s\in[0,T]}\|(\boldsymbol{U}_{{s}}\boldsymbol{U}_{{s}}^{\top}% )^{-1}\|_{\mathrm{F}}\leq\gamma\text{ and }\sup\limits_{s\in[0,T]}\|% \boldsymbol{U}_{s}\|_{\mathrm{F}}<\sqrt{{N}}\},blackboard_B start_POSTSUBSCRIPT italic_γ , italic_N end_POSTSUBSCRIPT := { italic_t ∈ [ 0 , italic_T ] → bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT italic_R × italic_d end_POSTSUPERSCRIPT ∣ roman_sup start_POSTSUBSCRIPT italic_s ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT ∥ ( bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ italic_γ and roman_sup start_POSTSUBSCRIPT italic_s ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT < square-root start_ARG italic_N end_ARG } ,

where the invertibility of 𝐔t𝐔tsubscript𝐔𝑡superscriptsubscript𝐔𝑡top\boldsymbol{U}_{t}\boldsymbol{U}_{t}^{\top}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT is implicitly assumed. Given 𝐔,𝐔~Bγ,N𝐔~𝐔subscript𝐵𝛾𝑁\boldsymbol{U},\tilde{\boldsymbol{U}}\in B_{\gamma,N}bold_italic_U , over~ start_ARG bold_italic_U end_ARG ∈ italic_B start_POSTSUBSCRIPT italic_γ , italic_N end_POSTSUBSCRIPT, define the orthogonal projectors P𝐔trow:=𝐔t(𝐔t𝐔t)1𝐔t,P_{\boldsymbol{U}_{t}}^{\mathrm{row}}:=\boldsymbol{U}_{t}{}^{\top}(\boldsymbol% {U}_{t}{}\boldsymbol{U}_{t}^{\top})^{-1}\boldsymbol{U}_{t},italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT := bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_FLOATSUPERSCRIPT ⊤ end_FLOATSUPERSCRIPT ( bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , P𝐔t~row:=𝐔t~(𝐔t~𝐔t~)1𝐔t~P_{\tilde{\boldsymbol{U}_{t}}}^{\mathrm{row}}:=\tilde{\boldsymbol{U}_{t}}{}^{% \top}(\tilde{\boldsymbol{U}_{t}}\tilde{\boldsymbol{U}_{t}}^{\top})^{-1}\tilde{% \boldsymbol{U}_{t}}italic_P start_POSTSUBSCRIPT over~ start_ARG bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT := over~ start_ARG bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG start_FLOATSUPERSCRIPT ⊤ end_FLOATSUPERSCRIPT ( over~ start_ARG bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG over~ start_ARG bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT over~ start_ARG bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG onto the rows of 𝐔tsubscript𝐔𝑡\boldsymbol{U}_{t}bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and 𝐔~tsubscript~𝐔𝑡\tilde{\boldsymbol{U}}_{t}over~ start_ARG bold_italic_U end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, respectively. Then there exists a constant C1>0subscript𝐶10C_{1}>0italic_C start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT > 0 such that the following holds

supt[0,T]P𝑼trowP𝑼t~rowFC1supt[0,T]𝑼t𝑼t~F.subscriptsupremum𝑡0𝑇subscriptnormsuperscriptsubscript𝑃subscript𝑼𝑡rowsuperscriptsubscript𝑃~subscript𝑼𝑡rowFsubscript𝐶1subscriptsupremum𝑡0𝑇subscriptnormsubscript𝑼𝑡~subscript𝑼𝑡F\sup\limits_{t\in[0,T]}\|P_{\boldsymbol{U}_{t}}^{\mathrm{row}}-P_{\tilde{% \boldsymbol{U}_{t}}}^{\mathrm{row}}\|_{\mathrm{F}}\leq C_{1}\sup_{t\in[0,T]}\|% \boldsymbol{U}_{t}-\tilde{\boldsymbol{U}_{t}}\|_{\mathrm{F}}.roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT ∥ italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT - italic_P start_POSTSUBSCRIPT over~ start_ARG bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ italic_C start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT ∥ bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT .

Further, given γ~,M>0~𝛾𝑀0\tilde{\gamma},M>0over~ start_ARG italic_γ end_ARG , italic_M > 0 two positive constants, let

𝔹γ~,M:={t[0,T]𝒀t[L2(Ω)]Rsups[0,T]𝔼[𝒀s𝒀s]1Fγ~ and 𝔼[sups[0,T]|𝒀s|2]<M}.assignsubscript𝔹~𝛾𝑀conditional-set𝑡0𝑇subscript𝒀𝑡superscriptdelimited-[]superscript𝐿2Ω𝑅subscriptsupremum𝑠0𝑇subscriptnorm𝔼superscriptdelimited-[]subscript𝒀𝑠superscriptsubscript𝒀𝑠top1F~𝛾 and 𝔼delimited-[]subscriptsupremum𝑠0𝑇superscriptsubscript𝒀𝑠2𝑀\mathbb{B}_{\tilde{\gamma},M}:=\{t\in[0,T]\to\boldsymbol{Y}_{t}\in[L^{2}(% \Omega)]^{R}\mid\sup\limits_{s\in[0,T]}\|\mathbb{E}[{\boldsymbol{Y}}_{s}{% \boldsymbol{Y}}_{s}^{\top}]^{-1}\|_{\mathrm{F}}\leq\tilde{\gamma}\text{ and }% \mathbb{E}\bigl{[}\sup\limits_{s\in[0,T]}|\boldsymbol{Y}_{s}|^{2}\bigr{]}<M\}.blackboard_B start_POSTSUBSCRIPT over~ start_ARG italic_γ end_ARG , italic_M end_POSTSUBSCRIPT := { italic_t ∈ [ 0 , italic_T ] → bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT ∣ roman_sup start_POSTSUBSCRIPT italic_s ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT ∥ blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT ≤ over~ start_ARG italic_γ end_ARG and blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_s ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] < italic_M } .

Given 𝐘,𝐘~𝔹γ~,M𝐘~𝐘subscript𝔹~𝛾𝑀\boldsymbol{Y},\tilde{\boldsymbol{Y}}\in\mathbb{B}_{\tilde{\gamma},M}bold_italic_Y , over~ start_ARG bold_italic_Y end_ARG ∈ blackboard_B start_POSTSUBSCRIPT over~ start_ARG italic_γ end_ARG , italic_M end_POSTSUBSCRIPT, let P𝐘t[]:=𝐘t𝔼[𝐘t𝐘t]1𝔼[𝐘t]P_{\boldsymbol{Y}_{t}}[\cdot]:=\boldsymbol{Y}_{t}^{\top}\mathbb{E}[{% \boldsymbol{Y}}_{t}{\boldsymbol{Y}}_{t}^{\top}]^{-1}\mathbb{E}[\boldsymbol{Y}_% {t}\cdot]italic_P start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT [ ⋅ ] := bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ], P𝐘~t[]:=𝐘~t𝔼[𝐘~t𝐘~t]1𝔼[𝐘~t]P_{\tilde{\boldsymbol{Y}}_{t}}[\cdot]:=\tilde{\boldsymbol{Y}}_{t}^{\top}% \mathbb{E}[{\tilde{\boldsymbol{Y}}}_{t}{\tilde{\boldsymbol{Y}}}_{t}^{\top}]^{-% 1}\mathbb{E}[\tilde{\boldsymbol{Y}}_{t}\cdot]italic_P start_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT [ ⋅ ] := over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT blackboard_E [ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ⋅ ] be the orthogonal projectors onto the subspace spanned by the components of 𝐘tsubscript𝐘𝑡\boldsymbol{Y}_{t}bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and 𝐘~tsubscript~𝐘𝑡\tilde{\boldsymbol{Y}}_{t}over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, respectively. Then there exists a constant C2>0subscript𝐶20C_{2}>0italic_C start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT > 0 such that the following holds

𝔼[supt[0,T]P𝒀tP𝒀~tL2(Ω)L2(Ω)2]12C2𝔼[supt[0,T]|𝒀t𝒀~t|2]12𝔼superscriptdelimited-[]subscriptsupremum𝑡0𝑇superscriptsubscriptnormsubscript𝑃subscript𝒀𝑡subscript𝑃subscript~𝒀𝑡superscript𝐿2Ωsuperscript𝐿2Ω212subscript𝐶2𝔼superscriptdelimited-[]subscriptsupremum𝑡0𝑇superscriptsubscript𝒀𝑡subscript~𝒀𝑡212\mathbb{E}[\sup\limits_{t\in[0,T]}\|P_{\boldsymbol{Y}_{t}}-P_{\tilde{% \boldsymbol{Y}}_{t}}\|_{L^{2}(\Omega)\to L^{2}(\Omega)}^{2}]^{\frac{1}{2}}\leq C% _{2}\mathbb{E}[\sup\limits_{t\in[0,T]}|\boldsymbol{Y}_{t}-\tilde{\boldsymbol{Y% }}_{t}|^{2}]^{\frac{1}{2}}blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT ∥ italic_P start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) → italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT ≤ italic_C start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT
Proof.

For 𝒀t,𝒀t~[L2(Ω)]Rsubscript𝒀𝑡~subscript𝒀𝑡superscriptdelimited-[]superscript𝐿2Ω𝑅\boldsymbol{Y}_{t},\tilde{\boldsymbol{Y}_{t}}\in[L^{2}(\Omega)]^{R}bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT , over~ start_ARG bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG ∈ [ italic_L start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( roman_Ω ) ] start_POSTSUPERSCRIPT italic_R end_POSTSUPERSCRIPT we have

𝒀t𝔼[𝒀t𝒀t]1𝔼[𝒀tg]superscriptsubscript𝒀𝑡top𝔼superscriptdelimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡top1𝔼delimited-[]subscript𝒀𝑡𝑔\displaystyle\boldsymbol{Y}_{t}^{\top}\mathbb{E}[{\boldsymbol{Y}}_{t}{% \boldsymbol{Y}}_{t}^{\top}]^{-1}\mathbb{E}[\boldsymbol{Y}_{t}g]bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_g ] 𝒀~t𝔼[𝒀~t𝒀~t]1𝔼[𝒀~tg]superscriptsubscript~𝒀𝑡top𝔼superscriptdelimited-[]subscript~𝒀𝑡superscriptsubscript~𝒀𝑡top1𝔼delimited-[]subscript~𝒀𝑡𝑔\displaystyle-\tilde{\boldsymbol{Y}}_{t}^{\top}\mathbb{E}[\tilde{\boldsymbol{Y% }}_{t}\tilde{\boldsymbol{Y}}_{t}^{\top}]^{-1}\mathbb{E}[\tilde{\boldsymbol{Y}}% _{t}g]- over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT blackboard_E [ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_g ]
=\displaystyle== (𝒀t𝒀~t)𝔼[𝒀t𝒀t]1𝔼[𝒀tg]superscriptsubscript𝒀𝑡topsuperscriptsubscript~𝒀𝑡top𝔼superscriptdelimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡top1𝔼delimited-[]subscript𝒀𝑡𝑔\displaystyle(\boldsymbol{Y}_{t}^{\top}-\tilde{\boldsymbol{Y}}_{t}^{\top})% \mathbb{E}[{\boldsymbol{Y}}_{t}{\boldsymbol{Y}}_{t}^{\top}]^{-1}\mathbb{E}[% \boldsymbol{Y}_{t}g]( bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ) blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_g ]
+𝒀~t(𝔼[𝒀t𝒀t]1𝔼[𝒀~t𝒀~t]1)𝔼[𝒀tg]superscriptsubscript~𝒀𝑡top𝔼superscriptdelimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡top1𝔼superscriptdelimited-[]subscript~𝒀𝑡superscriptsubscript~𝒀𝑡top1𝔼delimited-[]subscript𝒀𝑡𝑔\displaystyle+\tilde{\boldsymbol{Y}}_{t}^{\top}(\mathbb{E}[{\boldsymbol{Y}}_{t% }{\boldsymbol{Y}}_{t}^{\top}]^{-1}-\mathbb{E}[\tilde{\boldsymbol{Y}}_{t}\tilde% {\boldsymbol{Y}}_{t}^{\top}]^{-1})\mathbb{E}[\boldsymbol{Y}_{t}g]+ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ( blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT - blackboard_E [ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ) blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_g ]
+𝒀~t𝔼[𝒀~t𝒀~t]1(𝔼[𝒀tg]𝔼[𝒀~tg]).superscriptsubscript~𝒀𝑡top𝔼superscriptdelimited-[]subscript~𝒀𝑡superscriptsubscript~𝒀𝑡top1𝔼delimited-[]subscript𝒀𝑡𝑔𝔼delimited-[]subscript~𝒀𝑡𝑔\displaystyle+\tilde{\boldsymbol{Y}}_{t}^{\top}\mathbb{E}[\tilde{\boldsymbol{Y% }}_{t}\tilde{\boldsymbol{Y}}_{t}^{\top}]^{-1}(\mathbb{E}[\boldsymbol{Y}_{t}g]-% \mathbb{E}[\tilde{\boldsymbol{Y}}_{t}g]).+ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT blackboard_E [ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ( blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_g ] - blackboard_E [ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT italic_g ] ) .

Let 𝒀,𝒀~𝔹γ~,M𝒀~𝒀subscript𝔹~𝛾𝑀\boldsymbol{Y},\tilde{\boldsymbol{Y}}\in\mathbb{B}_{\tilde{\gamma},M}bold_italic_Y , over~ start_ARG bold_italic_Y end_ARG ∈ blackboard_B start_POSTSUBSCRIPT over~ start_ARG italic_γ end_ARG , italic_M end_POSTSUBSCRIPT. From [kazashi2021existence, Lemma 3.5], there exists a constant C(R,M)>0𝐶𝑅𝑀0C(R,M)>0italic_C ( italic_R , italic_M ) > 0 such that

𝔼[𝒀t𝒀t]1𝔼[𝒀~t𝒀~t]1Fsubscriptnorm𝔼superscriptdelimited-[]subscript𝒀𝑡superscriptsubscript𝒀𝑡top1𝔼superscriptdelimited-[]subscript~𝒀𝑡superscriptsubscript~𝒀𝑡top1F\displaystyle\|\mathbb{E}[{\boldsymbol{Y}}_{t}{\boldsymbol{Y}}_{t}^{\top}]^{-1% }-\mathbb{E}[\tilde{\boldsymbol{Y}}_{t}\tilde{\boldsymbol{Y}}_{t}^{\top}]^{-1}% \|_{\mathrm{F}}∥ blackboard_E [ bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT - blackboard_E [ over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ⊤ end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT - 1 end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT roman_F end_POSTSUBSCRIPT γ~C(R,M)𝔼[|𝒀t𝒀~t|2]12absent~𝛾𝐶𝑅𝑀𝔼superscriptdelimited-[]superscriptsubscript𝒀𝑡subscript~𝒀𝑡212\displaystyle\leq\tilde{\gamma}C(R,M)\mathbb{E}[|\boldsymbol{Y}_{t}-\tilde{% \boldsymbol{Y}}_{t}|^{2}]^{\frac{1}{2}}≤ over~ start_ARG italic_γ end_ARG italic_C ( italic_R , italic_M ) blackboard_E [ | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT
γ~C(R,M)𝔼[supt[0,T]|𝒀t𝒀~t|2]12,absent~𝛾𝐶𝑅𝑀𝔼superscriptdelimited-[]subscriptsupremum𝑡0𝑇superscriptsubscript𝒀𝑡subscript~𝒀𝑡212\displaystyle\leq\tilde{\gamma}C(R,M)\mathbb{E}[\sup_{t\in[0,T]}|\boldsymbol{Y% }_{t}-\tilde{\boldsymbol{Y}}_{t}|^{2}]^{\frac{1}{2}},≤ over~ start_ARG italic_γ end_ARG italic_C ( italic_R , italic_M ) blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT ,

and thus

supt[0,T]|(P𝒀tP𝒀~t)g|subscriptsupremum𝑡0𝑇subscript𝑃subscript𝒀𝑡subscript𝑃subscript~𝒀𝑡𝑔\displaystyle\sup_{t\in[0,T]}|(P_{\boldsymbol{Y}_{t}}-P_{\tilde{\boldsymbol{Y}% }_{t}})g|roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | ( italic_P start_POSTSUBSCRIPT bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT - italic_P start_POSTSUBSCRIPT over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT ) italic_g | γ~supt[0,T]|𝒀t𝒀~t|𝔼[supt[0,T]|𝒀t||g|]absent~𝛾subscriptsupremum𝑡0𝑇subscript𝒀𝑡subscript~𝒀𝑡𝔼delimited-[]subscriptsupremum𝑡0𝑇subscript𝒀𝑡𝑔\displaystyle\leq\tilde{\gamma}\sup_{t\in[0,T]}|\boldsymbol{Y}_{t}-\tilde{% \boldsymbol{Y}}_{t}|\,\mathbb{E}[\sup_{t\in[0,T]}|\boldsymbol{Y}_{t}||g|]≤ over~ start_ARG italic_γ end_ARG roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | | italic_g | ]
+γ~C(R,M)(supt[0,T]|𝒀~t|)(𝔼[supt[0,T]|𝒀t𝒀~t|2]12))𝔼[supt[0,T]|𝒀t||g|]\displaystyle+\tilde{\gamma}C(R,M)\Bigl{(}\sup_{t\in[0,T]}|\tilde{\boldsymbol{% Y}}_{t}|\Bigr{)}\Bigl{(}\mathbb{E}[\sup_{t\in[0,T]}|\boldsymbol{Y}_{t}-\tilde{% \boldsymbol{Y}}_{t}|^{2}]^{\frac{1}{2}})\Bigr{)}\mathbb{E}[\sup_{t\in[0,T]}|% \boldsymbol{Y}_{t}||g|]+ over~ start_ARG italic_γ end_ARG italic_C ( italic_R , italic_M ) ( roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | ) ( blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] start_POSTSUPERSCRIPT divide start_ARG 1 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT ) ) blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | | italic_g | ]
+(supt[0,T]|𝒀~t|)γ~(𝔼[supt[0,T]|𝒀t𝒀~t||g|]).subscriptsupremum𝑡0𝑇subscript~𝒀𝑡~𝛾𝔼delimited-[]subscriptsupremum𝑡0𝑇subscript𝒀𝑡subscript~𝒀𝑡𝑔\displaystyle+\Bigl{(}\sup_{t\in[0,T]}|\tilde{\boldsymbol{Y}}_{t}|\Bigr{)}% \tilde{\gamma}(\mathbb{E}[\sup_{t\in[0,T]}|\boldsymbol{Y}_{t}-\tilde{% \boldsymbol{Y}}_{t}||g|]).+ ( roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | ) over~ start_ARG italic_γ end_ARG ( blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | | italic_g | ] ) .

Then, using the Cauchy–Schwarz inequality to 𝔼[supt[0,T]|𝒀t||g|]𝔼delimited-[]subscriptsupremum𝑡0𝑇subscript𝒀𝑡𝑔\mathbb{E}[\sup_{t\in[0,T]}|\boldsymbol{Y}_{t}||g|]blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | | italic_g | ] and 𝔼[supt[0,T]|𝒀t𝒀~t||g|]𝔼delimited-[]subscriptsupremum𝑡0𝑇subscript𝒀𝑡subscript~𝒀𝑡𝑔\mathbb{E}[\sup_{t\in[0,T]}|\boldsymbol{Y}_{t}-\tilde{\boldsymbol{Y}}_{t}||g|]blackboard_E [ roman_sup start_POSTSUBSCRIPT italic_t ∈ [ 0 , italic_T ] end_POSTSUBSCRIPT | bold_italic_Y start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - over~ start_ARG bold_italic_Y end_ARG start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT | | italic_g | ], taking the square of both sides and taking the expectation yields the result. The result for P𝑼trowsuperscriptsubscript𝑃subscript𝑼𝑡rowP_{\boldsymbol{U}_{t}}^{\mathrm{row}}italic_P start_POSTSUBSCRIPT bold_italic_U start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_row end_POSTSUPERSCRIPT can be analogously shown. ∎

\printbibliography