Periodic source detection in Discrete dynamical systems via space-time sampling

Abstract.

In this paper, we examine a discrete dynamical system defined by $x(n+1)=Ax(n)+w(n)$, where $x$ takes values in a Hilbert space $\mathcal{H}$ and $w$ is a periodic source with values in a fixed closed subspace $\mathcal{W}$ of $\mathcal{H}$.

Our goal is to identify conditions on some spatial sampling system $G=\{g_{j}\}_{j\in J}$ of $\mathcal{H}$ that enable stable recovery of the unknown source term $w$ from space-time samples $\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J}$. We provide necessary and sufficient conditions on $G=\{g_{j}\}_{j\in J}$ to ensure stable recovery of any $w\in\mathcal{W}$. Additionally, we explicitly construct an operator $R$, dependent on $G$, such that $R\{\langle x(n),g_{j}\rangle\}_{n,j}=w$.

1. Introduction

In this paper, we study the problem of recovering a periodic source driving a dynamical system from space-time samples. The setting is described by a discrete dynamical system in a Hilbert space $\mathcal{H}$ given by

$$x(n+1)=Ax(n)+w(n),$$ (1.1)

where $w:\mathbb{N}\rightarrow\mathcal{W}$, is such that $w(n+N)=w(n)$ for all $n$, and where $\mathcal{W}$ is a fixed closed subspace of $\mathcal{H}$. The variable $n\in\mathbb{N}$ represents discrete time, and the operator $A$ in Equation (1.1) is assumed to be a bounded linear operator on $\mathcal{H}$. In some applications this operator may correspond to a physical phenomenon modeling a space-time signal evolving in time under the action of the operator $A$ and driven by the periodic source $w$. The problem we wish to solve is to find the unknown periodic source $w$ from space-time samples of the function $x$, given by

$$y_{n,j}=\langle x(n),g_{j}\rangle,\quad n\in\mathbb{N},j\in J,$$ (1.2)

where $G=\{g_{j}\}_{j\in J}\subset\mathcal{H}$ is a countable set representing spatial test functions for probing $x(n)$ at time $n$. Specifically, we want to determine conditions on the set $G$ so that we can recover $w$ from the collected samples $\{y_{n,j}\}$ such that the recovery operator $R$ is stable under perturbations of $\{y_{n,j}\}$. This means that the operator $R$ should be a continuous operator under appropriate norms (to be defined later).

This problem was inspired by environmental monitoring for the detection of pollutants emanating from smoke stacks (see e.g., [16]). The solution to this problem may also be useful in other applications such as epidemiology, network analysis, computational biology, and further applications.

The type of inverse problem we are studying falls into the so-called Dynamical Sampling problems, in which an unknown of interest in a dynamical system is to be determined from space-time samples of a time-evolving signal $x$. Dynamical sampling problems vary depending on which unknown of interest is to be found. When the unknown of interest is the initial distribution $x(0)$, it is called the space-time trade-off (see e.g., [1, 2, 7, 11, 12, 14, 15, 19, 20]). If the unknown is the operator $A$ or some parameters related to $A$, the problem is referred to as system identification [9, 10, 13, 17]. The problem of interest in this paper falls into the category of source recovery problems (see e.g., [4, 3, 6, 5, 6, 8] and the references therein).

1.1. Notation

Throughout the paper, $\mathcal{H}$ will denote a separable Hilbert space. $\mathcal{H}^{N}$ will denote the Hilbert space $\mathcal{H}\times\cdots\times\mathcal{H}$ with the natural inner product induced by $\mathcal{H}$. In particular, $\|h\|^{2}_{\mathcal{H}^{N}}=\sum\limits_{i=1}^{N}\|h_{i}\|^{2}_{\mathcal{H}}$ for $h\in\mathcal{H}^{N}$.

To simplify some of the notation, we introduce the following operators:

Let $A:\mathcal{H}\rightarrow\mathcal{H}$ be a bounded invertible operator with operator norm $\|A\|<1$, and an integer $N\geq 1$, we define $N$ invertible operators

$$T_{s}:=\left(Ie^{2\pi is/N}-A\right)^{-1},\quad\text{for each}\ 0\leq s\leq N-1.$$ (1.3)

Here $I$ denotes the Identity operator in $\mathcal{H}$. For the dynamical system (1.1) the sequence $w$ will be called the source term, and $N$ its period.

We now introduce two Banach spaces $\mathcal{B}(\ell^{2},\ell^{\infty})$, and $\mathcal{M}_{N}$ which we will need for out work.

Definition 1.1.

The space $\mathcal{B}(\ell^{2},\ell^{\infty})$ is the set of double infinite matrices

$D=[d_{i,j}]_{i,j\geq 1}$ such that each row $r_{i}$ of $D$ belongs to $\ell^{2}$, and $\sup\limits_{i\geq 1}\|r_{i}\|_{\ell^{2}}<\infty$. We endow $\mathcal{B}(\ell^{2},\ell^{\infty})$ with the norm $\|D\|_{\ell^{2}\to\ell^{\infty}}=\sup\limits_{i\geq 1}\|r_{i}\|_{\ell^{2}}$.

The space $\mathcal{B}(\ell^{2},\ell^{\infty})$ is a Banach space and can be identified with the space of bounded linear operators from $\ell^{2}$ to $\ell^{\infty}$, endowed with the operator norm. (See [3]). We are now ready to define the subspace $\mathcal{M}_{N}$.

Definition 1.2.

Let $N\geq 1$ be an integer. The space $\mathcal{M}_{N}$ is the set of matrices $\{D=[d_{i,j}]:i,j\geq 1\}\subset\mathcal{B}(\ell^{2},\ell^{\infty})$ with rows $r_{i}$ such that there exist $t_{1},\cdots,t_{N}\in\ell^{2}$ satisfying $\lim_{k\to\infty}\|r_{Nk+s}-t_{s}\|_{\ell^{2}}=0$. We endow $\mathcal{M}_{N}$ with the norm induced by $\mathcal{B}(\ell^{2},\ell^{\infty})$.

In Appendix B we prove properties of the space $\mathcal{M}_{N}$.

1.2. Contributions and Organization

The paper is organized as follows. In Section 2, we state Theorem 2.2 wich provide the necessary and sufficient conditions on the set $G=\{g_{j}\}_{j\in J}\subset\mathcal{H}$ for the stable recovery of the source term $w$ in (1.1) from the space-time samples (1.2). The proof of Theorem 2.2 is presented in Section 3, which also provides a reconstruction operator $R$ in (3.14). The two sections in the Appendix develop tools that are used in the proof of Theorem 2.2. Specifically, in Appendix A we develop the Discrete Fourier Transform for functions taking values in a general Hilbert space, while in Appendix B we show that $\mathcal{M}_{N}$ is a Banach space, prove some of its properties and conclude that it is the natural domain of the reconstruction operator $R$.

2. Main result

In this section, we provide the necessary and sufficient conditions on a set $G=\{g_{j}\}_{j\in J}\subset\mathcal{H}$ for solving the recovery of any $N$-periodic source term $w$ driving the system as described in Equation (1.1). Throughout the article, we will sometimes identify $N$-periodic sequences with the vector of their first $N$ elements, i.e. we will represent an $N-$periodic sequence $a:\mathbb{Z}\rightarrow\mathcal{H}$ by the finite sequence $(a(0),...,a(N-1))\in\mathcal{H}^{N}.$

We begin by defining the general problem:

Problem 1.

Let $A:\mathcal{H}\to\mathcal{H}$ be a bounded linear operator with $\|A\|<1$. Let $\mathcal{W}$ be a closed subspace of $\mathcal{H}$. Consider the dynamical system describing the evolution of $x(n)\in\mathcal{H}$ via

$$\begin{cases}x(n+1)=Ax(n)+w(n),&\text{subject to }w(n)\in\mathcal{W},\\ y_{n,j}=\langle x(n),g_{j}\rangle,&\text{for }j\in J,\end{cases}$$ (2.1)

where the initial state $x(0)=x_{0}$ is unknown, and $w(n+N)=w(n)$ is an unknown $N$-periodic sequence in $\mathcal{W}$. What are the conditions on $G=\{g_{j}\}_{j\in J}\subset\mathcal{H}$ such that $w$ can be recovered from $\{y_{n,j}\}_{n\geq 0,j\in J}$ in a stable way? Equivalently, under what conditions on $G$ does there exist a linear bounded operator $R:\mathcal{M}_{N}\to\mathcal{W}^{N}$ such that $R(\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J})=w$?

Before we describe our results several remarks are in order.

Remark 2.1.

1. Given $\mathcal{H}$, $\mathcal{W}\subset\mathcal{H}$, and $A$, if $\{g_{j}\}_{j\in J}$ is a Bessel sequence in $\mathcal{H}$, each solution $x$ of system (1.1) determines an element $\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J}$ in $\mathcal{M}_{N}$, (See Definition 1.2).

2. Given a fixed $w\in W^{N}$, consider the subset of $\mathcal{M}_{N}$ of all matrices
   $\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J}$ corresponding to solutions $x$ of the system associated with $w$. We require that the continuous operator $R$, described in Problem 1, has constant value $w$ on that set,. i.e., $R(\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J})=w$ for all solutions $x$, independent of the unknown initial state $x(0).$

The following theorem provides the necessary and sufficient conditions on the probing set of functions $G=\{g_{j}\}_{j\in J}$ for the existence of a continuous reconstruction operator $R$. One part of its proof describes a reconstruction algorithm. However, this algorithm is not unique, in general.

Using the notation from Equation (1.3), we present the main result.

Theorem 2.2.

Let $A:\mathcal{H}\rightarrow\mathcal{H}$ be a bounded operator with $\|A\|<1$, N a positive integer, and $\mathcal{W}$ a closed subspace of $\mathcal{H}$.

Fix $A,N$ and $\mathcal{W}$. The following are equivalent:

1. There exists a bounded operator ${R}:\mathcal{M}_{N}\rightarrow\mathcal{W}^{N}$ such that for each solution $x$ of the system in $\eqref{DS}$ it holds that ${R}(\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J})=w$.

2. The set $\{P_{\mathcal{W}}(T^{*}_{s}g_{j})\}_{j}$ is a frame of $\mathcal{W}$ for $s=0,\dots,N-1.$

3. $\{P_{\mathcal{W}_{s}}(g_{j})\}_{j\in J}$ is a frame of $\mathcal{W}_{s}$, for $s=0,\dots,N-1$, where $\mathcal{W}_{s}=T_{s}(\mathcal{W})$.

3. Proofs

Before proving Theorem 2.2, we start with some preliminaries.

3.1. Periodic solution related to the periodic source

In this subsection, we prove that there exists an unique periodic solution $x_{p}$ to the dynamical system in Equation 2.1.

A sequence $w$ with values in $\mathcal{W}$ satisfying

$$w(n+N)=w(n),\quad\text{for all }n\in\mathbb{N},$$

can be expressed as

$$w(n)=\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{w}(k)\,e^{2\pi ikn/N}.$$ (3.1)

The next Lemma proves the existence and uniqueness of a periodic solution to (2.1) and gives the relation between the unique periodic solution $x_{p}$ of (2.1) in terms of the source $w$.

Lemma 3.1.

Let $\mathcal{H}$ be a separable Hilbert space, let $\mathcal{W}\subset\mathcal{H}$ be a subspace, let $A:\mathcal{H}\to\mathcal{H}$ be a bounded operator with $\|A\|<1$, and let $w:\mathbb{Z}\rightarrow\mathcal{W}$, be $N$-periodic. Then there exists a unique periodic solution $x_{p}$ to (2.1). Moreover, the Fourier coefficients $\widehat{x_{p}}(k)\in\mathcal{H}$ of the $N$-periodic solution to (2.1), i.e.,

$$x_{p}(n):=\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{x_{p}}(k)\,e^{2\pi ikn/N}$$ (3.2)

are related to the Fourier coefficients of the periodic source $\widehat{w}(k)$ in (3.1) by the identities

$$\widehat{x_{p}}(k)\left(I\,e^{2\pi ik/N}-A\right)=\widehat{w}(k),\quad k=0,\cdots,N-1,$$

where $I$ denotes the identity operator on $\mathcal{H}$. Equivalently, using the notation introduced in equation (1.3),

$$\widehat{x_{p}}(k)=T_{k}\widehat{w}(k),\quad k=0,\dots,N-1.$$

Proof.

Assume $\{x_{p}(n)\}\subset\mathcal{H}$ is an $N$-periodic sequence that satisfies (2.1). Then, using (3.2), we have

$$x_{p}(n+1) =\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{x_{p}}(k)\,e^{2\pi ik(n+1)/N}$$

$$=A\left(\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{x_{p}}(k)\,e^{2\pi ikn/N}\right)+\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{w}(k)\,e^{2\pi ikn/N}.$$

Thus,

$$\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\left(\widehat{x_{p}}(k)\,e^{2\pi ik/N}\right)e^{2\pi ikn/N}=A\left(\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{x_{p}}(k)\,e^{2\pi ikn/N}\right)+\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{w}(k)\,e^{2\pi ikn/N}.$$

Finally, it follows that

$$\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{x_{p}}(k)\left(I\,e^{2\pi ik/N}-A\right)\,e^{2\pi ikn/N}=\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{w}(k)\,e^{2\pi ikn/N},$$

which, by the unicity of the Fourier coefficients yields

$$\widehat{x_{p}}(k)\left(I\,e^{2\pi ik/N}-A\right)=\widehat{w}(k),\ k=0,\dots,N-1.$$ (3.3)

Since $\|A\|<1$, $T_{k}$ is an invertible bounded operator on $\mathcal{H}$ for each $k=0,\cdots N-1$. Hence, the expression above also guarantees the existence and uniqueness of a periodic solution $x_{p}$. ∎

3.2. General solution of the difference equation with a periodic source

In this subsection, we obtain the relation between the periodic solution $x_{p}$ and the periodic source term $w$, using the discrete Fourier transform in Hilbert spaces described in Appendix A.

From the theory of difference equations (see for example [18]), the solution of (2.1), for the initial condition $x(0)=x_{0}$ is given by

$$x(n)=A^{n}x_{0}+\sum_{k=0}^{n-1}A^{n-1-k}w(k),\ n=0,\dots$$ (3.4)

Assuming that $\|A\|<1$, and $w(n)$ is $N$-periodic we re-write (3.4) as

$$x(n) =A^{n}x_{0}+\sum_{k=-\infty}^{n-1}A^{n-1-k}w(k)-\sum_{k=-\infty}^{-1}A^{n-1-k}w(k)$$

$$=A^{n}\left(x_{0}-\sum_{k=-\infty}^{-1}A^{-1-k}w(k)\right)+\sum_{k=-\infty}^{n-1}A^{n-1-k}w(k)$$

$$=A^{n}c+\sum_{k=-\infty}^{n}A^{n-k}w(k).$$ (3.5)

Here $c\in\mathcal{H}$ is defined by $c=x_{0}-\sum_{k=1}^{\infty}A^{k}w(-k-1)$ which converges by our assumption that $\|A\|<1$. Let $v(n)$ be defined by

$$v(n)=\sum_{k=-\infty}^{n}A^{n-k}w(k).$$ (3.6)

Then

$$v(n+N) =\sum_{k=-\infty}^{n+N}A^{n+N-k}w(k)$$

$$=\sum_{\ell=-\infty}^{n}A^{n-\ell}w(\ell+N)=\sum_{\ell=-\infty}^{n}A^{n-\ell}w(\ell)=v(n).$$ (3.7)

Hence, $\{v(n)\}$ is an $N$-periodic sequence in $\mathcal{H}$. In addition,

$$v(n+1) =\sum_{k=-\infty}^{n+1}A^{n+1-k}w(k)$$ (3.8)

$$=\sum_{k=-\infty}^{n}A^{n+1-k}w(k)+w(n)$$ (3.9)

$$=A\left(\sum_{k=-\infty}^{n}A^{n-k}w(k)\right)+w(n)$$ (3.10)

$$=Av(n)+w(n).$$ (3.11)

Therefore $\{v(n)\}$ is an $N$-periodic sequence in $\mathcal{H}$ that satisfies (2.1).

By Lemma 3.1, we obtain

$$v(n)=x_{p}(n) =\sum_{k=0}^{N-1}\widehat{x_{p}}(k)\,e^{2\pi ikn/N}$$

$$\sum_{k=0}^{N-1}\left(I\,e^{2\pi ikn/N}-A\right)^{-1}\widehat{w}(k)\,e^{2\pi ikn/N}.$$

Therefore, the solution for (2.1) with $x(0)=x_{0}$ is

$$x(n)=A^{n}c+x_{p}(n),$$ (3.12)

where $c=x_{0}-\sum_{k=1}^{\infty}A^{k}w(-k-1)$ and $x_{p}(n)=\sum_{k=0}^{N-1}\left(I\,e^{2\pi ikn/N}-A\right)^{-1}\widehat{w}(k)\,e^{2\pi ikn/N}$.

With the notation from (1.3), the periodic solution to (2.1) can be expressed as

$$x_{p}(n)=\sum_{k=0}^{N-1}T_{k}\widehat{w}(k)\,e^{2\pi ikn/N}.$$

3.3. Sufficient conditions for the stable recovery of the source $w$

In this section, we provide sufficient conditions on the set $G=\{g_{j}\}_{j\in J}$ for the stable recovery of any sequence $w$ taking values in $\mathcal{W}$ from the space-time samples $\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J}$. In doing so, we also develop an algorithm for the recovery of $w$. It turns out that these sufficient conditions are also necessary, as we will prove in the next section. However, the algorithm we describe is not unique; there are many algorithms that can achieve stable recovery as long as the conditions on $G$ are met. The theorem providing these sufficient condition is given below.

Theorem 3.2.

Consider the dynamical system (2.1) and let $\{g_{j}\}_{j\in J}\ \subset\mathcal{H}$ be a Bessel sequence. Then, the periodic source term $w$ can be recovered from the measurements $\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J}$ provided that $P_{\mathcal{W}_{s}}\{g_{j}\}_{j\in J}$ is a frame of $\mathcal{W}_{s}=T_{s}(\mathcal{W})$, for $s=0,\dots,N-1$ where $T_{s}$ is as in (1.3).

Proof.

From (3.12), the general solution of (2.1) is of the form

$$x(n)=A^{n}c+x_{p}(n)$$

where $x_{p}$ is the unique $N$-periodic solution to system (2.1) for $N$-periodic source $w$.

Set $n=Nk+r$ with $0\leq r\leq N-1$. Thus,

$$\langle x(Nk+r),g_{j}\rangle=\langle A^{Nk}A^{r}c,g_{j}\rangle+\langle x_{p}(r),g_{j}\rangle.$$

The first term on the right hand side can be bounded above by

$$|\langle A^{Nk}A^{r}c,g_{j}\rangle|\leq\|A^{Nk}A^{r}c\|\|g_{j}\|\leq\|A\|^{Nk}\|A^{r}c\|\|g_{j}\|.$$

Since $\|A\|<1$, it follows that $\lim_{k\rightarrow\infty}\langle A^{Nk}A^{r}c,g_{j}\rangle=0$. We conclude that

$$\lim_{k\rightarrow\infty}\langle x(Nk+r),g_{j}\rangle=\lim_{k\rightarrow\infty}\langle A^{Nk}A^{r}c,g_{j}\rangle+\langle x_{p}(r),g_{j}\rangle=\langle x_{p}(r),g_{j}\rangle.$$ (3.13)

In what follows, we will show how, under the right conditions of $G=\{g_{j}\}$, we can obtain $w$ from $\{\langle x_{p}(r),g_{j}\rangle\}_{j\in J}$.

For each $s=0,\cdots,N-1,\;\widehat{x_{p}}(s)=T_{s}\widehat{w}(s)$. Since $\widehat{w}(s)$ is a linear combination of the vectors $w(r),r=0,\dots,N-1$ belonging to $\mathcal{W}$, we conclude that $\widehat{x_{p}}(s)\in T_{s}(\mathcal{W})$, and that $x_{p}(k)\in T_{s}(\mathcal{W})$ (see Appendix A).

Let $\mathcal{W}_{s}$ be the closed subspace of $\mathcal{H}$, defined as $\mathcal{W}_{s}:=T_{s}(\mathcal{W})$. Assume that $P_{\mathcal{W}_{s}}\{g_{j}\}_{j\in J}$ is a frame of $\mathcal{W}_{s}$ for $s=0,\dots,N-1$ (or equivalently, that $\{P_{\mathcal{W}}(T^{*}_{s}g_{j})\}_{j}$ is a frame of $\mathcal{W}$ for $s=0,\dots,N-1$), and let $\{f_{j}^{s}\}_{j\in J}$ be one of its a dual frames in $\mathcal{W}_{s}$. Then, by the reconstruction formula for frames, we can recover $x_{p}(s)$ from

$$x_{p}(s)=\sum_{j\in J}\langle x_{p}(s),g_{j}\rangle f_{j}^{s}.$$

The relation $\widehat{x_{p}}(s)=T_{s}\widehat{w}(s)$ is then used to recover $\widehat{w}(s)$, $s=0,\cdots,N-1$ and hence $w(k)$, $k=0,\cdots,N-1$. ∎

Note that the reconstruction illustrated above implies for example the choice of a dual frame for $\{T^{*}_{s}g_{j}\}_{j}$ for $s=0,\dots,N-1$, which is, in general, not unique, showing that our reconstruction algorithm is not unique. However, we will show next, that the condition on the set $G=\{g_{j}\}_{j\in J}$ in theorem 3.2 turns out to be necessary for the existence of a continuous reconstruction operator $R$, as described in the next section.

3.4. Proof of necessity

In the next proposition we state that the frame condition in Theorem 3.2, is necessary for the existence of a continuous linear operator $\widetilde{R}$ from the Banach space $\mathcal{M}_{N}$ to $\mathcal{W}^{N}$ such that $\widetilde{R}(\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J})=\widehat{w}$ and hence an operator $R:=\mathcal{F}_{N}^{-1}\circ\widetilde{R}:\mathcal{M}_{N}\to\mathcal{W}^{N}$ such that $R(\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J})={w}$.

Proposition 3.3.

Fix $A,N$ and $\mathcal{W}$. Assume that there exists a bounded operator $\widetilde{R}:\mathcal{M}_{N}\rightarrow\mathcal{W}^{N}$ such that for each solution $x$ of a system in (2.1), we have $\widetilde{R}(\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J})=\widehat{w}$, then the set $\{P_{\mathcal{W}}(T^{*}_{s}g_{j})\}_{j}$ is a frame of $\mathcal{W}$ for $s=0,\dots,N-1.$

Proof.

Let $v\in\mathcal{W}$ be an arbitrary vector and $0\leq s\leq N-1.$ Define $w_{s}\in\mathcal{W}^{N}$ by $\widehat{w_{s}}(s)=v$, and $\widehat{w_{s}}(\ell)=0$ for $\ell\not=s$. Consider the dynamical system (2.1) with this choice of $w_{s}$ and the unique periodic solution $x_{p}$ associated with this choice. Note that, from Lemma 3.1 we have that $\widehat{x}_{p}(\ell)=T_{s}\widehat{w_{s}}(\ell)$, and hence $\widehat{x}_{p}(s)=T_{s}v$ and $\widehat{x}_{p}(\ell)=0$ for $\ell\not=s$. Then we have,

$$\|v\|_{\mathcal{H}^{N}}^{2}=\|\widehat{w_{s}}\|_{\mathcal{H}^{N}}^{2} =\|\widetilde{R}(\{<x_{p}(n),g_{j}>\}\|_{\mathcal{H}}^{2}$$

$$\leq\|\widetilde{R}\|^{2}\|\{<x_{p}(Nk+r),g_{j}>\}\|_{B}^{2}$$

$$=\sup_{0\leq r\leq N-1}\sup_{k}\sum_{j\in J}|<x_{p}(Nk+r),g_{j}>|^{2}$$

$$=\sup_{0\leq r\leq N-1}\sum_{j\in J}|<x_{p}(r),g_{j}>|^{2}$$

$$=\sup_{0\leq r\leq N-1}\sum_{j\in J}\left|\left\langle\left(\frac{1}{\sqrt{N}}\sum_{\ell=0}^{N-1}\widehat{x_{p}}(\ell)e^{2\pi i\ell r/N}\right),g_{j}\right\rangle\right|^{2}$$

$$=\sup_{0\leq r\leq N-1}\sum_{j\in J}|\frac{1}{\sqrt{N}}\sum_{\ell=0}^{N-1}e^{2\pi i\ell r/N}\langle T_{\ell}\widehat{w}(\ell),g_{j}\rangle|^{2}$$

$$=\frac{1}{N}\sum_{j\in J}|\langle T_{s}v,g_{j}\rangle|^{2}$$

$$=\frac{1}{N}\sum_{j\in J}|\langle v,T_{s}^{*}g_{j}\rangle|^{2}.$$

So we have that for any $v\in\mathcal{W}$,

$$N\|v\|_{\mathcal{H}^{N}}^{2}\leq\sum_{j\in J}|\langle v,T_{s}^{*}g_{j}\rangle|^{2}.$$

This says that $\{P_{\mathcal{W}}(T_{s}^{*}g_{j})\}_{j\in J}$ satisfies the lower frame inequality for $\mathcal{W}$. For the upper frame bound we have

$$\sum_{j\in J}|\langle v,T_{s}^{*}g_{j}\rangle|^{2}=\sum_{j\in J}|\langle T_{s}v,g_{j}\rangle|^{2}\leq c_{1}\|T_{s}^{*}v\|^{2}\leq c_{2}\|v\|^{2}.$$

Here $c_{1}$ is the Bessel constant of $\{g_{j}\}$. Since this argument can be repeated for each $0\leq s\leq N-1$ this concludes the proof of the implication. ∎

3.5. Proof of Theorem 2.2

We first need the following Lemma:

Lemma 3.4.

Let $\mathcal{H}$ be a Hilbert space, $\mathcal{V}\subset\mathcal{H}$ be a closed subspace and $\{g_{j}\}_{j\in J}$ a Bessel sequence in $\mathcal{H}$ and let $T:\mathcal{H}\rightarrow\mathcal{H}$ be a bounded invertible operator. Then the set $\{P_{\mathcal{V}}T^{*}g_{j}\}_{j}$ is a frame of $\mathcal{V}$ if and only if $\{P_{T\mathcal{V}}(g_{j})\}_{j\in J}$ is a frame of $T\mathcal{V}$.

Proof.

For the sufficiency, let $m$ and $M$ be the lower and upper frame bounds for $\{P_{\mathcal{V}}T^{*}g_{j}\}_{j}$. Then for $v\in\mathcal{V}$,

$$m\|v\|^{2}\leq\sum_{j\in J}|\langle v,P_{\mathcal{V}}T^{*}g_{j}\rangle|^{2}=\sum_{j\in J}|\left\langle Tv,g_{j}\right\rangle|^{2}.$$

Given $w\in T\mathcal{V}$, let $v=T^{-1}w$. We have

$$\begin{split}\sum_{j\in J}|\left\langle w,P_{TV}g_{j}\right\rangle|^{2}=\sum_{j\in J}|\left\langle w,g_{j}\right\rangle|^{2}=\sum_{j\in J}|\left\langle Tv,g_{j}\right\rangle|^{2}&=\sum_{j\in J}|\left\langle v,P_{\mathcal{V}}T^{*}g_{j}\right\rangle|^{2}\\ &\geq m\|v\|^{2}=m\|T^{-1}\|^{2}\|w\|^{2}.\end{split}$$

The upper frame bound follows from the fact that $\{g_{j}\}$ is Bessel. The proof of the converse is the same.

∎

Proof of Theorem 2.2.

1) $\Longrightarrow$ 2) Is simply Proposition 3.3 followed by the application of the Fourier matrix $F^{*}_{N}$ defined by (A.2).

2) $\Longrightarrow$ 1) Let us start by defining the operator ${Q}:\mathcal{M}_{N}\rightarrow\mathcal{W}^{N}$.

Let $\{f^{r}_{j}\}_{j}$ be a dual frame of $\{P_{\mathcal{W}}(T_{r}^{*}g_{j}\}_{j}$ in $\mathcal{W}$. Given $Y=[y_{Nk+r,j}]\in\mathcal{M}_{N}$, define

$$Q(Y):=\left[\lim_{k\rightarrow\infty}{\sum_{j\in J}{y}_{Nk+r,j}f^{r}_{j}}\right]_{r=0,\dots,N-1}.$$ (3.14)

By Lemma B.2, ${Q}$ is a well defined operator which is bounded since $\{f^{r}_{j}\}_{j}$ is Bessel for $0\leq r\leq N-1:$

$$\|{Q}(Y)\|_{\mathcal{H}^{N}}\leq C\|Y\|_{\ell^{2}\to\ell^{\infty}}.$$

Now if $x(n)$ is a solution of dynamical system (2.1) with $N$-periodic source $w$, then, by the proof of Theorem 3.2, we know that ${Q}(\{\langle x(n),g_{j}\rangle\}_{n\geq 0,j\in J})=x_{p}$, the unique periodic solution of (2.1) with $N$-periodic source $w$.

Using Lemma 3.1 we obtain $\widehat{w}$, and applying the inverse Fourier transform $\mathcal{F}^{-1}_{N}$ defined by (A.2), the result follows. So, our operator is

$$R:=\mathcal{F}_{N}^{-1}U\mathcal{F}_{N}Q\quad\text{where}\quad U=diag(T_{0}^{-1},\cdots,T_{N-1}^{-1}).$$

For $2)\Longleftrightarrow 3)$ see Lemma 3.4.

∎

Appendix A Discrete Fourier transform in general Hilbert spaces

In this section we prove the existence of the Fourier decomposition that we use in our main theorem. The Fourier transform can be defined for functions taking values in a general separable Hilbert space. Here we use the Fourier transform for periodic vector value sequences defined in the integers. Although this is a known folklore, we present it here for completeness.

Let $\mathcal{H}$ be a separable Hilbert space, $N\in\mathbb{Z},\;N\geq 1$, and $\mathbb{Z}_{N}$ the cyclic group of $N$ elements.

Proposition A.1.

Any function $q:\mathbb{Z}_{N}\rightarrow\mathcal{H}$ has a Fourier decomposition, i.e. there exist unique function $\widehat{q}:\mathbb{Z}_{N}\rightarrow\mathcal{H}$ such that

$$q(n)=\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{q}(k)\,e^{2\pi ikn/N},\;n\in\mathbb{Z}_{N}$$

Proof.

For $k\in\mathbb{Z}_{N}$ and $v\in\mathcal{H}$ define, $L_{k}(v)=\sum_{s=0}^{N-1}\langle v,q(s)\rangle\,e^{-2\pi isk/N}$. Note that $L_{k}:\mathcal{H}\rightarrow\mathbb{C}$ is a linear functional, and is bounded since

$$|L_{k}(v)|\leq\sum_{s=0}^{N-1}|\langle v,q(s)\rangle\,|\leq(\sum_{s=0}^{N-1}\|q(s)\|)\;\|v\|.$$

So, using Riesz theorem, for each $k\in\mathbb{Z}_{N}$ there exists $\widehat{q}(k)\in\mathcal{H}$ such that $L_{k}(v)=\langle v,\widehat{q}(k)\rangle\,$ for all $v\in\mathcal{H}.$

Now since $n\mapsto\langle v,q(n)\rangle$ is a scalar function it has a discrete Fourier decomposition, thus

$$\langle v,q(n)\rangle\,= \sum_{k=0}^{N-1}\left(\sum_{s=0}^{N-1}\langle v,q(s)\rangle\,e^{-2\pi isk/N}\right)\,e^{2\pi ikn/N}$$

$$= \sum_{k=0}^{N-1}L_{k}(v)\,e^{2\pi ikn/N}=\sum_{k=0}^{N-1}\langle v,\widehat{q}(k)\rangle\,e^{2\pi ikn/N},$$

for every $v\in\mathcal{H}$. Thus, $q(n)=\sum_{k=0}^{N-1}\widehat{q}(k)e^{2\pi ikn/N}.$

∎

The unitary transformation

$$\mathcal{F}_{N}:\ell^{2}(\mathbb{Z}_{N},\mathcal{H})\rightarrow\ell^{2}(\mathbb{Z}_{N},\mathcal{H})$$

defined by $q\longmapsto\widehat{q}$, is called the Fourier transform.

Thus, we have the formulae:

$$q(n)=\frac{1}{\sqrt{N}}\sum_{k=0}^{N-1}\widehat{q}(k)\,e^{2\pi ikn/N},\qquad\widehat{q}(k)=\frac{1}{\sqrt{N}}\sum_{n=0}^{N-1}q(n)\,e^{-2\pi ink/N}.$$ (A.1)

The Fourier transform can equivalently be defined component-wise:

Fix an orthonormal basis $\{v_{k}\}_{k\in I}$ of $\mathcal{H}.$ Given $q:\mathbb{Z}_{N}\rightarrow\mathcal{H}$ define for each $k\in I,\;q_{k}:\mathbb{Z}_{N}\rightarrow\mathbb{C}\;$ by $q_{k}(j)=\langle q(j),v_{k}\rangle,\;\forall j\in\mathbb{Z}_{N}.$

Then, we have $q(j)=\sum_{k\in I}q_{k}(j)\,v_{k},\;j\in\mathbb{Z}_{N}$. Now, each $q_{k}$ has a scalar discrete Fourier decomposition. i.e. $q_{k}(j)=\frac{1}{\sqrt{N}}\sum_{s=0}^{N-1}\widehat{q_{k}}(s)\;e^{2\pi ijs/N}$.

We have for $j\in\mathbb{Z}_{N}$,

$$q(j)= \sum_{k\in I}q_{k}(j)\,v_{k}=\sum_{k\in I}\langle q(j),v_{k}\rangle\,v_{k}$$

$$= \sum_{k\in I}(\frac{1}{\sqrt{N}}\sum_{s=0}^{N-1}\widehat{q_{k}}(s)\,e^{2\pi ijs/N})\,v_{k}=\frac{1}{\sqrt{N}}\sum_{s=0}^{N-1}\left(\sum_{k\in I}\widehat{q_{k}}(s)\,v_{k}\right)\,e^{2\pi ijs/N}$$

Now, using the unicity of the decomposition we conclude that

$$\sum_{k\in I}\widehat{q_{k}}(s)\,e_{k}=\widehat{q}(s).$$

The transformation $\mathcal{F}_{N}$ can be put in matrix form. Let $F_{N}$ be the matrix $F_{N}=\{\frac{1}{\sqrt{N}}e^{-2\pi iks/N}\}_{k,s=0,\dots,N-1}$. Thus $F_{N}$ is an unitary matrix with $F_{N}^{*}=\{\frac{1}{\sqrt{N}}e^{2\pi isk/N}\}_{s,k=0,\dots,N-1}$. Now if we write, for $q$, $\widehat{q}\in\mathcal{H}^{N}$,  ${q^{T}}=(q(0),\dots,q(N-1))$ and $\widehat{{q}}^{T}=(\widehat{q}(0),\dots,\widehat{q}(N-1))$ then

$$\widehat{{q}}=F_{N}\,{q}\;\text{ and }\;F_{N}^{*}\,\widehat{{q}}={q}.$$ (A.2)

Appendix B The subspace $\mathcal{M}_{N}$

In this section, we show that the space $\mathcal{M}_{N}$ in Definition 1.2 is a closed subspace of $\mathcal{B}(\ell^{2},\ell^{\infty})$ (see Definition 1.1), and hence $\mathcal{M}_{N}$ is also a Banach space. In addition, we prove an important property of the space $\mathcal{M}_{N}$ and show that it is a natural domain for the reconstruction operator $R$.

The first property is stated in the following Lemma.

Lemma B.1.

$\mathcal{M}_{N}$ is a closed subspace of $\mathcal{B}(\ell^{2},\ell^{\infty})$.

Proof.

Assume that a sequence $D^{(n)}=[d_{i,j}^{(n)}]\in\mathcal{M}_{N}\subset\mathcal{B}(\ell^{2},\ell^{\infty})$ converges to $D=[d_{i,j}]$, i.e., $\|D^{(n)}-D\|_{\ell^{2}\to\ell^{\infty}}\to 0$ as $n\to\infty$. Let $r_{k}(s)$ and $r^{(n)}_{k}(s)$ be defined as the rows $r_{k}(s)=\{d_{Nk+s,j}\}_{j}$ and $r^{(n)}_{k}(s)=\{d^{(n)}_{Nk+s,j}\}_{j}$. Since $D^{(n)}\in\mathcal{M}_{N}$, we have that $\lim_{k\to\infty}\|r^{(n)}_{Nk+s}-t^{(n)}_{s}\|_{\ell^{2}}=0$. To simplify notation, we will drop the script $s$ for the remainder of the proof. We first Show that the sequence $\{t^{(n)}\}_{n}$ is a Cauchy sequence. Since $D^{(n)}$ is convergent in $\mathcal{M}_{N}$, we have $\|r_{k}^{(m)}-r_{l}^{(n)}\|_{\ell^{2}}\leq\|D^{(m)}-D^{(n)}\|_{\ell^{2}\to\ell^{\infty}}$. Thus, given $\varepsilon>0$, we can find an integer $I$ such that

$$\|r_{k}^{(m)}-r_{l}^{(n)}\|_{\ell^{2}}\leq\|D^{(m)}-D^{(n)}\|_{\ell^{2}\to\ell^{\infty}}<\varepsilon/3\text{ for }\quad m,n\geq I,$$

and get

$$\begin{split}\|t^{(m)}-t^{(n)}\|_{\ell^{2}}&\leq\|t^{(m)}-r_{k}^{(m)}\|_{\ell^{2}}+\|t^{(n)}-r_{l}^{(n)}\|_{\ell^{2}}+\|r_{k}^{(m)}-r_{l}^{(n)}\|_{\ell^{2}}\\ &\leq\|t^{(m)}-r_{k}^{(m)}\|_{\ell^{2}}+\|t^{(n)}-r_{l}^{(n)}\|_{\ell^{2}}+\varepsilon/3\leq\varepsilon\quad\text{ for }\quad m,n\geq I,\end{split}$$

where $k,l$ are chosen large enough to obtain the last inequality. Hence, $\{t^{(n)}\}_{n}$ is a Cauchy sequence. Therefore, there exists $t\in\ell^{2}$ such that $\lim_{n\to\infty}\|t^{(n)}-t\|_{\ell^{2}}=0$. Finally, we show that $\lim_{k\to\infty}\|r_{k}-t\|_{\ell^{2}}=0$.

$$\|r_{k}-t\|_{\ell^{2}}\leq\|r_{k}-r^{(n)}_{k}\|_{\ell^{2}}+\|r^{(n)}_{k}-t^{(n)}\|_{\ell^{2}}+\|t^{(n)}-t\|_{\ell^{2}}.$$ (B.1)

For $\varepsilon>0$ choose $I$ such that $\|r_{k}-r_{k}^{(n)}\|_{\ell^{2}}\leq\|D-D^{(n)}\|_{\ell^{2}\to\ell^{\infty}}<\varepsilon/3$ and $\|t^{(n)}-t\|_{\ell^{2}}<\varepsilon/3$ for $n\geq I$. Then, by fixing $n\geq I$, and choosing $I_{2}\geq I$ large enough so that $\|r_{k}-r^{(n)}_{k}\|_{\ell^{2}}<\varepsilon/3$, Inequality (B.1) gives

$$\|r_{k}-t\|_{\ell^{2}}<\varepsilon\quad\text{ for }k\geq I_{2}.$$

∎

The second important property, stated in the lemma below, shows that the operator defined in (3.14) is a bounded operator from $\mathcal{M}_{N}$ to $\mathcal{W}^{N}$.

Lemma B.2.

Let $\mathcal{H}$ be a separable Hilbert space, and let $\mathcal{G}^{s}=\{g^{s}_{j}\}_{j\geq 1}$, $s=0,\dots,N-1$ be any $N$ Bessel sequences in $\mathcal{H}$ with optimal Bessel bound $C_{\mathcal{G}^{s}}$. Then the mapping

$$Q:\mathcal{M}_{N}\longrightarrow\mathcal{H}^{N},$$

defined by

$$Q(D):=\left[\lim_{i\to\infty}\sum_{j=1}^{\infty}d_{Ni+s,j}g^{s}_{j}\right]_{s=1}^{N}$$

is a well-defined bounded operator.

Proof.

As in the proof of he previous lemma we let $r_{k}(s)=\{d_{Nk+s,j}\}_{j}$ be the row $Nk+s$ of $D\in\mathcal{M}_{N}$. Since $D\in\mathcal{M}_{N}$, there exists a sequence $t_{s}\in\ell^{2}$ such that

$$\lim_{k\to\infty}\|r_{k}(s)-t_{s}\|_{\ell^{2}}=0.$$ (B.2)

Furthermore, since $\mathcal{G}^{s}=\{g^{s}_{j}\}_{j\geq 1}$ is a Bessel sequence in $\mathcal{H}$ with bound $C_{\mathcal{G}}^{s}$, then

$$\left\|\sum\limits_{j\geq 1}(r_{k}(s))(j)g^{s}_{j}-t_{s}(j)g^{s}_{j}\right\|_{\mathcal{H}}\leq\sqrt{C_{\mathcal{G}}^{s}}\,\|r_{k}(s)-t_{s}\|_{\ell^{2}}.$$ (B.3)

Thus, using (B.2) and (B.3), for each $s=0,\dots,N-1$, we have that

$$\big{[}Q(D)\big{]}_{s}=\lim_{k\to\infty}\sum\limits_{j\geq 1}(r_{k}(s))(j)g^{s}_{j}=\sum\limits_{j\geq 1}t_{s}(j)g^{s}_{j}.$$

Moreover, since $\|r_{k}(s)\|_{\ell^{2}}\leq\|D\|_{\ell^{2}\to\ell^{\infty}}$, we have $\|t_{s}\|_{\ell^{2}}\leq\|D\|_{\ell^{2}\to\ell^{\infty}}$ and we obtain

$$\left\|\big{[}Q(D)\big{]}_{s}\right\|_{\mathcal{H}}\leq\|t_{s}\|_{\ell^{2}}\leq\sqrt{C_{\mathcal{G}^{s}}}\|D\|_{\ell^{2}\to\ell^{\infty}}.$$

Since the inequality above holds for each $s=0,\dots,N-1$, taking $C=\max_{s}\{\sqrt{C_{\mathcal{G}^{s}}}\}$ we have

$$\|{Q}(D)\|_{\mathcal{H}^{N}}\leq C\|D\|_{\ell^{2}\to\ell^{\infty}}.$$

∎