Exact propagators of one-dimensional self-interacting random walks

Abstract

Self-interacting random walks (SIRWs) show long-range memory effects that result from the interaction of the random walker at time $t$ with the territory already visited at earlier times $t^{\prime}<t$. This class of non-Markovian random walks has applications in contexts as diverse as foraging theory, the behaviour of living cells, and even machine learning. Despite this importance and numerous theoretical efforts, the propagator, which is the distribution of the walker’s position and arguably the most fundamental quantity to characterize the process, has so far remained out of reach for all but a single class of SIRW. Here we fill this gap and provide an exact and explicit expression for the propagator of two important classes of SIRWs, namely, the once-reinforced random walk and the polynomially self-repelling walk. These results give access to key observables, such as the diffusion coefficient, which so far had not been determined. We also uncover an inherently non-Markovian mechanism that tends to drive the walker away from its starting point.

Figure 1: Sketch of a SATW. Unvisited sites are in gray, while already visited sites are in black. Different colors represent different situations : in the purple/green case, the RWer is at the left/right boundary of its span. In the blue case, it is in the bulk of its span. Jump probabilities are shown next to the arrows giving the jump direction.

Consider the once-reinforced random walker (RWer) $(X_{t})$ on $\mathbb{Z}$. This model, often called SATW (for self-attracting walk) in the physics literature, is defined as follows. A nearest neighbour RWer starts at $X_{0}=0$. If it is on site $x$ at time $t$ and has not yet visited site $x+1$ (resp. $x-1$), it jumps to this unvisited site at time $t+1$ with probability $1/(1+\beta)$ (resp. $1/(1+\alpha)$), while it jumps to the visited site $x-1$ (resp. $x+1$) with probability $\beta/(1+\beta)$ (resp. $\alpha/(1+\alpha)$). If it has already visited both $x+1$ and $x-1$, it jumps to either with equal probability. If $\alpha>1$ (or $\beta>1$), the RWer is thus attracted by the visited sites to its right (or left), whereas it is repelled if $\alpha<1$ (or $\beta<1$); $\alpha=\beta=1$ restores the simple random walk (see FIG.1)

This model belongs to the broad class of self-interacting random walks (SIRWs), which are characterized by long-lived memory effects that emerge from the interaction of the random walker at time $t$ with all the sites that it has visited at earlier times $t^{\prime}<t$. SIRWs, and in particular SATWs have clear applications in various examples where a random walker induces non vanishing, local perturbations in its environment—typically leaving footprints along its way and, in return, is sensitive to its own footprints, being either attracted or repelled [1, 2]. Such self-interactions have been reported qualitatively for ants or larger animals that deposit chemical cues as they move [3, 4] ; they also proved to be relevant to design sampling algorithms [5]. Recently, they have been identified for different types of living cells [6, 7, 8], whose dynamics was shown to be quantitatively captured by the SATW model. It was found in vitro in one- and two-dimensional geometries that these cells can chemically and mechanically modify their local environment. In turn, these non vanishing footprints were shown to drastically modify the large scale cell dynamics, with cells being effectively attracted by their footprints and thus preferentially remaining within the previously visited area. These experimental findings provide a prototypical example of attractive SATW, for which memory effects were demonstrated to have striking consequences on the dynamics of space exploration, such as aging (for $d=1,2$) and subdiffusion (for $d=2$) [6, 7, 8].

On the theoretical side, SIRW models have attracted a lot of attention in both the mathematics [9, 10, 11, 12, 13] and physics [14, 15, 16, 17, 18, 19, 20, 21, 7, 1, 2] communities. Related examples of non-Markovian processes, in which the full history of past trajectories determines the future evolution, include self-avoiding walks [22], locally activated RWs [23, 24] and RWs with reinforcement such as the elephant walks [25, 26, 27]. A wide variety of observables, such as first-passage properties [28, 11, 17] or scaling exponents [29, 10, 16, 15, 12] have been calculated for SIRWs. Arguably, the propagator $P_{\alpha,\beta}(x,t)$, which is the probability for the RWer to be at site $x$ at time $t$, is of fundamental importance. However, of all the SIRW models, so far the propagator has been determined explicitly only for the single example of the so-called ”true self-avoiding walk” in [13]. This model relies on the specific choice of self-interactions whose strength at each site depends linearly on the total number of visits up to time $t$ [14] and is thus unbounded, in sharp contrast with the SATW. Although it has been known [29] that the SATW is diffusive at long times, and that its propagator satisfies $P_{\alpha,\beta}(x,t)\sim p_{\alpha,\beta}\left(x/\sqrt{2t}\right)/\sqrt{2t}$ in the scaling limit $x,t\to\infty,x^{2}/t$ fixed, even the calculation of the diffusion coefficient has so far remained out of reach. Progresses have been made, notably in [10] and [11], to determine the scaling function $p_{\alpha,\beta}$ for the SATW using results from generalised Ray-Knight theory, but these approaches did not provide explicit expressions for the propagator. In this Letter, using a different strategy, we obtain such an expression, and, as by-products, several other important quantities that so far remained unknown. We first derive an exact expression of the joint distribution $\pi_{-m,\underline{k}}(t)$ of the minimum $-m$ and of the time $t$ needed to reach the maximum $k$ for the SATW. From this quantity, we explicitly obtain the joint distribution of the maximum, the minimum and the position of the RWer at time $t$. Taking the marginal of this distribution yields the following exact expression for the scaling function $p_{\alpha,\beta}$, which is our main result

$$\begin{gathered}p_{\alpha,\beta}\left(u=\frac{x}{\sqrt{2t}}\right)=\frac{(\beta-1)B\left(\beta,\frac{\alpha+1}{2}\right)}{B(\alpha,\beta)\sqrt{\pi}}\sum_{n=0}^{\infty}\frac{\left(\frac{1-\alpha}{2}\right)_{n}\left(\beta\right)_{n}}{\left(\frac{1+2\beta+\alpha}{2}\right)_{n}}\frac{n+\frac{\beta}{2}}{(n+\frac{\beta-1}{2})(n+\frac{\beta+1}{2})}\frac{e^{-u^{2}(2n+\beta)^{2}}}{n!}\text{ for $u\geq 0$}\end{gathered}$$ (1)

where $B(x,y)$ is the Beta function, and $(x)_{n}=x(x+1)\dots(x+n-1)$ is the Pochhammer symbol. The scaling function for $u<0$ follows from the space-reversal identity $P_{\alpha,\beta}(x,t)=P_{\beta,\alpha}(-x,t)$. Of note, as shown below, this function also provides the propagator of another class of SIRW, namely the polynomially self-repelling walk (PSRW) [10]; it is displayed in FIG. 2 and compared to numerical simulations in FIG. 3. We provide below the main steps of the derivation of Eq.(1).

Figure 2: Scaling function of the propagator of the SATW (1). Different colors correspond to different values of the parameters $(\alpha,\beta)$. Blue corresponds to $(0.2,0.6)$, orange to $(0.4,0.4)$ and green to $(0.7,1.2)$. Colored dots show the local maxima in the distribution as predicted by (11). The inset shows the derivative $\partial_{u}p_{\alpha,\beta}(u)$ of the scaling function. Derivatives vanish at $u=0$.

Figure 3: Propagators of the SATW and PSRW. The blue histograms show results of numerical simulations. (a) Scaling function of the propagator of a SATW with parameters $\alpha=\beta=1/e$. The red curve shows the theoretical result (1). Here, $u=x/\sqrt{2t}$. (b) Scaling function of the variable $u=\frac{x}{\sqrt{2t(2\gamma+1)}}$ for the polynomially self-repelling walk (PSRW), with exponent $\gamma=4$. The red curve shows $p_{1/2,1/2}(u)$ given by (1).

Joint distribution of the minimum and time to reach the maximum. Define $\pi_{-m,\underline{k}}(t)$ (resp. $\pi_{\underline{-m},k}(t)$) as the probability that the trajectory of the RWer has minimum $-m$ (resp. maximum $k$) and that it reaches its maximum $k$ (resp. minimum $-m$) at time $t$. Note that we underline the last location reached by the RWer. In this section, as a first step to obtain the propagator, we derive an exact expression for this joint distribution, which is interesting on its own as it was shown to play an important role in trapping problems [30]; in particular it gives access to classical splitting probabilities (see SM).

Throughout, we denote the generating function of a given function $f(t)$ by $\hat{f}(\xi)=\sum_{t=0}^{\infty}\xi^{t}f(t)$. We will write $\xi=(1+s)^{-1}$, and $\mu=-\log((1-\sqrt{1-\xi^{2}})/\xi)\mathrel{\mathop{\kern 0.0pt\sim}\limits_{s\to 0}}\sqrt{2s}$. A partition over the events where the RWer reaches either $k$ or $-m$ first yields

$$\hat{\pi}_{-m,\underline{k+1}}=\hat{\pi}_{-m,\underline{k}}\hat{F}^{\alpha,\beta}_{L}(\xi,+|+)+\hat{\pi}_{\underline{-m},k}\hat{F}^{\alpha,\beta}_{L}(\xi,+|-)$$ (2)

where $\hat{F}_{L}^{\alpha,\beta}(+|-)$ is the generating function of $F_{L}^{\alpha,\beta}(\tau=t,\varepsilon|\varepsilon^{\prime})$, which is defined as follows. Denote the span of the RWer at time $t$ (defined as the set of sites visited by the RWer up to time $t$) as $[-m,k]$, with $m,k\geq 0$, and set $L=k+m$. We denote by $\tau$ the time needed for the RWer starting from the boundary $\varepsilon=\pm$ of $[-m,k]$ ($+$ for $k$, $-$ for $-m$) to leave $[-m,k]$ through the boundary $\varepsilon^{\prime}=\pm$ exactly at time $\tau$ ; $F_{L}^{\alpha,\beta}(\tau=t,\varepsilon|\varepsilon^{\prime})$ is then defined as the distribution of $\tau$. It is a $2\times 2$ matrix with indices $\pm$, which we call $F_{L}^{\alpha,\beta}(t)$ ; its generating function $\hat{F}_{L}^{\alpha,\beta}$ is derived in the SM with the help of a renewal equation [22]. Equation (2) (and its counterpart for $\hat{\pi}_{\underline{-m-1},k}$) then gives access to the joint distribution $\pi$ we are looking for. Making use of the following non trivial symmetry relation proved in SM

$$\frac{\hat{\pi}_{-m,\underline{k}}}{\hat{\pi}_{\underline{-m},k}}=\frac{\sinh(k\mu)}{\sinh(m\mu)},$$ (3)

we obtain

$$\hat{\pi}_{-m,\underline{k}}=\hat{\pi}_{-m,\underline{1}}\prod_{j=1}^{k-1}\left[\frac{\sinh m\mu}{\sinh j\mu}\hat{F}^{\alpha,\beta}_{m+j}(+|-)+\hat{F}^{\alpha,\beta}_{m+j}(+|+)\right]$$ (4)

where $\hat{\pi}_{-m,\underline{1}}=\hat{F}_{m}^{\alpha,\beta}(+|-)\prod_{j=0}^{m-1}\hat{F}_{j}^{\alpha,\beta}(-|-)$, which holds for all values of parameters. In particular, in the scaling regime $L\to\infty,s\to 0,L\sqrt{s}$ fixed, we find

$$\hat{F}_{L}^{\alpha,\beta}\sim\mathds{1}_{2}+\sqrt{2s}\begin{bmatrix}-\beta\coth(L\sqrt{2s})&\frac{\alpha}{\sinh L\sqrt{2s}}\\ \frac{\beta}{\sinh L\sqrt{2s}}&-\alpha\coth(L\sqrt{2s})\end{bmatrix}$$ (5)

where $\mathds{1}_{2}$ is the identity matrix. Taking the scaling limit of (4) with the help of (5), in the regime $k,m\gg 1,s\to 0,L\sqrt{s}$ fixed, we finally obtain (see SM):

$$\hat{\pi}_{-m,\underline{k}}\sim\frac{\sqrt{2s}}{B(\alpha,\beta)}\frac{\sinh^{\beta-1}(m\sqrt{2s})\sinh^{\alpha}(k\sqrt{2s})}{\sinh^{\alpha+\beta}((k+m)\sqrt{2s})}.$$ (6)

Joint distribution of minimum, maximum, and position. Next, we derive the scaling limit of the generating function of the joint distribution $Q(k,m,x,t)$ of the minimum, maximum, and position of the RWer. A partition over the events where the most recent visited site is either $k$ or $-m$ yields

$$\hat{Q}(k,m,x,\xi)=\hat{\pi}_{\underline{k},-m}\hat{P}_{s}^{m,k}(x|+)+\hat{\pi}_{\underline{-m},k}\hat{P}_{s}^{m,k}(x|-)$$ (7)

where $\hat{P}_{s}^{m,k}(x|\varepsilon)$ is the generating function of $P_{s}^{m,k}(x,\tau|\varepsilon)$ defined as the probability that the RWer is on site $x$ at time $t+\tau$ and has not left the span $[-m,k]$, knowing that it was at the boundary $\varepsilon=\pm$ of the span at time $t$. Using a renewal approach [22], we compute this quantity in SM and show that, in the scaling limit $m,k\gg 1,s\to 0,L\sqrt{s}$ fixed, one has

$$\hat{P}_{s}^{m,k}(x|-)\sim\frac{2\alpha(\sinh(k-x)\sqrt{2s})}{\sinh L\sqrt{2s}}.$$ (8)

Finally, we have obtained all terms in the rhs of (7), which provides an exact determination of $\hat{Q}(k,m,x,s)$ for all values of the parameters. In the asymptotic limit $k,m\gg 1,s\to 0,L\sqrt{s}$ fixed, this gives the simpler form

$$\hat{Q}(k,m,x,s)\sim\frac{2\sqrt{2s}}{B(\alpha,\beta)}\frac{\sinh^{\beta}(m\sqrt{2s})\sinh^{\alpha}(k\sqrt{2s})}{\sinh^{\alpha+\beta+1}((k+m)\sqrt{2s})}\left(\beta\frac{\sinh(m+x)\sqrt{2s}}{\sinh(m\sqrt{2s})}+\alpha\frac{\sinh(k-x)\sqrt{2s}}{\sinh(k\sqrt{2s})}\right).$$ (9)

The joint distribution $Q(k,m,x,t)$ readily gives access to the propagator with absorbing boundaries $\tilde{P}_{a,b}(x,t)$, which is the probability that the RWer, starting at $0$ at time $t=0$, is at $x$ at time $t$, knowing that it is absorbed if it hits the sites $-a,b$. For $x\geq 0$, this can be written as $\tilde{P}_{a,b}(x,t)=\sum_{k=x}^{b-1}\sum_{m=0}^{a-1}Q(k,m,x,t)$. In the scaling limit, the sums can be written as integrals, which we compute explicitly for $a,b\to\infty$ (see SM) : this limit yields the unconstrained propagator (1), which is the main result of this Letter. Besides its intrinsic importance, this result reveals several remarkable features of the SATW.

Moments of the position $X_{t}$. First, Eq. (1) gives access to the moments $\langle X_{t}^{n}\rangle$ of the position of the RWer at time $t$. In the general case $\alpha\neq\beta$, the mean position $\langle X_{t}\rangle$ is non-zero ; it is obtained exactly from (1) and can be written $\langle X_{t}\rangle=g_{1}(\alpha,\beta)\sqrt{2t}$ where $g_{1}(\alpha,\beta)=-g_{1}(\beta,\alpha)$ is explicitly given in the SM and plotted in FIG. 4(a). Note the $\sqrt{t}$ scaling of the mean position (expected from the general scaling form of $p_{\alpha,\beta}$), which is at odds with the classical case of diffusion with constant drift. In limit cases, simple forms of $g_{1}(\alpha,\beta)$ can be derived : for $\alpha=1$, one has $g_{1}(1,\beta)=\left(1-\beta\right)/(\sqrt{\pi}\beta)$, and we find the asymptotic behaviour $g_{1}(\alpha,\beta)\mathrel{\mathop{\kern 0.0pt\sim}\limits_{\alpha\to 0}}-1/(\alpha\sqrt{\pi})$.

Next, the variance $V(X_{t})=\langle X^{2}_{t}\rangle-\langle X_{t}\rangle^{2}\mathrel{\mathop{\kern 0.0pt\sim}\limits_{t\to\infty}}2D_{\alpha,\beta}t$ is also obtained from Eq. (1) and defines the diffusion coefficient $D_{\alpha,\beta}$, which is a symmetric function of $\alpha,\beta$ given in SM. Limiting cases yield the simple expressions $D_{1,\beta}=\left(\pi\beta(\beta-1)-2(\beta-1)^{2}+\pi\right)/(2\pi\beta^{2})$ and $D_{\alpha,\beta}\mathrel{\mathop{\kern 0.0pt\sim}\limits_{\alpha\to 0}}(\pi-2)/(2\pi\alpha^{2})$. Remarkably, our approach provides in particular an explicit expression, so far unknown, in the symmetric case $\alpha=\beta$ :

$$D_{\alpha,\alpha}=\frac{1}{2}+\frac{(1-\alpha)B\left(\frac{\alpha+1}{2},\alpha\right)}{B(\alpha,\alpha)}\frac{\,{}_{4}F_{3}\left(\frac{1-\alpha}{2},\frac{\alpha}{2},\frac{\alpha}{2},\alpha;\frac{\alpha}{2}+1,\frac{\alpha}{2}+1,\frac{3\alpha}{2}+\frac{1}{2};1\right)}{\alpha^{2}}$$ (10)

where ${}_{p}F_{q}$ is a hypergeometric function.

Finally, Eq. (1) shows that the propagator is not Gaussian (for $(\alpha,\beta)\not=(1,1)$), even if it has a Gaussian tail $p_{\alpha,\beta}(u)\mathrel{\mathop{\kern 0.0pt\propto}\limits_{u\to\infty}}e^{-u^{2}\beta^{2}}$. Of note, if $\alpha=2n+1$ is an odd integer, the Pochhammer symbol $((1-\alpha)/2)_{k}$ is zero for $k>n$, so that $p_{\alpha,\beta}$ is a finite sum of $n+1$ Gaussian functions. Non-Gaussianity can be quantified by the fourth cumulant $\kappa_{4}(t)=\langle X_{t}^{4}\rangle-3\langle X_{t}^{2}\rangle^{2}=3g_{4}(\alpha,\beta)t^{2}$, where $g_{4}$ is a symmetric function given in SM and $g_{4}(1,\beta)=\beta^{-3}(\beta-1)^{2}$. This function is shown FIG. 4(b) for $\alpha=\beta$.

Figure 4: (a) Scaled mean $g_{1}(\alpha,\beta)\sim\frac{\langle X_{t}\rangle}{\sqrt{2t}}$ plotted for different values of $\alpha$. As expected, it becomes negative for $\beta>\alpha$, i.e. when the RWer is more likely to increment its span to the left than to the right. (b) Scaled fourth cumulant $g_{4}(\alpha,\alpha)\sim\frac{\kappa_{4}(t)}{3t^{2}}$ for symmetric SATW $\alpha=\beta$. Note that it vanishes only for $\alpha=1$.

Non-monotonicity and smoothness of $p_{\alpha,\beta}(u)$. A second remarkable feature of the propagator $P_{\alpha,\beta}(x,t)$, which is not captured by a direct analysis of the moments of $X_{t}$, is its non-monotonicity. In fact, for some values of $\alpha,\beta<1$ (repelling SATWs), we find that the distribution has local maxima, or bumps, for non-zero values of $x$, which we write as $x_{\pm}(t)$. While explicit exact expressions for $x_{\pm}$ seem out of reach, a good approximation can be obtained for $\alpha,\beta$ small by keeping only the first two terms in the sum (1) defining $p_{\alpha,\beta}(u)$. Solving $\partial_{u}p_{\alpha,\beta}(u)=0$ with this approximation then yields

$$x_{+}(t)\mathrel{\mathop{\kern 0.0pt\sim}\limits_{\alpha,\beta\to 0}}\sqrt{\frac{t}{2(1+\beta)}\log\frac{(1-\alpha)(1-\beta)(\beta+2)^{3}}{\beta^{2}(\beta+3)(\alpha+2\beta+1)}};$$ (11)

a similar expression for $x_{-}$ is obtained by swapping $\alpha$ and $\beta$. Requiring that the argument of the $\log$ in this expression is greater than $1$ provides an explicit condition on $\alpha,\beta$ for $P_{\alpha,\beta}(x,t)$ to have bumps for $x>0$ ; in the SM, we verify that this condition accurately predicts non monotonicity of the propagator for a broad range of values of $\alpha,\beta$. The accuracy of the approximate prediction (11) is illustrated in FIG.2. This shows that self-repulsion at the edges of the visited territory, if strong enough, can drive the RWer away from 0 and yield a non monotonic propagator, while preserving the diffusive scaling.

We now turn to regularity properties of the scaling function $p_{\alpha,\beta}$. First, note that due to the different definitions for $u>0$ and $u<0$ in (1) for $\alpha\not=\beta$, writing the continuity of $p_{\alpha,\beta}$ at $u=0$ yields a non trivial identity involving hypergeometric functions, which we indeed verify up to arbitrary precision numerically (see SM). Second, we show in SM (see FIG. 2) that $p_{\alpha,\beta}$ has a continuous, vanishing derivative at $u=0$ for all $\alpha,\beta$ : this is in contrast with the propagator of the true self-avoiding walk [13], or locally activated random walks [23, 24], which have singular derivatives at $u=0$.

Extension: polynomially self-repelling walk (PSRW). Last, we obtain the exact propagator of the PSRW introduced in [10]. It is defined as a RW on $\mathbb{Z}$ with jump probabilities

$$P_{t}(x+1|x)=\frac{w(L_{t}(x+1))}{w(L_{t}(x+1)+w(L_{t}(x))}=1-P_{t}(x-1|x)$$ (12)

where $L_{t}(x)$ is the number of times the RWer has crossed the unoriented edge $\{x,x-1\}$ up to time $t$, and $w(n)\mathrel{\mathop{\kern 0.0pt\sim}\limits_{n\to\infty}}n^{-\gamma}$ for $0<\gamma<\infty$. Although so far no explicit expression could be obtained for the propagator of the PSRW, it was shown in [10] that the scaling variable $u=x/\sqrt{2t(2\gamma+1)}$, in the regime $x,t\to\infty,u$ fixed, is distributed according to $p_{1/2,1/2}(u)$. Our explicit expression (1) thus provides readily an exact expression of the propagator of the PSRW as a by-product. Numerical simulations FIG. 3(b) confirm this result. In particular, an exact determination of the diffusion coefficient of the PSRW is deduced from our result (10) for $\alpha=\beta=1/2$ and reads

$$D_{PSRW}=(2\gamma+1)\left(\frac{1}{2}+C+\frac{\pi^{2}}{16}\right),$$ (13)

where $C$ is Catalan’s constant.

Finally, we have obtained an exact, explicit expressions for the propagator of two important classes of strongly non Markovian random walks, namely, the once-reinforced random walk (SATW) and the polynomially self-repelling walk (PSRW). These analytic expressions provide benchmark results which give access to various observables of broad relevance, such as the diffusion coefficient, which has so far remained undetermined. Our results reveal remarkable features of the SATW, such as a smooth, non monotonic behaviour of the propagator in the case of strong enough self-repulsion induced by the inherently non-Markovian nature of the dynamics.

See pages 1 of SM.pdf See pages 2 of SM.pdf See pages 3 of SM.pdf See pages 4 of SM.pdf See pages 5 of SM.pdf See pages 6 of SM.pdf See pages 7 of SM.pdf See pages 8 of SM.pdf See pages 9 of SM.pdf See pages 10 of SM.pdf See pages 11 of SM.pdf See pages 12 of SM.pdf See pages 13 of SM.pdf See pages 14 of SM.pdf See pages 15 of SM.pdf