Initial condition

In mathematics and particularly in dynamic systems, an initial condition, in some contexts called a seed value,^[1]^{: pp. 160} is a value of an evolving variable at some point in time designated as the initial time (typically denoted t = 0). For a system of order k (the number of time lags in discrete time, or the order of the largest derivative in continuous time) and dimension n (that is, with n different evolving variables, which together can be denoted by an n-dimensional coordinate vector), generally nk initial conditions are needed in order to trace the system's variables forward through time.

An initial condition of a vibrating string

Evolution from the initial condition

In both differential equations in continuous time and difference equations in discrete time, initial conditions affect the value of the dynamic variables (state variables) at any future time. In continuous time, the problem of finding a closed form solution for the state variables as a function of time and of the initial conditions is called the initial value problem. A corresponding problem exists for discrete time situations. While a closed form solution is not always possible to obtain, future values of a discrete time system can be found by iterating forward one time period per iteration, though rounding error may make this impractical over long horizons.

Linear system

Discrete time

A linear matrix difference equation of the homogeneous (having no constant term) form $X_{t+1}=AX_{t}$ has closed form solution $X_{t}=A^{t}X_{0}$ predicated on the vector $X_{0}$ of initial conditions on the individual variables that are stacked into the vector; $X_{0}$ is called the vector of initial conditions or simply the initial condition, and contains nk pieces of information, n being the dimension of the vector X and k = 1 being the number of time lags in the system. The initial conditions in this linear system do not affect the qualitative nature of the future behavior of the state variable X; that behavior is stable or unstable based on the eigenvalues of the matrix A but not based on the initial conditions.

Alternatively, a dynamic process in a single variable x having multiple time lags is

x_{t}=a_{1}x_{t-1}+a_{2}x_{t-2}+\cdots +a_{k}x_{t-k}.

Here the dimension is n = 1 and the order is k, so the necessary number of initial conditions to trace the system through time, either iteratively or via closed form solution, is nk = k. Again the initial conditions do not affect the qualitative nature of the variable's long-term evolution. The solution of this equation is found by using its characteristic equation $\lambda ^{k}-a_{1}\lambda ^{k-1}-a_{2}\lambda ^{k-2}-\cdots -a_{k-1}\lambda -a_{k}=0$ to obtain the latter's k solutions, which are the characteristic values $\lambda _{1},\dots ,\lambda _{k},$ for use in the solution equation

x_{t}=c_{1}\lambda _{1}^{t}+\cdots +c_{k}\lambda _{k}^{t}.

Here the constants $c_{1},\dots ,c_{k}$ are found by solving a system of k different equations based on this equation, each using one of k different values of t for which the specific initial condition $x_{t}$ Is known.

Continuous time

A differential equation system of the first order with n variables stacked in a vector X is

{\frac {dX}{dt}}=AX.

Its behavior through time can be traced with a closed form solution conditional on an initial condition vector $X_{0}$ . The number of required initial pieces of information is the dimension n of the system times the order k = 1 of the system, or n. The initial conditions do not affect the qualitative behavior (stable or unstable) of the system.

A single k^th order linear equation in a single variable x is

{\frac {d^{k}x}{dt^{k}}}+a_{k-1}{\frac {d^{k-1}x}{dt^{k-1}}}+\cdots +a_{1}{\frac {dx}{dt}}+a_{0}x=0.

Here the number of initial conditions necessary for obtaining a closed form solution is the dimension n = 1 times the order k, or simply k. In this case the k initial pieces of information will typically not be different values of the variable x at different points in time, but rather the values of x and its first k – 1 derivatives, all at some point in time such as time zero. The initial conditions do not affect the qualitative nature of the system's behavior. The characteristic equation of this dynamic equation is $\lambda ^{k}+a_{k-1}\lambda ^{k-1}+\cdots +a_{1}\lambda +a_{0}=0,$ whose solutions are the characteristic values $\lambda _{1},\dots ,\lambda _{k};$ these are used in the solution equation

x(t)=c_{1}e^{\lambda _{1}t}+\cdots +c_{k}e^{\lambda _{k}t}.

This equation and its first k – 1 derivatives form a system of k equations that can be solved for the k parameters $c_{1},\dots ,c_{k},$ given the known initial conditions on x and its k – 1 derivatives' values at some time t.

Nonlinear systems

Another initial condition

Evolution of this initial condition for an example PDE

Nonlinear systems can exhibit a substantially richer variety of behavior than linear systems can. In particular, the initial conditions can affect whether the system diverges to infinity or whether it converges to one or another attractor of the system. Each attractor, a (possibly disconnected) region of values that some dynamic paths approach but never leave, has a (possibly disconnected) basin of attraction such that state variables with initial conditions in that basin (and nowhere else) will evolve toward that attractor. Even nearby initial conditions could be in basins of attraction of different attractors (see for example Newton's method#Basins of attraction).

Moreover, in those nonlinear systems showing chaotic behavior, the evolution of the variables exhibits sensitive dependence on initial conditions: the iterated values of any two very nearby points on the same strange attractor, while each remaining on the attractor, will diverge from each other over time. Thus even on a single attractor the precise values of the initial conditions make a substantial difference for the future positions of the iterates. This feature makes accurate simulation of future values difficult, and impossible over long horizons, because stating the initial conditions with exact precision is seldom possible and because rounding error is inevitable after even only a few iterations from an exact initial condition.

Empirical laws and initial conditions

Every empirical law has the disquieting quality that one does not know its limitations. We have seen that there are regularities in the events in the world around us which can be formulated in terms of mathematical concepts with an uncanny accuracy. There are, on the other hand, aspects of the world concerning which we do not believe in the existence of any accurate regularities. We call these initial conditions.^[2]

References

^ Baumol, William J. (1970). Economic Dynamics: An Introduction (3rd ed.). London: Collier-Macmillan. ISBN 0-02-306660-1.
^ Wigner, Eugene P. (1960). "The unreasonable effectiveness of mathematics in the natural sciences. Richard Courant lecture in mathematical sciences delivered at New York University, May 11, 1959". Communications on Pure and Applied Mathematics. 13 (1): 1–14. Bibcode:1960CPAM...13....1W. doi:10.1002/cpa.3160130102. Archived from the original (PDF) on February 12, 2021.

External links

Quotations related to Initial condition at Wikiquote

[1] Baumol, William J. (1970). Economic Dynamics: An Introduction (3rd ed.). London: Collier-Macmillan. ISBN 0-02-306660-1.

[2] Wigner, Eugene P. (1960). "The unreasonable effectiveness of mathematics in the natural sciences. Richard Courant lecture in mathematical sciences delivered at New York University, May 11, 1959". Communications on Pure and Applied Mathematics. 13 (1): 1–14. Bibcode:1960CPAM...13....1W. doi:10.1002/cpa.3160130102. Archived from the original (PDF) on February 12, 2021.

[1]

[2]