1. Introduction
Many real processes in both research and practice can be well modelled by dynamical systems with random parameters. Dynamical systems of this kind are widely used for modelling in biology and medicine [
1], in sociology or socioeconomics [
2,
3], and in finance [
4,
5,
6,
7,
8]. They can also be applied to modelling security and risk management in cyberspace [
9,
10] and in many other areas.
It is known that, in general, difference equations with a random structure cannot be solved in a closed form except for several classes of such equations. In these cases of equations and systems, statistical characteristics of the solution are sought. Thus, finding a solution to an equation with a random structure in a broader sense means finding the statistical characteristics of the solution. There are several methods of obtaining such a solution. By one of them the problem of determining the probability density function of a solution transforms into one to find a solution to the Kolmogorov forward (Fokker–Plank) equation, which is a partial differential equation that describes the time evolution of the pdf [
11]. Another option is to find an approximate solution of stochastic differential equations that can be obtained directly using numerical methods [
12,
13]. A textbook by Kloeden and Platen [
14] describes many such algorithms. A statistical approach to biofidelic modelling is used in [
15,
16].
The method we propose is one of moment equations. It tries to find the moments of the solution without using the density function. It constructs a deterministic system of moment equations for a given dynamical system with random structure that can be solved using well-known methods, with the solutions to such a system of moment equations behaving like moments of solutions to the system with random structure. The origin of this method can be found in the works by Valeev and his scientific school [
17]. The derivation of moment equations for some classes of dynamical systems with random coefficients and their use for solving certain real problems can be found in our previous works. The problem of navigation to a target, for example, is considered in [
18] using the moment equations for a non-homogenous linear system of equations with random structure, which was derived in [
19]. The moment equations for systems of linear and nonlinear differential and difference equations with a random structure determined by a Markov or semi-Markov process are also derived in [
20,
21,
22].
In [
9], moment equations are obtained for systems of difference equations if the random structure is determined by a semi-Markov chain with jumps. In the present paper, we deal with the derivation of moment equations for systems of difference equations with random coefficients if these coefficients depend on a Markov chain with jumps. To derive moment equations, we use the results of [
9].
We will study systems in a probability space , where is the sample space, is the set of all possible events, and P is some probability measure on . Let a sequence of random variables , be a random Markov or semi-Markov chain. In our considerations, S is the state space of all random variables for which there exists a squared first-order moment.
In such a probability space, we consider a non-stationary system of linear difference equations
where the state function
is an
m-dimensional column vector-function with the initial state
,
is an
matrix whose elements depend on the Markov or semi-Markov chain
with jumps at points
.
The state
m-dimensional column vector-function
is called a solution to initial Cauchy problem (
1), (2) within the meaning of a strong solution if it satisfies (
1) with initial condition (2), see [
23].
The rest of the paper is organized as follows. In
Section 2, some preliminary remarks and auxiliary results are introduced. The main results concerning moment equations for system (
1) with Markov switching are proved in
Section 3. In
Section 4, selected three processes are modelled by difference equations with random structure depending on a Markov or semi-Markov chain. There we use the moment equations of system (
1) obtained in
Section 3 to determine the stability domain of processes mentioned above. The last
Section 5 suggests directions for further research in this area.
2. Preliminary Remarks
Assume that the random Markov or semi-Markov chain
can be in
n possible states
. Thus, for any realization
,
the initial Cauchy problem (
1), (2) determines an initial Cauchy problem for non-stationary systems of linear equations
where
if
,
Let
, be
fundamental matrices of solutions to initial Cauchy problem (
3), (4) such that
,
where
is the
identity matrix. Then, the solutions to (
1), (2) can be written in the form
Now, the jumps of solutions are associated with the moments of jumps,
, and, for any
regular constant matrix
, they have the following form
In the construction of moment equations, it is appropriate to use the probability density function of the random variable. Thus, we extend this concept to the case of a discrete random variable
X using the integrable Dirac delta function, as the function
which means that the discrete random variable
X can assume value
with probability
Given this extension, we can determine the moments of a discrete random variable in the same way as for a continuous one.
Definition 1. Let be a random variable depending on a random chain ξ with n possible states , . The vector functionwhereis called the first-order moment of the random variable . The values , are called the first-order particular moments corresponding to the states of the random variable with particular density functions , . The matriceswhereare called the second-order moments of the random variable . The values , , are called the second-order particular moments. Definition 2. The trivial solution to system (1) is said to be -stable, if, for any solution , to system (1), the series converges. Remark 1. It is easy to see that the trivial solution to system (1) is -stable if and only if the matrix series , or is convergent. 2.1. Markov Chain is Markovian
Assume that the random chain
is Markovian that can be in
n possible states
with probabilities
satisfying the system of difference equations
where
,
are transition probabilities from one state to another.
2.2. Markov Chain is Semi-Markovian
Assume that a random chain
is semi-Markovian with
n possible states
. The transition intensities
from state
to
at time
k satisfy the following conditions
When formulating our results, we use the concept of matrix operators.
Definition 3. In the probability space , let two random variables and be defined with probability density functions and respectively. Then, the operatoris said to be stochastic. In [
9], the moment equations for system (
1) with semi-Markov switching are derived. A similar result for a system (
1) in which the semi-Markov chain is transformed into a Markov chain will be derived using the results obtained in [
9].
Theorem 1 ([
9]).
Let , be solutions to system (1) with semi-Markov switching and jumps (5). Then, the vector of the first-order moments is determined by the system of equations for particular moments of the first order , ,The matrix of the second-order moments is determined by the system for particular second-order moments , , Theorem 2 ([
9]).
Let the sumsconverge and , . Then, for the trivial solution to system (1) with jumps of solutions (5) to be -stable, it is necessary and sufficient that the following equivalent conditions hold:- (1)
there exists a solution to system of matrix Equations (12) and (13) under the condition , - (2)
the successive approximationsare convergent.
4. Model Problems
In this section, we will present three model problems: Threats to security in cyberspace, radiocarbon dating, and stability of foreign currency exchange market. These processes are modelled by difference equations with random parameters that depend on a semi-Markov or Markov process. Process stability is investigated using the moment equations derived above.
4.1. Threats to Security in Cyberspace Modelled by a System with Semi-Markov Parameters
The era of artificial intelligence is coming and the cyberspace is becoming a place of numerous conflicts that differ in form and method, intensity and degree of threats. This forces us to develop new solutions and models that allow us to anticipate the threat in advance.
There are various criteria of information system security risks classification that provide an overview of most of the threat models. The current tendency is to describe the diversity of situations of exposure to limited information on various threats, considering the description of the greatest possible number of factors influencing the safety of information. This is usually a classification architecture that guides organizations to implement information security strategies.
Our approach to this problem is different. We create a dynamical system of difference equations with coefficients depending on a Markov or semi-Markov chain as a mathematical model. The emergence of real threats of cyberattacks with certain probabilities implements the transition of the system from one state to another. Thus, the transition from one state to another is affected by the simplest streams of events with the corresponding intensity of detection or elimination. The random parameters of threats obtained from the statistics of their occurrence and elimination can serve as the input parameters. Our goal is to determine the stability domain of an information system, that is, if the system is ready to operate in conditions of its security.
Suppose that the work of an information system is described by system (
15) with jumps of solutions
and the semi-Markov chain in (
15) can be in three possible states:
- θ1—
the system operates in a threat-free environment, or threats appear with transition intensities , but do not represent damage with probability ;
- θ2—
the system operates in an environment where threats occur with transition intensities , but the programmer is ready to reflect it with probability ;
- θ3—
the system operates in an environment where threats occur with transition intensities , and the programmer is not ready to reflect it with probability ;
We want to determine the conditions under which the computer system can work without leakage of information as a result of the threat action. Denote
and suppose that the transition intensities are given as
and equal to zero in other cases. Then, system (
14) takes the form
Thus, conditions of
-stability can be expressed in the form
The actual boundaries of the information system stability area can be determined in a specific case, see
Figure 1.
4.2. Stability of Foreign Currency Exchange Market
The largest market in the world is currently the foreign exchange market, which determines the exchange rates for each currency. The primary function of the foreign exchange market is the transfer of purchasing power from one currency to another. The demand for a country’s currency depends on the country’s balance of payments. In particular, central banks are responsible for maintaining inflation in the interest of sustainable economic growth and, at the same time, contributing to the overall stability of the financial system. A big factor affecting the exchange rates is the interest rate paid by a country’s central bank, the money supply created by the country’s central bank and a country’s economic growth and financial stability. Commercial banks operate in the foreign exchange market, buy and sell currencies for their clients.
A foreign exchange risk arises when a bank holds assets or liabilities in a foreign currency, which causes exchange rate fluctuations and affects the bank’s profit and capital. The actual rates may differ significantly from the trend if drastic changes in the country’s economy occur that may lead to a currency crisis.
The bank’s market activity can be described by system (
15). Let the semi-Markov chain in (
15) be in three possible states:
—there is a currency crisis, ,
—there is a stable foreign currency exchange market, ,
—there is a market with currency restrictions, .
If we denote transition intensities as mentioned above in the previous problem, the conditions for the stability of the foreign exchange market will be identical to those obtained there, i.e., (
28). In a special case, if
we get the condition of stability in the form
The actual boundaries of the foreign exchange market stability area are shown in
Figure 1.
4.3. Radiocarbon Dating Modelled by a System with Markov Parameters
The age of an object containing organic material can be determined by using a method called radiocarbon dating. The method is based on the fact that, during its life, a plant or animal is in equilibrium with its surroundings, therefore, it has the same proportion of . When the animal or plant dies, the amount of it contains begins to decrease and so the ratio of to in its remains will gradually decrease. The proportion of radiocarbon can be used to find out when the animal or plant died.
If we denote by
k the unit of time, then the amount
of radioactive carbon particles
can be expressed by a system of linear difference equations
where
is a random Markov chain with two possible states:
—the test sample (in terms of detecting age) is not affected by new pollution or the effects of radioactive substances,
—the sample process is subject to some kind of influence,
with transition probabilities
The following
matrices may correspond to these states:
and the moment Equations (
24) for the second-order moments obtain the form
Denoting
we get the scalar moment equations
the characteristic equation for which is in the form
By calculating the determinant, we get the equation
that has two different roots in the form
The condition
holds, if the inequalities
or, the inequalities
hold. Thus, we get
The first inequality holds for any and .
Then, the stability conditions result directly from the second inequality rewritten into the form
Thus, the process is stable if the probabilities of transition from one state to another satisfy the conditions
Under these circumstances, the decay of matter into isotopes is stable. The stability domain is shown in
Figure 2.
5. Conclusions
We study a dynamical system under the conditions of uncertainty which are described or are under the influence of a Markov process. The paper’s main contribution is a modified method by which systems of difference equations with random coefficients may be represented by deterministic systems to be investigated using well-known procedures. This modification is based on a suitable definition of stability and on deriving a system of momentum equations for difference equations in which the random parameter depends on a Markov or semi-Markov chain with jumps. The systems considered can be used for the description of a number of real phenomena that may assume an arbitrary finite number of different states.
A Markov process has a strict definition in both the continuous and discrete cases. For example, when a programmer works in the conditions of a hacker attack or its absence, these are two clear states. He can “jump” from one state to another. This means that protection is absent or not with a certain probability. Clear two states mean no drifting (no fluctuation). A special Markov process of the Wiener type might be described as roaming (or fluctuation), which is characteristic, among others, of a drunkard’s walk (with no jumps in such a case). In our problems, we study the stability of the system under conditions of transitions from one state to another by jumping, with history forgotten. Under certain conditions the jump may occur under the influence of some fluctuations. This depends on what definition is given by fluctuation. If fluctuations were investigated as a process that meets all the conditions of a Markov or semi-Markov process, new, interesting results could be derived for further real processes (described, for example, in [
15,
16]).
In the future, we plan to study the behavior of the system under the influence of processes without memory, as well as combinations of various influences, including those associated with periodic Markov processes to obtain the resonance conditions for solving problems of catastrophe theory, ecology and problems of the oceans. In addition, an infinite number of states of the Markov process is of interest.
There are many practical problems that are modelled by systems of equations of our type with a delayed argument depending on a process that satisfies the Markov property. Therefore, in the future we also plan to apply and justify the methods proposed in the article to systems of equations with random coefficients and a delayed argument.
Having obtained some results for non-linear systems, suitable for practical rather than theoretical applications, we are waiting for a potential demand by people in practical professions.