Strong solutions of mean-field FBSDEs and their applications to multi-population mean-field games
Abstract
We study the existence of strong solutions for mean-field forward-backward stochastic differential equations (FBSDEs) with measurable coefficients and their implication on the Nash equilibrium of a multi-population mean-field game. More specifically, we allow the coefficients to be discontinuous in the forward process and non-Lipschitz continuous concerning their time-sectional distribution. Using the Pontryagin stochastic maximum principle and the martingale approach, we apply our existence result to a multi-population mean-field game (MPMFG) model where the interacting agents in the system are grouped into multiple populations. Each population shares the same objective function, and we take changes in population sizes into consideration.
Keywords: mean-field FBSDEs; multi-population mean-field game; strong solutions; irregular coefficients; Girsanov transformation
AMS subject classification: 60H30
1 Introduction
In our framework, we provide a set of sufficient conditions for the existence of a strong solution for the following mean-field forward backward equations (FBSDEs):
(1.1) | ||||
Here are independent multidimensional Brownian motions and stands for marginals of . By decoupling (1.1) using the Girsanov transform, we prove the strong existence of a solution when i) the coefficients are discontinuous with respect to the state variable and ii) is not necessarily uniformly bounded. The result was applied to a multi-population mean-field game (MPMFG). FBSDE (1.1) is a probabilistic representation of the non-linear MPMFG model. We are interested in the evolution of large groups of interacting agents who are trying to realize a specific goal from an individual point of view. However, when the number of agents is large, it is usually very hard to keep track of all the agent-to-agent interactions and study the global behavior. Therefore, instead of focusing on the impacts of each single agent’s behavior, we can replace the influences of all the other players on a given agent (representative) by their average influences. Such an idea is named the mean-field approach borrowed from statistical physics. The goal of the theory is to derive effective equations for the optimal behavior of any single player when the size of the population grows to infinity. Compared to the single population mean-field game models, where the agents are assumed to share a common characteristic, in an MPMFG model, the social networks can be divided into several populations such that each population shares a common characteristic. An environment that contains several populations is common in practice. For instance, in the study of Lee et al., (2022), the MPMFG framework was applied to analyze population relocation and vaccine distribution during the COVID pandemic. Casgrain and Jaimungal, (2020) utilized MPMFGs to examine the trading actions of agents with different beliefs. Aurell and Djehiche, (2018) investigated mean-field control problems involving multiple populations to model crowd motion. In a series of works Banez et al., (2020) and Gao et al., (2021), they explored MPMFGs derived from some specific models, focusing on the role of different beliefs. Huang et al., (2006) introduced stochastic dynamic games in large populations where multi-class agents are coupled via their dynamics and costs. Furthermore, Wang et al., (2020) took the idea of FBSDEs and applied it to study how to keep a system stable and balanced in a broader context of mean-field control problems. They looked at situations where different parts of a system affect each other’s behavior and costs. In a related study, Li et al., (2023) used a similar approach, mean-field linear FBSDEs, to investigate a specific type of game where shared random factors influence the players’ decisions. Moreover, they obtained a unique classical solution over an arbitrary time horizon for FBSDE without any monotonicity conditions. While the majority of previous literature assumes the coefficients in (1.1) to be continuous, (mean-field) FBSDE with discontinuous coefficients are also studied. For instance, Carmona et al., (2012) studied a model about pricing carbon emission allowances where the terminal condition is not continuous. In Carmona et al., (2013), the model was extended to a mean-field framework. Also Carmona and Lacker, (2015) studied discontinuous mean-field game under weak formulation. Recently, strong solutions of FBSDEs with discontinuous coefficients are studied in Luo et al., (2022) and Nam and Xu, (2022). This paper is organized as follows: Section 2 introduces the definitions and notations. In Section 3, we present the main result, Theorem 3.12, in the context of mean-field FBSDE. In Corollary 3.15 and Corollary 3.17, we provide uniqueness results, and later we offer a counterexample where the uniqueness does not hold. In Section 4, we formulate our mathematical model of MPMFG and apply the Pontryagin Stochastic Maximum Principle. Using the martingale approach, we prove an MPMFG has a closed loop Nash equilibrium.
2 Notations and definitions
We denote by the set of probability measures on , and the space of continuous functions from to . In particular, we denote by the set of probability measures with a finite first-order moment, and the product space as
We use the notation for the distance of the metric space . For and in , the Wasserstein distance is defined by the formula
where stands for the space of all real-valued functions that are -Lipschitz continuous with respect to . Note the second equation is also known as the definition of Kantorovich-Rubinstein norm, which coincides with the -Wasserstein distance ; for more details, we refer Proposition and Corollary in Carmona and Delarue, (2018). For and in , we define the distance
Throughout the paper, we consider a vector as a column matrix and, for a matrix , we let be the transpose of and be the Euclidean norm. For a terminal time , we define
When the values for and are obvious, we use to simplify the notation. We denote the distribution of a random variable . For , we let be the marginals . The Doléans-Dade exponential of a local martingale is denoted by . Notice that we will repeatedly use the notation for arbitrary constants, which may differ from line to line, and sometimes we will add a subscript to it, e.g., , to emphasize the dependency on the coefficient . Let be a natural number and be the set . For each , we consider measurable functions
We are interested in the following coupled mean-field FBSDE
(2.1) |
where, for each , , and is an independent -dimensional Brownian motion. In addition, we assume to be independent Brownian motions.
3 Existence and uniqueness results of mean-field FBSDE
In this section, we assume the following conditions on the coefficients of (2.1).
Assumption 3.1.
There are nonnegative constants , and a nondecreasing function with for which satisfy the following conditions:
-
•
For all and , we have
-
•
There exists a constant such that
hold for all .
-
•
The functions is continuous in for each .
-
•
Either of the following conditions hold:
-
–
is locally Lipschitz with respect to for each and for all .
-
–
is a constant matrix and for all .
-
–
-
•
The function is continuous in for all .
-
•
The function is continuous in and either of the following conditions hold globally in :
-
–
is Lipschitz continuous in .
-
–
and is uniformly continuous with respect to .
-
–
To find a the solution for (2.1), we will use a topological fixed point theorem on the mapping where is the solution of (2.1) with is swapped to . The first step is to find the unique solution for a given .
Lemma 3.2.
For any given , the following FBSDE
(3.1) | ||||
has a unique strong solution
Proof.
Lemma 3.3.
For any , there exists a constant which does not depend on such that
In particular, we have .
Proof.
First, let us show that . Note that, by Theorem IV.2.5 of Protter, (2005),
Our assumption on the uniform ellipticity of tells us that is bounded by . Assume . Then, since is the unique solution of BSDE in (3.1), a similar argument to Proposition of Nam and Xu, (2022) tells us that is uniformly bounded by a constant determined by and . Therefore, is bounded by a constant does not depend on . Otherwise (), and therefore, is bounded by . In sum, is always bounded. On the other hand, when is a constant, the drift of has a linear growth with respect to , and therefore, is bounded by a constant that does not depend on . Otherwise, is uniformly bounded by . Either case, we have is bounded by a constant that does not depend on . Therefore, we proved our first claim. Now let us prove that is continuous in time. We will use the symbol if there exists a constant which does not depend on such that . Note that
Note that, by the Hölder inequality and the Burkeholder-Davis-Gundy inequality, we have
Therefore, there exists a constant , which is independent of the choice of , such that
and it proves our claim. ∎
Now we consider the space
for a large enough constant endow a distance
As mentioned in the introduction, we will show that has a fixed point on via the Schauder’s fixed point theorem, which is given in Lemma 3.11. This will show the FBSDE (2.1) has a solution. Let us first show that is complete metric space.
Remark 3.4.
Space is a complete metric space.
Proof.
First note that since is a separable and complete metric space we have is separable and complete by Bolley, (2008). Therefore, is a complete metric space. Now consider a Cauchy sequence in . Then,
In addition, we know that for any there exists an such that when
Thus, for any , the sequence is Cauchy in a complete space . Therefore, we can define
for each . Let us verify that . Note that, for and , we have
By taking , we deduce , and therefore, we conclude is a complete metric space. ∎
Let and consider the following decoupled FBSDE:
(3.2) | ||||
Remark 3.5.
For simplicity let us denote the following from now on
and we define the joint probability measure as the product measure of , where . Moreover, if FBSDE (3.2) has a solution, then by the non-degeneracy of and uniformly boundedness of , we know that Girsanov theorem can be applied. Thus is a weak solution of FBSDE (3.1).
For future purpose, from Proposition 3.6 to Remark 3.10, we will share some important properties about FBSDE (3.2).
Proposition 3.6.
For any given , the decoupled FBSDE (3.2) has a unique solution.
Proof.
Let and be two solutions of (3.2). First of all, Assumption 3.1 tells us that the forward SDE in (3.2) is uniquely solvable, and therefore, are indistinguishable. On the other hand, Hamadene et al., (1997) tell us that there exist Borel measurable functions
satisfying
are two weak solutions of FBSDE (3.1) under different measures. Note that the forward SDE of (3.1) after substituting using the functions has a unique strong solution by Assumption 3.1. This implies and are the strong solutions of (3.1) since they are the functions of , and therefore, adapted to the filtration generated by the driving martingale (measure-changed Brownian motion). By Lemma 3.2, we have
∎
The domination condition was defined in Hamadene et al., (1997) and presented below for the reader’s convenience.
Definition 3.7.
Consider a class of SDEs
(3.3) |
defined on . We say that the coefficients satisfy the -domination condition if the following conditions are satisfied:
-
•
For each , the SDE (3.3) has a unique strong solution . We denote as the law of , that is, .
-
•
For any -almost every , and , there exists a function such that
-
–
for all ,
-
–
.
-
–
Proposition 3.8.
For each , the coefficients satisfy the -domination condition and is bounded uniformly for .
Proof.
Proposition 4.5 in Nam and Xu, (2022) shows that the domination condition is satisfied. The uniform bound of can be found using the Grönwall’s inequality similar to the same proposition. ∎
Lemma 3.9.
Let be a sequence in converging to with respect to the metric . Then, the solutions and of (3.2) for and respectively satisfy,
for each .
Proof.
For the sake of simplicity, let us omit the population indicator in our proof. By denoting , one can easily verify that satisfies the growth condition for all . Thus from Assumption 3.1 and Lemma 26.2 of Hamadene et al., (1997), we know that there exists a constant that depends only on in Assumption 3.1 and the initial value of such that
(3.4) |
Moreover, from Proposition 3.6 we know that there exists a sequence such that is the unique solution of decoupled FBSDE (3.2) with given , namely the BSDE is with coefficients . For notation simplicity, we denote . Notice that there is a constant such that, for any , we have
for . Therefore, there exist a subsequence which we still denote by , and such that
(3.5) |
Observe that for each , , , ,
Since is continuous with respect to and , the terminal condition is a Cauchy sequence in , that is, as . Also we deduce that
On the other hand, there is a constant which depends only on such that
by applying Markov’s inequality. At last, the -domination condition implies
where represents the distribution of . Thus from (3.5) we have for -almost every
Therefore, for any , one can select large enough so that
for all , that is is a Cauchy sequence such that for all , -almost every . Define . Since (3.4) tells us that for any , , by the dominate convergence theorem we have
where . On the other hand, by the application of Itô formula one can obtain
Hence, by Hölder’s inequality and for any , , we have
Therefore, is also a Cauchy sequence in and we can denote as its limit. Now we are going to verify that is a solution of FBSDE (3.2) with given . Since the solution of (3.2) has a unique solution by Proposition 3.6, this implies and proves the claim. Let us take along the subsequence we chose previously to the following BSDE
It is obvious that the left hand side converges to almost every . In addition,
Lastly, the dominated convergence theorem tells us that
in for all . Therefore, is a solution to the (3.2). We conclude the proof by mention that since FBSDE (3.2) is uniquely solvable, we have shown for any converges to any , there exists a corresponding sequence such that every subsequence of there is a subsequence of the subsequence that converges to the same limit . It implies converges to in for any converges to in . ∎
Remark 3.10.
For the case the decoupled FBSDE (3.2) is one-dimensional and is uniformly continuous with respect to , the results from Hamadene et al., (1997), Hamadène, (2003), and Fan et al., (2010) support Proposition 3.6 holds. Meanwhile, since the natural property of uniformly continuous function that it can always be bounded by a linear growth function, still satisfies the linear growth condition in Lemma 3.9.
Let us prove has a fixed point. Recall Remark 3.5, we consider .
Lemma 3.11.
has a fixed point on .
Proof.
To apply the Schauder’s fixed point theorem, we need to check the following conditions:
-
(i)
is a non-empty convex set and is contained in a compact subset; and
-
(ii)
is continuous on .
Firstly, let us prove (i). It is trivial that is non-empty and convex. In addition, from Lemma 3.3, we have is -Hölder continuous. Note that, for and with is the Dirac-measure in ,
and therefore, . Now we are going to show that is contained in a compact subset of . Let us define
To show that is relatively compact in under , we need to use a type of Arzela-Ascoli theorem. Since consists of equicontinuous measure-valued processes, we only need to verify the relative compactness of for any given , that is
(3.6) |
where is the unit ball of radius centered at origin. For arbitrary and , by Markov’s inequality and Hölder’s inequality, we know that
Notice that above inequality goes to as , and therefore, equation (3.6) holds. Such tightness condition (3.6) gives us that for each , the collection of probability measures of is relatively weakly compact in by Prokhorov’s theorem. Now, let us prove (ii). Recall Remark 3.5 such that and are weak solutions of
respectively. Since the Girsanov transformed SDEs enjoy the uniqueness in law, we have
Note that
Using , Hölder inequality, and Minkowski’s inequality, we can obtain
By the definition of , we have for a suitable constant
Since , further by Grönwall inequality, we know that there exists a constant independent of , such that . Thus we could deduce that there is a constant which satisfies
Since is uniformly bounded and by Lemma 3.9, the following inequality is enough to conclude the proof:
Then from Lemma 3.9 and the transitivity of continuity we conclude is a continuous function on . ∎
It is noteworthy that we can extend Assumption 3.1 to the case where it has linear growth in the mean-field term by a localization argument.
Corollary 3.13.
For a process , we denote by , where is twice differentiable with uniformly bounded first- and second-order derivatives. Now we consider mean-field FBSDE to be of the form:
For any , we let
and FBSDE
(3.7) |
We assume all the coefficients satisfy Assumption 3.1 except we allow them have linear growth with respect to the expectation term for and . In this case, mean-field FBSDE (3.7) has a solution.
Proof.
This can be proven via a localization argument. Let
and , and . Thus from Theorem 3.12 we know that mean-field FBSDE
(3.8) |
has a strong solution since are uniformly bounded with respect to . Moreover, since are under the linear growth condition, has bounded derivative, and is bounded, we can apply Itô’s formula to deduce that
Thus we obtain
Consequently from Grönwall inequality we know that , and that is independent with respect to . Therefore, if we chose to be large enough, then the solution of (3.8) would be the solution of mean-field FBSDE (3.7). ∎
We are going to discuss that in some cases, FBSDE (2.1) could have a unique solution.
Assumption 3.14.
We assume does not depend on , and is modulus continuous in the third variable. We call is modulus continuous in the third variable if there exists a continuous function , with for all , for all such that for all
Proof.
Without losing generality in the proof we only consider the case when there is one population, and we apply as a solution indicator. We consider under measure , FBSDE (2.1) is of the form
(3.9) |
The key point is to verify whether the forward equation in (3.9) is uniquely solvable and the Corollary follows easily. The result is similar to Bauer et al., (2018) in which they proved the strong existence and uniqueness of mean-field SDEs with constant diffusion term. We notice that since is uniformly bounded and is non-degeneracy, we could apply Girsanov transform to define new Brownian motions. By denoting , we define a Brownian motion under a measure
So that we have under measure ,
Meanwhile, we further define the following that under some measures
where
(3.10) |
Notice that the following SDE has a unique strong solution
where is a well-defined Brownian motion. Thus we know there exists a measurable function such that
Furthermore, from (3.10) we can obtain that there exists a measurable function such that
Thus we have for all bounded measurable function
Therefore we can conclude
and so . Now from the definition of and Assumption 3.14 we have
Putting , since we have previously proved in Lemma 3.3 that is continuous and , then by Bihari’s inequality, we have for all . Thus we have which means the forward equation in FBSDE (3.9) is uniquely solvable, and from our assumptions, the backward equation in FBSDE (3.9) is uniquely solvable, which means the system has a unique solution. ∎
Assumption 3.16.
We assume is modulus continuous in the mean-field variable and do not have dependency on the mean-field term.
Proof.
Similar to previous proof, we only consider the case when there is one population, and we apply as a solution indicator. In this case, under measure , FBSDE (2.1) is of the form
(3.11) |
Since is uniformly bounded and is non-degeneracy, by denoting , we could apply Girsanov theorem for
such that are weak solutions of
Since the forward equation of above system is uniquely solvable, we can deduce that a.s. for a given . Moreover, the BSDE of (3.11) is also uniquely solvable for given , which means there exist measurable functions such that -a.s.. In this sense, we have the forward equation of (3.11) is of the form
which is also uniquely solvable from the proof of Corollary 3.15. Thus the system (3.11) has a unique solution. ∎
We provide an example here to demonstrate that even in a simple case, the uniqueness of (2.1) may fail.
Example 3.18.
We consider following mean-field FBSDE with
(3.12) |
We let are Lipschitz and bounded functions. In particular, we consider the case , when , where is a large enough constant. In this case, one can easily verify that with where is a suitable constant, is a solution of FBSDE (3.12). Thus uniqueness fails.
4 Mean-field FBSDE and multi-population mean-field game
4.1 Model setup
In order to facilitate a better understanding, we start with an -player optimal control problem where the players’ states and costs are influenced by other players’ states. For a player , his state can be described by the following SDE
(4.1) |
where is the state profile of the other players, and stands for the control of player . The goal of player is to try to minimize his cost at terminal time
(4.2) |
However, such game can be too complicated to study when is large. Luckily, when the number is large enough, we observe that the difference among players are negligible, or sometimes we call it indistinguishable. It allows us to consider the aggregation of the other players’ influence given as a empirical measure . Then the search for approximate Nash equilibriums could be done through the solution of the optimization problem of one single player interacting with the other players through the empirical distribution . Moreover, one can expect that the empirical measure will not be much affected by the deviation of one single player, and should be able to assume that the empirical measure is approximately equal to a limit , which can be taken as a deterministic function. Namely, we let the representative with its state denoted by and control denoted by and thus we translate the -player game into a mean-field game
(4.3) |
such that the representative aims at minimizing his cost
(4.4) |
with
Now we consider an environment that contains populations or groups, and each populations contains a large number of players. Moreover, we assume players in the same population are indistinguishable. Based on the mean-field notion, we denote as the state of the representative of population and its state can be given by the following SDE
(4.5) |
where here stands for a mean-field vector with the collective behavior in population , and is a vector with the proportion of the population in group relative to the total population. Similarly, we consider the payoff of representative is of the form
(4.6) |
and
In particular, we consider the population proportion changes in group satisfy the following replicator equation
(4.7) |
where is the fitness of this type and is the average payoff in the whole environment. Generally speaking, a replicator equation is a differential equation that governs the evolution of the densities of different strategies. In evolutionary game theory, the procedures that agents follow in deciding when to switch strategies and which strategies to switch to are called revision protocols. They are usually payoff functions of playing one strategy against another based on the current state of the entire environment, which, in our case, is the average state of each population and the population distribution . A revision protocol, for instance, is usually considered as a non-negative valued function . For more information about evolutionary games we refer the book Sandholm, (2010). In our case, we do not take migration into consideration but apply the idea of replicator equation to describe the population changes. We log the number of players in each groups, and add a small amount of randomness imposed on the changes in the number of players, and we consider as a new stochastic process to reformulate the mean-field problem.
Specifically, we consider (4.7) is of the form
(4.8) |
Then we times the total number of players in the environment on the both side of (4.8), and consider the logarithm of the number of population that we denote by . In the spirit of equation (4.8), we could write a equation
(4.9) |
and we assume there exists a constant such that for all , , . At last we add a noise to the logarithm number of players which still denote by with , and assume it satisfies the following SDE
(4.10) |
where , .
In this sense, we could properly define , with , , , , , and . Thus we could rewrite our multi-population mean-field problem as
where the representative tries to minimize
with
Remark 4.1.
Unlike the usual MPMFG, we take the population changes in each group into consideration. The crucial adjustment we made in our model is to reinterpret the variable not as a representation of the population distribution, but rather as the number of players influenced by a small degree of randomness. This strategic shift is motivated by the need to ensure that our findings accommodated a non-degenerate diffusion coefficient, while minimizing alterations to the fundamental aspects of the original model. Also, one should note that given above problem is solvable, we require the share the same for all . It is true since we assume is bounded, that once is given, Menoukeu-Pamen et al., (2013) provides us SDE (4.10) is uniquely solvable.
4.2 Multi-population mean-field game and corresponding Hamiltonian system
In this section we denote by the set of all the admissible actions or controls, which means will be the set of processes taking values in which satisfy a set of admissibility conditions. In our case one can consider as a convex subspace of Euclidean space . We introduce the Hamiltonian of the system for each representatives is the function
For notation simplicity sometimes we would omit the superscript from now on. For an admissible process , we denote be its corresponding controlled state process. We call adjoint processes associated with for any solution of the BSDE
(4.11) |
This equation is called the adjoint equation associated with the admissible control . Notice that when are given, BSDE (4.11) is uniquely solvable since it is linear. We consider the following assumptions hold for any given .
-
•
The terminal condition is bounded.
-
•
is non-degenerate and locally Lipschitz with respect to .
-
•
is a bounded function with bounded first order partial derivatives , and bounded second order partial derivative . Also we assume .
-
•
For all the mapping is twice continuously differentiable, and is bounded and Lipschitz continuous with respect to , and are uniformly bounded. Moreover, the second-order partial derivatives of with respect to and satisfy
for some and denotes the identity matrix of dimension .
-
•
All the coefficients and their partial derivatives with respect to are continuous with respect to .
Remark 4.2.
From our assumptions we know that and are uniformly bounded, therefore, for any , there exists a unique pair of solution of BSDE (4.11) with is uniformly bounded, namely
Lemma 4.3.
Under above assumptions, for any given , and for all there exists a unique minimizer . Furthermore, is bounded and is Lipschitz continuous with respect to uniformly in and continuous with respect to .
Proof.
Since the second partial derivative is invertible and its inverse is uniformly bounded, the implicit function theorem implies the existence and uniqueness of the minimizer , together with its boundedness on bounded subsets. Moreover, since is the unique solution of the equation , the implicit function theorem implies that is differentiable with respect to with a continuous derivative. Moreover, we could write and where stands for the Jacobian matrix. Thus by our boundedness assumptions on and Remark 4.2, such derivatives must be globally bounded. The regularity of with respect to follows from the following. If is fixed and are generic elements in , and denoting the associated minimizers, we deduce from the convexity assumption
Since and are continuous with respect to , we can conclude the result. ∎
Follow by Lemma 4.3, we could have the following mean-field FBSDE
For readers’ convenience, we recall that
-
•
-
•
Then the multi-population mean-field game can be translated into the following mean-field FBSDE problem
(4.12) |
Moreover, we further assume with is bounded, and are convex with respect to . Then we can deduce the following proposition.
Proposition 4.4.
Proof.
Firstly we verify that if a.s., is an optimal control, i.e., . Let be a generic admissible control, and we denote the associated controlled process. By integration by parts and the convexity of the functions, we have
Similarly, we can deduce that
Therefore, we can obtain
Now we verify the solvability of FBSDE (4.12). Notice that we have is Lipchitz continuous with respect to , and from Lemma 4.3 we know that is Lipchitz continuous with respect to . Therefore, combining is bounded, we have is Lipschitz with respect to . Moreover, we have are all bounded functions, are continuous with respect to , and is bounded from Lemma 4.2. Thus, the coefficients satisfy Assumption 3.1 with . ∎
For some cases, we do not necessarily need the boundedness of , or even the continuously differentiability for the coefficients.
Example 4.5.
We consider the th representative’s state satisfies the following one-dimensional mean-field SDE
and its objective is to minimize the cost functional
We consider with and is a bounded function. We also assume are uniformly Lipchitz, convex, possibly not continuous differentiable with respect to , and are continuous with respect to . Moreover, we assume is non-decreasing with respect to . In this sense, we could write the corresponding Hamiltonian and its minimizer
Lemma 4.6.
Let denote the right derivative, and be the solution of the following mean-field FBSDE
(4.13) |
Then is bounded for all a.s., and for , we have for any .
Proof.
Firstly note that from our assumptions, there exists a suitable constant such that and . By the well-known comparison principle, if (4.13) is solvable, then for all a.s., where
As and almost surely. Based on above observation we now prove the existence result of FBSDE (4.13) by using the localization argument. For , the boundary of we obtained above, we define be a smooth function on satisfying
and . Consider the mean-field FBSDE
(4.14) | ||||||
Then one can check that the coefficients satisfy our Assumption 3.1 with , and thus is a solution of (4.14). Moreover, by the same comparison argument, we could obtain that for all . Thus is also a solution of FBSDE (4.13). For the statement for any , one can easily verify that by using the similar idea in the proof of Proposition 4.4. ∎
4.3 Strong solvability of multi-population mean-field games
To begin with, we want to mention a pioneer work done by Carmona and Lacker, (2015), in which they studied mean-field games in a probability weak formulation. They take advantage of the comparison theorem of BSDEs and translate the search for the Nash equilibrium of a mean-field game into a decoupled mean-field FBSDE problem. However, since a measure-change technique is applied, they cannot obtain the equilibrium is adapted to the original filtration. To solve the mean-field game in a strong sense, one must solve a coupled mean-field FBSDE, and thus our results can be helpful.
We denote the control space by which is a compact convex subset of a normed vector space, and the set of admissible controls consists of all progressively measurable -valued processes. We consider a MPMFG under measure with
The representative’s state is given by the following SDE
with utility functional
and we require
The goal of the representative is to find the optimal control such that
for all . We assume coefficients are continuous in . For any and , we let and
We also assume satisfy the assumption in 3.1. We denote and introduce the following decoupled FBSDE
(4.15) |
where is a well-define Brownian motion for given . Furthermore, we denote
Notice that for each , the set is always non-empty since is assumed to be compact and is continous in . In particular, we assume for any , is continuous with respect to , uniformly continuous with respect to , and is continuous with respect to . Then we have for each , the FBSDE
(4.16) |
has a solution with by Theorem 3.12, and thus the existence of weak solution of (4.15).
Moreover, notice that we have
and
Thus from the well-known comparison principle of BSDEs, we know that where
such that for each . The existence of such can be obtained from well-known measurable selection theorem, e.g. Theorem 18.19 of Aliprantis and Border, (2007), namely there exists a function such that
and for each the map is jointly measurable with respect to . The only problem we face right now is the existence of the mapping such that has a fixed point. Notice that we have (4.16) is of the form
with requiring . This allows us to adopt results in Theorem 3.12. Therefore, such game has a solvable equilibrium in the strong sense. In particular, if we have set is a singleton and does not depend on and is modulus continuous with respect to , then according to Corollary 3.15, we can deduce such game has a unique equilibrium.
References
- Aliprantis and Border, (2007) Aliprantis, C. D. and Border, K. C. (2007). Infinite Dimensional Analysis: A Hitchhiker’s Guide. Springer Science & Business Media.
- Aurell and Djehiche, (2018) Aurell, A. and Djehiche, B. (2018). Mean-field type modeling of nonlocal crowd aversion in pedestrian crowd dynamics. SIAM Journal on Control and Optimization, 56(1):434–455.
- Banez et al., (2020) Banez, R. A., Gao, H., Li, L., Yang, C., Han, Z., and Poor, H. V. (2020). Belief and opinion evolution in social networks based on a multi-population mean field game approach. In ICC 2020-2020 IEEE International Conference on Communications (ICC), pages 1–6. IEEE.
- Bauer et al., (2018) Bauer, M., Meyer-Brandis, T., and Proske, F. (2018). Strong solutions of mean-field stochastic differential equations with irregular drift. Electronic Journal of Probability, 23:1–35.
- Bolley, (2008) Bolley, F. (2008). Separability and completeness for the Wasserstein distance. In Séminaire de probabilités XLI, pages 371–377. Springer.
- Carmona and Delarue, (2018) Carmona, R. and Delarue, F. (2018). Probabilistic Theory of Mean Field Games with Applications I: Mean Field FBSDEs, Control, and Games, volume 83. Springer.
- Carmona et al., (2012) Carmona, R., Delarue, F., Espinosa, G.-E., and Touzi, N. (2012). Singular Forward-Backward Stochastic Differential Equations and Emissions Derivatives. Annals of Applied Probability, 23:1086–1128.
- Carmona et al., (2013) Carmona, R., Delarue, F., and Lachapelle, A. (2013). Control of McKean–Vlasov dynamics versus mean field games. Mathematics and Financial Economics, 7:131–166.
- Carmona and Lacker, (2015) Carmona, R. and Lacker, D. (2015). A PROBABILISTIC WEAK FORMULATION OF MEAN FIELD GAMES AND APPLICATIONS. The Annals of Applied Probability, 25(3):1189–1231.
- Casgrain and Jaimungal, (2020) Casgrain, P. and Jaimungal, S. (2020). Mean-field games with differing beliefs for algorithmic trading. Mathematical Finance, 30(3):995–1034.
- Fan et al., (2010) Fan, S., Jiang, L., and Davison, M. (2010). Uniqueness of solutions for multidimensional bsdes with uniformly continuous generators. Comptes Rendus Mathematique, 348(11-12):683–686.
- Gao et al., (2021) Gao, H., Lin, A., Banez, R. A., Li, W., Han, Z., Osher, S., and Poor, H. V. (2021). Belief and opinion evolution in social networks: a high-dimensional mean field game approach. In ICC 2021-IEEE International Conference on Communications, pages 1–6. IEEE.
- Hamadène, (2003) Hamadène, S. (2003). Multidimensional backward stochastic differential equations with uniformly continuous coefficients. Bernoulli, pages 517–534.
- Hamadene et al., (1997) Hamadene, S., Lepeltier, J.-P., and Peng, S. (1997). BSDEs with continuous coefficients and stochastic differential games. Pitman research notes in mathematics series, pages 115–128.
- Huang et al., (2006) Huang, M., Malhamé, R. P., and Caines, P. E. (2006). Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle. Commun. Inf. Syst., 6(1):221–252.
- Lee et al., (2022) Lee, W., Liu, S., Li, W., and Osher, S. (2022). Mean field control problems for vaccine distribution. Research in the Mathematical Sciences, 9(3):1–33.
- Li et al., (2023) Li, M., Mou, C., Wu, Z., and Zhou, C. (2023). Linear-quadratic mean field games of controls with non-monotone data. Transactions of the American Mathematical Society, 376(06):4105–4143.
- Luo et al., (2022) Luo, P., Menoukeu-Pamen, O., and Tangpi, L. (2022). Strong solutions of forward–backward stochastic differential equations with measurable coefficients. Stochastic Processes and their Applications, 144:1–22.
- Menoukeu-Pamen et al., (2013) Menoukeu-Pamen, O., Meyer-Brandis, T., Nilssen, T., Proske, F., and Zhang, T. (2013). A variational approach to the construction and Malliavin differentiability of strong solutions of SDE’s. Mathematische Annalen, 357(2):761–799.
- Nam and Xu, (2022) Nam, K. and Xu, Y. (2022). Coupled FBSDEs with measurable coefficients and its application to parabolic pdes. Journal of Mathematical Analysis and Applications, page 126403.
- Protter, (2005) Protter, P. E. (2005). Stochastic Integration and Differential Equations, page 159. Springer Berlin Heidelberg, Berlin, Heidelberg.
- Sandholm, (2010) Sandholm, W. H. (2010). Population games and evolutionary dynamics. MIT press.
- Wang et al., (2020) Wang, B.-C., Zhang, H., and Zhang, J.-F. (2020). Mean field linear–quadratic control: Uniform stabilization and social optimality. Automatica, 121:109088.
Appendix A Measure Change of FBSDE
In this subsection, we provide sufficient conditions that guarantee the existence and uniqueness of a strong solution under the Girsanov transform. We assume the following conditions:
-
(H1)
The SDE
has a unique strong solution.
-
(H2)
For notation simplicity, we denote , and for the strong solution obtained in (H1), there exist Borel measurable functions such that and is a strong solution of BSDE
-
(H3)
For in (H1) and (H2), the process
is a martingale on .
-
(H4)
For in (H3), the forward SDE
has a (pathwise) unique strong solution .
Lemma A.1.
Assume (H1)–(H4). Then, the FBSDE
(A.1) |
has a strong solution that satisfies (H3) and . In addition, if we assume that, for any Itô process ,
has a unique strong solution, then (A.1) has a unique strong solution such that is a martingale on . Moreover, it also implies that BSDE
has a unique solution.