Mean-field FBSDE and optimal control
Nacira Agram, Salah Eddine Choutri

TL;DR
This paper develops a stochastic maximum principle for optimal control problems involving mean-field forward-backward stochastic differential equations, and demonstrates its application in a mean-field risk minimization portfolio problem.
Contribution
It introduces a new stochastic maximum principle for mean-field FBSDEs and applies it to solve a portfolio optimization problem with mean-field risk.
Findings
Derived necessary and sufficient optimality conditions.
Solved a portfolio risk minimization problem using the maximum principle.
Demonstrated the applicability of the theoretical results.
Abstract
We study optimal control for mean-field forward backward stochastic differential equations with payoff functionals of mean-field type. Sufficient and necessary optimality conditions in terms of a stochastic maximum principle are derived. As an illustration, we solve an optimal portfolio with mean-field risk minimization problem.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Mean-field FBSDE and optimal control
Nacira Agram and Salah Eddine Choutri
Department of Mathematics, Linnaeus University, Vaxjo, Sweden. Email: [email protected].
Department of Mathematics, KTH Royal Institute of Technology, 100 44, Stockholm, Sweden. Email: [email protected].
(Date: This version )
Abstract.
We study optimal control for mean-field forward backward stochastic differential equations with payoff functionals of mean-field type. Sufficient and necessary optimality conditions in terms of a stochastic maximum principle are derived. As an illustration, we solve an optimal portfolio with mean-field risk minimization problem.
Key words and phrases:
Mean-field forward-backward SDE, stochastic maximum principle, operator-valued BSDE, risk minimization.
2010 Mathematics Subject Classification:
60H05, 60H20, 60J75, 93E20, 91G80,91B70
This research was carried out with support of the Norwegian Research Council, within the research project Challenges in Stochastic Control, Information and Applications (STOCONINF), project number 250768/F20.
Contents
1. Introduction
Stochastic differential equation (SDE) of mean-field type (a.k.a McKean-Vlasov equation) is an SDE whose coefficients depend on the marginal law of the solution (state) as well as the solution itself, i.e.
[TABLE]
where is the law of , which is obtained as a limit of a sequence of empirical distribution functions representing the states.
The SDE (1.1) can be viewed as the limit of a system of particles with mean-field interaction
[TABLE]
when the size of the system tends to infinity.
Optimal control of mean-field SDEs was first studied by Andersson and Djehiche [andersson2011], and Buckdahn, Djehiche and Li [buckdahngeneral], where the mean-field coupling is represented by an expected value of the state. The authors established a suitably modified stochastic maximum principle which involves mean-field backward SDEs.
Extension to the case where the marginal law of the state process is the mean-field coupling was studied by Carmona and Delarue [carmona1]. The authors use the Wassertein metric space for measures and the lifting technique introduced by Lions [Lions] to differentiate a function of a measure. In [AO1], Agram and Øksendal have introduced a Sobolev space of random measures in which, the Fréchet derivative with respect to the measure can be used directly. This approach is used in the present paper.
The purpose of our work is to derive necessary and sufficient optimality conditions in terms of a stochastic maximum principle for a set of admissible controls which minimize a cost functional of the form
[TABLE]
with respect to admissible controls , for some functions , under dynamics governed by mean-field forward backward stochastic differential equations (MF-FBSDE). More specifically, we consider the coupled system
[TABLE]
[TABLE]
for some functions and a Brownian motion and denote the marginal laws of X and Y respectively.
Existence of a fully-coupled MF-FBSDE is studied by Carmona and Delarue under Lipschitz assumption on the coefficients but no uniqueness result was proven. Bensoussan et al [bens] prove existence and uniqueness of a fully coupled MF-FBSDE by assuming Lipschitz and monotonicity conditions. Recently, Djehiche and Hamadene in [Boualem2019] prove the same results but under weak monotonicity assumptions and without the non-degeneracy condition on the forward equation.
In the next section, we give some mathematical background. Next, we study stochastic optimal control of MF-FBSDE where sufficient and necessary optimality conditions are derived. In the last section, we construct a discounted dynamic risk measure by means of MF-BSDE and then we solve an associated risk minimization problem.
2. Generalities
Let be a one-dimensional Brownian motion defined in a complete filtered probability space The filtration is assumed to be the -augmented filtration generated by
Definition 2.1**.**
- •
Let be the space of random measures on equipped with the norm
[TABLE]
where is the Fourier transform of the measure , i.e.,
[TABLE]
We endow with the inner product , and are the Fourier transform of the measures and . Then is a pre-Hilbert space.
- •
We denote by the set of all deterministic elements of .
We give some examples:
Example 2.2** (Measures).**
Let us give some examples of measures in and :
- (1)
Suppose that , the unit point mass at . Then and
[TABLE]
and hence
[TABLE] 2. (2)
Suppose , where . Then and by Riemann-Lebesque lemma, , i.e. is continuous and when . In particular, is bounded on and hence
[TABLE] 3. (3)
Suppose that is any finite positive measure on . Then and
[TABLE]
and hence
[TABLE] 4. (4)
Next, suppose is random. Then is a random measure in . Similarly, if is random, then is a random measure in .
We denote by a nonempty convex subset of and we denote by the set of -valued -progressively measurable processes where with for all ; we consider them as the admissible control processes.
We will also use the following spaces:
- •
is the set of -valued -adapted càdlàg processes such that
[TABLE]
- •
is the set of -valued -adapted processes such that
[TABLE]
- •
denotes the set of absolutely continuous functions
- •
is the set of bounded linear functionals equipped with the operator norm
[TABLE]
- •
is the set of -adapted stochastic processes such that
[TABLE]
- •
is the set of -adapted stochastic processes such that
[TABLE]
We recall now the notion of differentiability which will be used in the sequel.
Let be two Banach spaces with norms , respectively, and let .
- •
We say that has a directional derivative (or Gateaux derivative) at in the direction if
[TABLE]
exists in .
- •
We say that is Fréchet differentiable at if there exists a continuous linear map such that
[TABLE]
where is the action of the liner operator on . In this case we call the gradient (or Fréchet derivative) of at and we write
[TABLE]
- •
If is Fréchet differentiable at with Fréchet derivative , then has a directional derivative in all directions and
[TABLE]
In particular, note that if is a linear operator, then for all .
3. Optimal control problem
Here we denote by the law of at time and by the law of at time . We assume that our system is gouverned by a coupled system of MF-FBSDE as follows:
The MF-SDE is given by
[TABLE]
for functions which are supposed to be -measurable and the initial value .
The couple MF-BSDE satisfies
[TABLE]
where is -adapted.
It is obvious from the definition of the norm (2.1) that
[TABLE]
where and are random variables that follow the distributions and respectively.
Assume that ( is a constant that may change from line to line)
- (A1)
there exists , such that
- •
for all , for all fixed
[TABLE]
- •
for all , for all fixed
[TABLE]
where is the distribution law of zero, i.e., the Dirac measure with mass at zero.
- (A2)
there exists , such that, for all fixed and all knowing of equation (3.1) and , we have
- •
for all
[TABLE]
- •
for all ,
[TABLE]
Proposition 3.1**.**
Under Assumptions (A1) and (A2), the MF-FBSDE (3.1)-(3.2) admits a unique solution
Since the system is partially-coupled i.e., the forward equation does not depend on the solution of the backward one, we can solve the system separately as follows: we first find a solution of the MF-SDE (3.1) and then we plug it into the backward equation (3.2), then we solve it.
Our aim is to maximize the performance functional of the form
[TABLE]
over all admissible controls, for functions , and
Now, we can define the Hamiltonian
[TABLE]
by
[TABLE]
Remark 3.2**.**
For ease of notation we drop the dependence of all variables except for the time we write Moreover, we will use
[TABLE]
For with corresponding solution , define, whenever solutions exist, and and by the adjoint equations:
The BSDE for the unknown processes
[TABLE]
The MF-BSDE for the unknown processes
[TABLE]
The forward SDE
[TABLE]
and
[TABLE]
Before stating and proving sufficient and necessary conditions of optimality, we need the following result, which is Lemma 2.3 in Agram and Øksendal [AO1]:
Lemma 3.3**.**
Suppose that is an Itô process of the form
[TABLE]
*where are adapted processes.
Then the map is absolutely continuous.*
It follows that is differentiable for -a.e. We will in the following use the notation
[TABLE]
3.1. Sufficient optimality conditions
Theorem 3.4**.**
Suppose that with corresponding solutions to equations (3.1), (3.2), (3.4),(3.5), (3.6) and (3.7) respectively. Suppose that
- •
* ,*
- •
* ,*
- •
* ,*
are concave functions -a.s for each Moreover,
[TABLE]
-a.s for all t Then is an optimal control.
Proof We show that for an arbitrary and a fixed
optimal
We introduce first the following notation and
[TABLE]
and
[TABLE]
From the definition of the Hamiltonian (3.3), we have
[TABLE]
and
[TABLE]
We use the concavity of and as well as the boundary values of equations (3.4), (3.5), (3.6) and (3.7)
[TABLE]
Applying It formula to and yields the following duality relations:
[TABLE]
[TABLE]
[TABLE]
[TABLE]
By the concavity of we obtain
[TABLE]
Finally, by substituting the derived duality relations (3.10),(3.11), (3.12) and (3.13) in (3.8) and using the estimates (3.9), (3.14), we obtain
[TABLE]
Using the tower property and the fact that is -adapted the desired result follows
[TABLE]
and thus, is optimal.
3.2. Necessary optimality conditions
Given an arbitrary but fixed control , we define
[TABLE]
Note that, the convexity of and guarantees that . We denote by and by the solution processes corresponding to and respectively.
For each and all bounded -measurable random variables the process
[TABLE]
belongs to .
In general, if is a process depending on , we define the operator on by
[TABLE]
whenever the derivative exists.
Define the following derivative processes
[TABLE]
such that
[TABLE]
and
[TABLE]
Moreover, we assume that all the partial derivatives of are bounded.
Theorem 3.5**.**
*Let be the optimal control and be the corresponding solutions to the
equations (3.17),(3.18), (3.4),(3.5), (3.6),(3.7). Then, the following statements are
equivalent*
- (i)
* for all bounded * 2. (ii)
* for all *
Proof We first prove theorem 3.5 by assuming (i) and aiming to show (ii)
[TABLE]
{ we substitute from equation }
[TABLE]
by using the chain rule, we obtain
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
and
[TABLE]
We apply It formula to and
then we take the expectation, we obtain the following important duality relations:
[TABLE]
[TABLE]
[TABLE]
[TABLE]
By substituting the derived duality relations and the partial derivatives of the desired result follows. This proof can be reversed to prove We omit the details.
4. Mean-field discounted risk measure
In this section we are interested in a particular class of MF-BSDE of the following form
[TABLE]
where
[TABLE]
We assume that the generator is -adapted, uniformly Lipschitz and concave, and the terminal condition
Definition 4.1**.**
Define by
[TABLE]
where is a component of the solution of the MF-BSDE (4.1) with terminal horizon , terminal condition and driver . Then is a dynamic risk measure induced by a MF-BSDE.
We may remark that the driver depends linearly on and its expected value , and nonlinear with respect to . This is interpreted as a market with interest rates . We can reformulated this as a problem with a driver independent of and by discounting the financial position . We assume that the instantaneous interest rates and are deterministic. We denote by , the corresponding discounted risk-measure.
Define the discounted process
[TABLE]
Then with driver
[TABLE]
and terminal value is a part of the solution of the associated BSDE. We obtain also a discounted risk-measure accordingly
[TABLE]
This discounted risk-measure is translation-invariant because does not depend on , we have for and
[TABLE]
Similarly we can get for each , that
[TABLE]
is translation-invariant.
4.1. Optimal portfolio with mean-field risk minimization
Consider a financial market with two investment possibilities:
(i) Safe, or risk free asset with unit price
[TABLE]
(ii) Risky asset with unit price
[TABLE]
Let be a self-financing portfolio invested in the risky asset at time . We want to minimize the risk of the terminal value of the wealth process corresponding to a portfolio which satisfies the linear SDE
[TABLE]
such that
[TABLE]
where satisfies a MF-BSDE
[TABLE]
Here we assume that are given deterministic functions and is some given concave function. We want to find such that
[TABLE]
Define the Hamiltonian that correspondds to our problem by
[TABLE]
The couple solution of the following BSDE
[TABLE]
and satisfies
[TABLE]
is given by the forward SDE
[TABLE]
and
[TABLE]
The first order necessary optimality condition gives
[TABLE]
where we denoted by and so on. Since for all -a.s., we obtain
[TABLE]
which implies
[TABLE]
this together with equation (4.4), yields
[TABLE]
From (4.5), we get
[TABLE]
For example, if we choose
[TABLE]
That is
[TABLE]
Substituting the expression of above into the MF-BSDE (4.3), we obtain
[TABLE]
Consequently
[TABLE]
thus
[TABLE]
Define to be the solution of the linear SDE
[TABLE]
or explicitely
[TABLE]
By the Girsanov theorem of change of measures, we know that there exists an equivalent local martingale measure , such that
[TABLE]
with is called the Radon-Nikodym derivative of with respect to on .
Substituting (4.8)-(4.9) into (4.7) we have
[TABLE]
Taking the expectation but now with respect to the new measure , we get
[TABLE]
where is the entropy of with respect to .
Since we obtained the optimal value of , we can get the corresponding optimal terminal wealth
Summarizing, we have the following conclusion:
Theorem 4.2**.**
Suppose that (4.6) holds. Then the minimal risk of our problem is given by (4.10).
References
