Optimal control for the stochastic FitzHugh-Nagumo model with recovery variable
Francesco Cordoni, Luca Di Persio

TL;DR
This paper establishes the existence and uniqueness of solutions for an optimal control problem involving a stochastic FitzHugh-Nagumo model with a recovery variable, addressing challenges posed by non-linear drift coefficients.
Contribution
It introduces a novel approach using Ekeland's variational principle to handle the non-linearities in the stochastic control of the FitzHugh-Nagumo model.
Findings
Proves existence and uniqueness of solutions for the control problem.
Develops a method to handle cubic non-linearity in stochastic models.
Provides a framework for optimal control in complex neural models.
Abstract
In the present paper we derive the existence and uniqueness of a solution for the optimal control problem determined by a stochastic FitzHugh-Nagumo equation with recovery variable. In particular due the cubic non-linearity in the drift coefficients, standard techniques cannot be applied so that the Ekeland's variational principle has to be exploited.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Optimal control for the stochastic FitzHugh-Nagumo model with recovery variable
Francesco Cordonia
Luca Di Persioa
Abstract
In the present paper we derive the existence and uniqueness of a solution for the optimal control problem determined by a stochastic FitzHugh-Nagumo equation with recovery variable. In particular due the cubic non-linearity in the drift coefficients, standard techniques cannot be applied so that the Ekeland’s variational principle has to be exploited.
††footnotetext: a Department of Computer Science, University of Verona, Strada le Grazie, 15, Verona, 37134, Italy††footnotetext: E-mail addresses: [email protected] (Francesco Cordoni), [email protected] (Luca Di Persio)
AMS Classification subjects: 34K35, 35R60, 49J53, 49K99, 60H15, 65K10, 93E03.
**Keywords or phrases: **Stochastic FitzHugh-Nagumo equation, stochastic optimal control, Ekeland’s variational principle, stochastic partial differential equations.
1 Introduction
The mathematical formulation of the signal propagation in a neural cell has been firstly introduced by A. L. Hodgkin, and A. F. Huxley in [26], where the authors proposed a mathematical model based on a system of four non-linear, coupled differential equations describing how action potentials in neurons are initiated and propagated. In particular, latter system describes the evolution in time of four state variables and even if it is possible to state some qualitative properties for it, an analytical solution is missing. Therefore, alternative approaches have been developed by several authors, as in the case of the celebrated FitzHugh-Nagumo model (FHN), see [25, 29], where the system is reduced to two equations describing the evolution in time of the (neuronal) voltage variable and of the so called recovery variable. It is worth to mention that the previous description, as noted by the FitzHugh in his seminal paper, is an example of relaxation oscillator, in fact, FitzHugh referred to his model as the Bonhoeffer–Van der Pol oscillator. During recent years, the FHN model has gained a lot of attention, particularly from the point of view of the stochastic analysis in order to consider the influence of random perturbations of the original, deterministic description, see, e.g. [10, 28] In fact, from the experimental point of view, many neuronal activities can be better understood allowing for random components which affect the transmission of signals, as well as the inaccuracy of laboratory measures and the lack of a complete knowledge of the particular cerebral activity under study. Aiming at considering such a generalized, random framework, we will analyse the following stochastic system
[TABLE]
where, as mentioned above, the variable represents the voltage quantity, denotes the recovery variable, while the other components will be specified in a while. For the moment, let us note that the function is a polynomial of degree , then standard existence and uniqueness results do not hold for eq. (1.1), since the non-linear term fails to be Lipschitz continuous. Latter problem is often overcome taking into account some additional regularity properties of the infinitesimal generator, namely the Laplacian appearing in eq. (1.1), such as the so-called dissipativity assumption, see, e.g., [2, 3, 21] and references therein, for details.
We will not concern in the present paper with the existence and uniqueness result, since it is an already established result in literature, but on the existence of an optimal control for the aforementioned equation. In particular in [6], the existence and uniqueness of an optimal control has been proved for a similar equation, without the recovery variable . To prove the existence of an optimal control in the stochastic case is a rather delicate point and it implies the use of non trivial results. In particular the main result of the present work, is based, following [6], on the Ekelands’s variational principle.
The present work is so structured, in section 2 we introduce the main notation and assumptions used throughout the work, and we state the existence and uniqueness result for the main equation of interest. Then, in section 3, we derive the main result, namely we prove the existence and uniqueness solution of the optimal control problem associtaed to the FH-N model with recover variable, exploiting the Ekelands’s variational principle
2 The abstract setting
Let us consider the following controlled stochastic FitzHugh-Nagumo system of equations
[TABLE]
where represents the transmembrane electrical potential, is a recovery variable, also known as gating variable and which can be used to describe the potassium conductance, , is a bounded and open set with smooth boundary . Furthermore is the Laplacian operator with respect to the spatial variable , while and are positive constants representing phenomenological coefficients, is the outer unit normal direction to the boundary and denotes the derivative in the direction , is a given external forcing term, represents the Ionic current assumed to be as in the FitzHugh-Nagumo model, namely it is taken as a cubic non-linearity of the following form , , . and and two independent -Brownian motions, , being positive trace class commuting operators. Eventually we assume that the two operators and diagonalize on the same basis , namely we assume that there exists a sequence of positive real numbers , such that
[TABLE]
moreover we also assume that , . Eventually let be a Hilbert space equipped with the scalar product , we have that denotes the control and .
In order to rewrite (2.1) in a more compact form as an infinite dimensional stochastic evolution equation, let us define the Hilbert space endowed with the inner product
[TABLE]
where denotes the usual scalar product in , and the corresponding norm will be indicated by . Let us further introduce the space with the norm
[TABLE]
We then define the operator as follows
[TABLE]
with domain given by
[TABLE]
In particular we have that generates a semigroup satisfying
[TABLE]
see, e.g. [11].
We further define the non-linear operator
[TABLE]
as
[TABLE]
In what follows we will assume that it exists a positive constant such that
[TABLE]
and also that it holds . This implies that the term is dissipative in the sense of [18].
Let us thus consider the filtered probability space , such that the two independent Wiener processes and are adapted to the filtration , , and we define a cylindrical Wiener process on and by the operator
[TABLE]
Exploiting previously introduced notation, eq. (2.1) can be rewritten as follows
[TABLE]
Definition 2.1**.**
We say that the function is called a mild solution to (2.3) if is continuous a.s., and it satisfies the stochastic integral equation
[TABLE]
The we have the following existence and uniqueness result concerning equation (2.3).
theorem 2.2**.**
For any , there exists a unique mild solution to (2.3) which satisfies
[TABLE]
Proof.
Under above assumptions the proof follows from [2, Prop. 3.8] or [11, theorem 3.1]. ∎
3 The optimal control problem
Let us now consider a controlled version of equation (2.3). Let then defined as
[TABLE]
We shall denote by the space of all adapted processes s.t. . The space is a Hilbert space with the norm and scalar product
[TABLE]
where is the scalar product of .
Consider the functions , and , which satisfy the following conditions
(i)
, and , , where stands for the Fréchet differential
(ii)
is convex, lower-semicontinuous and where is the subdifferential of , see, e.g., [8, p. 82]. Moreover we assume that and s.t. , , and we set .
We consider the following optimal control problem
[TABLE]
subject to and
[TABLE]
theorem 3.1**.**
Let . Then there exists independent of such that for there is a unique solution to problem (P).
Proof.
Let us consider the function defined by
[TABLE]
where is the solution to (3.1). Recall that is lower-semicontinuous.
We shall apply Ekeland’s variational principle (See, e.g., [23] or also [6, 7]), that is there is a sequence such that
[TABLE]
In other words,
[TABLE]
Hence is a solution to the optimal control problem
[TABLE]
Equation (3.3) means that for all and it holds
[TABLE]
that is we get
[TABLE]
where solves the system in variations associated with (3.1),
[TABLE]
and is the directional derivatives of , see, e.g., [8, p.81], namely
[TABLE]
We thus associate with (3.1) the dual stochastic backward equation
[TABLE]
It is well-known that equation (3.6) has a unique solution satisfying
[TABLE]
(See, e.g., [24, Prop. 4.2] or [31]). By Itô’s formula we have from (3.5) and (3.6) that
[TABLE]
and this immediately implies
[TABLE]
which substituted in (3.4) yields that , the following inequality holds
[TABLE]
Let , then its sub-differential , evaluated in is given by
[TABLE]
(See, e.g., [8, p.81]). Then we infer that
[TABLE]
where and , .
Therefore, we have shown that
[TABLE]
Using the Itô formula applied to , we have that it holds
[TABLE]
(Here and everywhere in the following we shall denote by several positive constants independent of .)
From the fact that is a square integrable martingale, [18, Th. 3.14, Th. 4.12] and recalling the assumption we have that
[TABLE]
and from the fact that generates a strongly continuous semigroup, see, e.g. [11], we have that
[TABLE]
We also have that it holds,
[TABLE]
see, e.g. [2, 11] for details. Eventually from assumption (ii) we have
[TABLE]
Taking then the expectation on both side of (3.8) yields
[TABLE]
and applying Gronwall’s lemma it follows eventually that
[TABLE]
In an analogous manner, applying Itô formula to by (3.7) we obtain that
[TABLE]
which yields after applying arguments similar to the ones above
[TABLE]
We have that
[TABLE]
In virtue of (3.10) this yields
[TABLE]
where .
We further have that, see, e.g. [2, 11]
[TABLE]
which yields, for , applying Young inequality,
[TABLE]
Applying Gronwall’s lemma in (3.12), we have
[TABLE]
Similarly we get by the Itô formula
[TABLE]
Exploiting again Young’s inequality, and denoting for short
[TABLE]
we get,
[TABLE]
Substituting now (3.15) into (3.12), (3.14), we obtain a.s.
[TABLE]
Exploiting thus the fact that the process is a local martingale on , hence by the Burkholder-Davis-Gundy inequality, see, e.g., [20, p.58], we have for all
[TABLE]
Taking then the expectation in and by (3.16), and using (3.17) we get
[TABLE]
Taking into account estimates (3.13) and (3.14), from (3.18) we have
[TABLE]
where is a positive constant independent of and . It follows that if , then, for any ,
[TABLE]
Let us define for
[TABLE]
then estimates (3.9) implies that
[TABLE]
for some constant independent of .
If we set , and , then such quantities satisfy the system (3.7), with . The latter means that estimate (3.20) still holds in this context, so that we have
[TABLE]
By Gronwall’s lemma we get, for any
[TABLE]
hence, for and all and all , we obtain
[TABLE]
Therefore for each , we have that are Cauchy sequences in , with respect to and by estimates (3.9) and (3.10) it follows that taking related subsequences, still denoted by , we have
[TABLE]
where means weak (respectively, weak-star) convergence, so we have for
[TABLE]
We also have, since is bounded in , then it is weakly compact in and by (3.25) we have that for a subsequence ,
[TABLE]
which implies that
[TABLE]
Then, letting we obtain
[TABLE]
Taking into account that is weakly lower semicontinuous in we infer by (3.2) that
[TABLE]
therefore is optimal for the problem (P) and the proof of existence is therefore complete. ∎
Concerning the uniqueness for the optimal pair given by Th. 3.1, we have that it follows by the same argument via the maximum principle result for problem (P), namely one has the following result.
theorem 3.2**.**
Let be optimal in problem (P), then
[TABLE]
where is the solution to the backward stochastic equation (3.6).
Proof.
If is optimal for the problem (P), then by the same argument used to prove Th. 3.1, see (3.4), we have
[TABLE]
where is solution to equation (3.5) with replaced by . This implies as above that (3.27) holds. ∎
The uniqueness in (P).
If is optimal in (P) then it satisfies systems (2.3), (3.27) and (3.28), so that arguing as in the proof of Th. 3.1, the same set of estimates implies that the previous system has at most one solution if , where is sufficiently small. ∎
4 Conclusions
In the present work we have derived the existence and uniqueness of the solution to the control problem associated to a FH-N system of equations perturbed by a Gaussian noise and with respect to a recovery variable. We would like to underline that the presented result has potential applications in medicine, particularly from the point of view of neuronal diseases care. Indeed, the scheme of equations we have studied is linked to the Bonhoeffer–van der Pol oscillator, namely a nonlinear damping governed by a second-order differential equation that we are able to treat in presence of random (Gaussian) noise. The latter aspect is of great relevance in desincronize abnormal electrical activities that happen under the influence of pathologies as the Parkinson’s one, or during epileptic attacks. Possible generalizations of the proposed analysis will concern the study of the full Hodgkin-Huxley model, when a random source of noise has to be taken into consideration, as well as the study of the aforementioned models over networks of interconnected neurons, mainly following the approach derived in [15, 16]. The latter are the subjects of our ongoing research.
Acknowledgement
The authors wish to thank Prof. Viorel Barbu for his stimulating comments and enlightening suggestions. The authors would like also to thank the group Gruppo Nazionale per l’Analisi Matematica, la Probabilità e le loro Applicazioni (GNAMPA) for the financial support that has founded the present research within the project Stochastic Partial Differential Equations and Stochastic Optimal Transport with Applications to Mathematical Finance.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] S. Albeverio and L. Di Persio, Some stochastic dynamical models in neurobiology: recent developments Europena communications in mathematical and theoretical biology, vol. 14 , 2011 , pp. 44-53
- 2[2] S. Albeverio, L. Di Persio and E. Mastrogiacomo. Small noise asymptotic expansions for stochastic PDE’s, I. The case of a dissipative polynomially bounded non linearity. Tohoku Mathematical Journal Vol.63, No.4 (2011): 877-898.
- 3[3] S. Albeverio, L. Di Persio, E. Mastrogiacomo, and B. Smii. A Class of Lévy Driven SD Es and their Explicit Invariant Measures Potential Analysis, 45 (2), pp. 229-259, 2016.
- 4[4] V. Barbu. Nonlinear differential equations of monotone types in Banach spaces. Springer Monographs in Mathematics. Springer, New York, 2010.
- 5[5] V. Barbu. Analysis and control of nonlinear infinite-dimensional systems. Mathematics in Science and Engineering, 190. Academic Press, Inc., Boston, MA, 1993.
- 6[6] V. Barbu, F. Cordoni and L. Di Persio. Optimal control of stochastic Fitz Hugh-Nagumo equation. International Journal of Control (2015): 1-11.
- 7[7] V. Barbu and M. Iannelli. Optimal control of population dynamics. Journal of optimization theory and applications, Vol.102, No.1,(1999) 1-14.
- 8[8] V. Barbu and T. Precupanu. Convexity and optimization in Banach spaces. Springer Science & \& Business Media, 2012.
