The Inverse first passage time method for a two dimensional Ornstein Uhlenbeck process with neuronal application
Alessia Civallero, Cristina Zucca

TL;DR
This paper develops a numerical method to solve the inverse first passage time problem for a two-dimensional Ornstein-Uhlenbeck process, with applications in neuroscience, exploring boundary shapes for various distributions.
Contribution
It introduces a numerical solution for the inverse first passage time problem in 2D Gauss-Markov processes, with novel applications to neuronal modeling.
Findings
Boundary shapes vary with different first passage time distributions.
The method handles heavy and light tail distributions effectively.
Applications demonstrate relevance to neuroscience modeling.
Abstract
The Inverse First Passage time problem seeks to determine the boundary corresponding to a given stochastic process and a fixed first passage time distribution. Here, we determine the numerical solution of this problem in the case of a two dimensional Gauss-Markov diffusion process. We investigate the boundary shape corresponding to Inverse Gaussian or Gamma first passage time distributions for different choices of the parameters, including heavy and light tails instances. Applications in neuroscience framework are illustrated.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 1
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
The Inverse first passage time method for a two dimensional Ornstein Uhlenbeck process with neuronal application
A. Civallero, C. Zucca
Dept. of Mathematics “G. Peano”,
University of Torino, Turin, Italy
Abstract
The Inverse First Passage time problem seeks to determine the boundary corresponding to a given stochastic process and a fixed first passage time distribution. Here, we determine the numerical solution of this problem in the case of a two dimensional Gauss-Markov diffusion process. We investigate the boundary shape corresponding to Inverse Gaussian or Gamma first passage time distributions for different choices of the parameters, including heavy and light tails instances. Applications in neuroscience framework are illustrated.
Keywords: Inverse First-passage-time problem, two-dimensional Ornstein Uhlenbeck process, two-compartment leaky integrate and fire model, Gamma, Inverse Gaussian.
1 Introduction
In many situations arising from applications (i.e. neuroscience, finance, reliability, …), the quantity of interest is the first time that a random quantity crosses a given fixed level. In a mathematical framework, this corresponds to the first passage time (FPTs) of a stochastic process through an eventually time dependent boundary. However, it can happen that the FPT distribution is known as well as the random process, while one is interested in determining the corresponding time dependent boundary. This is the so-called Inverse FPT problem. This problem has been investigated both from a theoretical [6, 7] and an empirical point of view [2, 12, 16, 19] in the one-dimensional case. In [6] the existence and uniqueness of the solution of the Inverse FPT is studied. In [7] the problem is interpreted in terms of an optimal stopping problem. A numerical algorithm has been proposed in [19] for the Wiener process. In [16] the Inverse FPT of an Ornstein Uhlenbeck (OU) process has been studied and it has been applied to a classification method with applications to neuroscience. The same framework is in [12], where possible thresholds corresponding to Gamma distributed FPTs for an OU process has been investigated with modelling purposes.
Here, we resort again to the Inverse FPT method, we generalize the algorithms to a two-dimensional OU process and we study the possibility to have Inverse Gaussian (IG) or Gamma distributed FPTs. The choice of these two distributions grounds on their role in neurosciences [9, 11, 13, 14, 15, 17, 18] and reliability theory [8, 10].
In Section 2 we introduce the two dimensional Gauss-Markov process of interest, underlying some properties that we will use to deal with the Inverse FPT algorithm. In Section 3 we introduce the Inverse FPT method for a two dimensional process but we postpone to a future work the mathematical discussion about its convergence. In Section 4 we apply the algorithm to two choices of the FPT distribution, determining the thresholds corresponding to IG or Gamma FPTs probability density function (pdf). We underline the differences between the two models and we explain how heavy or light tails influence the boundary behavior. The last section discusses the obtained results in neuroscience contest. The two compartment model of Leaky Integrate and Fire type presented in [13] and studied in [5] describes the membrane potential evolution of a neuron as a two-dimensional OU process. Hence, in Section 5 we reinterpret the Inverse FPT results in this framework.
2 The two dimensional Ornstein Uhlenbeck process
Let us consider a stochastic process that is solution of the following stochastic differential system
[TABLE]
with and where is a one-dimensional standard Brownian motion. Here, , , and are constants.
To solve the stochastic differential system (1), we rewrite it in matrix form
[TABLE]
where
[TABLE]
It is an autonomous linear stochastic differential equation, in particular it is a two-dimensional Ornstein Uhlenbeck process, special case of a Gauss-Markov diffusion process [3]. The solution of (2) is
[TABLE]
It is a Gaussian vector with mean
[TABLE]
and variance-covariance matrix where,
[TABLE]
and
[TABLE]
Trajectories of the process are plotted in Figure 1. The different behavior of the two components is evident: the noisy behavior is prevalent in , while the first component is smoother. Indeed, as shown in (5), the multiplying function of the random term on the first component reduces the noise effect.
We consider the first passage time of the first component of the process (1)
[TABLE]
where is a continuous function with .
Note that it is possible to rewrite (5) in iterative form. This version is useful for simulation purposes, in order to generate the trajectories in an exact way. Discretizing the time interval with the partition in subintervals of constant length , we can express the position of the process at time in terms of the position of the process at time
[TABLE]
where the term
[TABLE]
known as innovation, is a Gaussian vector with zero mean and variance-covariance matrix .
In the following we will also need the conditioned mean of the first component
[TABLE]
and the conditioned variance of the first component
[TABLE]
In some instances can be useful to transfer the time dependency from the boundary shape to an input . Mathematically it is possible to relate these two situations with a simple space transformation. Indeed, the space transformation
[TABLE]
changes our process given by (1), originated in in presence of a time dependent boundary
[TABLE]
into a two dimensional process characterized by time dependent input and constant threshold
[TABLE]
Here, the term
[TABLE]
can be interpreted as an external input acting with different weights on the two compartments. Note that in (27) should be interpreted as a function of time and not as a boundary of a FPT problem. Indeed, in this case the boundary of the model is constant.
The stochastic process (1) can be used to describe a system whose behavior depends by two components that are strictly correlated by the parameter . The second component is driven by a random Gaussian noise and its evolution is stopped when the first component reaches a given fixed level. This model, known as two compartment model, has many interesting applications, for example in neuroscience, reliability and finance.
3 Inverse first passage time method
The inverse FPT problem consists in searching the unknown boundary given that the FPT density is known. We work under the assumption that the boundary exists, it is unique and sufficiently regular.
Let us consider a diffusion process , solution of the stochastic differential equation (2). The proposed method is based on the numerical approximation of the following Volterra integral equation [5]
[TABLE]
where is a random variable that represents the position of the second component of the process when the first component hits the boundary at time , i.e.
[TABLE]
Let us fix a time interval and a partition in subintervals of constant length . Using Euler formula for integrals [1], equation (28) can be approximated as
[TABLE]
,
Equation (30) represents a non linear system of equations in unknown that can be solved by means of root finding iterative algorithms [4]. Its solution gives an approximation of the boundary in the partition points . Note that in step the only unknown quantity is and it is estimated using the boundary approximations , computed in the previous steps.
The quantity
[TABLE]
is not easily handled because it depends on the unknown time dependent boundary. In general, the computation of is not trivial but, performing a suitable limit on the considered process we can show that for each value of . To compute (31) when , we use a Monte Carlo method: we simulate the process until the first component exceeds the threshold and we save the corresponding value of . At step , we need to compute for . The presence of an expectation with respect to determines a difficulty for the estimation of (31) through Monte Carlo because we need the value of at time . To circumvent this problem we introduce an approximate approach as follows. At step we approximate the threshold with a piecewise linear curve with knots in the already computed boundary values. Hence, for , we substitute the exact boundary with
[TABLE]
and we simulate the process up to or until it reaches the threshold. To compute , we use only the trajectories that crossed the approximated boundary (32) in a neighbourhood of . Then, in correspondence to each of these sample paths we identify with the sequence of values of the second component of the process (when the first component has exceeded the threshold). In this way, the Monte Carlo estimate for is
[TABLE]
It is possible to prove that this further approximation does not seriously influence the reliability of the algorithm.
4 Examples
In this Section we illustrate the use of the Inverse FPT method through two examples. The first situation concerns FPTs with Inverse Gaussian distribution. The second one deals with the Gamma distribution. Lastly, a comparison between boundaries and drift terms arising in the two examples is developed.
4.1 Inverse Gaussian random variable
The IG random variable has pdf
[TABLE]
where is the mean and is the shape parameter. Mean, variance and coefficient of variation are given by
[TABLE]
Throughout all this paper, when not differently specified, we fix the values of the two compartment model as follows: and . We choose the shape of the IG distribution by fixing its mean and different values of (see Figure 2, panel (a)). From (34) we see that changes of imply changes of the shape parameter . Moreover, as increases, the density becomes more peaked. The corresponding shapes of the time varying thresholds are illustrated in panels (b) where the shapes of the boundary present a maximum that tends to disappear as grows to higher values.
When is finite, the IG distribution has light tails but if the IG becomes
[TABLE]
and it catches the heavy tails feature of interest for the analysis of some data [9, 11, 17]. The density (35) is known to be the density of the FPT of a Brownian motion with zero drift and diffusion coefficient through a constant boundary with the relation
[TABLE]
Since , it makes no sense to compute the but, in order to compare light and heavy tails distributions, we use the same values of in Figure 2 and 3. In Figure 3, different shapes of the pdfs (panel (a)) and of the corresponding boundaries (panel (b)) are shown. The heavy tails of this distribution determine a new shape for the threshold that has a decreasing maximum as increases, followed by a minimum and by an increasing shape of the boundary. The maximum tends to disappear for large values of and the values of the boundary are essentially positive. The growth of the boundary, for larger values of , stop to allow the crossing of the samples determining the tail of the distribution. Figure 3 refers to the time interval , corresponding to a low probabilistic mass. A check for longer intervals does not change the results from a qualitative viewpoint, while higher probability masses are reached (figure not shown).
4.2 Gamma random variable
A random variable is Gamma distributed if its pdf is
[TABLE]
Here, is the rate parameter and is the shape parameter. Such a random variable is characterized by the following mean, variance and coefficient of variation
[TABLE]
The shapes of Gamma pdf for different values of the parameters and can be seen in Figure 4, panel (a). The shapes of the Gamma pdf strongly change with the value of . We recall that corresponds to the exponential distribution. Tails of the Gamma distribution are light, decaying to zero as an exponential. The corresponding shapes of the time varying thresholds are shown in panel (b) where the values of the two compartment model are: , and . Here, as increases, the maximum of the boundary disappears and the threshold time varying threshold becomes flat or, eventually when , increasing. This is the main difference of the boundary behavior with respect to the IG case.
4.3 Comparison
Often, IG and Gamma distributions appear as output of models of the same phenomenon but, for different choices of diffusion parameters. Hence, it seems useful to compare these distributions in terms of corresponding boundaries, using the Inverse FPT method. Hence, in this subsection we compare the boundaries corresponding to IG and to Gamma distributions when mean and are the same.
Figure 5 shows the time varying boundaries corresponding to the IG (dashed) and the Gamma-distributed (solid) interspike intervals (ISIs) with the same mean value and the same . In this example while . Densities and corresponding boundaries become more and more different as we increase the value (cf. inbox of Figure 5). The different spreading of probability mass of the two classes of distributions is reflected in different shapes of the corresponding boundaries. Since the IG density has heavier tails, the probability mass should not be consumed for short times. For this reason the boundary increases allowing crossings for large times.
To help a physical interpretation of the results in terms of input of a two compartment model, in Figure 6 we compare the behavior of the two components (27) of , when the boundary is transformed into a constant through (20). We ask what would be the input to both compartments if the output distribution is fixed and threshold is constant. We illustrate the cases of FPT distributed as IG (a-b), IG with heavy tails (c-d) and Gamma (e-f), respectively. Reinterpreting the time dependent boundary in terms of a modification of the drift allows to interpret our results in terms of increasing or decreasing drift. We note that a positive drift on the first component is always necessary to obtain the prescribed FPT distribution. When , FPTs distributed as Gamma or IG imply similar input. On the contrary, when tails of IG are heavy (panel (c)) or is large enough (panels (a) or (e)), the drift term of the first component strongly changes becoming decreasing. Interestingly the behavior of the second component (panels (b),(d) and (f)) is the opposite of that of .
Lastly, we change the comparison criterion and we apply the Inverse FPT method varying the values of the parameter in (1). We fix the values of the model as follows: , and . We consider examples of boundaries corresponding IG or Gamma spiking densities for (Figure 7) or (Figure 8).
In the figures, we also compare the boundaries (thicker line) with the mean of the first component . We note that boundary always intersects the function . Interestingly, if we fix the firing FPT and its , the intersection value is the same for different values of the parameter . This fact can be easily understood by noting that a change in determines the same shift both on the mean value of and on the boundary. However, this value changes considering different s.
5 Application to neuroscience
We give here an example of application of the Inverse FPT method to neuroscience.
Simplest neuronal models resort to one-dimensional processes to describe the membrane potential evolution. This choice implies a strong simplification of the neuronal structure that is identified by a single point. More complex models introduce bivariate stochastic processes to discriminate the membrane potential dynamics in the dendritic or in the trigger zone [13]. Neurophysiological reasons suggest the existence of an interaction between the membrane potential dynamics in the two zones and, when the first component (the trigger one) attains a boundary value, the neuron releases a spike. A reasonable simplification allows to add a noisy term only to the dendritic component. The reset after the spike can include both the components or only the trigger zone. Here, we will consider only the case of total resetting of both components to a resting value that we fix, for simplicity, equal to zero.
In this framework, the stochastic process (1) describes the depolarization of the trigger zone and the dendritic one, respectively [13]. The model assumes that external inputs, with intensity and variability , influence the second compartment and a weight takes into account the interconnection between the parts of the neuron. Moreover, the constant accounts for the spontaneous membrane potential decay (cf. Figure 9). Then, the FPT mimics the ISI of the neuron and the boundary corresponds to the spiking threshold for the neuron.
Often, IG and Gamma distribution fit neuronal data and FPT may help to interpret the presence of these distributions. Here, we reinterpret Figures 2-8 in the neuronal model framework. Hence, constants and will be measured in , while will be measured in and in .
Figures 2, 3, 4 and 5 reinterpret the heaviness of the tail of the ISI distributions in terms of the threshold shapes. As we increase the value, IG and Gamma densities and the corresponding boundaries become more and more different. This means that plays an important role in the formulation of the model. Moreover, in the case of the Gamma ISI distribution, the slope of the threshold becomes increasing when CV is large enough. A similar increasing behavior of the boundary could be obtained with IG distributed ISIs with heavy tails (cf. Figure 3).
In Figures 7 and 8 we investigate not only the behavior of the time varying firing threshold but also the dynamics of the underlying two compartment neuronal model. The mean membrane potentials and the corresponding boundaries are plotted for different values of the mean input and for different values of . For low input , the curves exhibit a maximum after which the firing threshold starts to decrease. As the input increases, the firing threshold from concave and decreasing become convex and increasing. Indeed, a big input facilitates the spiking. Therefore, to obtain the assigned distribution, the threshold must move away, becoming increasing.
Lastly in Figure 10 we study the role of the parameter in the model, applying the Inverse FPT method to IG (panel (a)) and Gamma (panel (b)) FPT distribution and varying the values of the parameter . As decreases, the boundary becomes almost constant and equal to zero. This is consistent with the fact that, for , the two components of the process gets independent and is deterministic and equal to zero, since . Then, in order to have a crossing and to get a prescribed distribution, the threshold should approach zero.
6 Conclusions
The extension of the Inverse FPT method to two-dimensional OU diffusion processes allows to study the shape of the boundaries for a given FPT pdf. We applied the algorithm to FPT distributed as an Inverse Gaussian and as a Gamma random variable. Differences in the boundary shape corresponding to FPTs with heavy or light tails enlighten different features of the corresponding two compartment model.
Lastly, we reinterpret the obtained results in a neuroscience framework. The shape of the boundaries corresponding to different firing distributions may enlighten features of the model eventually recognizing instances of scarce physiological significance such as diverging thresholds.
Acknowledgement
The authors are grateful to Professor L. Sacerdote and Professor L. Kostal for their interesting and useful comments and suggestions.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] M. Abramowitz and I.A. Stegun. Handbook of Mathematical Functions With Formulas, Graphs, and Mathematical Tables, Dover, New York, 1964.
- 2[2] M. Abundo. An inverse first-passage problem for one-dimensional diffusions with random starting point. Stat. Probab. Lett. 82: 7–-14, 2012.
- 3[3] L. Arnold. Stochastic Differential Equations: Theory and Applications. Krieger Publishing Company, Malabar, Florida, 1974.
- 4[4] K.E. Atkinson. An introduction to numerical analysis. Wiley, New York, 1989.
- 5[5] E. Benedetto, L. Sacerdote and C. Zucca. A first passage problem for a bivariate diffusion process: numerical solution with an application to neuroscience when the process is Gauss-Markov. J. Comp. Appl. Math. 242: 41–52, 2013.
- 6[6] X. Chen, L. Cheng, J. Chadam, D. Saunders Existence and uniqueness of solutions to the inverse boundary crossing problem for diffusions. Ann. Appl. Probab. 21: 1663–1693, 2011.
- 7[7] E. Ekström, and S. Janson. The inverse first-passage problem and optimal stopping Ann. Appl. Probab. 26 (5): 3154–3177, 2016.
- 8[8] J.L. Folks and R.S. Chhikara The Inverse Gaussian Distribution and Its Statistical Application–A Review J. of the Royal Statistical Society. Series B (Methodological) 40 (3): 263–289, 1978.
