On extension of the Markov chain approximation method for computing Feynman--Kac type expectations
Vincent Liang, Konstantin Borovkov

TL;DR
This paper extends a Markov chain approximation method with Brownian bridge correction to efficiently compute Feynman--Kac expectations, especially for option pricing, demonstrating high convergence rates in numerical experiments.
Contribution
The paper introduces an extension of the Markov chain approximation method to compute Feynman--Kac expectations for diffusion processes, applicable to option pricing.
Findings
Convergence rate of $O(n^{-2})$ for smooth integrands.
Effective extension to path-dependent functionals.
Numerical experiments confirm high accuracy.
Abstract
An efficient discrete time and space Markov chain approximation employing a Brownian bridge correction for computing curvilinear boundary crossing probabilities for general diffusion processes was recently proposed in Liang and Borovkov (2021). One of the advantages of that method over alternative approaches is that it can be readily extended to computing expectations of path-dependent functionals over the event of the process trajectory staying between two curvilinear boundaries. In the present paper, we extend the scheme to compute expectations of the Feynman--Kac type that frequently appear in option pricing. To illustrate our approximation scheme, we apply it in three special cases. For sufficiently smooth integrands, numerical experiments suggest that the proposed approximation converges at the rate , where is the number of steps on the uniform time grid used
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStochastic processes and financial applications · Advanced Queuing Theory Analysis
11institutetext: Vincent Liang 22institutetext: School of Mathematics and Statistics, The University of Melbourne, Parkville 3010, Australia 22email: [email protected] 33institutetext: Konstantin Borovkov 44institutetext: School of Mathematics and Statistics, The University of Melbourne, Parkville 3010, Australia 44email: [email protected]
On extension of the Markov chain approximation method for computing Feynman–Kac type expectations
Vincent Liang and Konstantin Borovkov
Abstract
An efficient discrete time and space Markov chain approximation employing a Brownian bridge correction for computing curvilinear boundary crossing probabilities for general diffusion processes was recently proposed in Liang and Borovkov (2021). One of the advantages of that method over alternative approaches is that it can be readily extended to computing expectations of path-dependent functionals over the event of the process trajectory staying between two curvilinear boundaries. In the present paper, we extend the scheme to compute expectations of the Feynman–Kac type that frequently appear in option pricing. To illustrate our approximation scheme, we apply it in three special cases. For sufficiently smooth integrands, numerical experiments suggest that the proposed approximation converges at the rate , where is the number of steps on the uniform time grid used.
1 Introduction
Barrier options are widely used path-dependent derivative securities, and there is extensive literature on their valuation (see e.g. Armstrong2001 , Carr1995 and the references therein). Most of the literature is focused on the case where the barriers are “flat”. However, curved boundaries also appear in the context of pricing options on underlying assets that have a volatility term structure. Using a deterministic time-change, the time dependence in the volatility can be transferred into the boundary, reducing the problem of pricing call and put options in the Black–Scholes type setting with deterministic interest rates to computing the curvilinear boundary crossing probability of a diffusion process (see e.g. Section 3 in Borovkov2005 ). Methods for solving the latter problem are numerous, and we refer the interested reader to Liang2021 for a literature review. To extend the aforementioned problem to the case of stochastic interest rates, one needs to introduce a numeraire process.
It is well-known that, under the no-arbitrage assumption, the fair price of a replicable derivative on an underlying asset with maturity and general payoff is equal to , where denotes the expectation with respect to the martingale measure associated with the numeraire process (for details, see e.g. Chapter 6 in Bingham2004 ). If we introduce a barrier feature for the above option using two time-dependent barriers , the payoff of the new option will be given by
[TABLE]
Hence the fair price of the barrier option is equal to
[TABLE]
The purpose of this paper is to extend the Markov chain approximation method proposed in Liang2021 to compute the above expectation in the case when the numeraire process takes the form for some continuous function , i.e. to evaluate
[TABLE]
The method suggested in Liang2021 was a development of the approach from FuWu2010 for computing boundary non-crossing probabilities of the Brownian motion process. That approach suggested to replace the continuous dynamics of the underlying Brownian motion process with those of a denumerable discrete time Markov chain, by discretising both time and space using uniform grids. The transition probabilities for these Markov chains were specified to be proportional to the values of the Brownian motion transition densities for the respective time and space increments. The desired approximation for the boundary non-crossing probability was then computed in FuWu2010 by multiplying finite-dimensional substochastic matrices obtained by retaining the entries corresponding to the space nodes located between the given boundaries at the respective times.
Our modification of this method developed in Liang2021 dramatically improved the convergence rate of the procedure by shifting and adjusting the uniform space grids so that they would have nodes lying exactly on the boundaries, and by implementing one-step Brownian bridge corrections taking into account the possibility that the process could cross a boundary at a time between the points on the discrete time grid. At the same time, the method was extended in Liang2021 to a much broader class of diffusions.
Roughly speaking, one can think about the workings of this method as summing up the probabilities of all the Markov chain trajectories lying between the boundaries (and applying appropriate corrections). As, for each trajectory, its probability is given by the product of one-step transition probabilities, one basically “tracks” each trajectory of the chain in this computational process. Unlike alternative approaches to computing boundary crossing probabilities, such as the method of integral equations (see e.g. GuRiRoTo1997 and further references therein), this provides one with an opportunity to compute not only probabilities but also expectations of path-dependent functionals, finding the values of expressions of the form (2) being of particular convenience.
Turning back to applications related to (1), we note that when the underlying is the spot interest rate, this includes the case when the numeraire is the bank account process, i.e. . This expression can also be used to price what we call a hybrid step-barrier option, an option that has a step option feature (see Linetsky1999 ) and a barrier above the step level (see Example 3 below).
It was reported in Liang2021 that numerical experiments had showed that the proposed method produces approximations for boundary crossing probabilities with convergence rate , where is the number of nodes on the regular time discretisation grid. It turns out that this convergence rate is preserved in the new extension of the method presented in this paper when is sufficiently smooth. Note that proving the above-mentioned very fast convergence rate for our scheme is a very difficult task already in the basic case of computing boundary crossing probabilities. Establishing this rate in the one-sided boundary case with for the Brownian motion process is work in progress.
The paper is organised as follows. In Section 2 we describe our approximation procedure and demonstrate its convergence. In Section 3 we present the results of applying it in three special cases.
2 The method
We will begin by specifying the diffusion process model for the underlying asset . We assume a unit diffusion coefficient since we can transform a large class of diffusion processes to this case using the well-known unit-diffusion transform (see e.g. Section 2 in Liang2021 ). Then, we will describe the sequence of Markov chain approximations and prove that the sequence converges weakly to the desired diffusion process. Using the weak convergence result, we will show that the corresponding approximations to the option price that are using the Brownian bridge correction techniques converge as well. Recall that employing this correction dramatically improves convergence rates in the basic problem of computing boundary crossing probabilities Liang2021 . As we will see this applies in the present paper setup as well.
Without loss of generality, we set the terminal time since a deterministic time change can be applied to get the results for a general fixed .
2.1 The setup
Suppose that the underlying asset’s price is modelled by the one-dimensional diffusion process
[TABLE]
where is a standard Brownian motion process, and is non-random. Assume the following condition is satisfied:
- (C)
For any fixed , one has , and for any fixed , one has . Moreover, for any , there exists a such that one has
[TABLE]
We will also need some notations and conditions related to the boundaries . Denote by the space of continuous functions equipped with the uniform norm . For a fixed , consider the class
[TABLE]
of pairs of functions from and introduce the notation
[TABLE]
for the “bunch” of continuous functions whose graphs are entirely contained in the strip between the boundaries
Let be a (possibly complex-valued) continuous function and be some continuous function. The problem we deal with in this paper is how to compute
[TABLE]
for some . To explain our approach, set and introduce Feynman–Kac type time-dependent semigroup defined by
[TABLE]
and represent (3) as
[TABLE]
for
[TABLE]
the uniform partition of of rank , . The idea of our method is to approximate operators with their discrete versions. We will implement it in the next section, leading to approximation (8) to our .
2.2 Markov chain approximation
To specify our time-dependent Markov chain approximation, we first define the space grids and the transition probabilities , and then introduce the corrective terms and which account for boundary correction and the presence of the term with respectively.
The grids are constructed as follows. Set , and, for fixed \delta\in(0,\mbox{\frac{1}{2}}] and , put
[TABLE]
assuming that is large enough such that the integer parts in all the denominators are positive. We set the time-dependent space lattice step sizes to be
[TABLE]
Next, we define
[TABLE]
We also put and define the corresponding boundary restricted lattices
[TABLE]
Further, for we introduce the discrete time drift and diffusion coefficients
[TABLE]
and define one-step “pseudo-transition probabilities” (we use this expression because they do not sum to one, although the normalising constants converge to 1 so quickly as that it makes no sense to normalise them, see Remark 7 in Liang2021 ) as
[TABLE]
where , , . We will implement the Brownian bridge correction for two-sided boundary crossing probabilities by using the factor
[TABLE]
Note that we ignore here the highly unlikely event that the trajectory of the Brownian bridge process hits both the upper and lower boundaries in the small time interval , see Liang2021 . The following expression will be used as a trapezoidal approximation of the exponential term :
[TABLE]
Now we introduce the pseudo-transition matrices involving both the boundary crossing correction terms and our adjustments for the presence of the exponential terms with :
[TABLE]
Denoting by the -th payoff column vector, our approximation to (3) is given by the sequence of matrix products
[TABLE]
which are discrete analogues of (5).
2.3 Weak convergence
Theorem 2.1
Let condition (C) be met, , and , be continuous functions. Then as .
Proof
We will use the method of weak convergence. First, we normalise the pseudo-transition probabilities and prove that the corresponding sequence of Markov chains converges weakly to the target diffusion process using convergence results from Liang2021 . Then we extend this convergence result to a sequence of auxiliary bivariate processes, where from the desired convergence will follow as these quantities can be expressed as expectations of a suitable functional.
Let denote a Markov chain with transition probabilities , , where . Furthermore, let denote the Brownian bridge-interpolated version of , i.e.
[TABLE]
where
[TABLE]
and , , are independent Brownian motions “pinned” at the time-space points and , these bridges being independent of our chain. From Corollary 1 in Liang2021 , we know that as , where “” denotes weak convergence of random elements in the respective functional space (in this case, in space ).
Define the two-dimensional process by letting
[TABLE]
Then we can rewrite from (3) as
[TABLE]
where . Our approximation (8) can also be rewritten as
[TABLE]
where , and, for
[TABLE]
We will now show that in the respective Skorokhod space by verifying the consistency of infinitesimal moments and tightness. We first define the auxiliary process , , with and show that .
Define the joint process and the stopping time
[TABLE]
being the Chebyshev norm of . Note that
[TABLE]
Let . It follows immediately that, for all ,
[TABLE]
and
[TABLE]
Tightness of the sequence of the distributions of in the respective Skorokhod space is immediate since is bounded on compact sets and hence it follows from Corollary 4.2 in EthierKurtz that . For all
[TABLE]
and hence it follows that as well. By the continuous mapping theorem applied to the function , the Portmanteau theorem (see e.g. p. 24 in Billingsley1968 ), and Corollary 2 from Liang2021 , the claimed result follows from the established weak convergence of the processes and boundedness of the integrands in .
3 Numerical examples
In this section, we will illustrate the efficiency of our approximation scheme (8). The run times for these computations using the programming language Julia run on a MacBook Pro 2020 laptop computer with an i5 processor (2 GHz, 16 GB RAM) are basically the same as the ones reported in Liang2021 for computing boundary-crossing probabilities employing the same hardware and software. To evaluate the partial derivatives in (6), we used the package HyperDualNumbers.jl
We apply our algorithm in three different examples, where is equal to , , and respectively, for some . Due to the discontinuity of the function at in the last case, we modify the scheme slightly for that choice of .
For each example, we compute and plot the observed convergence rate of to zero as grows. Closed-form expressions for are not available in any of these examples. Due to the iterative nature of our scheme (8), as a byproduct, we obtain approximations to , where appeared in (4). We will plot the surfaces for each example as well.
3.1 The case
To demonstrate general methods for obtaining distributional properties of Wiener functionals of the form , the characteristic function of the random variable was computed in Kac1949 and CameronMartin1945 yielding
[TABLE]
Using our scheme, we compute approximations to the expressions of this form restricted to the event of non-crossing given boundaries:
[TABLE]
with time-dependent boundaries
[TABLE]
In Fig 1, we plot our approximation of the form (8) to . We see from Fig 2, that converges to zero at the rate , suggesting that as .
3.2 The case
In this example, we price a zero-coupon bond with a two-sided time-dependent knock-out barrier, using a one-factor Hull–White model for spot interest rates. This problem was also explored in Kuan2003 . For the Hull–White model assumes that the spot interest rate has the following dynamics:
[TABLE]
where depends on , and the currently observed instantaneous forward rate curve (see e.g. Proposition 10.1.6 in Piterbarg2010):
[TABLE]
assuming that . To apply our scheme to this example, we scale all the space variables by to transform into a unit-diffusion process. Using the martingale pricing theorem, the fair price of a one-year maturity zero-coupon bond with a barrier option feature is equal to
[TABLE]
We used the time-dependent boundaries given by
[TABLE]
To demonstrate the performance of our scheme, we set , and a flat instantaneous forward curve . In the left pane in Fig 3, we plot our approximation of
[TABLE]
for different initial values using our approximation algorithm (8). We see from the right pane in Fig 3 that converges to zero at the rate , suggesting that as .
3.3 The case
The standard barrier option is one of the most popular first-generation exotic derivatives, due to its cheaper price compared to their vanilla counterparts. If an investor believes that a certain price is unlikely to fall below a certain level, they can choose to include a knock-out feature in the option, which reduces the price. These cost reductions can be substantial when volatility is high. However, standard barrier options come with a few disadvantages. Option buyers can lose their entire investment due to short time price spikes once the price is near the barrier. The delta sensitivity of such a barrier option is discontinuous near the boundary, making it difficult to hedge for options dealers.
The so-called “step option” was introduced in Linetsky1999 to address these issues. The payoff of an “up-and-out” step option with finite knock-out rate written on an option with payoff is given by the formula
[TABLE]
where is a constant and is the sojourn time of the underlying price process above the level until time :
[TABLE]
We will assume to be the standard Brownian motion process in this example.
This option can be modified by adding barrier features that will further reduce its price. We introduce a time-dependent knock-out barrier above the step option barrier and a lower knock-out barrier . We call this option a “hybrid step-barrier option”. Its payoff is given by
[TABLE]
The expectation of this functional is a special case of our from (3) with . In this case, the trapezoidal approximation (7) converges very slowly due to the discontinuity of at the occupation level . We now describe a modification of to address this issue. Let . Conditioning on endpoints and , one can expect that for small times , the sojourn time is “almost independent” of the boundary crossing event:
[TABLE]
There is a semi-explicit formula for given in (1.4.7) in Borodin2002 . However, efficient numerical computations of the double convolution present in that formula was challenging in the case when and . Hence we decided to use the following simple approximation.
Lemma 1
For , as ,
[TABLE]
where is the standard normal distribution function and .
Proof
Since , a Taylor series expansion of yields
[TABLE]
Changing the order of integration using Fubini’s theorem we get
[TABLE]
Since
[TABLE]
one has
[TABLE]
Remark 1
One could actually compute the second-order term in the expansion for using the following formula for the second moment of :
[TABLE]
Let denote the Brownian motion pinned at and . For brevity, we also set . It is well-known that, for ,
[TABLE]
and hence
[TABLE]
where
[TABLE]
Now since , , we get
[TABLE]
Therefore
[TABLE]
where denotes the bivariate standard normal cumulative distribution function with correlation given by (10). Hence we have
[TABLE]
However, numerically computing this integral turned out to be too computationally expensive and did not improve the efficiency of the algorithm.
To summarise, our modification of the term in this special case when is discontinuous amounts to replacing (7) with
[TABLE]
In our numerical implementation, we computed the time integral appearing in (11) using Gaussian quadratures. To demonstrate the performance of our scheme, we set , and . Without replacing with (11), the convergence of to zero is highly non-smooth and slow. With the proposed modification, the scheme appears to converge at rate , as shown in the right pane of Fig 4. The left pane in Fig 4 shows our approximation for the values of
[TABLE]
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) Armstrong, G.: Valuation formulae for window barrier options. Appl. Math. Fin. 8 , 197–208 (2001)
- 2(2) Billingsley, P.: Convergence of Probability Measures. Wiley, New York (1968)
- 3(3) Bingham, N. and Kiesel, R.: Risk-Neutral Valuation, 2nd ed., Springer, London (2004)
- 4(4) Borodin, A. and Salminen, P.: Handbook of Brownian Motion: Facts and Formulae, 2nd ed., Birkhaüser, (2002)
- 5(5) Borovkov, K. and Novikov, A.: Explicit bounds for approximation rates of boundary crossing probabilities for the Wiener process. J. Appl. Probab. 42 , 82-92 (2005)
- 6(6) Carr, P.: Two extensions to barrier option valuation. Appl. Math. Fin. 2 , 173–209 (1995)
- 7(7) Cameron, R. and Martin, W.: Transformations of Wiener Integrals Under a General Class of Linear Transformations. Trans. Amer. Math. Soc. 58 , 184–219 (1945)
- 8(8) Ethier, S. and Kurtz, G.: Markov Processes. Wiley, New York, (1986)
