Global $C^1$ Regularity of the Value Function in Optimal Stopping Problems
Tiziano De Angelis, Goran Peskir

TL;DR
This paper proves the $C^1$ regularity of the value function at the optimal stopping boundary in various stochastic processes, using probabilistic methods, and extends known results to integro-differential equations.
Contribution
It establishes the $C^1$ regularity of the value function at the boundary under probabilistic regularity conditions, including for integro-differential equations, with a purely probabilistic proof.
Findings
Value function is continuously differentiable at the boundary.
Regularity holds for both parabolic and elliptic cases.
First probabilistic proof of the continuity of the time derivative in American put options.
Abstract
We show that if either the process is strong Feller and the boundary point is probabilistically regular for the stopping set, or the process is strong Markov and the boundary point is probabilistically regular for the interior of the stopping set, then the boundary point is Green regular for the stopping set. Combining this implication with the existence of a continuously differentiable flow of the process we show that the value function is continuously differentiable at the optimal stopping boundary whenever the gain function is so. The derived fact holds both in the parabolic and elliptic case of the boundary value problem under the sole hypothesis of probabilistic regularity of the optimal stopping boundary, thus improving upon known analytic results in the PDE literature, and establishing the fact for the first time in the case of integro-differential equations. The method of proof…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Global Regularity of the Value Function
in Optimal Stopping Problems
T. De Angelis & G. Peskir
We show that if either the process is strong Feller and the boundary point is probabilistically regular for the stopping set, or the process is strong Markov and the boundary point is probabilistically regular for the interior of the stopping set, then the boundary point is Green regular for the stopping set. Combining this implication with the existence of a continuously differentiable flow of the process we show that the value function is continuously differentiable at the optimal stopping boundary whenever the gain function is so. The derived fact holds both in the parabolic and elliptic case of the boundary value problem under the sole hypothesis of probabilistic regularity of the optimal stopping boundary, thus improving upon known analytic results in the PDE literature, and establishing the fact for the first time in the case of integro-differential equations. The method of proof is purely probabilistic and conceptually simple. Examples of application include the first known probabilistic proof of the fact that the time derivative of the value function in the American put problem is continuous across the optimal stopping boundary.
1 Introduction
A challenging question in boundary value problems is to establish regularity of the solution up to the boundary. By regularity we mean continuity, differentiability, and/or higher degrees of smoothness. The problem has a long and venerable history. Continuity results can be traced back to Poincaré [43] and the references therein. Differentiability results date back to Gevrey [22] for parabolic equations and Kellog [29] for elliptic equations (see also [30]). Extensions to more general parabolic and elliptic equations were made possible using the techniques developed by Schauder [48] (see [32] for further details). As a rule of thumb in the PDE literature it is known that (probabilistic) regularity of the boundary implies continuity of the solution up to the boundary, and smoothness (or Hölder continuity) of the boundary implies smoothness of the solution up to the boundary (see e.g. [19, Theorem 7, p. 64] for parabolic equations and [23, Lemma 6.18, p. 111] for elliptic equations). This common belief translates to free boundary problems for parabolic and elliptic equations as well (see e.g. [20, Lemma 4.5, p. 167] for a definite result of this kind dating back to Gevrey [22] as well as [4] and [5, Chapter 8] for rela- ted results in higher dimensions). The analytic method of variational inequalities removes the focus from the free boundary itself and derives a global continuity of the space derivative (for parabolic and elliptic equations of diffusion processes) when the obstacle function is globally while establishing that the time derivative exists in a weak sense only (see [1, Corollary 1.3, p. 207] and [21, Theorem 3.2, p. 26; Theorem 8.2, p. 77; Theorem 8.4, p. 80]). The latter fact is not surprising since the time derivative can fail to exist in the absence of probabilistic regularity of the free boundary (see e.g. [40, Example 14]). A probabilistic approach in [36] returns to a probabilistic regularity of the free boundary by assuming moreover that the free boundary is twice continuously differentiable and thus making the assumption ‘intractable’ as the paper points out itself.
In this paper we develop a conceptually simple/direct probabilistic method which shows that the differentiability results for free boundary problems can be derived solely from a probabilistic regularity of the boundary i.e. with no need for its smoothness (or Hölder continuity) of any kind. This applies to (i) both the space derivative and the time derivative, (ii) more general strong Markov/Feller processes (not just diffusions), and (iii) both smooth and non-smooth obstacle functions. Free boundary problems (in analysis) are known to be equivalent to optimal stopping problems (in probability) and we derive the differentiability results in the context of optimal stopping problems which are also of interest in themselves. We do that by establishing a continuous smooth fit between the value function and the gain (obstacle) function at the optimal stopping (free) boundary that is traditionally derived using probabilistic methods in a directional sense only (see Section 2 for details).
In Section 2 we formulate the optimal stopping problem (2.1)/(2.2) and explain its background in terms of (i) strong Markov/Feller processes, (ii) boundary point regularity (probabilistic, Green, barrier, Dirichlet), (iii) stochastic flow regularity, and (iv) infinitesimal generator regularity (including continuous and smooth fit). In Section 3 we show that if either the process is strong Feller and the boundary point is probabilistically regular for the stopping set, or the process is strong Markov and the boundary point is probabilistically regular for the interior of the stopping set, then the boundary point is Green regular for the stopping set (in the sense that the expected waiting time for entering the stopping set vanishes as the initial point of the process approaches the boundary point from within the continuation set). Combining this implication with the existence of a continuously differentiable flow of the process we show in Sections 4 and 5 that the value function is continuously differentiable at the optimal stopping boundary whenever the gain function is so. Theorems 8 and 10 deal with the space derivative (in infinite and finite horizon respectively) and Theorems 13 and 15 deal with the time derivative (in infinite and finite horizon respectively). Examples 12 and 17 derive the analogous regularity results for the space derivative and the time derivative respectively, when the gain function is not smooth away from the optimal stopping boundary, using the local time of the process on the singular points at which the smoothness breaks down.
The advantage of the probabilistic method employed in the derived results is that the only hypothesis on the optimal stopping boundary used is its probabilistic regularity for the stopping set or its interior (which is implied by monotonicity of the optimal stopping boundary for instance). This level of generality is insufficient for the PDE methods as they require at least a Lipschitz (or Hölder) continuity of the optimal stopping boundary. The derived results hold both in the parabolic and elliptic case of the free boundary problem, thus improving upon known analytic results in the PDE literature, and establishing the fact for the first time in the case of integro-differential equations. Moreover, the ‘lifting’ method of Example 17 to our knowledge is applied for the first time in the literature. It enables one to ‘lift’ a Lipschitz continuity of the superharmonic/value function to its regularity at Green regular boundary points. Among other implications this yields the first known probabilistic proof of the fact that the time derivative of the value function in the American put problem is continuous across the optimal stopping boundary.
In parallel to producing a first draft of the present paper we have also applied/tested some parts of the method of proof in specific examples. This includes [10] for the time derivative in the Brownian motion case and [27] for the space derivative in the Bessel process case. For further/existing applications to (singular) stochastic control problems and optimal stopping games we refer to [11] and [12] respectively. Among intermediate references we note that the paper [2] studies continuity of the time derivative of solutions to parabolic free-boundary problems in one (spatial) dimension under the hypotheses that on the stopping set (with at the end of time) and globally in the optimal stopping problem (2.2) below. These hypotheses are rarely satisfied in the mainstream examples of optimal stopping problems studied in the literature (including the American put problem where on the stopping set and globally) and the present paper fills this gap as well.
2 Problem formulation
In this section we introduce the setting of the problem and explain its background in terms of the general hypotheses imposed and sufficient conditions that imply them.
1. Optimal stopping problem. We consider the optimal stopping problem
[TABLE]
for with where is a standard Markov process (in the sense of [3, p. 45]) taking values in . Thus is strong Markov, right-continuous with left limits, and left-continuous over stopping times. The process starts at under the probability measure for (or its measurable subset identified with in the sequel for simplicity). The supremum in (2.1) is taken over all stopping times of (i.e. stopping times with respect to the natural filtration of ), or equivalently, over all stopping times with respect to a (right-continuous) filtration that makes a strong Markov process under for . All stopping times considered throughout are assumed to be finite valued unless otherwise stated (upon recalling that extensions to infinite valued stopping times are both standard and straightforward). We will also consider the optimal stopping problem (2.1) with finite horizon obtained by imposing an upper bound on . In this case we also need to account for the length of the remaining time so that (2.1) extends as follows
[TABLE]
for and . Note that this includes the case when the functions and are time dependent which can be formally obtained by setting for . The functional in (2.1) and (2.2) is defined by
[TABLE]
where is a continuous function with values in . The real-valued functions and are also assumed to be continuous. Under these hypotheses it is known (cf. [41] and [49]) that the first entry time of into the (finely) closed set where equals (the stopping set) is optimal in (2.1)/(2.2) provided that and satisfy mild integrability conditions. This is true for example if and both and are bounded but this sufficient condition can be considerably strengthened (see [41] and [49] for details). The (finely) open set where is strictly larger than (the continuation set) will be denoted by . The (optimal stopping) boundary between the sets and will be denoted by . We will make use of and distinguish between the first entry time of into defined by
[TABLE]
and the first hitting time of to defined by
[TABLE]
where can also be replaced by any other measurable subset of and an upper bound applies to admissible in (2.4) and (2.5) when the horizon is finite as in (2.2). When the standard regularity hypotheses recalled above are satisfied, or any other sufficient conditions implying that is optimal in (2.1)/(2.2), we will say that the problem (2.1)/(2.2) is well posed. This will be a standing premise for the rest of the paper. Any additional hypotheses will always be invoked explicitly in the statements of the results below when needed.
2. Strong Feller processes. Recall that the process is strong Feller if
[TABLE]
for every real-valued (bounded) measurable function with given and fixed. Recall also that is Feller if (2.6) holds for every real-valued (bounded) continuous function . Recall finally that Feller processes are strong Markov. Strong Feller processes were introduced and initially studied by Girsanov [24]. All one-dimensional diffusions in the sense of Itô and McKean [26] are known to be strong Feller processes because the transition density of with respect to its speed measure (in the sense that ) can be chosen to be jointly continuous in all three arguments (cf. [26, p. 149]). Unique weak solutions to (non-degenerate) SDEs driven by a Wiener process in are known to be not only strong Markov but also strong Feller processes (see e.g. [47, p. 170]). A time-space process such as where is a standard Wiener process is not a strong Feller process. Not all Lévy processes are strong Feller either. Hawkes [25, Theorem 2.2] showed that a Lévy process is strong Feller if and only if for every and where denotes Lebesgue measure on . Strong Feller property is important in relation to boundary point regularity. We will now present basic facts in this direction.
3. Boundary point regularity. There are four closely related concepts of boundary point regularity that we will address in the sequel. Throughout we let denote the open ball in the Euclidean topology of with centre at and radius . By we denote the closure of and by we denote the interior of . Recall that a real-valued function is superharmonic on a set relative to if for all and all (bounded) stopping times of . A boundary point is said to be:
[TABLE]
Regularity of in definitions (2.7)-(2.10) refers to the set . If we replace in (2.7)-(2.10) by any measurable subset of then we speak about regularity of for the set . By Blumenthal’s 0-1 law (cf. [3, p. 30]) we know that the probability in (2.7) can only be either zero or one. The super(harmonic) function in (2.9) is referred to as a barrier itself. The main example of a barrier is for with when holds (where could be replaced by to make it bounded).
It is well known (cf. [16, pp. 32-40]) that if is strong Feller then
[TABLE]
Moreover, if is strong Feller and uniformly continuous on compacts in the sense that
[TABLE]
for each compact set in and each then
[TABLE]
where denotes the Euclidean norm in . We will see in the proofs below that our main focus will be on the Green regularity. When the process fails to be strong Feller however, then the first equivalence in (2.11)/(2.13) can break down generally, and we will then require probabilistic regularity for instead of to gain the Green regularity. Further details in this direction will be presented in the next section.
We will close this subsection with a few historical details aimed at clarifying definitions (2.7)-(2.10) above. Note that many papers cited below contain sufficient conditions for boundary point regularity that are directly relevant for the main results in Sections 4 and 5 below.
Definition (2.7) embodies what probabilists understand under regularity. Definition (2.10) embodies what analysts understand under regularity. The implication (2.7)(2.10) was first proved by Doob [14] for a Wiener process and was then extended by Girsanov [24] to other strong Feller processes. The converse implication (2.10)(2.7) for strong Feller processes was derived by Krylov [33]. Definition (2.8) embodies a “hybrid” condition representing a mixture of (2.7) and (2.10) that makes it suitable for applications as we will see below. Definition (2.9) is often used to derive various sufficient conditions for regularity. Poincaré [43] used barriers to derive a sphere condition. Zaremba [53] replaced sphere by a cone (cf. [28, pp. 247-250]). Wiener [52] derived a necessary and sufficient condition for regularity using the capacity of a set (Wiener’s test). These papers deal with the Laplace equation (when is a Wiener process) and extensions to more general elliptic equations are normally not difficult (probabilistically this can be seen through time changes and comparison arguments). The same phenomenon does not hold for the heat equation (when is a time-space Wiener process) and more general parabolic equations (see e.g. [17, Theorem 8.1] for a simple example). Petrovsky [42] derived sufficient conditions for regularity in the heat equation by considering boundaries as functions of time (Kolmogorov-Petrovsky’s test). Necessary and sufficient conditions for regularity in the heat equation were announced by Landis [35]. An analogue of Wiener’s test for the heat equation was derived in the papers by Lanconelli [34] and Evans & Gariepy [18] (see pp. 295-296 in the latter paper for related results and historical comments). We refer to the paper by Watson [51] and the references therein for subsequent analytic results and further developments. Boundary point regularity and continuity of the solution to the Dirichlet problem for standard Markov processes have been studied by Dembinski [13] using purely probabilistic methods (see also the references therein for further probabilistic papers on this topic).
4. Stochastic flow regularity. Stochastic processes whose sample paths are indexed by their initial points are referred to as stochastic flows. Motivated by needs in the proofs below we will assume that the standard Markov process can be realised as a stochastic flow on a probability space in the sense that where we set for .
Examples of stochastic flows include a standard Wiener flow where (which extends to all Lévy processes analogously), an exponential Wiener flow where for and , and a reflecting Wiener flow where . Very often an explicit construction of the stochastic flow is not possible and then one usually aims to establish its existence satisfying some/further regularity properties. Among these we will need to consider continuous, differentiable, and continuously differentiable stochastic flows. For us in this paper it will mean that there exists a (universal) set satisfying such that the mapping is continuous, differentiable, or continuously differentiable on for every and each given and fixed. The first spatial derivative of the stochastic-flow coordinate with respect to will be denoted by for and with . (The same notation will also be applied to deterministic functions throughout including their time derivatives whenever convenient.) Thus when the stochastic flow is continuously differentiable we know that is continuous on for every and each where and . We will also assume that the (timewise) sample path regularity of translates to the same sample path regularity of , i.e. if is continuous or right-continuous with left limits, then is continuous or right-continuous with left limits for every and each where and .
To obtain sufficient conditions for stochastic flow regularity, which are directly relevant for the main results in Sections 4 and 5 below, recall that a stochastic flow may be viewed as a stochastic field , where we set for , so that the results on sample path regularity of stochastic fields are applicable to stochastic flows. The earliest results of this kind for the existence of (Hölder) continuous modifications of stochastic processes (when the index set of a stochastic field is ) were derived by Kolmogorov in 1934 (unpublished) and published subsequently by Slutsky [50] ( see also [31, pp. 158-165] for extensions of these results to stochastic fields when the index set is for ). Sufficient conditions for the existence of right-continuous modifications of stochastic processes (with left limits) have been derived by Chentsov [6] and Cramér [8]. Sufficient conditions for the existence of continuously differentiable modifications of stochastic processes have been derived in the book by Cramér and Leadbetter [9, pp. 67-70]. All these conditions are of a Hölder-in-mean type involving either two-dimensional (for continuity) or three-dimensional (for right-continuity or differentiability) marginal laws of the process. Different sufficient conditions for the existence of continuously differentiable modifications of stochastic fields (indexed by for ) have been derived by Potthoff [44, Theorem 3.2] based on the ideas of Loève cited therein. These conditions require the existence of the first partial derivative of the original stochastic flow in the mean-square sense (thus again being of a Hölder-in-mean type however without specifying the admissible rate of convergence) combined with the existence of a continuous modification of the resulting partial derivative flow (which can be established at least formally using the extended Kolmogorov conditions for stochastic fields referred to above).
The preceding results give a variety of general sufficient conditions for the existence of a regular stochastic field and hence a regular stochastic flow as well. Entering into a more specific class of stochastic processes, it is well known that SDEs driven by semimartingales with differentiable coefficients having locally Lipschitz first partial derivatives generate continuously differentiable flows (cf. [45, Theorem 39, p. 305]). In particular, this is true for SDEs driven by a standard Wiener process or a more general Lévy process in . Each of these processes therefore satisfies the hypothesis on the existence of a continuously differentiable flow. To express the hypothesis in a compact form we will simply say that the process can be realised as a continuously differentiable stochastic flow in the space variable.
5. Infinitesimal generator regularity. We will assume in the sequel that the infinitesimal generator of is given by
[TABLE]
for any function from its domain and , where the matrix with values in is symmetric and positive semi-definite (diffusion coefficient), the vector takes values in (drift coefficient), takes values in (killing coefficient), and is a non-negative measure on ( the compensator of the measure of jumps of ). For more details we refer to [46, pp. 281-299] and [41, pp. 128-142]. The infinitesimal role of is uniquely determined through its action on sufficiently regular (smooth) functions that could also involve various boundary conditions ( on curves or surfaces in ) depending on the stochastic behaviour of the process (on these curves or surfaces). It is well known that if belongs to the domain of then
[TABLE]
is a (local) martingale. This is a single most useful consequence of the previous inclusion (if known) that we will need in the sequel. When is a semimartingale then (2.15) with from (2.14) can also be derived for sufficiently regular (smooth) functions using stochastic calculus techniques (Itô’s formula and its extensions). The importance of the infinitesimal generator (2.14) follows from the well-known fact that the optimal stopping problem (2.1) is equivalent to the free boundary problem
[TABLE]
where on , and the continuity condition (2.17) or (2.18) applies as a variational principle when the expectation in (2.1) with in place of for is discontinuous or has discontinuous first partial derivatives at as a function of the initial point respectively (for more details see [41, p. 49]). Continuity of the partial derivatives in (2.18) has been traditionally understood/derived in the directional sense as follows
[TABLE]
upon assuming that belongs to and belongs to for and . Our main aim in this paper is to derive the continuity of the partial derivatives in (2.18) globally at , i.e. we aim to show that if converges to then converges to as for . When combined with the interior regularity results for on , making it at least continuously differentiable (in the sense of classical derivatives), this fact will establish a global continuous differentiability of on .
We will conclude this section with a few remarks on the interior regularity of on . It is well known that this can be achieved by considering the Dirichlet/Poisson problem on a ball (elliptic case) or a rectangle (parabolic case) contained in where the boundary values are determined by the value function itself upon knowing/establishing that is continuous (which normally presents no difficulty in specific examples). Since the boundary of a ball or a rectangle is known to be sufficiently regular we know that the Dirichlet/Poisson problem can be solved uniquely. For example, when in (2.14) it is known that (locally) Hölder coefficients in (2.14) yield a unique solution which is in the space variables and in the time variable (see [23, Theorem 6.13, p. 106] for the elliptic case and [19, Theorem 9, p. 69] for the parabolic case). This solution can then be identified with the value function itself using the stochastic calculus or infinitesimal generator techniques as described above (see [41, p. 131] for further details) thus establishing the interior regularity of on as claimed. The central aim of the present paper is to establish the regularity of the value function at the optimal stopping boundary that in turn is not accessible by these arguments.
3 Green regularity
In this section we present two sufficient conditions for the Green regularity of boundary points as defined in (2.8) above. The first condition is contained in the first equivalence of (2.11) and we expose its proof for completeness and comparison (Lemma 1 & Corollary 2). The second condition (Lemma 4 & Corollary 5) has its origin in the facts that the mapping is finely continuous if as where denotes the shift operator and the implication is applicable to when is an open set in (see [15, Corollaries 1 & 2, p. 123]). The two sufficient conditions applied to stochastic flows (Corollaries 3 & 6) will be used in the proofs of the main results in Sections 4 and 5 below.
Throughout this section we recall/assume that the (standard Markov) process and the filtration (to which is adapted) are right-continuous so that the first entry and hitting times of to Borel (open and closed) sets are stopping times (cf. [3, Theorem 10.7, p. 54]). Recall that denotes the continuation (open) set, denotes the stopping (closed) set, and denotes the boundary of the set (see Section 2 above).
Lemma 1. If is strong Feller then
[TABLE]
for each given and fixed.
Proof. Using that as , and letting be given and fixed, we find by the strong Markov property of that
[TABLE]
where is measurable so that x\mapsto G_{\delta}(x):=\mathsf{E}\>\!_{x}\big{[}\>\!F_{\delta}(X_{\delta})\>\!\big{]} is continuous on by the strong Feller property of . Since moreover is decreasing on as , we see from (3.2) that (3.1) is satisfied as claimed.
Corollary 2. If is probabilistically regular for and is strong Feller, then is Green regular for .
Proof. Take any converging to as . Then by (3.1) we get
[TABLE]
for each given and fixed, where the final equality follows by probabilistic regularity of for . This shows that (2.8) is satisfied as claimed.
When the process can be realised as a stochastic flow we write
[TABLE]
to denote the dependence of and on . In this case we can reformulate the result of Corollary 2 as follows.
Corollary 3. If is probabilistically regular for and is strong Feller, then in probability whenever converges to as .
Proof. This is a direct consequence of the Green regularity established in Corollary 2.
When the process fails to be strong Feller then the conclusions of Lemma 1, Corollary 2 and Corollary 3 can generally fail under probabilistic regularity of a point from for the set . We now show that the conclusions remain valid if can be realised as a stochastic flow that is continuous in the space variable and a point from is probabilistically regular for the interior of the set .
Lemma 4. If can be realised as a stochastic flow such that
[TABLE]
almost surely for each given and fixed, then
[TABLE]
for each given and fixed.
Proof. We first show that
[TABLE]
almost surely. For this, take any in as . Denoting the exceptional set of -measure zero in (3.5) by , and setting which also is a set of -measure zero, we know that (3.5) holds on for every . Let be given and fixed. By definition of and right-continuity of we know that for given and fixed, there exists such that . Because is open it follows that there exists such that . Since (3.5) holds on for we see that there exists such that for all . This shows that for all and hence we find that . Letting we get and this establishes (3.7) as claimed.
We next show that (3.6) holds. For this, take any in as and set for . Then by Fatou’s lemma for sets we find that
[TABLE]
where the second inequality follows since if and only if for , so that for and hence by (3.7) we get implying the claim. This shows that (3.6) is satisfied as claimed.
Corollary 5. If is probabilistically regular for and can be realised as a stochastic flow such that (3.5) holds, then is Green regular for (and thus too).
Proof. Take any converging to as . Then similarly to the proof of Corollary 2, we find by (3.6) that (3.3) holds with in place of for each given and fixed, where the final equality follows by probabilistic regularity of for . This shows that (2.8) is satisfied with in place of as claimed.
Corollary 6. If is probabilistically regular for and can be realised as a stochastic flow such that (3.5) holds, then almost surely (and thus almost surely too) whenever converges to as .
Proof. This is a direct consequence of (3.7) upon noting that for and since is open.
According to [13] and the references therein, a point that is regular for is called a stable boundary point, and the boundary is said to be (strongly) transversal if almost surely with respect to for all ( for all ). Note that the results of Corollary 5 and Corollary 6 can be rephrased in terms of stable boundary points. An important example of the strongly transversal boundary is obtained as follows.
Example 7. If is (piecewise) monotone and (left/right) continuous on and
[TABLE]
then for any regular (recurrent) Itô-McKean diffusion we have almost surely with respect to for every with (see the proof of Corollary 8 in [7]). Note that Corollary 5 in this case implies that probabilistic regularity of a boundary point implies its Green regularity despite the fact that the time-space process is not strong Feller so that the (general) first equivalence in (2.11) is not applicable.
4 Continuity of the space derivative
In this section we show that probabilistic regularity of the optimal stopping boundary implies continuous spatial differentiability of the value function at the optimal stopping boundary whenever the process admits a continuously differentiable flow.
1. We first consider the case of infinite horizon in Theorem 8. This will be then extended to the case of finite horizon in Theorem 10 below. Similarly to (3.4) above we write to denote the dependence of on for . We set if and for with .
Theorem 8. Consider the optimal stopping problem (2.1) upon assuming that it is well posed in the sense that the stopping time from (2.4) is optimal. Assume that
[TABLE]
Assume moreover that the process can be realised as a continuously differentiable stochastic flow in the space variable and that for given and fixed we have
[TABLE]
for some with for . If is strong Feller and is probabili- stically regular for , or is strong Markov and is probabilistically regular for , then
[TABLE]
with for . If the hypotheses stated above hold at every then is continuously differentiable on .
Proof. It will be clear from the proof below that the same arguments are applicable in any dimension so that for ease of notation we will assume that in the sequel.
(I): To illustrate the arguments in a clearer manner we first consider the special case when for . Note that the conditions (4.6) and (4.7) are not needed in that case.
1. Take any converging to as . Passing to a subsequence of if needed there is no loss of generality in assuming that
[TABLE]
for some as (we write to denote throughout). Let be the optimal stopping time for when . Then by the mean value theorem and (4.3) we find that
[TABLE]
where and belong to for . Dividing both sides by and letting we find from (4.9)+(4.10) that
[TABLE]
where in the final equality we use that almost surely as by Green regularity of for as established in Corollary 3 and Corollary 6 above (in the former case one may need to pass to a subsequence of which is sufficient for the present purposes) combined with the dominated convergence theorem which is applicable due to (4.4) and (4.5) respectively.
2. Similarly, there is no loss of generality in assuming that
[TABLE]
for some as . By the mean value theorem and (4.3) we find that
[TABLE]
where and belong to for . Dividing both sides by and letting we find from (4.12)+(4.13) that
[TABLE]
where in the final equality we use the same arguments as following (4.11) above. Combining (4.11) and (4.14) we see that and this completes the proof when for .
(II): Next we consider the general case when for . Note that the conditions (4.6) and (4.7) are needed in that case unless is constant for all . The proof in the general case can be carried out along the same lines as in the special case above and we only highlight the needed modifications throughout.
3. Taking any converging to as and arguing as in (4.9) above, we see that the right-hand side of the first inequality in (4.10) reads as follows
[TABLE]
for . The second expectation and the fourth expectation on the right-hand side of (4.15) can be handled in exactly the same way as the corresponding two expectations in (4.10), and this yields the conclusion of (4.11) above, i.e.
[TABLE]
provided that the liminf of the first expectation on the right-hand side of (4.15) divided by and the liminf of the third expectation on the right-hand side of (4.15) divided by are non-negative as . To see that both liminfs are non-negative, note that (4.3) and the mean value theorem imply that
[TABLE]
with equal to either (the first expectation) or (the third expectation) where belongs to and belongs to for . Using then the same arguments as in (4.11) above with (4.6)+(4.7) in place of (4.4)+(4.5), we see that the inequality (4.17) yields the fact that the two liminfs are non-negative so that (4.16) holds as claimed.
4. Similarly, arguing as in (4.12) we see that the right-hand side of the first inequality in (4.13) reads as follows
[TABLE]
for . The second expectation and the fourth expectation on the right-hand side of (4.18) can be handled in exactly the same way as the corresponding two expectations in (4.13) and this yields the conclusion of (4.14) above, i.e.
[TABLE]
provided that the limsup of the first expectation on the right-hand side of (4.18) divided by and the limsup of the third expectation on the right-hand side of (4.18) divided by are non-positive as . To see that both limsups are non-positive, note that (4.3) and the mean value theorem imply that
[TABLE]
with equal to either (the first expectation) or (the third expectation) where belongs to and belongs to for . Using then the same arguments as in (4.14) above with (4.6)+(4.7) in place of (4.4)+(4.5), we see that the inequality (4.20) yields the fact that the two limsups are non-positive so that (4.19) holds as claimed. Combining (4.16) and (4.19) we see that and this completes the proof when for .
Remark 9. Note that the conditions (4.4)-(4.7) are used in the proof above as sufficient conditions for the dominated convergence theorem to establish the convergence relations (4.11) and (4.14) (when is zero) and their extensions (4.16) and (4.19) (when is not constant). (Recall from the proof that the conditions (4.6) and (4.7) are not needed when is constant.) These sufficient conditions, although applicable in a large number of examples, are not necessary in general and in some specific examples one can often exploit additional information (e.g. the geometric/analytic structure of the optimal stopping boundary) and derive the convergence relations without appealing to the dominated convergence theorem (see the proof of Theorem 3.1 in [37] for such an example). As it is exceedingly complicated to describe all possible ways that lead to relaxed forms of the sufficient conditions (4.4)-(4.7), we have stated them in their present form with a view that the structure of the proof above remains unchanged if these sufficient conditions are replaced by other/weaker ones. A similar remark applies to the condition (4.3). For instance, replacing the global Lipschitz continuity of in (4.3) by a local Lipschitz continuity in the sense that
[TABLE]
for all with some constant large enough where as , it is seen from the proof above that the result of Theorem 8 ( with ) remains valid if
[TABLE]
where and is chosen large enough so that
[TABLE]
for all with given and fixed. Similarly, the global Lipschitz continuity of in (4.3) can be replaced by a local Lipschitz continuity and we will omit further details. Finally, the proof above shows that it is sufficient to have continuous differentiability of the flow near the optimal stopping boundary only.
2. The optimal stopping problem (2.1) considered in Theorem 8 has infinite horizon. The arguments used in the proof carry over to the optimal stopping problem (2.2) with finite horizon as long as continuous spatial differentiability of the value function is considered. We formally present this extension in the next theorem. Continuous temporal differentiability of the value function requires different arguments and will be considered in the next section.
Recall that the optimal stopping problem (2.2) includes the case when the functions and are time dependent which can be formally obtained by setting for . Thus the process in this case is given by for . The continuation set is given by and the stopping set is given by . Note that the process can always be realised as a stochastic flow by setting for and . Hence when can be realised as a stochastic flow in the space variable from we will denote the entire flow by for and . Note that for and .
Theorem 10. Consider the optimal stopping problem (2.2) upon assuming that it is well posed in the sense that the stopping time from (2.4) is optimal. Assume that
[TABLE]
Assume moreover that the process can be realised as a continuously differentiable stochastic flow in the space variable for and and that for given and fixed the conditions (4.4)-(4.7) are satisfied for some with for and . If is probabilistically regular for then
[TABLE]
with for . If the hypotheses stated above hold at every then exist and are continuous on .
Proof. This can be established using exactly the same arguments as in the proof of Theorem 8 upon noting that adding to any but the first (time) coordinate of the process does not alter the remaining time horizon.
Remark 11. Note that the comments on the sufficient conditions from Theorem 8 made in Remark 9 above extend to the corresponding sufficient conditions in Theorem 10 and we will omit further details in this direction.
3. The result and proof of Theorems 8 and 10 extend to the case when the gain function in the optimal stopping problem (2.1)/(2.2) is not smooth away from the optimal stopping boundary . Instead of formulating a general theorem of this kind, which would be overly technical and rather difficult to read, we will illustrate key arguments of such extensions through an important example next. A different method of proof is based on extensions of the Itô-Tanaka formula dealing with singularities of on curves and surfaces (cf. [38] and [39]) and this will be presented in the next section.
Example 12 (Continuity of the space derivative in the American put). Consider the optimal stopping problem
[TABLE]
where , , and the supremum is taken over stopping times of solving the stochastic differential equation
[TABLE]
with where and is a standard Brownian motion (see [41, Section 25] for further details). Horizon in the optimal stopping problem (4.28) is finite so that the setting belongs to Theorem 10 above. Since the gain function for is not differentiable at we see that the condition (4.25) fails and hence we cannot conclude that
[TABLE]
using Theorem 10 (we write to denote throughout). We will now show however that the method of proof of Theorems 8 and 10 extends to cover the case of the non-differentiable gain function for . This will also serve as an illustration of how similar other cases of non-smooth gain functions in the optimal stopping problem (2.1)/(2.2) can be handled. The derivation of (4.30) will be divided in three steps as follows.
1. Well-known arguments show that the optimal stopping time in (4.28) equals where the optimal stopping boundary is increasing on with (see [41, Subsection 25.2]). If a point is given and fixed, then by the increase of combined with the law of iterated logarithm for standard Brownian motion (cf. [28, p. 112]) we see that is probabilistically regular for (formally this could also be derived from probabilistic regularity of for combined with the fact of Example 7 above). Since can be realised as a continuous stochastic flow on , where we set for , it follows by Corollary 5 that is Green regular for . Taking any sequence converging to as , it follows therefore by Corollary 6 that almost surely as . Note that the latter Green regularity has been obtained without appeal to a strong Feller property which fails for the time-space process in this case.
2. We next connect to the first part of the proof of Theorems 8 and 10. Passing to a subsequence of if needed there is no loss of generality in assuming that
[TABLE]
for some as . Let denote the optimal stopping time for when . Then using that if and only if we find that
[TABLE]
for . Dividing both sided by and letting we find from (4.31)+(4.32) that
[TABLE]
where in the last equality we use that almost surely as combined with the dominated convergence theorem due to .
3. We finally connect to the second part of the proof of Theorems 8 and 10. Similarly, there is no loss of generality in assuming that
[TABLE]
for some as . Then using the same arguments as in (4.32) we find that
[TABLE]
for . Dividing both sided by and letting we find from (4.34)+(4.35) that
[TABLE]
where in the last equality we use the same arguments as in (4.33) above. Combining (4.33) and (4.36) we see that and this completes the proof of (4.30).
5 Continuity of the time derivative
In this section we show that probabilistic regularity of the optimal stopping boundary implies continuous temporal differentiability of the value function at the optimal stopping boundary whenever the process admits a continuous flow. We assume throughout that the process is given by for as discussed prior to Theorem 10 above.
1. We first consider the case of infinite horizon in Theorem 13. This will be then extended to the case of finite horizon in Theorem 15 below.
Theorem 13. Consider the optimal stopping problem (2.1) upon assuming that it is well posed in the sense that the stopping time from (2.4) is optimal. Assume that
[TABLE]
Assume moreover that the process can be realised as a continuous stochastic flow in the space variable for and and that for given and fixed the following conditions are satisfied
[TABLE]
for some . If is probabilistically regular for then
[TABLE]
with . If the hypotheses stated above hold at every then exists and is continuous on .
Proof. Due to for as assumed throughout we see that the setting of Theorem 13 reduces to the setting of Theorem 8. All the claims therefore follow by applying Theorem 8 upon noting that and for with and so that the sufficient conditions (4.4)-(4.7) in Theorem 8 transform to the sufficient conditions (5.4)-(5.7) stated above.
Remark 14. Note that the comments on the sufficient conditions from Theorem 8 made in Remark 9 above extend to the corresponding sufficient conditions in Theorem 13 and we will omit further details in this direction.
2. The optimal stopping problem considered in Theorem 13 has infinite horizon and the arguments used in the proof are analogous to the arguments used in the proofs of Theorems 8 and 10 above. Continuous temporal differentiability of the value function on finite horizon requires different arguments and will be considered in the next theorem. A key difficulty in the previous approach is that adding to the first (time) coordinate of the process (see (4.10) above) alters the remaining time horizon so that the stopping time which is optimal for is no longer admissible for with . To overcome this difficulty we will apply a Taylor expansion of the second order (Itô’s formula) instead of the first order as in the proofs of Theorems 8 and 10 above.
Theorem 15. Consider the optimal stopping problem (2.2) upon assuming that it is well posed in the sense that the stopping time from (2.4) is optimal. Assume that
[TABLE]
Assume moreover that the process can be realised as a continuous stochastic flow in the space variable for and and that for given and fixed the following conditions are satisfied
[TABLE]
for all stopping times of with values in and all with some . If is probabilistically regular for then
[TABLE]
with . If the hypotheses stated above hold at every then is continuous on .
Proof. It will be clear from the proof below that the same arguments are applicable in any dimension so that for ease of notation we will assume that in the sequel.
(I): To illustrate the arguments in a clearer manner we first consider the special case when for .
1. Take any converging to as . Passing to a subsequence of if needed there is no loss of generality in assuming that
[TABLE]
for some as (we write to denote throughout). Let denote the optimal stopping time for and set for . Then by (5.11) and (5.12) we find that
[TABLE]
for . Dividing both sides by and letting we find from (5.15) and (5.16) that
[TABLE]
where we use that almost surely as by probabilistic regularity of for and Corollary 6 above combined with the dominated convergence theorem which is applicable due to (5.13) above.
2. Similarly, there is no loss of generality in assuming that
[TABLE]
for some as . By (5.11) and (5.12) we find that
[TABLE]
for . Dividing both sides by and letting we find from (5.18) and (5.19) that
[TABLE]
where we use the same arguments as following (5.17). Combining (5.17) and (5.20) we see that and this completes the proof when for .
(II): Next we consider the general case when for . The proof in the general case can be carried out along the same lines as in the special case above and we only highlight the needed modifications throughout.
3. Taking any converging to as and arguing as in (5.15) above, we see that the right-hand side of the first inequality in (5.16) reads as follows
[TABLE]
for . The second and third expectation on the right-hand side of (5.21) can be handled in exactly the same way as the corresponding expectations in (5.16), and this yields the conclusion of (5.17), provided that the liminf of the first expectation on the right-hand side of (5.21) divided by is non-negative as . To see that the liminf is non-negative, note that (5.11) and the mean value theorem imply that
[TABLE]
where belongs to for . Using then the same arguments as in (5.17) above, we see that the inequality (5.22) yields the fact that the liminf is non-negative so that (5.17) holds in the general case when for as well.
4. Similarly, arguing as in (5.18) we see that the right-hand side of the first inequality in (5.19) reads as follows
[TABLE]
for .
The second expectation on the right-hand side of (5.23) can be handled in exactly the same way as the corresponding expectation in (5.19), and this yields the conclusion of (5.20), provided that the limsup of the first expectation on the right-hand side of (5.23) divided by is non-positive as . To see that the limsup is non-positive, note that (5.11) and the mean value theorem imply that
[TABLE]
where belongs to for . Using then the same arguments as in (5.20) above, we see that the inequality (5.24) yields the fact that the limsup is non-positive so that (5.20) holds in the general case when for as well. Combining the conclusions of (5.17) and (5.20) we see that and this completes the proof.
Remark 16. Note that the comments on the sufficient conditions from Theorem 8 made in Remark 9 above extend to the corresponding sufficient conditions in Theorem 15 and we will omit further details in this direction. Note also that the proof of (5.20) above could also be accomplished by means of the mean value theorem (as in the proof of Theorems 8 and 10) without appeal to the identity (5.12).
3. The result and proof of Theorem 13 and Theorem 15 extend to the case when the gain function in the optimal stopping problem (2.1)/(2.2) is not smooth away from the optimal stopping boundary . Instead of formulating a general theorem of this kind, which would be overly technical and rather difficult to read, we will illustrate key arguments of such extensions through an important example that was already considered in Example 12 above for the space derivative. The method of proof to be presented below is different from the method of proof applied in Example 12 above.
Example 17 (Continuity of the time derivative in the American put). Consider the optimal stopping problem (4.28) above where solves (4.29). Horizon in the optimal stopping problem (4.28) is finite so that the setting belongs to Theorem 15 above. Since the gain function for is not differentiable at we see that the condition (5.10) fails and hence we cannot conclude that
[TABLE]
using Theorem 15 (we write to denote throughout). We will now show however that the method of proof of Theorem 15 extends to cover the case of the non-differentiable gain function for . This will also serve as an illustration of how similar other cases of non-smooth gain functions in the optimal stopping problem (2.1)/(2.2) can be handled. The derivation of (5.25) will be divided in three steps as follows.
1. We first recall the facts about the optimal stopping problem (4.28) stated in the first step of the proof of (4.30) above. In particular, taking any sequence converging to we know that almost surely as . Moreover, applying the Itô-Tanaka formula, we find using (4.29) that
[TABLE]
for where is the local time process of defined by
[TABLE]
where the convergence takes place in probability and the quadratic variation process of is given by for . It is easily verified that the third term on the right-hand side in (5.26) defines a continuous martingale for . Hence by the optional sampling theorem we find that the Bolza formulated optimal stopping problem (4.28) can be Lagrange reformulated (see [41, p. 141] for the terminology) as follows
[TABLE]
for and . Thus the optimal stopping problems (4.28) and (5.28) are equivalent and a stopping time is optimal in (4.28) if and only if it is optimal in (5.28).
2. We next connect to the first part of the proof of Theorem 15. Passing to a subsequence of if needed there is no loss of generality in assuming that
[TABLE]
for some as . Let be the optimal stopping time for and thus as well. Set for . We then have
[TABLE]
for all . By (5.27) and Fatou’s lemma we find that
[TABLE]
for all where denotes the density function of for and in the last equality we use the dominated convergence theorem. Using the scaling property it is easily verified that is given by
[TABLE]
for and where denotes the standard normal density function given by for . Inserting (5.32) into (5.31) we find that
[TABLE]
for all with some large enough, where the constant is given by
[TABLE]
with the supremum being taken over all and (upon substituting in (5.32) above). Making use of (5.33) in (5.31) we obtain
[TABLE]
for all . Note that we can formally replace in (5.35) by because the constant depends only on and the resulting inequality holds uniformly over all .
Having (5.35) we modify the optimal stopping time by setting where is any (small) number such that for all where is sufficiently large. (Note that this is possible since with and as .) Since is superharmonic on and harmonic on , we find that
[TABLE]
for all where in the final inequality we use (5.35) applied to in place of for and holding uniformly over all . Dividing both sides in (5.36) by we find from (5.29) that
[TABLE]
where we use that almost surely so that as .
3. We finally connect to the second part of the proof of Theorem 15. Similarly, there is no loss of generality in assuming that
[TABLE]
for some as . We then have
[TABLE]
for . Note that this inequality also follows from (4.28) from where we see directly that is decreasing on for . Dividing both sides in (5.39) by we find from (5.38) and (5.39) that
[TABLE]
Combining (5.37) and (5.40) we see that so that (5.25) holds as claimed and the proof is complete.
Remark 18. Note that the method of proof presented in Example 17 first derives Lipschitz continuity of uniformly over all and then ‘lifts’ this continuity to regularity of at using the superharmonic property of on . To our knowledge this ‘lifting’ method is applied in Example 17 for the first time in the literature. In addition to yielding the first known probabilistic proof of (5.25) in the American put problem, it is also clear from the arguments used in Example 17 that the ‘lifting’ method is applicable to a large class of diffusion/Markov processes in optimal stopping and free boundary problems with non-smooth gain functions.
Acknowledgements. T. De Angelis gratefully acknowledges partial support by EPSRC Grant EP/R021201/1 while working on the paper.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Bensoussan, A. and Lions, J. L. (1982). Applications of Variational Inequalities in Stochastic Control . North-Holland.
- 2[2] Blanchet, A. Dolbeault, J. and Monneau, R. (2006). On the continuity of the time derivative of the solution to the parabolic obstacle problem with variable coefficients. J. Math. Pures Appl. (9) 85 (371–414).
- 3[3] Blumenthal, R. M. and Getoor, R. K. (1968). Markov Processes and Potential Theory . Academic Press.
- 4[4] Caffarelli, L. A. (1977). The regularity of free boundaries in higher dimensions. Acta Math. 139 (155–184).
- 5[5] Caffarelli, L. A. and Salsa, S. (2005). A Geometric Approach to Free Boundary Problems . Graduate Studies in Mathematics 68, American Mathematical Society.
- 6[6] Chentsov, N. N. (1956). Weak convergence of stochastic processes whose trajectories have no discontinuities of the second kind and the “heuristic” approach to the Kolmogorov-Smirnov tests. Theory Probab. Appl. 1 (140–144).
- 7[7] Cox, A. M. G. and Peskir, G. (2015). Embedding laws in diffusions by functions of time. Ann. Probab. 43 (2481–2510).
- 8[8] Cramér, H. (1966). On stochastic processes whose trajectories have no discontinuities of the second kind. Ann. Mat. Pura Appl. 71 (85–92).
