Expected Supremum Representation of a Class of Single Boundary Stopping Problems
Luis H. R. Alvarez E., Pekka Matom\"aki

TL;DR
This paper presents an explicit integral representation for the value of certain optimal stopping problems involving linear diffusions, linking it to known probabilistic marginals and the smooth fit principle, with applications in finance.
Contribution
It introduces a novel explicit integral representation of the value function for a class of optimal stopping problems, connecting it with the monotonicity of the generator and known probabilistic marginals.
Findings
Explicit integral representation derived for the value function.
Connection established between the representation and the smooth fit principle.
Illustrations provided through financial application examples.
Abstract
We consider the representation of the value of a class of optimal stopping problems of linear diffusions in a linearized form as an expected supremum of a known function. We establish an explicit integral representation of this representing function by utilizing the explicitly known marginals of the joint probability distribution of the extremal processes. We also delineate circumstances under which the value of a stopping problem induces directly this representation and show how it is connected with the monotonicity of the generator. We compare our findings with existing literature and show, for example, how our representation is linked to the smooth fit principle and how it coincides with the optimal stopping signal representation. The intricacies of the developed integral representation are explicitly illustrated in various examples arising in financial applications of optimal…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStochastic processes and financial applications · Capital Investment and Risk Analysis · Advanced Queuing Theory Analysis
Expected Supremum Representation of a Class of Single Boundary Stopping Problems
Luis H. R. Alvarez E. Pekka Matomäki
Department of Accounting and Finance
Turku School of Economics
FIN-20014 University of Turku
Finland [email protected]@utu.fi
Abstract
We consider the representation of the value of a class of optimal stopping problems of linear diffusions in a linearized form as an expected supremum of a known function. We establish an explicit integral representation of this representing function by utilizing the explicitly known marginals of the joint probability distribution of the extremal processes. We also delineate circumstances under which the value of a stopping problem induces directly this representation and show how it is connected with the monotonicity of the generator. We compare our findings with existing literature and show, for example, how our representation is linked to the smooth fit principle and how it coincides with the optimal stopping signal representation. The intricacies of the developed integral representation are explicitly illustrated in various examples arising in financial applications of optimal stopping.
AMS Subject Classification: 60G40, 60J60, 91G80
Keywords: linear diffusions, optimal stopping, supremum representation for excessive functions
1 Introduction
It is well-known from the literature on stochastic processes that the probability distributions of first hitting times are closely related to the probability distributions of the running supremum and running infimum of the underlying diffusion. Consequently, the question of whether a linear diffusion has exited from an open interval prior to a given date or not can be answered by studying the behavior of the extremal processes up to the date in question. If the extremal processes have remained in the open interval up to the particular date, then the process has not yet hit the boundaries and vice versa. In this study we utilize this connection and develop a linearized representation of the value function of an optimal stopping problem as the expected supremum of a representing function with known properties in the spirit of the pioneering work by [20, 21] and its subsequent extension to the treatment of optimal stopping problems by [11]. More formally, we plan to determine explicitly the nondecreasing, nonnegative, and upper semicontinuous representing function for which
[TABLE]
where denotes the value of the considered class of optimal stopping problems and is an exponentially distributed random time independent of the underlying process .
The relatively recent literature on stochastic control theory indicates that the connection between, among others, the value functions and extremal processes in optimal stopping and singular stochastic control problems goes far beyond the standard connection between first hitting times and the running supremum and infimum of the underlying process (see, for example, [4, 5, 6, 7, 9, 14, 17, 15, 18, 19]). Essentially, in these studies the determination of the optimal policy and its value is shown to be equivalent with the existence of an appropriate optional projection involving the running supremum of a progressively measurable process (known as the Bank - El Karoui representation). The advantage of the representation utilized in these studies is that it is very general and applies also outside the standard Markovian and infinite horizon setting. Moreover, it can be utilized for studying and solving other stochastic control problems as well. For example, as was shown in [5, 6], the approach is applicable in the analysis of the Gittins-index familiar from the literature on multi-armed bandits (cf. [16, 22, 23, 24, 26]).
Instead of establishing directly how the value of the considered class of optimal stopping problems can be expressed as an expected supremum, we take an alternative route and compute first explicitly the expected value of the supremum of an unknown function satisfying a set of monotonicity and regularity conditions by utilizing the known probability distribution of the running supremum of the underlying. Setting this expected value equal with the value of the optimal stopping problem then results into a functional identity from which the unknown function can be explicitly determined. In the considered single boundary setting the function admits a relatively simple characterization in terms of the increasing minimal excessive mapping for the underlying diffusion (cf. [4]). We find that the required monotonicity of the function needed for the representation is closely related with the monotonicity of the generator on the state space of the underlying process. However, since only the sign of the generator typically affects the determination of the optimal strategy and its value, our results demonstrate that not all single boundary problems can be represented as the expected supremum of a monotonic function. We also investigate the regularity properties of the function needed for the representation and show that it needs not be continuous at the optimal stopping boundary. More precisely, we find that if the optimal boundary is attained at a point where the exercise payoff is not differentiable and, hence, the standard smooth fit condition is not satisfied, then the representing function is only upper semicontinuous at the optimal boundary. This is a result which is in line with the findings by [11].
The contents of this study is as follows. In section two we formulate the considered problem, characterize the underlying stochastic dynamics, and state a set of auxiliary results needed in the subsequent analysis of the problem. Section three focuses on a single boundary setting where the optimal rule is to exercise as soon as a given exercise threshold is exceeded. Our general findings on the representing function are explicitly illustrated in section four in various settings including incentive compatible stopping rules, Gittins indices, optimal entry, and stopping of spectrally negative jump diffusions. Finally, section five concludes our study.
2 Problem Formulation
2.1 Underlying stochastic dynamics
We consider a linear, time homogeneous and regular diffusion process , where denotes the possible infinite life time of the diffusion. We assume that the diffusion is defined on a complete filtered probability space , and that the state space of the diffusion is . Moreover, we assume that the diffusion does not die inside , implying that the boundaries and are either natural, entrance, exit or regular (see Section II. 1 in [8] for a characterization of the boundary behaviour of diffusions). If a boundary is regular, we assume that it is killing and that the process is immediately sent to a cemetery state as soon at it hits that boundary. Furthermore we will denote by the running supremum process of the considered diffusion .
As usually, we denote by the differential operator representing the infinitesimal generator of . For a given smooth mapping this operator is given by
[TABLE]
where the drift coefficient and the volatility coefficient are given continuous mappings. In order to avoid interior singulairties, we assume throughout this study that for all . As is known from the classical theory on linear diffusions, there are two linearly independent fundamental solutions and satisfying a set of appropriate boundary conditions based on the boundary behavior of the process and spanning the set of solutions of the ordinary differential equation , where denotes the differential operator associated with the diffusion killed at the constant rate . Moreover, where denotes the constant Wronskian of the fundamental solutions and
[TABLE]
denotes the density of the scale function of (for a comprehensive characterization of the fundamental solutions, see [8], pp. 18–19). The functions and are minimal in the sense that any non-trivial -excessive mapping for can be expressed as a combination of these two (cf. [8], pp. 32–35). Given the fundamental solutions, let be an arbitrary twice continuously differentiable -harmonic function and define for sufficiently smooth mappings the functional
[TABLE]
associated with the representing measure for -excessive functions (cf. [33]). Noticing that if is twice continuously differentiable, then
[TABLE]
where denotes the density of the speed measure of . Hence, we find that
[TABLE]
for any .
Finally, we denote by the class of measurable functions satisfying the integrability condition
[TABLE]
for all . As is known from the literature on linear diffusions, if then its expected cumulative present value
[TABLE]
can be expressed as (cf. [8], p. 29)
[TABLE]
where
[TABLE]
2.2 The Optimal Stopping Problem and Auxiliary Results
In this paper our objective is to examine the optimal stopping problem
[TABLE]
for exercise payoff functions satisfying a set of sufficient regularity conditions and establish a representation of the value as the expected supremum of an appropriately chosen representing function along the lines of the pioneering studies [5], [6], [11], [15], [17], [20], [21]. Our main result is based on the following representation theorem originally established in [11].
Theorem 2.1**.**
([11], Theorem 2.5) Let be a Hunt process on and . Assume that the exercise payoff is non-negative, lower semicontinuous, and satisfies the condition for all . Assume also that there exists an upper semicontinuous and a point such that
- (a)
* for , is non-decreasing and positive for ,* 2. (b)
* for , and* 3. (c)
* for .*
Then
[TABLE]
and is an optimal stopping time.
This theorem essentially states that if we can find a representing function satisfying the required conditions (a)-(c), then the optimal stopping policy for (6) constitutes an one-sided threshold rule and its value can be expressed in a linearized form as an expected supremum attained at an independent exponential random time. As we will prove later in this paper, the reverse argument is also sometimes true: under certain circumstances the value of the optimal policy generates a continuous and monotone function for which the representation (7) is valid. However, as we will point out later in the case where the exercise reward can be expressed as an expected cumulative present value of a continuous flow, all single boundary stopping problems cannot be represented as proposed in Theorem 2.1.
Before proceeding in our analysis and the explicit identification of the representing function, we first establish two auxiliary lemmata needed in the analysis of the problem. Our first findings based on the known joint probability distribution of the underlying and its running supremum are summarized in the following.
Lemma 2.2**.**
(A) If satisfies , then
[TABLE]
and
[TABLE]
for all . Especially, if , then
[TABLE]
*for all .
(B) If , where is a finite set of points, and , then for all *
[TABLE]
where .
Proof.
See Appendix A. ∎
Second, in order to characterize how increased volatility affects the representing function, we need to state conditions under which the sign of the impact of increased volatility on the Laplace transform of the first hitting time to a constant boundary can be unambiguously described. A set of sufficient conditions under which this sign is positive are now stated in the following.
Lemma 2.3**.**
If is convex, then increased volatility increases or leaves unchanged the ratio for all and decreases or leaves unchanged the ratio for all .
Proof.
See Appendix B. ∎
3 Representation as Expected Supremum
3.1 Problem Setting
Our main objective is now to delineate general circumstances under which the value of a one-sided threshold policy can be expressed as the expected supremum of a monotonic representing function and to identify that function explicitly. In what follows, we will focus on the case where the considered stopping policy can be characterized as a rule where the underlying process is stopped as soon as it exceeds a given constant threshold. The case where the single boundary stopping rule is to exercise as soon as the underlying falls below a given constant threshold is completely analogous and, therefore, left untreated.
Let be a continuous payoff function satisfying the condition for some and
[TABLE]
for all . Assume also that , where is a finite set of points in and that and for all .
Given the assumed regularity conditions, let denote the first exit time of the underlying diffusion from the set , where . Define now the parameterized family of nonnegative and continuous functions by
[TABLE]
Given representation (13), we can now state our identification problem as follows.
Problem 3.1**.**
(A) For a given , does there exist a nonnegative function such that for all we would have
[TABLE]
(B) Under which conditions on the function and the threshold we have
[TABLE]
and, consequently,
[TABLE]
It’s worth emphasizing that Problem 3.1 is twofold. The first representation problem essentially asks if the expected value of the exercise payoff accrued at the first hitting time to a constant boundary can be expressed as the expected value of an yet unknown representing function at the running maximum of the underlying diffusion at an independent exponentially distributed date. The second question essentially asks when the function is such that the representation agrees with the general functional form utilized in Theorem 2.1 and in that way results into the value of the considered stopping problem. As we will later establish in this paper, the class of functions satisfying the first representation is strictly larger than the latter.
3.2 Standard Sufficiency Conditions
Before proceeding in the derivation of the representation as an expected supremum, we first need to characterize sufficient conditions under which the value coincides with the value of the optimal stopping problem (6). To accomplish this, we follow the Martin boundary representation approach introduced in the pioneering study [33] (for associated results focusing precisely on single-boundary problems, see [13]) and establish the following result characterizing the optimal policy. We apply this result later for the identification of circumstances under which the value of the considered one-sided problem can be expressed as the expected supremum of a monotonic function.
Lemma 3.2**.**
Assume that the following conditions are satisfied:
- (i)
there exists a ,
- (ii)
* for all *
- (iii)
* for all *
Then and is an optimal stopping time.
Proof.
See Appendix C. ∎
Remark 3.3**.**
It is at this point worth emphasizing that under the following slightly stricter assumptions there always exists a unique maximizing threshold and the conditions of Lemma 3.2 are satisfied (cf. Lemma 3.4 in [2]):
- (A)
, where , and is unattainable for ,
- (B)
there exists a so that for all and for all ,
- (C)
* for all and for all *
These assumptions of Remark 3.3 are typically met in financial applications of optimal stopping. Note that these conditions do not impose monotonicity requirements on the behavior of the generator on and only the sign of essentially counts.
3.3 Characterization of the Representing Function
Let be given. Utilizing the known distribution function of yields (cf. [8], p. 26)
[TABLE]
Given this expression, it is now sufficient to find a function for which the identity holds for all . This identity holds for provided that the Volterra integral equation of the the first kind
[TABLE]
is satisfied. Standard differentiation of identity (16) now shows that for all we have
[TABLE]
coinciding with the function derived in [4] by relying on functional concavity arguments. Utilizing (3) demonstrates that this representing function can be alternatively be expressed as
[TABLE]
Consequently, if , and , then according to Lemma 2.2 we have
[TABLE]
for all . Our first representation result is now stated in the following theorem.
Theorem 3.4**.**
Fix and let be as in (17). Then, if , we have . Moreover, if is also nonnegative and nondecreasing and is lower semicontinuous for all , then is -excessive for .
Proof.
The first claim follows directly from identity (16) after noticing that the representing function can be re-expressed for all as
[TABLE]
and invoking the condition . Noticing that since , and are continuous the lower semicontinuity of on guarantees that is upper semicontinuous on as well. If is also nonnegative and nondecreasing, then is nondecreasing, nonnegative, and upper semicontinuous on . In that case and Proposition 2.1 in [20] then guarantees that is -excessive for . Since the alleged result follows. ∎
Theorem 3.4 shows that when is chosen according to the rule (17) representation is valid provided that the limiting condition is met. Moreover, Theorem 3.4 also shows that if is also nonnegative, nondecreasing, and upper semicontinuous, then the representation is -excessive for the underlying diffusion . This observation is of interest since it demonstrates that the needed monotonicity of the representing function does not, in principle, require twice differentiability of the exercise payoff . This is especially beneficial in the verification of the -excessivity of a value since it essentially reduces the analysis into the analysis of the sign, monotonicity and semicontinuity of . Note, however, that the representation needs not to majorize the exercise payoff and, therefore, it does not necessarily coincide with the value of the considered stopping problem. Moreover, the required conditions for are sufficient but not necessary for the -excessivity of . As we will later see, there are circumstances where is -excessive even when is not monotonic.
An interesting comparative static result characterizing the sign of the relationship between increased volatility and the representing function defined by (17) is now summarized in the the next theorem.
Theorem 3.5**.**
Assume that the exercise reward is nondecreasing and that is convex. Then, increased volatility decreases or leaves unchanged the value of the representing function defined by (17). Moreover, increased volatility increases the expected value for nondecreasing functions satisfying .
Proof.
As shown in Lemma 2.3, the assumed convexity of guarantees that increased volatility decreases the logarithmic growth rate . Consequently, if the reward is nondecreasing on , then increased volatility increases the product for all . However, the assumed monotonicity of and the existence of the left- and right-hand limits at all demonstrates that increased volatility increases the product for all as well. Applying this finding to the definition (17) of the representing function proves the first claim. On the other hand, utilizing the assumed monotonicity of the function in connection with Fubini’s theorem yields
[TABLE]
from which the alleged comparative static result follows. ∎
Theorem 3.5 characterizes circumstances under which increased volatility unambiguously decreases or leaves unchanged the representing function and increases or leaves unchanged the expected value of nondecreasing functions depending on the running supremum . As we will later observe, both of these results have economically interesting consequences.
Having characterized the basic properties of the representing function , we are now in position to establish the following theorem connecting the representing function approach to standard sufficiency conditions.
Theorem 3.6**.**
Assume that the conditions of Lemma 3.2 are satisfied, that , and that is lower semicontinuous on . Then,
[TABLE]
Proof.
It is clear that the conditions of the first claim of Theorem 3.4 are satisfied. Consequently, . The alleged result now follows from Lemma 3.2. ∎
Theorem 3.6 states a set of conditions under which the value of the optimal stopping strategy can be expressed as the expected value of the mapping at the running maximum of the underlying diffusion. However, this does not yet guarantee that the value of the stopping problem could be expressed as an expected supremum since that requires in addition to the conditions of Theorem 3.6 the monotonicity of . Moreover, Theorem 3.6 relies on a set of sufficiency conditions based on the sign of and as such utilizes second order properties of the exercise payoff. Hence, it is of interest to investigate if at least part of the assumptions could be relaxed in the verification of optimality and the validity of the representation as an expected supremum. A set of sufficient conditions resulting into the desired outcome are summarized in our next theorem.
Theorem 3.7**.**
Assume that the exercise payoff is nondecreasing, that there is a unique interior threshold so that for and for , that is lower semicontinuous on , that is nondecreasing on , and that as . Then,
[TABLE]
for all .
Proof.
Since
[TABLE]
for all , we notice that our assumptions on the sign of guarantee that is increasing on and decreasing on . Consequently, and by Theorem 2.1 in [12]. The monotonicity of and positivity of on then imply that . Since as , we find by utilizing Theorem 3.4 that for all . Moreover, the lower semicontinuity of and monotonicity and positivity of on guarantee that the conditions of the second claim of Theorem 3.4 are satisfied and, therefore, that is -excessive for . Since majorizes the payoff for all and can be attained by utilizing the stopping strategy we notice that . Finally the monotonicity of implies that from which the alleged identity follows. ∎
Theorem 3.7 states a set of conditions under which the value of the considered stopping problem admits a representation as an expected supremum. Instead of having to rely on the behavior of , Theorem 3.7 demonstrates that the verification of the optimality of a single boundary stopping strategy can be reduced to the study of the sing, monotonicity and sufficient regularity of the representing function . This observation is very useful especially in situations where the fundamental solution has a simple functional form since under such circumstances the verification of the validity of the conditions of Theorem 3.7 is straightforward. However, as soon as takes more complicated forms, establishing the monotonicity of becomes significantly more challenging and requires further analysis. In order to characterize relatively general circumstances under which the function is indeed monotonic, we first state the following auxiliary lemma.
Lemma 3.8**.**
Let be given. Assume that either
- (A)
* is concave and is convex on , or*
- (B)
there is a so that is locally increasing at , for all , and is non-increasing and non-positive for all .
Then, the function characterized by (17) is non-decreasing on .
Proof.
It is clear from (17) that the required monotonicity of is met provided that inequality
[TABLE]
is satisfied for all and
[TABLE]
for all . First, if is concave and is convex on , then the inequalities (20) and (21) are satisfied and is non-increasing on as claimed. Assume now instead that the conditions of part (B) are satisfied. It is clear that since (21) is satisfied by assumption for all . On the other hand, standard differentiation shows that for all
[TABLE]
where
[TABLE]
The assumed monotonicity and non-positivity of on and identity (3) now implies that
[TABLE]
for all . However, the assumed monotonicity of in a neighborhood of then guarantees that , proving that for all . ∎
Lemma 3.8 states a set of conditions under which the function characterized by (17) is non-decreasing on the set and, therefore, the function is nondecreasing on . Interestingly, the first of these conditions is based solely on the concavity of the exercise payoff and the convexity of the increasing fundamental solution without imposing further requirements. Since the convexity of the fundamental solution is determined by and , part (A) of Lemma 3.8 essentially delineates circumstances under which the monotonicity of the representing function could be, in principle, characterized solely based on the infinitesimal characteristics of the underlying diffusion and the concavity of the exercise payoff. Part (B) of Lemma 3.8 shows, in turn, how the monotonicity of the function is associated with the monotonicity of the generator . The conditions of part (B) of Lemma 3.8 are satisfied, for example, under the assumptions of Remark 3.3 provided that is non-increasing on and .
Moreover, it is clear that under the conditions of Lemma 3.8 we have for all . However, without imposing further restrictions on the behavior of the payoff we do not know whether generates the smallest -excessive majorant of the exercise payoff or not, nor do we know how behaves in the neighborhood of the optimal stopping boundary. Our next theorem summarizes a set of conditions under which these questions can be unambiguously answered.
Theorem 3.9**.**
Assume that there is a unique interior threshold , that the conditions (A) or (B) of Lemma 3.8 are satisfied on , and that is lower semicontinuous on . Then, if and
[TABLE]
if . Moreover,
[TABLE]
for all , and
[TABLE]
Proof.
Claim (22) follows from the identity by invoking the canonical form (3). The rest of the claims follow directly from Theorem 3.7. ∎
Theorem 3.9 shows that the continuity of the function at the optimal boundary coincides with the standard smooth fit principle requiring that the value should be continuously differentiable across the optimal boundary. However, as is clear from Theorem 3.9, if the optimal boundary is attained at a threshold where the exercise payoff is not differentiable, then is discontinuous at the optimal boundary . Furthermore, since the nonnegativity and monotonicity of on are sufficient for the validity of Theorem 3.9, we observe in accordance with the results by [11] that is only upper semicontinuous on .
Theorem 3.9 also shows that has a neat integral representation (22) capturing the size of the potential discontinuity of at . In the case where is unattainable and the smooth fit principle is satisfied at (22) can be re-expressed as (cf. Proposition 2.13 in [11])
[TABLE]
and, hence, in that case the value reads as
[TABLE]
It is clear that if the sufficient conditions stated in Remark 3.3 are satisfied, and in addition is non-increasing on , and is unattainable for the underlying diffusion, then the conditions of Theorem 3.9 are met and
[TABLE]
Remark 3.10**.**
Our approach relies on the identity
[TABLE]
which is essentially based on the continuity of the running supremum process . Since the running supremum of a spectrally negative jump-diffusion is continuous as well and a jump-diffusion is a Hunt process, we notice that our principal findings on the representing function are valid for that class of processes as well provided that a set of sufficient regularity conditions are met (cf. [2]). In that setting the increasing fundamental solution can be identified as the -scale function associated with the particular spectrally negative jump diffusion (cf. Theorem 8.1 in [30]).
4 Illustrations and Extensions
We now illustrate our general findings in five separate examples in order to illustrate the applicability of the developed approach as well as the intricacies associated with the considered representation. The first example focuses on a stopping problem arising in the literature on economic mechanism design. In the second example we reconsider the analysis of an optimal stopping signal originally studied in [4] and connect it to the analysis developed in our manuscript. The third example focuses, in turn, on a case where the payoff is smooth and the stopping strategy is of the single boundary type. Despite these favorable properties, we will show that it does not always result into a value characterizable as an expected supremum in the spirit of (15). The fourth example, in turn, focuses on a less smooth case resulting into a representation where the representing function is monotone but not everywhere continuous. Finally, the fifth example focuses on spectrally negative jump diffusions and show how the developed approach applies there as well.
4.1 Incentive Compatible Implementable Stopping Rules
[29] and [28] consider the determination of incentive compatible implementable stopping rules arising in economic studies analyzing mechanism design. One of the key questions within the framework developed in [29] and [28] is to investigate if there exits a transfer which would result into the optimality of a desired exercise strategy characterized by a so-called cut-off rule. Such problems arise quite naturally, for example, in models considering situations where individual exercise strategies do not coincide with a socially desirable exercise rule. In such cases the decision making problem of a social planner can be reduced into the determination of a transfer rule (for example, a tax) resulting into the individual optimality of the socially desirable state. As we will now demonstrate, the approach developed in this study is particularly appropriate for the analysis of this question within the considered infinite horizon setting. To see that this is indeed the case, assume for simplicity that the exercise payoff is continuously differentiable on . Assume also that the representing function defined for by is nondecreasing and changes uniquely sign at the interior threshold . It is clear from Theorem 3.9 that in that case , is an optimal stopping time, and the value reads as in (23). Given these observations, we now consider the associated optimal stopping problem
[TABLE]
where is an exogenously set threshold. We now find that our assumptions guarantee the following result.
Proposition 4.1**.**
Under our assumptions,
[TABLE]
* is an optimal stopping time, and the value reads as*
[TABLE]
Proof.
Consider now the function . It is clear that our assumptions guarantee that vanishes at and is continuous and nondecreasing on . On the other hand, the representing function of the exercise payoff reads as
[TABLE]
The alleged result now follows from Theorem 3.9. ∎
Proposition 4.1 states a set of conditions under which the representing function can be utilized for characterizing a transfer rule resulting into the optimality of a desired fixed exercise threshold. This result is interesting since it essentially delineates circumstances under which a social planner can shift the individually optimal exercise threshold of a decision maker to a different socially optimal level by simply subtracting (or adding) the value of the representing function at the desired state to the exercise payoff. As we will notice in the following section, this result is closely related with the literature on optimal stopping signals and Gittins indices as well. A nice comparative static implication of our Lemma 2.3 is summarized in the following.
Corollary 4.2**.**
Assume that there is a so that is non-increasing on , for and whenever is attainable for the underlying diffusion. Then increased volatility decreases or leaves unchanged the transfer .
Proof.
The alleged result is a direct consequence of Lemma 2.3 after noticing that the assumptions guarantee that is strictly convex on (see Lemma 3.3 in [3]). ∎
4.2 Optimal Stopping Signals
We now proceed in our illustrations and show how the developed representation approach is related with non-standard stopping problems arising in the analysis of Gittins indices and optimal stopping signals (cf., for example, [4], [6], [15], [16], [27], and [32]). In line with the notation in [4], we assume that is an exogenously given parameter and let
[TABLE]
denote the value of the considered optimal stopping problem and assume that the exercise payoff is continuously differentiable on . As in [4] we also assume that the boundaries are natural for the underlying diffusion . This guarantees that even though the process may tend towards a boundary, it will never attain it in finite time. In connection with problem (28), we also consider the associated non-standard stopping problem
[TABLE]
where denotes the class of firs exit times from open subsets of with compact closure in . As was established in [4], the stopping region for the problem (28) coincides with the set . We now plan to show how these results can be replicated by utilizing the representation result developed in our paper.
It is clear from our analysis that in the present case it is sufficient that for the representing function
[TABLE]
is nondecreasing and changes uniquely sign at the interior threshold satisfying equation . If that is the case, then
[TABLE]
and . As was established in Theorem 13 of [4], in the present single boundary setting (see also Section 3.10 in [16] for the decreasing case). Consequently, we notice that the considered supremum representation results in the correct expressions for the considered functionals. Moreover, given the identity we observe the following interesting comparative static property of the the value (29):
Corollary 4.3**.**
Assume that the condition of Corollary 4.2 are satisfied. Then increased volatility increases the value (29).
Proof.
Analogous with the proof of Corollary 4.2. ∎
We would like to point out at that the determination of incentive compatible implementable stopping rules considered in the previous subsection is closely associated with the present case as well. To see that this is indeed the case, we immediately notice that if the representing function is monotonically increasing then choosing for some fixed threshold implies that .
Finally, it is also worth noticing that the non-standard stopping problem (29) has in many cases an interesting interpretation as an appropriate maximal conditional expectation. To see that this is indeed the case, denote by the set of functions belonging into the domain of the extended operator of the underlying process killed at and satisfying for the generalized Dynkin formula (see, for example, [11], [13],[25], and [31])
[TABLE]
where naturally coincides with the generator whenever the payoff is sufficiently smooth. It is now clear that in this case (29) can be re-expressed as
[TABLE]
Especially, if the exercise payoff constitutes an expected cumulative present value of a flow and reads as for some continuous then and the non-standard stopping problem (29) can be re-expressed in a more familiar form as
[TABLE]
implying along the lines of our Lemma 2.2 that
[TABLE]
Consequently, we notice that in this case the representing function can be interpreted as the maximal expected present value of the cash flow at the independent exponential terminal date provided that the process is still alive at that instant.
4.3 Optimal Entry
In order to illustrate circumstances where the value of a single boundary problems cannot necessarily be expressed as an expected supremum, we now assume that the upper boundary is unattainable for and that the exercise payoff can be expressed as an expected cumulative present value for some continuous revenue flow satisfying the conditions for , where , and for some . This type of models arise frequently in studies considering optimal entry under uncertainty.
It is clear that under these conditions the exercise payoff satisfies the conditions and for . Moreover, utilizing representation (4) shows that in the present case
[TABLE]
Our assumptions guarantee that for all and that is monotonically increasing on . Fix . Then a standard application of the mean value theorem for definite integrals yields
[TABLE]
where . Letting and noticing that as (since was assumed to be unattainable for , cf. p. 19 in [8]) then shows that proving that equation has a unique root and that . Moreover, the value (6) can be expressed as
[TABLE]
The representing function characterized in Theorem 3.4 can be expressed in the present setting as
[TABLE]
As was established in Theorem 3.9, we have that and
[TABLE]
Moreover, standard differentiation shows that for all we have
[TABLE]
demonstrating that is nondecreasing for only if
[TABLE]
for all . Otherwise it is clear from our results that the value of the considered optimal stopping problem cannot be expressed as an expected supremum of the form (15) (see Figure 1(a)). A simple sufficient condition guaranteeing the required monotonicity is to assume that is nondecreasing on since in that case we have
[TABLE]
If this is indeed the case, then
[TABLE]
4.4 Capped Call Option
In order to illustrate our findings in a nondifferentiable setting, assume now that the upper boundary is unattainable for and that the exercise payoff , with , satisfies the limiting inequality
[TABLE]
Assume also that the appreciation rate satisfies the conditions , for , where , and for .
We notice that the exercise payoff is continuous, nondecreasing, and twice continuously differentiable on . Moreover, , , and
[TABLE]
It is now clear that the conditions of Remark 3.3 are satisfied. Thus, we known that there exists a unique optimal exercise threshold and . Our objective is now to prove that this threshold reads as , where is the unique root of the ordinary first order condition
[TABLE]
To see that this is indeed the case, we first observe by applying part (A) of Corollary 3.2 in [1] combined with the limiting condition (34) that
[TABLE]
Applying analogous arguments with the ones in Example 3, we find that equation
[TABLE]
has a unique root so that . Moreover,
[TABLE]
In light of these observations, we find that if , then it is sufficient to notice that is -excessive since constants are -excessive and is also -excessive. Moreover, since both and dominate the payoff, we notice that constitutes the smallest -excessive majorant of and, therefore, . If instead , then and the optimal policy is to follow the stopping policy with a value
[TABLE]
Given these findings, we notice that if , then and
[TABLE]
is nonnegative and nondecreasing and, consequently,
[TABLE]
However, since and we notice that is discontinuous at the optimal threshold (see Figure 1(b)). If , then the nonnegative function
[TABLE]
in nondecreasing only if the increasing fundamental solution is convex on (it has to be locally convex at ). If the convexity requirement is met, then
[TABLE]
Moreover, since , we notice that is discontinuous at .
4.5 Spectrally Negative Jump-diffusions
In order to illustrate our findings for a spectrally negative jump diffusion, consider now the geometric Lévy process with a finite Lévy measure , where denotes the jump size distribution, characterized by the dynamics
[TABLE]
where and . It is now a straightforward exercise to show that , where denotes the positive root of the characteristic equation
[TABLE]
and
[TABLE]
denotes the expected jump size. We observe that if
[TABLE]
is nondecreasing, there is an interior point , and is lower semicontinuous on , then
[TABLE]
It is at this point worth emphasizing that in this jump-diffusion setting verifying optimality by investigating the behavior of the representing function is easier than by investigating the behavior of the generator of the underlying process.
5 Conclusions
We considered the representation of the value of a class of optimal stopping problems of linear diffusions as the expected supremum of a function with known regularity and monotonicity properties. By focusing on the single exercise boundary case, we developed an explicit integral representation for the above mentioned function by first computing the probability distribution of the running supremum of the underlying diffusion and then utilizing this distribution in determining the expected value explicitly in terms of the increasing minimal excessive mapping and the infinitesimal characteristics of the diffusion.
There are at least three directions towards which our analysis could be potentially extended. First, the present approach focuses on single boundary problems and consequently overlooks general problems with more boundaries. Extending our analysis towards this setting and computing the representing function explicitly would, therefore, constitute a natural extension of our approach. Second, impulse control and optimal switching problems can in many diffusion cases be interpreted as sequential stopping problems of the underlying process. Thus, extending our representation to that setting would be interesting too (for a recent approach to this within impulse control, see [10]). However, given the potential discreteness of the optimal policy in the impulse control policy setting seems to make the explicit determination of the integral representation a very challenging problem which at the moment is outside the scope of our study.
Acknowledgements: We would like to thank an anonymous Associate Editor, Peter Bank, Paavo Salminen, and the participants of the workshop Strategic Aspects of Optimal Stopping and Control in Economics and Finance at ZIF (Bielefeld University) as well as the participants of the conference Optimization of the flow of dividends: 20 years after at the Palais Brongniart (Paris) for valuable suggestions and helpful comments.
Appendix A Proof of Lemma 2.2
Proof.
(A) Assume that is such that . Noticing that
[TABLE]
demonstrates that
[TABLE]
Invoking the strong Markov property and utilizing the known form of the Laplace transform of the first hitting time (p. 18 on [8]) yields (8). On the other hand, combining the joint probability density of and stated on p. 26 of [8] with the density yields
[TABLE]
The proposed expectation (9) then follows by standard integration. Letting in (8) and invoking L’Hospital’s rule yields
[TABLE]
Applying now the representation (4) yields the proposed identity (10), thus completing the proof of part (A). (B) Finally, identity (11) follows under the assumption of the lemma from (3) and (9) after letting and noticing that . ∎
Appendix B Proof of Lemma 2.3
Proof.
In order to prove the alleged comparative static results, we first denote by the increasing fundamental solution associated with the more volatile dynamics characterized by the volatility coefficient for all . Denote by the first exit date of the diffusion from the open subset , where . Standard application of Dynkin’s theorem shows that for all we have
[TABLE]
since
[TABLE]
by the assumed convexity of . Consequently, by utilizing standard computations we notice that for all it holds
[TABLE]
where denotes the first hitting time of to a state . Letting and utilizing the fact that for the considered class of boundary behaviors (cf. [8], p. 19) then shows that
[TABLE]
for all . On the other hand, noticing that
[TABLE]
for all implies that for all , thus completing the proof of our lemma. ∎
Appendix C Proof of Lemma 3.2
Proof.
It is clear that under our assumptions is nonnegative, continuous, and dominates the exercise payoff for all . Moreover, since by Theorem 2.1 in [12], we find that the stopping region is nonempty. Let be a fixed reference point and define the ratio . It is clear that our assumptions combined with (2) guarantee that
[TABLE]
is nonnegative and nonincreasing for all . Analogously,
[TABLE]
is nonnegative and nondecreasing for all . Moreover, noticing that shows, by imposing the condition , that constitutes a probability measure. Therefore, it induces an -excessive function via its Martin representation (cf. Proposition 3.3 in [33]). However, since increasing linear transformations of excessive functions are excessive and , we observe that constitutes an -excessive majorant of for . Invoking now (13) shows that and consequently, that is an optimal stopping time. ∎
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] L. H. R. Alvarez E., A class of solvable stopping games , Appl. Math. Optim. 58 (2008), no. 3, 291–314.
- 2[2] L. H. R. Alvarez E., P. Matomäki, and T. A. Rakkolainen, A class of solvable optimal stopping problems of spectrally negative jump diffusions , SIAM J. Control Optim. 52 (2014), no. 4, 2224–2249.
- 3[3] Luis H. R. Alvarez E., A class of solvable impulse control problems , Appl. Math. Optim. 49 (2004), no. 3, 265–295.
- 4[4] P. Bank and C. Baumgarten, Parameter-dependent optimal stopping problems for one-dimensional diffusions , Electron. J. Probab. 15 (2010), 1971–1993.
- 5[5] P. Bank and N. El Karoui, A stochastic representation theorem with applications to optimization and obstacle problems , Ann. Probab. 32 (2004), 1030–1067.
- 6[6] P. Bank and H. Föllmer, American options, multi-armed bandits, and optimal consumption plans: a unifying view , Paris-Princeton Lectures on Mathematical Finance, 2002, Lecture Notes in Math., vol. 1814, Springer, Berlin, 2003, pp. 1–42.
- 7[7] P. Bank and F. Riedel, Optimal consumption choice with intertemporal substitution , Ann. Appl. Probab. 11 (2001), 750–788.
- 8[8] A. N. Borodin and P. Salminen, Handbook of Brownian motion—facts and formulae , (corrected second printing) second ed., Probability and its Applications, Birkhäuser Verlag, Basel, 2015.
