A Generalization of the Robust Positive Expectation Theorem for Stock Trading via Feedback Control
Atul Deshpande, B. Ross Barmish

TL;DR
This paper extends the Robust Positive Expectation Theorem from single-stock to pairs of stocks, providing conditions for guaranteed positive expected gains using feedback control, applicable to pairs trading strategies.
Contribution
It generalizes the RPE Theorem to two stocks with correlation and momentum assumptions, offering necessary and sufficient conditions for positive expectation in pairs trading.
Findings
Generalized RPE Theorem for two stocks with correlation and momentum assumptions
Derived necessary and sufficient conditions on feedback parameter K
Applicable to pairs trading scenarios
Abstract
The starting point of this paper is the so-called Robust Positive Expectation (RPE) Theorem, a result which appears in literature in the context of Simultaneous Long-Short stock trading. This theorem states that using a combination of two specially-constructed linear feedback trading controllers, one long and one short, the expected value of the resulting gain-loss function is guaranteed to be robustly positive with respect to a large class of stochastic processes for the stock price. The main result of this paper is a generalization of this theorem. Whereas previous work applies to a single stock, in this paper, we consider a pair of stocks. To this end, we make two assumptions on their expected returns. The first assumption involves price correlation between the two stocks and the second involves a bounded non-zero momentum condition. With known uncertainty bounds on the parametersâŠ
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
A Generalization of the Robust Positive Expectation
Theorem for Stock Trading via Feedback Control
Atul Deshpande1 and B. Ross Barmish2 1âAtul Deshpande is a graduate student working towards his doctoral dissertation in the Department of Electrical and Computer Engineering, University of Wisconsin, Madison, WI 53706. [email protected]âB. Ross Barmish is a faculty member in the Department of Electrical and Computer Engineering, University of Wisconsin, Madison, WI 53706. [email protected]
Abstract
The starting point of this paper is the so-called Robust Positive Expectation (RPE) Theorem, a result which appears in literature in the context of Simultaneous Long-Short stock trading. This theorem states that using a combination of two specially-constructed linear feedback trading controllers, one long and one short, the expected value of the resulting gain-loss function is guaranteed to be robustly positive with respect to a large class of stochastic processes for the stock price. The main result of this paper is a generalization of this theorem. Whereas previous work applies to a single stock, in this paper, we consider a pair of stocks. To this end, we make two assumptions on their expected returns. The first assumption involves price correlation between the two stocks and the second involves a bounded non-zero momentum condition. With known uncertainty bounds on the parameters associated with these assumptions, our new version of the RPE Theorem provides necessary and sufficient conditions on the positive feedback parameter of the controller under which robust positive expectation is assured. We also demonstrate that our result generalizes the one existing for the single-stock case. Finally, it is noted that our results also can be interpreted in the context of pairs trading.
I Introduction
The primary motivation for this paper is the so-called Robust Positive Expectation Theorem for Simultaneous Long-Short (SLS) trading of a single stock; see [1] and [2]. This result is a stochastic version of an arbitrage theorem originally introduced for continuously differentiable stock prices in [3]. It tells us that a combination of two controllers, one for the long trade and one for the short trade, provides a guarantee that the expected value of the gain-loss function is robustly positive with respect to a family of underlying stock prices which are Geometric Brownian Motions (GBM) with unknown drift and unknown volatility . Whereas robust portfolio balancing strategies have been presented in papers such as [4], the earliest contribution we find on robust positive expectation can be found in papers such as [5] and other related work by the same authors, such as [6]. In contrast to the above, we focus here on the linear feedback control framework which is covered in papers such as [3, 1, 2] and [7, 8, 9, 11, 10, 12].
The body of literature motivating this paper includes a number of flavors for the underlying stock prices and the control structure. For example, in reference [9], robustness results are given for stock prices generated by Mertonâs jump diffusion model and references [10, 11, 12] address variants of the SLS controller for the discrete-time case. To conclude this brief survey, we note that most of the literature cited above falls within the robust control paradigm formulated in [13]. Less closely related to this line of research are references [14, 16, 19, 15, 18, 20, 17], which, unlike the papers on robust control, are based on rather specific stock-price models. For example, in [14], stock prices are modeled as GBM processes coupled by a finite-state Markov chain, and in [15], trading signals are modeled as Ito processes based on GBM models. On the other hand, in [16, 19, 18, 20, 17], either the asset being traded or a relationship between multiple assets, is modeled as a mean-reverting Ornstein-Uhlenbeck process.
Whereas the SLS literature focuses on trading shares of a single stock, in this paper, we consider scenarios involving simultaneously trading two stocks. One simple method to extend the single-stock theory to two stocks would be to implement separate SLS controllers for each stock. That is, a robustly positive expected (RPE) gain for each stock individually implies that the pairs trade has RPE too. In this paper, we study a different approach for trading a pair, where one arm of a controller goes long on one of the stocks and the other arm goes short on the other stock. This new control structure is motivated by the desire to exploit correlated price behavior between two stocks rather than treating them separately.
To this end, we make certain assumptions on the stock dynamics, namely the satisfaction of directional correlation and bounded momentum conditions. Letting denote the cumulative gain or loss up to stage , we describe a generalized SLS controller with feedback parameter , which is constructed using the known uncertainty bounds. Our main result for the two-stock case provides necessary and sufficient conditions on under which robust satisfaction of the condition is guaranteed with respect to parameter variations associated with the conditions above. We also show how these results generalize the RPE Theorem for the single-stock scenario.
Given that our formulation is aimed at two stocks with correlated price dynamics, this paper provides a new perspective on âpairs-tradingâ literature. Unlike this literature, however, we do not include assumptions of price reversion, either through reliance on models such as those of Ornstein-Uhlenbeck as seen in [17, 18, 19, 20] or more general models for the spread function as in [21] and [22].
Existing Result Being Generalized
The take-off point for this paper is the Robust Positive Expectation Theorem for an SLS controller used to trade a single stock. Indeed, assuming a stock with prices represented by a discrete-time stochastic price process over , let denote the return in the -th period; i.e.,
[TABLE]
are taken to be independent, with an unknown constant mean for .
Given the setup above, the Simultaneous Long-Short (SLS) controller, depicted in Figure 1, determines the net investment level in the stock at stage . This is accomplished by summing the outputs of two linear time-invariant controllers. The first uses an initially positive for the long trade and the second uses an initially negative for the short trade. To elaborate, a long position represents the trader holding the appropriate number of shares of the stock and making profit as increases. On the other hand, a short position leads to a profit when there is a decrease in the stock price. We take
[TABLE]
with initial investment , feedback parameter and , being the cumulative gain-loss functions of the two controllers, with initial values . Subsequently, the traderâs net investment level in the stock is obtained as
[TABLE]
The robust positive expectation result from which we take off tells us: Except for the degenerate break-even case obtained with , the cumulative gain-loss function
[TABLE]
is robustly positive in expectation. That is, without knowledge of , the condition is satisfied. Furthermore, as seen in existing work such as [10], the expected gain-loss function is explicitly given by
[TABLE]
with the positivity of the above expression guaranteed for all non-zero by virtue of the basic fact that for all and . Since this result is the starting point for our current work, for the sake of a self-contained exposition, we provide an elementary derivation of the formula for above in the appendix.
II Two-Stock Setup and Market Assumptions
In this section, we consider two stocks instead of one and now describe the assumptions which are in force. These assumptions are not only on the price processes for the two stocks, but also on the market within which we operate.
Stock Price Dynamics
We consider stocks and with stochastically varying prices and respectively for and . The returns on the stocks, given by
[TABLE]
for are respectively assumed to be independent for , with constant means The relationship between these returns are assumed to satisfy the following conditions:
Directionally Correlated Returns Assumption
We assume that there exists a constant such that  with
[TABLE]
known to the trader and uncertain, with known bounds Note that the above implies that for all admissible , that is, there is uncertainty in the magnitude of , but not its sign.
Bounded Non-Zero Momentum Assumption
It is assumed that there are positive constants and known to the trader, such that
[TABLE]
Remarks: The bounds on above in combination with the assumption of directionally correlated returns lead to bounds on given by
[TABLE]
For the special case when the two stocks are one and the same, with , and this formulation reduces to a restricted version of the single-stock problem described in literature.
Idealized Market Assumptions
The trading is assumed to be carried out under idealized market conditions. That is, there are no transaction costs such as brokerage commission, fees or taxes for buying or selling shares. For such a market, it is also assumed that there is perfect liquidity; i.e., there is no gap between the bid and ask prices, and the trader can buy or sell any number, including fractions, of shares as desired at the currently traded price. That is, the trader is a price taker, investing small enough amounts so as not to affect the prices of the stocks. These assumptions are similar to those made in finance literature in the context of âfrictionless marketsâ going as far back as [23].
Leverage, Margin and Interest
In practice, brokers usually impose a limit on the investment levels based on the account value . For example, a trader may be bound by the constraint where denotes the so-called leverage which is extended. In the theory to follow, it is assumed that leverage is never a limiting factor. That is, sufficient resources are available to cover any desired investment levels in the respective stocks. Accordingly, issues involving margin interest are not in play. Finally, it is noted that there is no mention of ordinary interest on idle cash in the trading account. The explanation for this is that the results in this paper focus entirely on the gains and losses and which are attributable to trading.
III The Two-Stock Controller
Beginning with stocks and , the two-stock generalized SLS controller which we now describe has the same structure as the one in Figure 1. However, for this more general case, we have both stock prices as inputs to the controller, allow for different initial investments instead of and have instead of . The linear feedback controllers investing in and in are given by
[TABLE]
with parameters and chosen by the trader as explained below and with and being the cumulative gain-loss functions of the investments with initial values of .
Choice of Parameters
We first select initial investment parameter and feedback parameter . Then, the two controllers, defined in terms of these two parameters, have initial investment levels
[TABLE]
and feedback parameters
[TABLE]
Remarks: We observe that the choices of and above compensate against the differing momenta of the two stocks. When , notice that the initial investments satisfy and . However, the signs of one or both these quantities may change at a later stage . Thus, despite being initially long on and short on , our stock positions at later stage can be different. A similar statement can be made for .
Starting Point for the Analysis
A simple adaptation of the single-stock formula in Section I leads us to
[TABLE]
for the two-stock case. Note that with , the formula above reduces to the one for the single-stock case. The notation above making the dependence on , and explicit will be useful in the sequel for presentation and proof of the results.
IV Main Results
In the theorem to follow, we characterize the set of leading to the satisfaction of the robust positive expectation of with respect to and within their respective bounding sets. We also provide a corollary which leads to the recovery of the existing single-stock result when and . All the proofs for the results in this section are furnished in Section V.
Robust Positive Expectation Theorem
Suppose two stocks and have directionally correlated returns and satisfy the bounded non-zero momentum condition, with associated uncertainty bounds and . Then, for odd, the two-stock generalized SLS controller with guarantees robust satisfaction of the condition for all admissible and , if and only if
[TABLE]
For even, robust satisfaction is guaranteed if and only if either or when both and
[TABLE]
Remarks:
To accurately estimate the set of which guarantees satisfaction of the robust positive expectation conditions above, as demonstrated in Section VI, we can simply conduct a parameter sweep over a suitably large range with . Unlike existing results for the single-stock case, one possible outcome is that the set of satisfying the theorem requirements is empty. This can occur when the uncertainty bounds are âtoo large.â The corollary below is apropos to the special case when both stocks are one and the same; i.e. and we consider to recover the existing result for the single-stock case is presented below.
Corollary
Given any , for suitably small, robust satisfaction of the condition for all admissible and is guaranteed.*
V Proof of the Theorems
This section can be skipped by the reader seeking to avoid technicalities. Recalling that represents for a fixed , and , the starting point for our analysis is the fact that the robust positive expectation property holds if and only if
[TABLE]
for all admissible pairs . We first present some notation, a preliminary definition and a few lemmas which will be instrumental to the proofs to follow. Indeed, for fixed , we define the polynomial
[TABLE]
for . Note the similarity between the expressions for and . Indeed, when , if and only if .
Definition (Critical Uncertainty Bound)
For a fixed , the critical uncertainty bound is defined as
[TABLE]
Remarks: Given and , the quantity tells us the smallest for which the expected gain is non-positive. Using the convention that the infimum over an empty set is , if , since for all , we obtain . Furthermore, when , for all , thus . Finally, for , notice that the continuity of in combination with the fact that ensures that . The lemmas to follow more fully characterize the function for the non-trivial case when .
Notational Convention
In the proof to follow, there are numerous occasions where root operations are required. To avoid ambiguities attributable to non-unique or complex roots, the following notational conventions are in force: If is real and is a positive integer, then is taken to be the unique positive -th root of . For and odd, we take which is obtained using the definition for the positive variable case. We provide no definition when for even since this case is never encountered in the sequel. There are also cases when we consider expressions of the form for an integer . In this case, this quantity is defined as , where , and evaluated in a manner consistent with the convention above.
Lemma 1** (Critical Uncertainty).**
*Given , it follows that *
[TABLE]
Proof: For even and , since
[TABLE]
for all , it follows that the set of for which is empty. Hence, . For all other for odd or even, must be the smallest finite solving the equation . This is easily found to be
[TABLE]
Definition
To facilitate the proof of the following lemmas, we define the function on the set of positive  as
[TABLE]
Furthermore, in the sequel, we also use its derivative for . This is calculated to be
[TABLE]
Lemma 2** (Monotonicity).**
For , the function is monotonically increasing with derivative
[TABLE]
Proof: In the interval , a straightforward calculation leads to as given above. To complete the proof, it suffices to show that in the interval of interest. Since , and in the interval, by inspection, it follows that for all in the interval.â
Lemma 3** (Maximality).**
For odd and , the function has a unique stationary point where it attains its maximum value, with its derivative
[TABLE]
Proof: For odd and , we show that initially increases, thereafter achieves a maximum and decreases as continues to increase. To this end, it suffices to show that is initially positive, later crosses zero and thereafter stays negative. For , straightforward calculation leads to as given above. Indeed, it now suffices to show that its numerator behaves in the manner described above. Indeed, for , tends to infinity as approaches from above. However, it decreases monotonically thereafter as is negative for all . Finally, the fact that eventually becomes negative is immediate since Hence, , while initially positive for , decreases to cross zero and turns negative, which in turn implies that increases to its maximum and decreases thereafter as increases to infinity. This completes the proof. â
Proof of Robust Positive Expectation Theorem
To prove necessity, we assume for all admissible and , and consider two cases. For the case when is odd, the claimed necessary condition
[TABLE]
follows trivially from the fact that and are both admissible pairs. For the case when is even, the second necessary condition is immediate using the same argument as for odd. To complete the proof of necessity, we assume and must show that
[TABLE]
Indeed, proceeding by contradiction, if
[TABLE]
it is straightforward to verify that
[TABLE]
which contradicts the assumed positivity of .
To establish sufficiency, we assume feedback gain satisfying the conditions in the theorem and must show that for all admissible and . To this end, we choose an arbitrary admissible pair , and divide the analysis into three cases:
Case 1 (): In this case, whether is even or odd, the condition is trivially satisfied by virtue of the fact that
[TABLE]
with the last inequality following from the single-stock result; see Section I and the Appendix.
Case 2 (,  odd): Assuming satisfaction of the theorem requirements and , and noting that , for , we obtain and . Using this fact in conjunction with the definition of the critical uncertainty bound , we obtainÂ
Invoking Lemma , we see that is increasing when and from Lemma , monotonically decreases after achieving a unique maximum at some . Thus, irrespective of the position of this maximal point, considering and , we have for all . Thus, for the arbitrarily chosen , it follows that , which implies that .
Case 3 ( even): The first subcase which we consider is when
[TABLE]
holds. To show that , we first note that the above strict inequality and the positivity of and being even implies that
[TABLE]
For the second subcase with ,
[TABLE]
and , it follows that
[TABLE]
and
[TABLE]
Hence,
[TABLE]
which, upon rearrangement and use of Lemma 1 leads to
[TABLE]
Now, in the sub-subcase where , we have
[TABLE]
In the other sub-subcase, , from Lemma 2, we know that Therefore, implying that for the pair , we have . â
Proof of Corollary
Given , it suffices to show that for sufficiently small, the requirements of the RPE theorem are satisfied. For odd, this follows since and are continuous functions of , and . That is, there exists a such that for ,
[TABLE]
For even and suitably small, the condition
[TABLE]
is easily seen to be satisfied. Now, arguing as in the case of odd, for suitably small, we again obtain
[TABLE]
Thus, there exists such that for , the sufficient conditions for even are satisfied. â
VI Illustrative Example
This section demonstrates the construction and use of the two-stock controller for a toy example with Geometric Brownian Motion (GBM) as the underlying price process. For the first stock, the discrete-time GBM which we use for daily updates is described by
[TABLE]
where is the drift, the volatility and the are independent standard normal random variables. To illustrate the application of the Robust Positive Expectation Theorem, we begin with uncertainty bounds and . Assuming each time step above represents a daily return, these bounds correspond to variations of and respectively on an annualized basis. In addition, the two stocks are assumed to be directionally correlated with a nominal and uncertainty bound ; i.e., . Therefore, the discrete-time GBM for the second stock is described by uncertain drift and volatility as
[TABLE]
with the being independent random variables, each having standard normal distribution. It is important to note here that the trader does not know the direction of the underlying stock-price movement. That is, the sign of is unknown; only the bounds on are available. In the analysis to follow, we take , which represents, given the daily update equations, about six months of trading.
Controller Design
Beginning with initial investment in dollars, we seek to find a suitable satisfying the requirements of the RPE Theorem. Since is odd, we work with the inequalities
[TABLE]
For the given uncertainty bounds, we obtain the conditions
[TABLE]
as being necessary and sufficient for robust positive expectation. Conducting a parameter sweep with , the inequalities above are satisfied if and only ifÂ
Some Practical Considerations
In this subsection, we continue the analysis of the example above by introducing some practical considerations into a simulation not covered by the theorem. Recalling the discussion of leverage in Section II, we now take , use and assume an initial account value in dollars. Then, to remain in compliance with the leverage constraint, any time the controller in Section III encounters , the two investments are scaled back using the formula
[TABLE]
Controller Performance Over a Sample Path
For our simulations, we use daily volatilities of , and admissible GBM drift parameter , with . This corresponds to between the two stocks and a drift of . First, we illustrate the controller performance for a single sample path for each of the two stock prices; see Figure 2 where we observe price declines of approximately for and for over the trading period.
Figure 3 shows the performance of the controller. We see an overall return of on the initial \10,000$ during the trading period. It is also noteworthy that most of the gains come in the trading period between stages 70 and 100. This is the period when the largest downward stock price movement occurs.
Aggregate Statistics over Many Sample Paths
Now, instead of the single sample path analysis, we consider the performance against the entire family of GBM processes under consideration. We now calculate the returns using one million sample paths with and chosen using the uniform distribution over their respective admissible ranges. Figure 4 shows the empirically estimated probability density function of . The controller yields an average return of about and a median return of about with a probability of profit of . Interestingly, the statistics indicate positive expected value for even with the added leverage constraints. Most notably, even among the unprofitable scenarios, we observe that the controller limits the losses. For example, 99.99% of all the unprofitable sample paths show losses limited to less than 10% of the initial account value.
VII Conclusion
The main result in this paper is a new version of the Robust Positive Expectation (RPE) Theorem for the case of trading two directionally correlated stocks with bounded non-zero momenta. Given the uncertainty bounds , and , the theorem provided necessary and sufficient conditions on under which robustly positive expected trading gain is guaranteed. If the conditions of the theorem result in no positive satisfying the RPE condition, we deem the pair as not tradable. This reflects the fact that the uncertainty bounds are too large to enable robustness guarantees.
By way of future research, a logical step would be to back-test our new two-stock controller using historical data and to compare the performance to that of traditional pairs-trading algorithms. It is also worth noting that the investment levels and of the two arms of our new controller evolve independently. A potential research direction involves the development of new controllers with cross-coupling in their investment levels; each controller depends on the performance of the other. Another interesting direction of research would be to generalize the theory presented here to a basket of more than two directionally-correlated stocks.
Here, we obtain the expression for for an SLS controller operating on a single stock. Given the price process over , having independent returns with constant mean , beginning with the SLS controller described in Section I with the update equations
[TABLE]
for and , substituting for ,
[TABLE]
Taking the expectation in both the equations while noting that and are independent, we obtain
[TABLE]
Since each equation above has a simple scalar state-space form with zero initial condition and constant input , a straightforward calculation leads to
[TABLE]
Now, summing the two solutions above, we obtain
[TABLE]
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] B. R. Barmish and J. A. Primbs, âOn Arbitrage Possibilities Via Linear Feedback in an Idealized Brownian Motion Stock Market,â Proceedings of IEEE Conference on Decision and Control , pp. 2889â2894, Orlando, 2011.
- 2[2] B. R. Barmish and J. A. Primbs, âOn a New Paradigm for Stock Trading Via a Model-Free Feedback Controller,â IEEE Transactions on Automatic Control , AC-61, pp. 662â676, 2016.
- 3[3] B. R. Barmish, âOn Performance Limits of Feedback Control-Based Stock Trading Strategies,â Proceedings of the American Control Conference , pp. 3874â3879, San Francisco, 2011.
- 4[4] T. M. Cover, âUniversal Portfolios,â Mathematical Finance , vol. 1, pp. 1â29, 1991.
- 5[5] N. G. Dokuchaev and A. V. Savkin, âA Bounded Risk Strategy for a Market with Non-Observable Parameters,â Insurance: Mathematics and Economics , pp. 243-254, vol. 30, Issue 2, 2002.
- 6[6] N. G. Dokuchaev, Dynamic Portfolio Strategies: Quantitative Methods and Empirical Rules for Incomplete Information , Springer Science & Business Media, 2012.
- 7[7] B. R. Barmish and J. A. Primbs, âOn Market-Neutral Stock Trading Arbitrage Via Linear Feedback,â Proceedings American Control Conference , pp. 3693â3698, Montreal, Canada, 2012.
- 8[8] S. Malekpour, J. A. Primbs and B. R. Barmish, âOn Stock Trading Using a PI Controller in an Idealized Market: The Robust Positive Expectation Property,â Proceedings of the IEEE Conference on Decision and Control , pp. 1210-1216, Florence, Italy, 2013.
