Anomalous Scaling of Stochastic Processes and the Moses Effect
Lijian Chen, Kevin E. Bassler, Joseph L. McCauley, and Gemunu H., Gunaratne

TL;DR
This paper investigates the causes of anomalous scaling in stochastic processes, introducing the Moses effect as a new mechanism, and applies the analysis to financial data to identify its role in market fluctuations.
Contribution
The paper defines and relates the Moses effect to other known effects, providing methods to measure each and demonstrating their relevance in financial time series analysis.
Findings
Financial data's anomalous scaling is due to the Moses effect.
The Joseph exponent, not the Hurst exponent, tests market efficiency.
Methods enable independent measurement of scaling effects.
Abstract
The state of a stochastic process evolving over a time is typically assumed to lie on a normal distribution whose width scales like . However, processes where the probability distribution is not normal and the scaling exponent differs from are known. The search for possible origins of such "anomalous" scaling and approaches to quantify them are the motivations for the work reported here. In processes with stationary increments, where the stochastic process is time-independent, auto-correlations between increments and infinite variance of increments can cause anomalous scaling. These sources have been referred to as the the , respectively. If the increments are non-stationary, then scaling of increments with can also lead to anomalous scaling, a mechanism we refer to as the .âŠ
| Abbreviations | Process or Index | Description |
| SIP | stationary increment process | increments: identical |
| NIP | nonstationary increment process | increments: different |
| CLT | central limit theorem | |
| R/S | re-scaled range statistics | Eqn. (7) |
| BM | Brownian motion | increments: independent, Gaussian distributed |
| LM | Lévy motion | increments: independent, Lévy distributed |
| FBM | fractional Brownian motion | increments: identical, correlated, Gaussian distributed |
| FLM | fractional Lévy motion | increments: identical, correlated, Lévy distributed |
| SBM | scaled Brownian motion | increments: scaled, independent, Gaussian distributed |
| SLM | scaled Lévy motion | increments: scaled, independent, Lévy distributed |
| SFBM | scaled fractional Brownian motion | increments: scaled, correlated, Gaussian distributed |
| SFLM | scaled fractional Lévy motion | increments: scaled, correlated, Lévy distributed |
| VDP | variable diffusion processes | Eqns. (18) and  (19) |
| DIA | Dow Jones Industrial Average | |
| SPY | S&P500 Index | |
| QQQ | PowerShare NASDAQ-100 Index |
| Processes | |||||
|---|---|---|---|---|---|
| BM | 0.4997(5) | 0.5000(1) | 0.5000(1) | 0.4997(5) | 0.501(1) |
| SBM() | 0.4996(5) | 0.5000(1) | 0.3000(1) | 0.2996(5) | 0.300(3) |
| SBM() | 0.4999(5) | 0.5000(1) | 0.4000(1) | 0.3999(5) | 0.400(1) |
| SBM() | 0.4995(4) | 0.5000(1) | 0.6000(1) | 0.5995(5) | 0.601(1) |
| SBM() | 0.4993(4) | 0.5000(1) | 0.7000(1) | 0.6993(5) | 0.700(2) |
| LM() | 0.4998(2) | 0.7139(6) | 0.5001(2) | 0.7139(6) | 0.714(2) |
| LM() | 0.4996(3) | 0.5883(2) | 0.5000(1) | 0.588(3) | 0.588(3) |
| LM() | 0.5004(4) | 0.5266(2) | 0.5000(1) | 0.5270(5) | 0.5256(9) |
| SLM(, ) | 0.4998(3) | 0.5268(3) | 0.3000(1) | 0.3266(6) | 0.3254(4) |
| SLM(, ) | 0.4999(7) | 0.5263(2) | 0.4000(1) | 0.4263(9) | 0.426(2) |
| SLM(, ) | 0.4989(6) | 0.5265(2) | 0.6000(1) | 0.6253(8) | 0.626(2) |
| SLM(, ) | 0.5000(4) | 0.5265(2) | 0.7000(1) | 0.7265(5) | 0.726(1) |
| SLM(, ) | 0.5000(2) | 0.769(5) | 0.3004(4) | 0.569(5) | 0.569(1) |
| SLM(, ) | 0.4998(2) | 0.768(2) | 0.4009(5) | 0.669(2) | 0.669(2) |
| SLM(, ) | 0.5002(2) | 0.769(5) | 0.6006(5) | 0.870(4) | 0.869(2) |
| SLM(, ) | 0.4997(2) | 0.768(4) | 0.7006(5) | 0.969(3) | 0.970(1) |
| FBM() | 0.2994(5) | 0.5000(1) | 0.5000(1) | 0.2994(5) | 0.300(1) |
| FBM() | 0.4000(5) | 0.5000(1) | 0.5000(1) | 0.3999(5) | 0.400(1) |
| FBM() | 0.6001(3) | 0.5000(1) | 0.5000(1) | 0.6001(3) | 0.598(2) |
| FBM() | 0.6998(2) | 0.5000(1) | 0.5000(1) | 0.6998(2) | 0.700(1) |
| SFBM(, ) | 0.2988(7) | 0.5000(1) | 0.3000(1) | 0.0988(8) | 0.097(3) |
| SFBM(, ) | 0.3004(5) | 0.5000(1) | 0.4000(1) | 0.2004(5) | 0.201(2) |
| SFBM(, ) | 0.2997(5) | 0.5000(1) | 0.6000(1) | 0.3998(6) | 0.400(2) |
| SFBM(, ) | 0.2989(6) | 0.5000(1) | 0.7000(1) | 0.4989(6) | 0.500(1) |
| SFBM(, ) | 0.3990(6) | 0.5000(1) | 0.3000(1) | 0.1990(6) | 0.2007(5) |
| SFBM(, ) | 0.3991(6) | 0.5000(1) | 0.4000(1) | 0.2991(6) | 0.3006(4) |
| SFBM(, ) | 0.3993(4) | 0.5000(1) | 0.6000(1) | 0.4993(4) | 0.500(1) |
| SFBM(, ) | 0.3994(4) | 0.5000(1) | 0.7000(1) | 0.59994(4) | 0.6001(5) |
| SFBM(, ) | 0.5998(5) | 0.5000(1) | 0.3000(1) | 0.3998(5) | 0.4004(6) |
| SFBM(, ) | 0.5998(3) | 0.5000(1) | 0.4000(1) | 0.4998(3) | 0.5004(5) |
| SFBM(, ) | 0.5998(2) | 0.5000(1) | 0.6000(1) | 0.6998(2) | 0.700(1) |
| SFBM(, ) | 0.6000(3) | 0.5000(1) | 0.7000(1) | 0.8000(3) | 0.800(2) |
| SFBM(, ) | 0.6989(8) | 0.5000(1) | 0.3000(1) | 0.4989(8) | 0.498(2) |
| SFBM(, ) | 0.6999(3) | 0.5000(1) | 0.4000(1) | 0.5999(3) | 0.5987(7) |
| SFBM(, ) | 0.7000(2) | 0.5000(1) | 0.6000(1) | 0.7999(2) | 0.7997(4) |
| SFBM(, ) | 0.6999(1) | 0.5000(1) | 0.7000(1) | 0.8999(2) | 0.900(2) |
| FLM(, ) | - | 0.600(4) | 0.4999(1) | - | 0.4991(5) |
| FLM(, ) | 0.5996(3) | 0.600(3) | 0.4999(1) | 0.699(3) | 0.699(1) |
| FLM(, ) | - | 0.5560(3) | 0.4999(1) | - | 0.4564(7) |
| FLM(, ) | 0.5996(3) | 0.5558(4) | 0.5000(1) | 0.6553(7) | 0.6547(4) |
| SFLM(, , ) | - | 0.601(2) | 0.2998(1) | - | 0.300(1) |
| SFLM(, , ) | - | 0.600(3) | 0.4000(1) | - | 0.401(3) |
| SFLM(, , ) | - | 0.6003(4) | 0.5999(1) | - | 0.5995(4) |
| SFLM(, , ) | - | 0.6002(4) | 0.6999(1) | - | .6992(9) |
| SFLM(, , ) | 0.5990(6) | 0.602(3) | 0.2998(2) | 0.500(4) | 0.499(1) |
| SFLM(, , ) | 0.6000(2) | 0.600(2) | 0.4001(1) | 0.600(2) | 0.600(1) |
| SFLM(, , ) | 0.5996(4) | 0.6003(4) | 0.5998(1) | 0.7998(7) | 0.798(1) |
| SFLM(, , ) | 0.6000(3) | 0.5993(8) | 0.7001(1) | 0.900(4) | 0.898(1) |
| VDP() | 0.4999(5) | 0.498(4) | 0.302(4) | 0.300(5) | 0.2996(7) |
| VDP() | 0.4999(5) | 0.500(3) | 0.400(3) | 0.400(4) | 0.4003(5) |
| VDP() | 0.4994(4) | 0.500(2) | 0.600(1) | 0.599(2) | 0.6008(4) |
| VDP() | 0.4993(4) | 0.499(5) | 0.701(4) | 0.699(5) | 0.6999(7) |
| Processes | |||||
|---|---|---|---|---|---|
| SPY(30:190) | 0.500(2) | 0.503(4) | 0.290(2) | 0.294(4) | 0.298(7) |
| DIA(30:190) | 0.502(2) | 0.497(6) | 0.287(4) | 0.286(4) | 0.29(1) |
| QQQ(30:190) | 0.500(2) | 0.501(6) | 0.295(2) | 0.296(5) | 0.29(1) |
| SPY(260:380) | 0.500(2) | 0.511(9) | 0.552(4) | 0.564(7) | 0.55(1) |
| DIA(260:380) | 0.499(1) | 0.50(1) | 0.552(2) | 0.56(1) | 0.55(1) |
| QQQ(260:380) | 0.501(1) | 0.50(1) | 0.550(4) | 0.56(1) | 0.55(1) |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsComplex Systems and Time Series Analysis · Stock Market Forecasting Methods · Financial Risk and Volatility Modeling
Anomalous Scaling of Stochastic Processes and the Moses Effect
Lijian Chen
Department of Physics, University of Houston, Houston, TX 77204, USA
ââ
Kevin E. Bassler
Email address: [email protected]
Department of Physics, University of Houston, Houston, TX 77204, USA
Department of Mathematics, University of Houston, Houston, TX 77204, USA
Texas Center for Superconductivity, University of Houston, 77204, USA
ââ
Joseph L. McCauley
Department of Physics, University of Houston, Houston, TX 77204, USA
ââ
Gemunu H. Gunaratne
Email address: [email protected]
Department of Physics, University of Houston, Houston, TX 77204, USA
Abstract
The state of a stochastic process evolving over a time is typically assumed to lie on a normal distribution whose width scales like . However, processes where the probability distribution is not normal and the scaling exponent differs from are known. The search for possible origins of such âanomalousâ scaling and approaches to quantify them are the motivations for the work reported here. In processes with stationary increments, where the stochastic process is time-independent, auto-correlations between increments and infinite variance of increments can cause anomalous scaling. These sources have been referred to as the Joseph effect the Noah effect, respectively. If the increments are non-stationary, then scaling of increments with can also lead to anomalous scaling, a mechanism we refer to as the Moses effect. Scaling exponents quantifying the three effects are defined and related to the Hurst exponent that characterizes the overall scaling of the stochastic process. Methods of time series analysis that enable accurate independent measurement of each exponent are presented. Simple stochastic processes are used to illustrate each effect. Intraday financial time series data is analyzed, revealing that its anomalous scaling is due only to the Moses effect. In the context of financial market data, we reiterate that the Joseph exponent, not the Hurst exponent, is the appropriate measure to test the efficient market hypothesis.
PACS numbers
02.50.Fz, 02.50.Ey, 89.65.Gh, 89.75.Da
pacs:
Valid PACS appear here
â â preprint: APS/123-QED
I Introduction
A stochastic process is a sequence of random variables indexed either continuously or discretely, through a parameter often interpreted as time. Stochastic processes have been used to model a range of phenomena from stock prices Black and Scholes (1973); Mandelbrot (1963); Mantegna and Stanley (1995) to precipitation levels Le Cam (1961); Richardson (1981); Wheater et al. (2005) and animal locomotion Viswanathan et al. (1999); Sims et al. (2008); Soibam et al. (2014). A standard example is Brownian motion, which is described by the Wiener process . It has Gaussian distributed increments that are uncorrelated and independent of . The probability distribution of is also Gaussian, but with a width that grows as . Thus, , also referred to as ânormalâ diffusive motion Mandelbrot (2002), is said to scale as . More generally, processes are found that scale as , where is referred to as the self-affine exponent or Hurst exponent Embrechts and Maejima (2002).
Following experimental observations including in biological systems Iannaccone and Khokha (1995), financial markets Mantegna and Stanley (1995), and turbulence Castaing et al. (1989), it is of considerable interest to understand the nature of stochastic processes that scale anomalously. For example, has been associated with the failure of the efficient market hypothesis (EMH) Malkiel and Fama (1970); Malkiel (2003), namely that asset prices do not fully reflect all pertinent information on the market Alvarez-Ramirez et al. (2008); Eom et al. (2008); Wang and Liu (2010).
For processes whose increments lie on stationary, time-independent probability distributions, Mandelbrot identified two causes of anomalous scaling, which he referred to as the Noah Effect and the Joseph Effect, and furthermore defined scaling exponents to characterize them Mandelbrot and Wallis (1968); Mandelbrot (2002); Eliazar and Shlesinger (2013). The Noah effect represents the occurance of large increments with anomalously large frequency resulting in a probability distribution with infinite variance. It is quantified by the latent exponent ; increment distributions with have âfat tailsâ and exhibit anomalous scaling. The Joseph effect occurs when increments are correlated and is quantified by the Joseph exponent . When increment correlations can result in anomalous scaling. Mandelbrotâs nomenclature are biblical references: Noah built an ark to save mankind and other creatures from the great flood bib (1982a), an occurrence of an anomalously large event, and Joseph, interpreting a dream of Pharaohâs, counceled him concerning what he predicted would be a correlated sequence of years of abundance, followed by years of famine bib (1982b).
In this paper, we extend the characterization of scaling of stochastic processes to include those with non-stationary increments. Such processes can model the intraday prices of financial markets Bassler et al. (2007); MĂŒller et al. (1990); Dacorogna et al. (1993), daily precipitation levels Kantelhardt et al. (2006, 2003); Brunsell (2010); Rehman (2009); Richardson (1981), the abundance of solar flares Lepreti et al. (2000); Oliver and Ballester (1998); Rehman (2009); Richardson (1981), and temperature fluctuations in turbulence Castaing et al. (1989); Rehman (2009); Richardson (1981). An additional mechanism that can produce anomalous scaling is identified. It is referred to as the Moses effect and characterized with the Moses exponent , which quantifies the growth of the increment distribution. The nomenclature continues Mandlebrotâs tradition: Moses led the Israelites after their Exodus from Egypt as they wandered through the wilderness having no stationary settlements bib (1982c).
The many abbreviations used in the text are summarized in Table 1.
We will generalize the definitions of , , and and show that the sum of increments scale as with . For normal diffusive processes with stationary increments and thus . Anomalous scaling can occur when any of the exponents , , or differ from . We argue the even for processes with a Moses effect, as we have previously discussed McCauley et al. (2008a), the EMH should be validated by measuring the Joseph exponent , not the Hurst exponent , since the EMH relates to the absence of correlations in market returns. A measurement of , indicating the presence of the Joseph effect, would violate the EMH, but anomalous scaling resulting from a combination of Noah or Moses effects can still be consistent with the EMH.
The principal result of the work is the decomposition of the overall scaling of the probability distributions into Joseph, Noah, and Moses effects via . Accurate numerical methods for establishing the four scaling exponents independently will be presented. They account for finite-time corrections to the scaling behavior, and will be applied to standard and scaled versions of example stochastic processes to highlight the roles played by , , , and . Finally, exponents for a model of intraday trading in financial markets, variable diffusion processes Gunaratne et al. (2005); Bassler et al. (2006); McCauley et al. (2007, 2008b); Alejandro-Quiñones et al. (2006); Bassler et al. (2007); McCauley (2009); Seemann et al. (2012); Hua et al. (2015), will be computed and compared to the results with an empirical analysis of financial market data.
The paper is organized as follows. Definitions of the scaling exponents and methods to quantify them are given in Section 2. A collection of example stochastic processes that will be studied and the numerical methods to simulate them are given in Section 3. Section 4 presents the analysis of scaling in the various processes, demonstrating how the different effects can combine to yield an overall anomalous scaling. The methods used to accurately measure scaling indices are also presented in this section. In section 5, empirical financial market data is analyzed and compared to that of variable diffusion processes. The results are discussed in Section 6.
II Scaling in Stochastic Processes
Consider a one-dimensional stochastic process where the set can either be a subset of the real numbers or a subset of the integers. If the increments of the process
[TABLE]
have a probability distribution that is independent of , then the stochastic process is said to be a stationary increment process (SIP). If instead, the probability distribution of depends on , the process is referred to as a non-stationary increment process (NIP). Statistical analyses of SIPs can be preformed on a single time series of data, as the time independence of the increments permits a statistical ensemble to be constructed by time translations of the starting point. Statistical analyses of NIPs, on the other hand, generally can not be performed on a single time series, requiring instead an ensemble of time series. If, however, a NIP begins anew at certain times, such as after a triggering event, then corresponding time translations may be used to construct a statistical ensemble from a single time-series McCauley (2008); Bassler et al. (2007); McCauley et al. (2008c). Although, this perhaps can only be done if the time between renewals has a finite average Sibani (2013), since, more generally, weak ergodicity breaking Bouchaud (1992); Bel and Barkai (2005) may prevent time averages being equated with ensemble averages in diffusive processes that scale anomalously.
The generalization of time series analyses to include NIPs necessitates generalizing the definitions of indices used to characterize scaling in SIPs. Consider an ensemble of realizations of a stochastic process , each of which starts at the origin, i.e., , and has increments . The increments are random variables with probability distributions that can depend on , but are the same for all realizations . These realizations can either have continuous or discrete time, but for the purposes of analyzing the scaling of the process assume that they are sampled at regular intervals of time , which can be taken to be unity. The sampled times are then . Then
[TABLE]
where here and in what follows the superscript is suppressed for simplicity and . Define also the following random variables: the the sum of the absolute values of increments
[TABLE]
and the sum of increment squares
[TABLE]
Probability distributions of these variables and of over the ensemble will be used to characterize and quantify the scaling of NIPs. The definitions of the scaling exponents that follow, which involve ensemble averages, i.e., over , become equivalent to standard definitions for processes with stationary increments.
A stochastic processes is self-similar if, for any , there exists an exponent such that
[TABLE]
where ââ represents equality âin distribution;â quantifies the scaling of the overall process. Note that, in general, only the one-point probability distribution scales in self-similar processes; higher-order, multi-point distributions do not necessarily scale. Operationally, scaling of a suitable âwidthâ of the probability distribution of can be used to estimate
[TABLE]
In this paper, we use the difference of the 75th quantile and the 25th quantile of the ensemble probability distribution as the measure of this width. For SIPs this definition of becomes equivalent to Mandelbrotâs Embrechts and Maejima (2002); Mandelbrot (2002); Eliazar and Shlesinger (2013) and can be estimated by a variety of means, including de-trended fluctuation analysis Peng et al. (1994). Using the quantiles circumvents difficulties in cases where moments of the probability distribution diverge.
Since is the sum of increments [Eq. (2)], it follows from the central limit theorem (CLT) that if the increment probability distributions are
- (a)
uncorrelated,
- (b)
have finite variance, and
- (c)
identical, independent of time,
then the process will scale ânormally,â with . Anomalous scaling in stochastic processes () may originate from the failure of one or more of these conditions. Joseph, Noah and Moses effects are associated with the failures of conditions (a), (b), and (c) respectively, which are analyzed in following subsections.
II.1 Joseph effect
The Joseph effect is associated with the failure of condition (a) and can be quantified through a variant of rescaled range statistics (R/S) Mandelbrot and Wallis (1969, 1968); Avram and Taqqu (2000); Mandelbrot (2002); Hurst (1951). Estimate the range and standard deviation of a stochastic process as
[TABLE]
Then the ensemble averaged ratio of and scales as
[TABLE]
where is the Joseph exponent. Negatively dependent processes have , positively dependent processes have , and independent processes have .
II.2 Noah effect
The Noah effect refers to the failure of condition (b), and is quantified by the latent exponent Mandelbrot and Wallis (1968); Mandelbrot (2002); Eliazar and Shlesinger (2013). Suppose the tails of the increment distributions decay as
[TABLE]
where . Then . In this paper, we only consider processes for which is independent of time. Note that CLT condition (b) fails when , because the variance of is then infinite. If the increment distribution is Gaussian, log-normal or is any distribution with , then . If instead the increment distribution has fat tails with , then . We further limit our considerations to processes with , as otherwise the increment distributions have infinite mean Samoradnitsky and Taqqu (1994).
For time series analyses, a more convenient and stable way to estimate the latent exponent is from the scaling of ensemble probability distribution of the sum of increment squares, which can be estimated by the scaling of the median of the probability distribution of
[TABLE]
where is Moses exponent introduced below. A proof for Eqn. (10) is given in the Supplemental Material at [URL will be inserted by publisher].
II.3 Moses effect
We define the failure of condition (c) as the Moses effect. It occurs when the increment distribution is time dependent. We consider processes with increment distributions whose mean absolute deviation scale as
[TABLE]
where, as before, is the ensemble average. For SIPs, , whereas for NIPs, .
In time series analyses, a convenient and more robust way to estimate the Moses exponent is from the scaling of the ensemble probability distribution of the sum of the absolute value of increments, which can be estimated by the scaling of the median of the probability distribution of
[TABLE]
A proof for Eq. (12) and a discussion of the effects on changes in the measurement frequency are given in the Supplemental Material at [URL will be inserted by publisher]. Typically, we find that varying the increment interval, in Eqn. 1, does not affect the leading scaling behavior of .
The anomalous scaling of NIPs can arise due to combination of all three effects listed above. Equations (6), (8), (10), and (12) provide independent estimates of the four exponents. However, they are related through
[TABLE]
This scaling relation provides a useful independent check of the estimates of the four exponents.
III Examples of Self similar processes
In this section several model stochastic processes are introduced that will be used to illustrate the relationship (13). However, we emphasize that the relationship is expected to be valid for other stochastic processes as well.
III.1 Processes with Gaussian Increments
The classic example is Brownian motion (BM) which consist of a sequence of identical, independent Gaussian increments Feller (1957). BM can be generalized by including (a) correlations between increments, and (b) time-dependent increments. One way to include long-term correlations is through fractional Brownian motion (FBM), denoted , and defined below. These âcorrelationsâ can be characterized by an index which, as shown below, is the Joseph exponent. As for time-dependent increments, we limit consideration to processes whose increments scale in time. As shown below, the growth can be characterized by the Moses exponent . A stochastic process consisting of correlated and scaled Gaussian increments is denoted . In this notation, Brownian motion is denoted .
Fractional Brownian motions that scale in time have the form
[TABLE]
where the the proportionality constant is and . The Gaussian increments of FBM are correlated Mandelbrot (1975); Avram (1986), and the scaling exponents are derived as follows:
- (i)
Using Donskerâs theorem Donsker (1951) and continuous mapping therom Billingsley (2013); Whitt (2002), Avram and et al. proved that the index is the Joseph exponent Mandelbrot (1975); Avram (1986); Avram and Taqqu (2000).
- (ii)
Since individual increments are Gaussian-distributed, .
- (iii)
Since FBM is a SIP, .
- (iv)
To derive , let , then , . Thus, . From definition  (5) .
Observe that .
A scaled FBM is an NIP, except when , and is defined as
[TABLE]
where . Since increments and FBM is a SIP, is the Moses exponent of . Furthermore, since [see (iv) above], the self-similarity exponent is . Consequently, .
Generation of FBM and scaled FBM: There are several methods proposed to generate FBM, three of them, the Hosking method Brockwell and Davis (2013), the Cholesky method Dieker (2004); Bardet et al. (2003), and the Davies-Harte method Davies and Harte (1987); Dietrich and Newsam (1997); Wood and Chan (1994), are exact. We used the Davies-Harte method, which requires operations, due to its computational efficiency. The algorithm is predicated on computing the square root of the covariance matrix using the circulant matrix and a fast Fourier transform instead of much slower lower-upper triangular decomposition Dieker (2004); Bardet et al. (2003).
III.2 Processes with Lévy Increments
Independent and identically distributed increments in the classic Lévy motions can be characterized by a single index  Samoradnitsky and Taqqu (1994), which, as shown below, turns out to be the latent index. As before we can generalize the underlying process by including correlations and time-scaling of increments. The resulting process will be denoted .
Increments of the Lévy motion are stochastic variates from a probability distribution whose characteristic function is Gnedenko et al. (1954); Uchaikin and Zolotarev (1999); Nolan (2015)
[TABLE]
The scaling exponents for Lévy motions are evaluated as follows:
- (i)
It has been shown that , where Embrechts and Maejima (2002); Samoradnitsky and Taqqu (1994). Consequently, . For , increments of LM have the property that , which implies that . Applying CLT for processes with infinite variance Uchaikin and Zolotarev (1999); Gnedenko et al. (1954), we obtain that , . Thus, , and  Mandelbrot (2002).
- (ii)
Increments satisfy implying that is the latent exponent.
- (iii)
For with , the first order moment is bounded; since LM is a SIP, we have , therefore .
- (iv)
 Embrechts and Maejima (2002); Samoradnitsky and Taqqu (1994).
Note that .
As with the Brownian case, correlations between the variates can be induced using the Fractional Lévy motion (FLM) defined as
[TABLE]
where and the proportionality constant is . Only the exponents and of a FLM differ from those of the corresponding Lévy motion. The Joseph exponent cannot be defined using R/S statistics when , since the process is nowhere bounded in that case Embrechts and Maejima (2002); Samoradnitsky and Taqqu (1994); Eliazar and Shlesinger (2013). Thus, we restrict consideration to . Avram et al. proved that the index here is Joseph exponent Avram (1986); Avram and Taqqu (2000).
In order to estimate H, setting , Eqn. (17) can be expressed as
[TABLE]
where the proportionality constant is the same as before. It follows that , and hence that .
Finally, time-dependent increments can be generated through scaled FLM is defined via
[TABLE]
where . Only the values of and of a scaled FBM differ from the corresponding exponents of the associated FBM. Specifically, using a calculation similar to that of for FBM, , thus .
Generation of Lévy-stable random variables. Let be a uniform random variate on and let a random variable be exponential with mean 1. Assume and to be independent. Then the random variable
[TABLE]
is known to be distributed  Samoradnitsky and Taqqu (1994); DuMouchel (1971); Chambers et al. (1976).
The Davies-Harte method cannot be used to generate FLM variates since the associated correlation function does not exist. We used an approach introduced by Stoev and Wu Stoev and Taqqu (2004); Wu et al. (2004) that takes advantage of the circulant matrix and the fast Fourier transform to generate FLM. It requires operations. However, the algorithm can only simulate FLM approximately.
III.3 Variable Diffusion Process
Processes with Gaussian or Lévy increments, discussed above, have one common characteristic, that the increments are from a stable process and independent of the stochastic variable . In this subsection we introduce a set of diffusive processes whose increments depend on as well. Variable diffusion processes (VDPs) was introduced as a model for intraday variations in financial markets Bassler et al. (2007); Seemann et al. (2012); Hua et al. (2015). Here satisfies the stochastic differential equation: , where is the diffusion coefficient. If the probability distribution function at time is self-similar (as given by Eqn. (5)),
[TABLE]
where the scaling variable is . Variable diffusion processes exhibit many stylized facts (i.e., common statistical features) reported in financial markets Gunaratne et al. (2005).
For variable diffusion processes with finite variance, Eqn. (18) shows that and , and hence that . The self-similarity of the probability distribution implies further that the diffusion coefficient scales as Gunaratne et al. (2005)
[TABLE]
The probability distribution satisfies the Fokker-Planck equation:
[TABLE]
Using Eqns. (18) and  (19), we obtain , whose solution is
[TABLE]
As an example, if is constant , . If and , where is a constant, then , the bi-exponential distribution. The corresponding variable diffusion process is given by
[TABLE]
The associated exponents are:
- (i)
Since VDP is a Markov process .
- (ii)
For VDP with finite variance .
- (iii)
, thus .
- (iv)
Since , the Hurst exponent is .
Once again, .
IV Results From Simulations
IV.1 Finite-Size Corrections
Rescaled range statistics (R/S) analysis has been used extensively in studying persistence and long-term dependence in natural time series. The classical approach using the best linear relationship between and yields a biased estimate unless is large Caccia et al. (1997); Bisaglia and Guégan (1998); Taqqu et al. (1995); Hamed (2007). Corresponding approaches to measure , , and also suffer from analogous finite-time corrections. Ref. Hamed (2007) showed that the first order finite-time corrections take the form
[TABLE]
where are constants. As an example, Figure 1 shows the nonlinear fit given by Eqn. (22) for a SFLM with parameters , , and for the (known) indices , , , and . Here, the reciprocal of the variance has been used as the weight of a point.
When exponents for a stochastic process are unknown (e.g., financial markets) we use the form
[TABLE]
for finite-time corrections, and estimate as well. For the remainder of the paper, we use this approach to estimate the exponents , , , and .
IV.2 Exponents for different processes
For model stochastic processes, we use an ensemble of 100,000 stochastic realizations, each of length million. The lower cutoff is chosen to be . We select points between and ; the i-th point () is
[TABLE]
where represents the integer nearest to ; these points are (approximately) uniformly distributed in log scale. , , , , estimated independently, are given in Table 2. The reported standard errors are obtained through a bootstrap method. The relation is found to hold for each process.
V Application to financial markets
V.1 Financial Markets Data
The data used for the analyses were one-minute valuations for the most actively traded exchange-traded funds (ETFs) in the US market extracted from PiTrading.com. We restrict consideration to the most recent 2500 trading days ( 10 years). Intra-day trading is assumed to be a realization of the same stochastic process. The data provide open, close, high, and low prices within every minute; we use close price for our analysis. Missing data, perhaps due to technical problems or errors, are replaced by the last recorded price. We studied the three most traded ETFs, the Dow Jones Industrial Average (DIA), SP 500 (SPY), and PowerShare NASDAQ-100 (QQQ).
Stochastic processes underlying financial time series are represented using the return
[TABLE]
where is the price of a financial asset at time , and is a reference price, typically the price at the start of a session. The one-minute increments are
[TABLE]
Note that , which is the necessary condition for to scale, i.e. .
V.2 Scaling regions
Intraday seasonality. The analysis is predicated on the assumption that intra-day variations of the return follow a same stochastic process each day. Consequently, return data from the 2500 trading days constitute the ensemble. In order to eliminate any drift within the trading day, the data is âde-trendedâ by subtracting ensemble average at each . The intraday pattern of shows that the stochastic behavior is non-stationary within the day. of SPY (as well as for the other ETFs) appears to scale as a power law within two intervals during the day, the first following the opening of the market and and the second in the afternoon, see Figure 2. The horizontal bars indicate the start and end of the two scaling intervals. The first ranges from 30 to 190 minutes and the second from 260 to 380 minutes from the start of the trading day.
V.3 Estimation of the exponents
The duration of the two scaling intervals are 180 and 120 minutes respectively. The lower cutoff for the finite-time analysis [Section 4(b)] was set to 10 minutes. The total number of points used for the analysis, with intervals given by Eqn. (24), is . Methods outlined in the previous section were used for the analysis and Figure 3 shows the nonlinear fit for SPY(30:190). The indices extracted from the analyses are given in Table 3, and conclusions include (1) , implying that increments of the prices of ETFs are not from fat-tailed distributions, and (2) implying the absence of long-term memory. The latter is validated using the auto-correlation function which vanishes for time delays larger than 1 minute. Furthermore, the relation is validated.
The analyses outlined in Section IV were carried out for 100,000 ensembles of length 1 million. In contrast, financial market analysis was conducted for an ensemble of size 2500, and the intervals were 180 and 120 minutes respectively. One may inquire if the information extracted from these short processes through finite-size corrections are reliable. In order to address this issue, we re-computed the indices for variable diffusion process over a time interval . As described below, is evaluated using the relaxation of the finite-time indices. Specifically, we write Eqn. (22) as
[TABLE]
where is a time-scale for convergence of the index. In order to estimate for the VDP, we note that the nonlinear fit for for SPY(30:190) gives . The corresponding analysis of the VDP () should be of length , . Figure 4 shows the nonlinear fit for this VDP with . The estimated exponents are , , , , . We thus infer that exponents computed for financial markets are reliable.
VI Conclusions
There are increasing numbers of examples, ranging from variations in biological systems Iannaccone and Khokha (1995) and thermal fluctuations in turbulence Castaing et al. (1989) to price variations in financial markets Mantegna and Stanley (1995), where probability distributions associated with a stochastic process exhibit anomalous scaling and are non-Gaussian. The anomalies can have different origins, and the goal of the work reported here is to disentangle them. Previous studies on stationary processes Mandelbrot (2002); Eliazar and Shlesinger (2013) had established that infinite variance of increments (Noah effect) and long-time correlations between increments (Joseph effect) are two sources of the anomaly. However, these studies failed to recognize that time-dependence of the increments themselves can also be a source of anomalous scaling. In this paper, we showed how scaling of the increments with time, referred to as the Moses effect, can also contribute to anomalous scaling. Noah, Joseph, and Moses effects, characterized by , and respectively, are independent and the overall scaling of probability distributions, quantified by the Hurst exponent , is given by . As was emphasized, definitions of the exponents require the use of an ensemble of (nominally identical) stochastic trajectories when the underlying processes are time dependent.
Numerical approaches of time series analysis to accurately estimate each of the four scaling exponents independently were introduced. They are based on the use of medians and quantiles, which is especially appropriate for probability distributions lacking finite variance. These methods account for finite-time power-law corrections to scaling. The fact that the four indices can be measured independently allows the scaling relation that connects them to be verified, providing a stringent numerical check on the accuracy of the time-series analysis. The new numerical techniques were applied to a variety of different stochastic processes, including ones with both stationary and non-stationary increments, with and without long-time auto-correlations, and with both finite and infinite increment variance, to demonstrate the role of each effect toward anomalous scaling.
Financial time series of exchange-traded funds (ETFs) were analyzed as an application of the methods introduced here. As has been found to be the case for other financial markets Bassler et al. (2007); Seemann et al. (2012); Hua et al. (2015), the intraday prices of ETFs can be considered to be governed by non-stationary stochastic processes that repeat each trading day. We find two intervals where the underlying stochastic process scales anomalously with , which is often associated with a violation of the efficient market hypothesis (EMH). However, we find that and ; i.e., neither Noah nor Joseph effects are observed in financial markets. The deviation from results solely from the Moses effect (). Previously, it was proposed that the true test of the EMH should be the lack of correlations, i.e., , and not  McCauley et al. (2008a). Therefore, our analysis reiterates that ETF markets satisfy the EMH, despite the fact that they exhibit anomalous scaling. Finally, consistent with other recent studies of intraday trades in financial markets Bassler et al. (2007); McCauley et al. (2008b, c), we found that a variable diffusion process accurately models the scaling behavior in the two scaling intervals.
Although the scaling exponents defined here characterize the sources of anomalous scaling of the distribution functions, they do not uniquely identify higher order statistic or the underlying stochastic processes themselves. As an example, a scaled Brownian process and a variable diffusion process can have the same exponents as the first stage of stock markets (i.e., with , , and ). As discussed in the Supplemental Material at [URL will be inserted by publisher], VDP exhibits volatility clustering (i.e., the absolute values and the squares of increments exhibit long-time correlations) while the corresponding scaled BM does fails to do so. Volatility clustering is one of the well-known stylized facts on financial market dynamics Cont et al. (1997).
It would be interesting to apply the methods of time series analysis developed here to other, more physical, recurring stochastic processes with non-stationary increments. For example, the amount of daily precipitation recorded at a fixed location Kantelhardt et al. (2006, 2003); Brunsell (2010); Rehman (2009); Richardson (1981) may be amenable to such analysis. If underlying (stochastic) process is assumed to repeat itself each year, an ensemble can be constructed using the data for each year. Similarly, the daily, or monthly abundance of solar flares Lepreti et al. (2000); Oliver and Ballester (1998); Rehman (2009); Richardson (1981) may also be amenable to our methods of analysis. Solar activity is known to have an eleven year cycle, so that the days or months at the same phase each cycle may form an ensemble. The approach may also be useful for analyzing hard turbulence Castaing et al. (1989); here the temperature variation at a given location may be taken to be a stochastic process with non-stationary increments Rehman (2009); Richardson (1981). The process may then be considered to repeat after a non-periodic triggering event, such as a boundary layer separation Castaing et al. (1989). In this case, the temperatures at a given time following the triggering event form an ensemble. In each of these systems, it would be interesting to learn if the scaling is anomalous and, if so, which of the Noah, Joseph, and Moses effects, or what combination thereof, leads to the anomaly.
This work was supported by NSF-DMR-1507371 (KB) and NSF-IOS-1546858 (KB).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Black and Scholes (1973) F. Black and M. Scholes, Journal of Political Economy 81 , pp. 637 (1973) .
- 2Mandelbrot (1963) B. Mandelbrot, The Journal of Business 36 , pp. 394 (1963) .
- 3Mantegna and Stanley (1995) R. N. Mantegna and H. E. Stanley, Nature 376 , 46 (1995).
- 4Le Cam (1961) L. Le Cam, in Proceedings of the fourth Berkeley symposium on mathematical statistics and probability , Vol. 3 (University of California Berkeley, Calif, 1961) pp. 165â186.
- 5Richardson (1981) C. W. Richardson, Water Resources Research 17 , 182 (1981).
- 6Wheater et al. (2005) H. Wheater, R. Chandler, C. Onof, V. Isham, E. Bellone, C. Yang, D. Lekkas, G. Lourmas, and M.-L. Segond, Stochastic Environmental Research and Risk Assessment 19 , 403 (2005).
- 7Viswanathan et al. (1999) G. Viswanathan, S. V. Buldyrev, S. Havlin, M. Da Luz, E. Raposo, and H. E. Stanley, Nature 401 , 911 (1999).
- 8Sims et al. (2008) D. W. Sims, E. J. Southall, N. E. Humphries, G. C. Hays, C. J. Bradshaw, J. W. Pitchford, A. James, M. Z. Ahmed, A. S. Brierley, M. A. Hindell, et al. , Nature 451 , 1098 (2008).
