Modeling and statistical analysis of non-Gaussian random fields with heavy-tailed distributions
Mohsen Ghasemi Nezhadhaghighi, Abbas Nakhlband

TL;DR
This paper introduces a new approach for analyzing non-Gaussian, heavy-tailed random fields, including a modified fractional Edwards-Wilkinson model with Lévy noise, and demonstrates how contour loop properties can distinguish these from Gaussian fields.
Contribution
It develops a novel numerical analysis method for heavy-tailed random fluctuations and proposes a substitution for the fractional EW equation with μ-stable Lévy noise.
Findings
Heavy-tailed fluctuations identified via tail exponent scaling
New model explains dynamics with heavy-tailed correlated noise
Contour loop properties differentiate non-Gaussian from Gaussian fields
Abstract
In this paper, we investigate and develop a new approach to the numerical analysis and characterization of random fluctuations with heavy-tailed probability distribution function (PDF), such as turbulent heat flow and solar flare fluctuations. We identify the heavy-tailed random fluctuations based on the scaling properties of the tail exponent of the PDF, power-law growth of th order correlation function and the self-similar properties of the contour lines in two-dimensional random fields. Moreover, this work leads to a substitution for fractional Edwards-Wilkinson (EW) equation that works in presence of -stable L\'evy noise. Our proposed model explains the configuration dynamics of the systems with heavy-tailed correlated random fluctuations. We also present an alternative solution to the fractional EW equation in the presence of -stable L\'evy noise in the steady-state,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Modeling and statistical analysis of non-Gaussian random fields with heavy-tailed distributions
Mohsen Ghasemi Nezhadhaghighi
Department of Physics, Shiraz University, Shiraz 71454, Iran
Abbas Nakhlband
Department of Physics, Sharif University of Technology, Tehran 14588-89694, Iran
Abstract
In this paper, we investigate and develop a new approach to the numerical analysis and characterization of random fluctuations with heavy-tailed probability distribution function (PDF), such as turbulent heat flow and solar flare fluctuations. We identify the heavy-tailed random fluctuations based on the scaling properties of the tail exponent of the PDF, power-law growth of th order correlation function and the self-similar properties of the contour lines in two-dimensional random fields. Moreover, this work leads to a substitution for fractional Edwards-Wilkinson (EW) equation that works in presence of -stable Lévy noise. Our proposed model explains the configuration dynamics of the systems with heavy-tailed correlated random fluctuations. We also present an alternative solution to the fractional EW equation in the presence of -stable Lévy noise in the steady-state, which is implemented numerically, using the -stable fractional Lévy motion. Based on the analysis of the self-similar properties of contour loops, we numerically show that the scaling properties of contour loop ensembles can qualitatively and quantitatively distinguish non-Gaussian random fields from Gaussian random fluctuations.
I Introduction
The ubiquitous existence of Gaussian random fluctuations in natural phenomena has been subject of plenty of interest in many fields, such as condensed matter physics, cosmology, string theory, biology, economics and earth science mandelbrot ; surface2 ; sornette ; mandelbrot1 ; falconer ; nelsonbook ; adler . Experimental measurements and numerical simulations show the presence of particular scaling properties in time and space in the fluctuations of Gaussian random fields. For instance, growing interfaces and elastic membranes were known to be described by a finite set of geometrical scaling exponents surface2 ; nelsonbook .
In Refs. kondevprl ; kondevpre the self-similar properties of two-dimensional Gaussian random fields are discussed by the analysis of the scaling properties of contour loop ensembles. Using the scaling analysis of contour loops, it has been shown that such properties are valid for the contour lines in glassy interfaces and turbulence kondevother , two-dimensional fractional Brownian motion rajabpour2009 , discrete scale-invariant rough surfaces haghighi2011 , synthetic multifractal rough surfaces hosseinabadi2012 , discrete surface growth models in (2+1)Dimensions hosseinabadi2014 , isothermal loops on the cosmic microwave background cmbcontours , and electron-hole puddles in Graphene sarma2011 ; najafi2016 . In most cases, fast decaying distributions are a noteworthy characteristic of the above mentioned examples. Thus, they seem, not to be significantly different from Gaussian random fluctuations kondevprl ; kondevpre . However, in reality, there are many cases where nonlinear effects result in strong correlations in the system. In addition, in these systems, the probability distributions often display heavy-tailed non-Gaussian behavior sornette .
There have been many studies exploring heavy-tailed non-Gaussian behaviors of the probability density function of natural phenomena, such as fluctuations in the resistance of conducting wires weissman1988 ; Orlyanchik2006 , the statistics of turbulent fields sorriso ; biskamp and turbulent heat flows kadanoff , the global velocity of imbibition fronts planet2009 , density of a vibrated column of granular material Nowak , solar flare fluctuations Scafetta , particle velocity fluctuations in granular systems Radjai , and the intensity histograms of individual images Ruderman
Our focus, in this paper, is modeling, simulation and characterization of the random fluctuations with power-law tails in their probability density functions. In order to drive some statistical properties of random fluctuations with heavy-tailed PDF, we will begin with proposing a rather simple linear differential equation i.e. fractional Edwards-Wilkinson equation in the presence of -stable Lévy noise. The scaling theory implies the existence of a few scaling laws and exponents. For example, th order two-point correlation function has power-law behavior with exponent , the so-called roughness exponent. In order to further characterize the random fluctuations with heavy-tailed distribution, the scaling properties of our proposed model are computed in the steady state, using the -stable fractional Lévy motion. In particular we will examine the power-law behavior of the th order correlation functions and self-affine properties of the contour loop ensembles. We will show that there are some “non-negligible” differences between the scaling properties of Gaussian random fluctuations and heavy-tailed non-Gaussian random fluctuations in two spatial dimensions.
The rest of this paper is organized as follows: In the Section II, we will introduce a linear dynamical process that describes the out-of-equilibrium interface dynamics with Gaussian statistics. Then a computational model for simulating random Gaussian process, such as fractional Brownian motion, is presented. In the Section III, a substitution for the fractional Edwards-Wilkinson equation is introduced. This equation works in the presence of -stable Lévy noise for modeling of the systems with heavy-tailed non-Gaussian PDF. Also, we have studied particular scaling properties of our proposed model. In the same section, we provide a general method which generates random fluctuations with heavy-tailed PDF. In the Section IV, simulations of -stable fractional Lévy motion and also an analysis based on the scaling properties of the probability distributions are discussed. Finally, the summary and the conclusions are presented in Section V.
II Random fluctuations with Gaussian statistics
A linear model for Gaussian random fluctuations
The simplest stochastic partial differential equations that describes the out-of-equilibrium interface dynamics with Gaussian statistics, are the Edwards-Wilkinson (EW) and noisy Mullins-Herring (MH) equations surface2 ; nelsonbook . The usual generalized form of EW and MH equations can be written as
[TABLE]
where is an even number. For we recover the EW equation, whereas yields the MH equation. Here is the scalar field parameterized by space coordinates and time . The coefficient is a constant and is usually assumed to be a Gaussian white noise with which satisfies the fluctuation-dissipation relation surface2 ; nelsonbook .
It is worth mentioning that, in the thermodynamic limit when the central limit theorem for independent random variables asserts that the probability distribution function of the random profile should converge to a Gaussian form: stochastic book ; gardiner .
Defining the Fourier-Laplace transform as
[TABLE]
Under this transformation the stochastic partial differential equation (1) becomes:
[TABLE]
where the Fourier transformed noise has a zero mean, and its correlations obey the equation . By inverting the Laplace transform, one can obtain
[TABLE]
The theory of kinetic roughening predicts that the random fluctuation is correlated in space and time nelsonbook . The simplest quantitative measure of a given random process is its spectral autocorrelation function, given by
[TABLE]
In the limit , we have the steady state structure function
[TABLE]
More generally, one can look at the matter of dealing with the linear stochastic partial differential equation (1) in such a way that when takes a fractional order we have: . Introducing the fractional Langevin equation for random fields, which were studied prior to this work, it is shown that steady state structure function behaves as Masoudi2013 :
[TABLE]
where is the fractional order.
Since the fractional Langevin approach provides an efficient method to study the statistical properties of the Gaussian random fields, one must consider the other possible methods to generate correlated random fluctuations, such as fractional Brownian motion. Such methods describe the steady states of linear growth models, i.e. Eq. (1).
Fractional Brownian motion
Fractional Brownian motion , in , is a Gaussian, non-stationary, and continuous random field. Its correlation function follows power-law scaling behavior described by Hurst index , while . A wide range of physical processes can be modeled by fractional Brownian random field, including, biological, economical, geological phenomena peitgen . Several methods have been commonly used to generate multidimensional fBm. The midpoint displacement method peitgen , the successive random addition method peitgen , the optimization method hamzehpour2006 and the Weierstrass-Mandelbrot functionausloos1985 are the most common methods to generate fBm samples. A very efficient way to generate fractional Brownian random field is the modified Fourier filtering method makse1996 . To simulate Gaussian random fields in -dimensions with this method, we consider the following power spectrum makse1996 :
[TABLE]
in which is an arbitrary constant and , with being the Fourier components in the th direction. In Eq. (8), is the cutoff wave vector and is the Hurst exponent. Two points belonging to the same random field, separated with distance , are correlated, while this correlation diminishes for makse1996 . For the small values of , Eq. (8) leads to the asymptotic power-law behavior: . Note that the scaling form of the power spectrum coincides with the spectral correlation function, Eq. (7). Therefore, we expect a linear relation between fractional order in Eq. (7) and Hurst index :
[TABLE]
It is worthwhile mentioning that two-dimensional fractional Brownian random field (), with , corresponds to the Edwards-Wilkinson equation universality class () surface2 , and describes the universality class of the Mullins-Herring model () surface2 .
To simulate a random Gaussian surface in two dimensions, one can consider a square lattice with sides of length and with grid size . The associated value for each cell , where , is given by Fourier-transforming , where the Fourier components and take their values in the range . To obtain the correlated surface with the desired correlation exponent , one needs to calculate the inverse Fourier transform:
[TABLE]
where , and is an independent uncorrelated Gaussian set of random variables associated with each possible values of and in the range of . Thanks to the central limit theorem, the probability density function will be Gaussian.
Scale invariance in Gaussian random fluctuations
The most interesting feature of the Langevin equation (1) is the scaling behavior of the interface fluctuations. The scaling properties of the random field can be characterized in terms of the height-height correlation function by
[TABLE]
where , and the angular brackets denote the ensemble average. The scaling function behaves like
[TABLE]
Another interesting measure, associated with fluctuating random fields in -dimensional space at a given system size , is the global width
[TABLE]
where . In many cases, the global roughness is observed to satisfy the dynamic scaling; such that
[TABLE]
where and is the global roughness exponent. The random fluctuation, when , is self-affine surface2 . The ratio in Eq. (14) is called the time exponent.
The scaling properties of the fractional Edwards-Wilkinson equation has been studied in Re. nezhadhaghighi2014 . Since this model is linear the scaling exponents , and can be easily calculated:
[TABLE]
We stress that the fractional Brownian random field resulted from the power spectrum is also scale invariant. The height correlation function, which is related to the height power spectrum, has the scaling form . From this scaling form we conclude that there is a one-to-one correspondence between the stationary solution of the fractional version of the stochastic differential equation (1) and the fractional Brownian motion with .
III Random fluctuations with power-law statistics
A linear model for heavy-tailed random fluctuations
Here we are interested in modifying the fractional generalization of the Eq. (1) in order to investigate and quantify the statistical properties of non-Gaussian heavy-tailed random field. In this paper, we consider the following stochastic partial differential equation
[TABLE]
where is the multidimensional Riesz-Feller fractional space derivative of order , and is -stable Lévy noise with . The parameter characterizes the asymptotic power-law behavior (see Fig.(1)) of the stable distribution for the -stable Lévy noise:
[TABLE]
Riesz-Feller fractional operator is also defined via its Fourier transform through the functional relation
[TABLE]
where is Fourier transform of the random field . It is also possible to rewrite the Riesz-Feller derivative using the standard Laplacian as samko ; kilbas .
We should note that the noise term in the Eq. (16) with corresponds to the usual uncorrelated Gaussian white noise. Besides, and correspond to the ordinary Edwards-Wilkinson and Mullins-Herring equations (1). Moreover, with , the corresponding Lévy white noise has infinite variance and the higher cumulants ps1 . For infinite variance models, the generalized central limit theorem states that the average of a large number of independent identically distributed random variables with the probability distribution Eq. (17) converges to the heavy-tailed stable distribution.
The solution to Eq. (16) is a scale invariant function. Therefore, we have
[TABLE]
where is a power function of the scale factor . In the following, we will analyze the scaling properties of the non-Gaussian random fields generated by the solution of Eq. (16), in and out of equilibrium.
Consider the fractional Langevin equation (16) under a scaling transformation and , together with a specified rescaling of the fields . Using the scale transformations, the Eq. (16) yields
[TABLE]
where , and is the space dimension. For the Eq. (16) to be scale invariant it is required that
[TABLE]
where and are called the growth and the roughness exponents, respectively.
In the next section, we will introduce -stable fractional Lévy motion, which provides a perfect candidate for the solution to Eq. (16) in the saturated regime (when ).
-stable fractional Lévy motion
The most well-known examples of the stochastic random fields with Gaussian distributed increments is the -dimensional fractional Brownian motion (fBm). In contrast to the usual fBm with Gaussian statistics, we will propose a new algorithm, -stable fractional Lévy motion (fLm), to simulate random fields with non-Gaussian statistics.
According to the generalized central limit theorem gardiner , it would be possible to generate random fields with heavy-tailed fluctuations and non-Gaussian distribution function, i.e. stable distributions. The best possible way to generalize fractional Brownian motion is to change the probability distribution of the random variables in the Fourier space. Therefore, we used a standard procedure to generate random variables from a -stable Lévy distribution. One can generate the -stable fractional Lévy motion, , over a substrate with a size by the equation
[TABLE]
where s are independent and identically distributed random variables, and . Let is the distribution function of the random variable with the asymptotic power-law behavior . The probability density of a symmetrical -stable Lévy process is given by
[TABLE]
where is the scale unit of the process, and characterizes the distribution weron . The spacial case corresponds to Gaussian PDF. The procedure of generating uncorrelated random variable corresponding to the probability distribution function, Eq. (23), is
[TABLE]
where is a uniformly distributed random variable in the interval , and the random number has an exponential distribution with mean weron .
The advantage of this algorithm for generating non-Gaussian, as well as Gaussian, random fields is demonstrated in the next section, where it is shown that the random profiles in two dimensions have the desired statistical properties.
For further analysis of the random fields with infinite variance fluctuations and heavy-tailed distributions, we need to study the scaling properties of the th order moments (see comment following ps1 ). The most useful measures for characterization of the heavy-tailed fluctuations are the th order two-point correlation function,
[TABLE]
and the th order global width of the random field defined by
[TABLE]
where the overline denotes a spatial average over the system of size , and the bracket denotes an ensemble averaging. Note that the th order moments (25) and (26) are finite only if .
Based on the scaling arguments made previously for heavy-tailed random fluctuations (see Eq. (20)), we believe that ().
Here, we mainly focus on the so-called -stable fractional Lévy motion, as an examples of the random fluctuations with heavy-tailed probability distribution functions. The two-dimensional -stable fractional Lévy fields also satisfy the scaling relations analogous to (25) and (26) with exponents and . Our purpose is to numerically measure the local and global roughness exponents and as functions of the control parameters and . We believe that for a given value of the stable parameter , there is a direct relation between and , which means that there is a linear relation between the fractional order in Eq. (16) and the Hurst index in -stable fractional Lévy motion.
IV Results
IV.1 Testing for Gaussianity and self-affinity
In this subsection, we will outline the essential properties of the non-Gaussian self-affine random fields. Here we considered the -stable fractional Lévy motion, Eq. (22) which is equivalent to the solution of the Eq. (16) in the saturation limit.
IV.1.1 Probability density of non-Gaussian random fields
Consider a single valued Gaussian random field which satisfies up/down symmetry . The most essential condition for the probability density of a Gaussian random field which is necessary to be satisfied is
[TABLE]
where is the variance of the fluctuation.
As illustrated in the Fig. (2), the probability distribution function of the -stable fractional Lévy motion with exhibits non-Gaussian behaviors with heavy-tailed distribution function. Conversely, for the limiting case the probability distribution function, , tends to Gaussian distribution (27) (see Fig. (2)).
By studying the scaling properties of the probability distribution function of the -stable fractional Lévy motion, we obtain an interesting result on the existence of the scaling properties:
[TABLE]
with the tail scaling exponent . Results from a simulation of -stable fractional Lévy motion are shown in Fig. 3. It is noteworthy that there is a linear relation between and the control parameters of the -stable fLm model, and the Hurst index ,. The relation is
[TABLE]
To present additional evidences of the existence of scale invariant features of our proposed non-Gaussian random field (-stable fLm), in the following, we will examine other properties of the model i.e. th order correlation function and the th order global width.
IV.1.2 Local and global roughness exponents
Two-point correlation function of the Gaussian random field configuration , for the most statistical models, behaves like: , where , and the parameter is called the local roughness exponent surface2 . The value of the scaling exponent can be measured by a linear fit , with in scale. Like the two-point function , the th order correlation function can also be used to analyze the self-affine properties of the random fluctuations. More specifically, we need to analyze the scaling properties of for the random fluctuations with heavy-tailed distributions. In Fig. (4), we have plotted the scaling relation between th order two-point correlation function for the -stable fLm model. The insets of Fig. (4) show as function of . We note that the local roughness exponent , as shown in the top panel of Fig. (4), is a linear function of the Hurst index .
We also calculated the th order global width of the fluctuations , from which the global roughness exponent is extracted using the scaling relation . In the bottom panel of Fig. (4), we have presented the th order global width for different values of the Hurst index and stable parameter . From these results, we extract the scaling exponent . In the inset of the same figure, we present as a function of . Conspicuously, the global roughness exponent linearly depends on the parameter . Our results for the exponents and (see Fig. (4)) are the same within statistical errors. This indicates that the -stable fractional Lévy motion obeys the mono-fractal random fields laws. It is worth mentioning that, for a given mono-fractal random field surface2 .
Here we have supposed that the solution to Eq. (16) (in the limit ) and the -stable fractional Lévy motions, are statistically equivalent. If we assume that the roughness exponent for the fractional Langevin equation (16) is similar to the one which has been measured for the -stable fractional Lévy motion, we are able to find a direct relation between the fractional order and the Husrt index . For two-dimensional Gaussian process, this relation is given by . As shown in Fig. (5), we present our numerical estimates for the fractional order for the corresponding value of the parameter . Our numerical test shows that one can approximately find a linear relation for all the values of the stable parameter .
In the next section, we will numerically calculate the scaling exponents related to the contour lines of the -stable fractional Lévy motion.
IV.2 Scaling properties of contour loop ensembles
Consider the random profile of a scale invariant two-dimensional self-affine stochastic field that obeys the scaling law . The iso-height lines of at the level set contains many non-intersecting closed loops; in other words, a set of “contour ensembles”. In Fig. (6), we have plotted the contour loop ensembles for -stable fLm with different values of the control parameters and .
According to the scaling theory of random fields, a contour loop ensemble of a mono-fractal random Gaussian surface (governed by a Gaussian distribution Eq. (27)) is a scale-invariant geometrical object kondevprl ; kondevpre . A key question about non-Gaussian random fields is whether there is any relation between the contour loop exponents and the roughness exponent of the process or the control parameters and .
One of the most interesting aspects of the scale invariant contour loop ensembles is a scaling relation between the mean loop length and loop radius , such that
[TABLE]
where the exponent is called the fractal dimension of contour loops. The radius for a given closed loop is defined by , where is the center of mass. It is worth mentioning that for a Gaussian random field, with roughness exponent , the fractal dimension follows from kondevprl ; kondevpre .
In order to evaluate the fractal dimension of the contour loops , we examined the scaling relation between the mean value of the loop perimeter and , according to Eq. (30). With regards to the contour loop ensemble of the non-Gaussian -stable fractional Lévy field, there is a scaling relation between and with the fractal dimension exponent , as shown in Fig. (7). The fractal dimension of the closed contours is measured using the linear fit in the scaling regime. The graph of the fractal dimension , as a function of , (Fig (7)), shows a linear dependence . In addition, in the inset we demonstrate the fractal dimension for a fixed value of the parameter . The results of simulations behave like . Our studies are currently in progress to determine the exact dependence of on and . It is important to note that, the relation is not true for the -stable fractional Lévy field (except when ).
Another possible way for examining the self-similarity of the contour lines is box-counting approach mandelbrot . For an object with deterministic self-similarity, one can determine the fractal dimension based on the scaling relation , where is the number of boxes with size needed for covering the fractal object. It is believed mandelbrot ; kondevpre , for a Gaussian random field with roughness exponent , that the fractal dimension of all contours is defined by . The scaling relation between and , for -stable fractional Lévy motion, is presented in Fig. (8). The slope of this plot determines the fractal dimension . At the bottom of Fig. (8) we have shown the measured value of . We emphasize that, interestingly, the relation is not valid for non-Gaussian power-law random fields.
V Conclusion
In this paper, we have presented a generalization of Edwards-Wilkinson equation (see Eq. (16)) to investigate the dynamics and statistical properties of correlated random fluctuations with heavy-tailed probability distribution function. Following the scaling analysis presented here, we calculated the roughness exponent associated with the non-Gaussian fluctuations with a heavy-tailed PDF. The Eq. (16) in the limit has a solution for an arbitrary and . For example, the Gaussian free field corresponds to and . Also the fractional Brownian motion, a well-known example of correlated Gaussian fluctuations, corresponds to and . For arbitrary values of and the solution to Eq. (16) is expected to be a non-Gaussian correlated random field. Using the -stable fractional Lévy motion, we proposed a way to analyze the statistical properties of the random correlated fluctuations with heavy-tailed PDF. One of the special features is that the contour lines of the introduced fluctuations in two spatial dimensions are self-similar. The fractal dimensions of -stable fLm contours do not follow the famous behavior of the Gaussian random fluctuations, and kondevpre ; kondevprl , although some numerical and experimental observations have shown that the same relations work for non-Gaussian fluctuations hosseinabadi2012 ; hosseinabadi2014 ; najafi2016 ; cmbcontours . The key point to be gleaned from our analysis is that the scaling theory reported for Gaussian random fluctuations kondevprl ; kondevpre holds only for fast decaying distributions. Since most of the well-known statistical fluctuations exhibiting a heavy-tailed distribution, it seems that we need also the scaling theory for those random fluctuations with heavy tailed PDFs. Specifically, we need a better understanding of the scaling properties of the contour loop ensembles in two-dimensional non-Gaussian random fields with heavy-tailed PDFs. It is quite natural to numerically find some other scaling exponents associated with contour lines and find other relevant aspects of random fluctuations with heavy-tailed PDF.
Acknowledgments: The authors would like to thank the anonymous referees for their constructive comments that greatly contributed to improving this paper. MGN thanks M. R. Nematollahi for reading the manuscript and M. Nattagh-Najafi for helpful discussions.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) B. B. Mandelbrot, The fractal geometry of nature (Freeman, New York, 1982).
- 2(2) A. L. Barabási and H. E. Stanley, Fractal Concepts in Surface Growth (Cambridge University Press, Cambridge, 1995)
- 3(3) D. Sornette, Critical Phenomena in Natural Sciences: Chaos, Fractals, Selforganization and Disorder: Concepts and Tools , (Heidelberg, Germany: Springer-Verlag, 2000).
- 4(4) B. B. Mandelbrot, Gaussian Self-Affinity and Fractals: Globality, The Earth, 1 / f 1 𝑓 1/f Noise, and R/S (Springer-Verlag, 2002)
- 5(5) K. Falconer, Fractal geometry: mathematical foundations and applications , (Wiley, Chichester, UK 2003).
- 6(6) D. Nelson, T. Piran, S. Weinberg, Statistical Mechanics of Membranes and Surfaces (World Scientific, 2004)
- 7(7) R. J. Adler, The geometry of random fields , (Vol. 62. Siam, 2010) stochastic book,gardiner
- 8(8) J. Kondev and C. L. Henley, Phys. Rev. Lett. 74 (1995) 4580
