Randomized Computation of Continuous Data: Is Brownian Motion Computable?
Willem Fouch\'e, Hyunwoo Lee, Donghyun Lim, Sewon Park, Matthias, Schr\"oder, Martin Ziegler

TL;DR
This paper investigates the computability of continuous data, specifically Brownian motion, within the framework of Computable Analysis, establishing conditions under which it is computable based on moduli of continuity and extending previous results on randomized computation.
Contribution
It confirms the sufficiency of using the Cantor space of infinite fair coin flips for randomized computation and characterizes the computability of Brownian motion via computable moduli of continuity and their distributions.
Findings
Randomized computation can be confined to Cantor space without loss of generality.
Brownian motion is computable iff its moduli of continuity have a computable distribution.
Extends prior work on biased coin sequences to the case of continuous stochastic processes.
Abstract
We consider randomized computation of continuous data in the sense of Computable Analysis. Our first contribution formally confirms that it is no loss of generality to take as sample space the Cantor space of infinite FAIR coin flips. This extends [Schr\"oder&Simpson'05] and [Hoyrup&Rojas'09] considering sequences of suitably and adaptively BIASED coins. Our second contribution is concerned with 1D Brownian Motion (aka Wiener Process), a probability distribution on the space of continuous functions f:[0,1]->R with f(0)=0 whose computability has been conjectured [Davie&Fouch\'e'13; arXiv:1409.4667,S6]. We establish that this (higher-type) random variable is computable iff some/every computable family of moduli of continuity (as ordinary random variables) has a computable probability distribution with respect to the Wiener Measure.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsComputability, Logic, AI Algorithms · Mathematical Dynamics and Fractals · Benford’s Law and Fraud Detection
11institutetext: 1 University of South Africa 2 KAIST 3 University of Birmingham
Randomized Computation of Continuous Data:
Is Brownian Motion Computable?††thanks: Supported by the National Research Foundation of Korea (grant NRF-2017R1E1A1A03071032), by the International Research & Development Program of the Korean Ministry of Science and ICT (grant NRF-2016K1A3A7A03950702), and by the European Union’s Horizon 2020 MSCA IRSES project 731143. Dedicated to the memory of Klaus Keimel who in 2014 suggested to the last author to study the computability of càdlàg functions. We thank Volker Betz and Frank Aurzada for advice and assistance.
Willem L. Fouché1
Hyunwoo Lee2
Donghyun Lim2
Sewon Park2
Matthias Schröder3
Martin Ziegler2
(keywords: Computer Science of Continuous Data, Type-2 Theory of Effectivity, Randomization, Brownian Motion)
Abstract
We consider randomized computation of continuous data in the sense of Computable Analysis. Our first contribution formally confirms that it is no loss of generality to take as sample space the Cantor space of infinite fair coin flips. This extends [Schröder&Simpson’05] and [Hoyrup&Rojas’09] considering sequences of suitably and adaptively biased coins.
Our second contribution is concerned with 1D Brownian Motion (aka Wiener Process), a probability distribution on the space of continuous functions with whose computability has been conjectured [Davie&Fouché’2013; arXiv:1409.4667,§6]. We establish that this (higher-type) random variable is computable iff some/every computable family of moduli of continuity (as ordinary random variables) has a computable probability distribution with respect to the Wiener Measure.
1 Introduction
Randomization is a powerful technique in classical (i.e. discrete) Computer Science: Many difficult problems have turned out to admit simple solutions by algorithms that ‘roll dice’ and are efficient/correct/optimal with high probability [DKM*+*94, BMadHS99, CS00, BV04]. Indeed, fair coin flips have been shown computationally universal [Wal77]. Over continuous data, well-known closely connected to topology [Grz57] [Wei00, §2.2+§3], notions of probabilistic computation are more subtle [BGH15, Col15].
1.1 Overview
Section 2 resumes from [SS06] the question of how to represent Borel probability measures. [SS06, Proposition 13] had established that, on ‘reasonable’ spaces, every such distribution can be represented by the distribution of an infinite sequence of coin flips (i.e. over Cantor space) with a suitably and adaptively biased coin. Theorem 2.3 shows that such can in turn be represented by ‘fair’ coins. Lemma 2 characterizes computability of a Borel probability measure on the reals: Necessary and sufficient is that both the lower and upper semi-inverse of its cumulative probability distribution are, respectively, lower and upper semi-computable real functions.
Section 3 approaches the question of whether Brownian Motion (aka Wiener Process), a popular probability distribution on the space of continuous real functions, is computable: in the strong sense of Subsection 2.2 underlying [DF13, MTY13]. Subsection 3.1 recalls several known mathematical characterizations of this distribution, and relates their types of convergence to weaker notions of probabilistic computation [Bos08] while pointing out their differences to the strong sense. It turns out that quantitative continuity of Brownian Motion, captured in terms of some modulus considered as a derived random variable, constitutes the major obstacle: Theorem 3.2 establishes that computability of the probability distribution of any computable such a modulus is both sufficient and necessary for the computability of Brownian Motion. This reduces the conjecture from the probability distribution on a function space to that of an ordinary real random variable.
2 Representing Borel Probability Measures
Recall that a measure space is a triple , where is a non-empty set, is a -algebra over , and is a measure on . For measure spaces and and a measurable partial mapping , is the pushforward measure of w.r.t. if \mu\big{(}F^{-1}[V]\big{)} is defined and equal to for every . In this case we say realizes on and write . This notion is similar to, but not in danger of confusion with, [Wei00, Definition 2.3.2]; we will generalize it in Definition 1. Note that realizability is transitive; and a realizer must have of measure .
The Type-2 Theory of Effectivity employs Cantor space to encode, and define computation over, any topological T0 space, such as real numbers and continuous real functions [Wei00, §3.2+§4].
Example 2.1
- a)
Consider the real unit interval equipped with the -algebra of Borel subsets and the Lebesgues probability measure . 2. b)
Consider Cantor space equipped with the -algebra of Borel subsets and the canonical (=fair coin flip) probability measure : , where denotes the length of . 3. c)
The continuous total mapping realizes on : . 4. d)
Consider the real line equipped with (the Borel -algebra and) the standard Gaussian/normal probability distribution, realized on via the partial mapping for the cumulative distribution
[TABLE] 5. e)
Consider equipped with the Dirac point measue for some . It is realized on \big{(}[0,1],\mathcal{A},\lambda\big{)} via the constant function . 6. f)
*Consider equipped with the Cantor measure. It is realized on \big{(}[0,1],\mathcal{A},\lambda\big{)} via the inverse of Devil’s Staircase (aka Cantor–Vitali function). *
Let us combine and generalize the real Items (d), (e), and (f) of Example 2.1:
Lemma 1 (Real Case)
Fix equipped with some Borel probability measure . Recall that its cumulative distribution function \mathbb{R}\ni s\mapsto\mu\big{(}(-\infty,s]\big{)}\in[0,1] is càdlàg (continuous from right with left limits) and non-decreasing, hence upper semi-continuous. On the other hand s\mapsto\mu\big{(}(-\infty,s)\big{)} is càglàd and lower semi-continuous. Now consider the cumulative distribution function’s upper and lower semi-inverse:
[TABLE]
* is càdlàg and upper-semicontinuous; is càglàd and lower-semicontinuous; and both realize on \big{(}[0,1],\mathcal{A},\lambda\big{)}: see Figure 1.*
In the sequel we consider topological spaces, implicitly equipped with the Borel -algebra, and a Borel probability measure. [SS06, Proposition 13] establishes the following:
Fact 2.2
To every 2nd countable T0 space with Borel probability measure there exists a Borel probability measure on such that has a continuous partial realizer over .
The metric case is treated in [HR09, Theorem 5.1.1]. We show that the probability measure on can in fact be chosen as the canonical ‘fair’ one:
Theorem 2.3
Every Borel probability measure on Cantor space admits a continuous partial realizer over the ‘fair’ measure . The realizer is defined on with the exception of at most countably many points.
Indeed, Fact 2.2 and transitivity together imply that every 2nd countable T0 space with a Borel probability measure to admit a continuous partial realizer over . One cannot hope for a total realizer in general, though:
Proposition 1
*Let be a Borel probability measure on such that there is some such that the measure of the basic open set is *non-dyadic. Then there is no total continuous function with .
2.1 Proofs of Theorem 2.3 and Proposition 1
Proof (Theorem 2.3)
For each open interval consider the set of measure . Note that and . Fix and equip with the total lexicographical order; and consider the disjoint open intervals
[TABLE]
of lengths for each . Since is a Borel probability measure on , these lengths add up to . Also note that are disjoint with lengths ; and that may be empty in case . Finally abbreviate
[TABLE]
so that is defined except for at finitely many arguments (namely the binary encodings of the real interval endpoints) with of measure \gamma\big{(}F_{n}^{-1}(\vec{w})\big{)}=\tilde{\gamma}\big{(}\mathcal{C}_{\vec{w}}\big{)}. Since , is well-defined (except for at countably many arguments) and continuous with for every . Hence coincides with on the basic clopen subsets of and, being Borel measures, also on all Borel subsets. ∎
Proof (Proposition 1)
Suppose that is such a continuous function. For every there is a word of length such that contains an element of and an element of its complement, because otherwise the preimage would be the finite union of all open balls with all of length satisfying ; but the -measure of this union is dyadic. By the fan theorem (or by the fact the is a (sequentially) compact space), there is some and some infinite subset of such that is a prefix of for all . But cannot be continuous in the point , because no prefix of can tell whether is inside or outside the clopen set , a contradiction! ∎
2.2 Computability of Borel Probability Distributions
Of course a realizer in the sense of Theorem 2.3 is usually far from unique. We are interested in those computable with respect to a representation of the space under consideration:
Definition 1
Fix a Borel probability measure on and a representation in the sense of TTE [Wei00, §3]. A -realizer of is a mapping such that is a realizer of (over the ‘fair’ measure) in the above sense. Call -computable if it has a computable -realizer.
Note that is a 2nd countable T0 space, equipped with the pushforward measure of : hence Fact 2.2 and Theorem 2.3 together assert that a (possibly uncomputable) -realizer exists!
Example 2.4
Recall [Wei00, Definition 2.3.2] computable reduction between representations as well as the importance of admissible ones [Wei00, §3.2], which does not belong to [Wei00, Theorem 4.1.13.6].
- a)
The identity on constitutes a computable -realizer of the Lebesgues measure on according to Example 2.1c). 2. b)
If is -computable and if holds, then is also -computable. 3. c)
In particular the Lebesgues measure on is -computable for the admissible representation [Wei00, Theorem 4.1.13.7]. 4. d)
And so is the Gaussian distribution from Example 2.1d) as well as the Cantor distribution from Example 2.1f). The Dirac distribution is -computable iff is -computable. 5. e)
For admissible , integration is \big{(}[\xi\!\to\rho],\rho_{<}\big{)}-computable iff has a computable -realizer [Sch07].
Regarding (eq), recall [Wei00, §3.3] that every admissible representation of induces a canonical admissible representation of the space of continuous functions ; and recall [Wei00, Lemma 4.1.8] the representation of encoding approximations from below only. It is well-known that every -computable function must be lower semi-continuous [WZ00, Zie07]. Resuming Lemma 1, we can now characterize the real case [Wei99]:
Lemma 2
Fix a Borel probability measure on with cumulative distribution function and lower and upper semi-inverse and . Then is computable in the sense of Definition 1 iff both is -computable and is -computable.
3 Characterizing Computability of Brownian Motion
1D Brownian Motion aka Wiener Process is a probability measure on the space of (i) continuous functions satisfying (ii) and characterized by the following properties:
- iii)
For every , is independent of . 2. iv)
is Gaussian normally distributed with mean and variance .
Compare [Gal16, KT75, Mal15] for details. Here we approach the question of whether this measure is computable [Fou08, DF13] in the sense of admitting a computable -realizer; recall Definition 1.
Remark 3.1
The representation encodes any via both (I) its values on the countable dense subset of dyadic rationals , \mathbb{D}_{n}:=\big{\{}0/2^{n},1/2^{n},\ldots,2^{n}/2^{n}\big{\}}, and (II) a binary modulus of continuity of : a sequence such that implies ; see [Wei00, §6.1].
- a)
Based on Example 2.1e), Conditions (iii) and (iv) immediately yield an algorithm for computably ‘guessing’ the values W\big{|}_{\mathbb{D}} according to (I) iteratively on-the-fly with respect to the appropriate Gaussian normal distribution in relation to the previous values. However this approach does not allow to then (II) determine within finite time: with small but positive probability, W\big{|}_{\mathbb{D}_{n+m}} may exceed any purported upper bound . 2. b)
Conversely first (II) ‘guessing’ requires to know the probability distribution of the random variable exactly: otherwise the resulting Wiener Process will have skewed quantitative continuity. This in turn affects (I) the distribution of W\big{|}_{\mathbb{D}}, with properties (iii) and (iv) now having probabilities conditional to said . Recall the following generic (though not necessarily efficient) way of modifying any randomized algorithm to adjust its internal guesses to become conditional to some event : For every independent sample , test shether ; if not, discard and sample again — until obtaining one that complies with . 3. c)
By Lévy’s modulus of continuity theorem, with probability 1 it holds
[TABLE]
The Wiener Process is thus -Hölder continuous for every exponent , but not for . 4. d)
More explicitly, abbreviating and , Equation (1) says that, to every (except for a subset of measure zero) there exists some least such that
[TABLE]
depicted in Figure 2 constitutes a parameterized modulus of continuity of in the following sense: 5. e)
For a function between metric spaces of diameter 1 and , a (classical, as opposed to binary) modulus of continuity is a mapping such that it holds
[TABLE]
If is continuous with compact domain, then it has a modulus of continuity . It is additionally convex, can be chosen subadditive.
The from Item (c) is thus an unbounded real random variable, parameterizing the family of subadditive moduli of continuity from Equation (2) strictly increasing in both arguments.
We can now state our main result characterizing computability of the Wiener Process in terms of computability of the probability distribution of any/all parameterized moduli of continuity:
Theorem 3.2
Let denote any computable (and thus continuous) one-parameter family of subadditive functions strictly increasing in both arguments with . Suppose that to every Wiener Process (except for a subset of measure zero) there exists a (necessarily unique) least such that constitutes a modulus of continuity of in the sense of Remark 3.1e). Then the following are equivalent:
- •
The Wiener Process is computable (formally: has a computable -realizer).
- •
The random variable has a computable probability distribution.
- •
There exists a random variable with computable probability distribution such that is a modulus of continuity of with probability 1.
3.1 Naïve Approaches and their Deficiencies
Before proceeding to the proof of Theorem 3.2, let us report some well-known alternative characterizations of mathematical Brownian Motion and why they do not imply computability.
Example 3.3
For probability spaces and , recall that a sequence of random variables converges almost surely to if the set \big{\{}y:R_{n}(y)\to R(y)\big{\}}\subseteq Y has -measure 1.
On the other hand for a metric space, uniform almost sure convergence of to means that there exists of -measure 1 such that \sup_{y\in U}d\big{(}R_{n}(y),R(y)\big{)}\to 0.
- a)
Let and
[TABLE]
denote the Schauder ‘hat’ functions and independent standard normally distributed random variables. Then following sequence converges to the Wiener Process almost surely:
[TABLE] 2. b)
Let be independent standard normally distributed random variables (Example 2.1d). Then following sequence converges to the Wiener Process in mean.
[TABLE] 3. c)
Let be independent random variable with mean 0 and variance 1 and . Then following sequence converges to the Wiener Process in distribution:
[TABLE]
3.2 Proof of Theorem 3.2
We first record that the hypotheses ensure that does constitute a modulus of continuity for every , namely one of itself. Moreover strict monotonicity in asserts that the measure of all those Wiener Processes which have as modulus of continuity is strictly increasing and continuous. Hence we can apply Lemma 2 with continuous (as opposed to just càdlàg) cumulative probability distribution and with lower and upper semi-inverse coinciding and continuous.
First suppose the random variable parameterizing has a computable inverse cumulative probability distribution. Similarly to Example 2.1d), this allows to algorithmically ‘guess’ the value of according to said distribution; and computability of can be turned into an (upper bound on the) binary modulus of continuity (II). Regarding (I), having guessed and fixed a modulus of continuity affects properties (iii) and (iv) of the Wiener Process. As mentioned in Remark 3.1b), this can be atoned for by discarding guesses for values that violate — but is complicated in our case with undecidable real equality [Wei00, Exercise 4.2.9]. So we make a point of carefully using only strict inequalities, which are at least semi-decidable:
Beginning with iteratively/on-demand guess a new value , , subject to (iii) and (iv). Then check whether it complies with all previously guessed values , , in satisfying ; and if so, add to . On the other hand if there is some with , then discard and guess again the value of .
Note that the above comparisons exclude and fail in the case : which occurs only with probability 0, though: The above algorithm thus computes with probability 1.
Conversely suppose that Brownian Motion has a computable -realizer . For each given and and W:=\big{[}\rho\!\to\!\rho\big{]}(\bar{u}), computability of then implies [Wei00, Corollary 6.2.5] computability of
[TABLE]
and of defined for almost all : since is continuous and strictly increasing and unbounded by hypothesis. Again we consider instead, in order to avoid undecidable real equality. Preimages of open sets can be exhausted (only) from inside [Wei00, Theorem 2.4.5.3], and their measure (only) from below; cmp. Example 2.4e). With computable and a realizer of Brownian Motion, the sought cumulative probability \mathbb{P}\big{[}W:c(W)\leq C\big{]} thus coincides with the fair/canonical measure of \big{(}F\circ c\big{)}^{-1}\big{[}[0,C)\big{]}\subseteq\mathcal{C}, and with 1-\gamma\Big{(}\big{(}F\circ c\big{)}^{-1}\big{[}(C,\infty)\big{]}\Big{)}: the former yields approximations from below, the latter yield approximations from above, and together they yield approximations up to any given error [Wei00, Lemma 4.1.9]. Note that we do not need to be semi-decidable as it has measure zero anyway. ∎
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[BGH 15] Vasco Brattka, Guido Gherardi, and Rupert Hölzl. Probabilistic computability and choice. Information and Computation , 242:249–286, 2015.
- 2[B Mad HS 99] P. Berenbrink, F. Meyer auf der Heide, and K. Schröder. Allocating weighted jobs in parallel. Theory of Computing Systems , 32(3):281–300, 1999.
- 3[Bos 08] Volker Bosserhoff. Notions of probabilistic computability on represented spaces. In Ruth Dillhage, Tanja Grubba, Andrea Sorbi, Klaus Weihrauch, and Ning Zhong, editors, Proceedings of the Fourth International Conference on Computability and Complexity in Analysis (CCA 2007) , volume 202 of Electronic Notes in Theoretical Computer Science , pages 137–170. Elsevier, 2008. CCA 2007, Siena, Italy, June 16–18, 2007.
- 4[BV 04] René Beier and Berthold Vöcking. Random knapsack in expected polynomial time. J. Comput. Syst. Sci. , 69(3):306–329, 2004.
- 5[Col 15] Pieter Collins. Computable stochastic processes. ar Xiv , 1409.4667 v 2, 2015.
- 6[CS 00] Artur Czumaj and Christian Scheideler. Coloring nonuniform hypergraphs: A new algorithmic approach to the general lovász local lemma. Random Struct. Algorithms , 17(3-4):213–237, 2000.
- 7[DF 13] George Davie and Willem L. Fouché. On the computability of a construction of Brownian motion. Mathematical Structures in Computer Science , 23:1257–1265, 12 2013.
- 8[DKM + 94] Martin Dietzfelbinger, Anna R. Karlin, Kurt Mehlhorn, Friedhelm Meyer auf der Heide, Hans Rohnert, and Robert Endre Tarjan. Dynamic perfect hashing: Upper and lower bounds. SIAM J. Comput. , 23(4):738–761, 1994.
