Shape Analysis, Lebesgue Integration and Absolute Continuity Connections
Javier Bernal

TL;DR
This paper reviews the fundamental concepts of Lebesgue integration and absolute continuity, highlighting their connections to shape analysis and functional data analysis, with some proofs included for key results.
Contribution
It provides a comprehensive overview linking Lebesgue integration, absolute continuity, and shape analysis, including proofs of key results often omitted in other texts.
Findings
Connections between Lebesgue integration and shape analysis clarified
Key results about absolute continuity are proved and explained
Foundational concepts are linked to practical shape analysis applications
Abstract
As shape analysis of the form presented in Srivastava and Klassen's textbook 'Functional and Shape Data Analysis' is intricately related to Lebesgue integration and absolute continuity, it is advantageous to have a good grasp of the latter two notions. Accordingly, in these notes we review basic concepts and results about Lebesgue integration and absolute continuity. In particular, we review fundamental results connecting them to each other and to the kind of shape analysis, or more generally, functional data analysis presented in the aforementioned textbook, in the process shedding light on important aspects of all three notions. Many well-known results, especially most results about Lebesgue integration and some results about absolute continuity, are presented without proofs. However, a good number of results about absolute continuity and most results about functional data and shape…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Shape Analysis, Lebesgue Integration and Absolute Continuity
Connections
Javier Bernal
National Institute of Standards and Technology,
Gaithersburg, MD 20899, USA
( )
Abstract
As shape analysis of the form presented in Srivastava and Klassen’s textbook “Functional and Shape Data Analysis” is intricately related to Lebesgue integration and absolute continuity, it is advantageous to have a good grasp of the latter two notions. Accordingly, in these notes we review basic concepts and results about Lebesgue integration and absolute continuity. In particular, we review fundamental results connecting them to each other and to the kind of shape analysis, or more generally, functional data analysis presented in the aforemetioned textbook, in the process shedding light on important aspects of all three notions. Many well-known results, especially most results about Lebesgue integration and some results about absolute continuity, are presented without proofs. However, a good number of results about absolute continuity and most results about functional data and shape analysis are presented with proofs. Actually, most missing proofs can be found in Royden’s “Real Analysis” and Rudin’s “Principles of Mathematical Analysis” as it is on these classic textbooks and Srivastava and Klassen’s textbook that a good portion of these notes are based. However, if the proof of a result does not appear in the aforementioned textbooks, nor in some other known publication, or if all by itself it could be of value to the reader, an effort has been made to present it accordingly.
1 Introduction
The concepts of Lebesgue integration and absolute continuity play a major role in the theory of shape analysis or more generally in the theory of functional data analysis of the form presented in [23]. In fact, well-known connections between Lebesgue integration and absolute continuity are of great importance in the development of functional data and shape analysis of the kind in [23]. Accordingly, understanding functional data and shape analysis as presented in [23] requires understanding the basics of Lebesgue integration and absolute continuity, and the connections between them. It is the purpose of these notes to provide a way to do exactly that.
In Section 2, we review fundamental concepts and results about Lebesgue integration. Then, in Section 3, we review fundamental concepts and results about absolute continuity, some results connecting it to Lebesgue integration. Finally, in Section 4, we shed light on some important aspects of functional data and shape analysis of the type in Srivastava and Klassen’s textbook [23], in the process illustrating its dependence on Lesbesgue integration, absolute continuity and the connections between them. Accordingly, without page numbers, a table of contents for these notes would be roughly as follows:
-
Introduction
-
Lebesgue Integration
Algebras of sets, Borel sets, Cantor set
Outer measure
Measurable sets, Lebesgue measure
Measurable functions, Step functions, Simple functions
The Riemann integral
The Lebesgue integral
The Spaces
-
Absolute Continuity and its Connections to Lebesgue Integration
-
Functional Data and Shape Analysis and its Connections to Lebesgue Integration and Absolute Continuity
Summary
Acknowledgements
References
Index of Terms
The material in these notes about Lebesgue integration and absolute continuity is mostly based on Royden’s “Real Analysis” [16] and Rudin’s “Principles of Mathematical Analysis” [18]. The fundamental ideas on functional data and shape analysis are mostly from Srivastava and Klassen’s “Functional and Shape Data Analysis” [23]. An index of terms has been included at the end of the notes.
2 Lebesgue Integration
**Algebras of sets, Borel sets, Cantor set
Definition 2.1:** A collection of subsets of a set is called an algebra on if for , in , is in , and for in , is in .
Observation 2.1: From De Morgan’s laws if is an algebra, then for , in , is in .
Definition 2.2: An algebra is called a -algebra if the union of every countable collection of sets in is in .
Observation 2.2: From De Morgan’s laws if is a -algebra, then the intersection of a countable collection of sets in is in .
Definition 2.3: A set of real numbers is said to be open if for each there is such that each number with belongs to . A set of real numbers is said to be closed if its complement in R is open, i.e., is open, where R is the set of real numbers. The collection of Borel sets is the smallest -algebra on the set R of real numbers which contains all open sets of real numbers.
Observation 2.3: The collection of Borel sets contains in particular all closed sets, all open intervals, all countable unions of closed sets, all countable intersections of open sets, etc.
Proposition 2.1: Every open set of real numbers is the union of a countable collection of disjoint open intervals. Proof in [16].
Proposition 2.2 (Lindelöf): Given a collection of open sets of real numbers, then there is a countable subcollection of with
[TABLE]
Proof in [16].
Definition 2.4: A set of real numbers is said to be compact if every open cover of contains a finite subcover, i.e., if is a collection of open sets of real numbers such that , then there is a finite subcollection of with .
Proposition 2.3 (Heine-Borel): A set of real numbers is compact if and only if it is closed and bounded. Proof in [16] and [18].
Proposition 2.4: Given a collection of closed sets of real numbers such that at least one of the sets is bounded and the intersection of every finite subcollection of is nonempty, then . Proof in [16] and [18].
Definition 2.5: A number is said to be a limit point of a set of real numbers if every open set that contains contains , in .
Definition 2.6: A set of real numbers is said to be perfect if it is closed and if every number in is a limit point of .
Proposition 2.5: A set is closed if and only if every limit point of the set is a point of the set. A nonempty perfect set is uncountable. Proofs in [18].
Corollary 2.1: Every interval is uncountable, thus the set of real numbers is uncountable.
Observation 2.4: Let be the union of the intervals , that are obtained by removing the open middle third of the interval . Let be the union of the intervals , , , that are obtained by removing the open middle thirds of the intervals and . Continuing this way, a sequence of compact sets is obtained with for every positive integer . The set , called the Cantor set, is compact, nonempty, perfect thus uncountable, and contains no interval. Proofs in [18].
Definition 2.7: The extended real numbers consist of the real numbers together with the two symbols and . The definition of is extended by declaring that if is a real number, then . The operation is left undefined, the operation is defined to be [math], while other definitions are extended: If is a real number, then
x+\infty=\infty,\ \ \ \ x-\infty=-\infty,\ \ \ \ ,
x\cdot\infty=\infty,\ \ \ \ x\cdot-\infty=-\infty\ \ \ \ if ,
x\cdot\infty=-\infty,\ \ \ \ x\cdot-\infty=\infty\ \ \ \ if .
Finally
\infty+\infty=\infty,\ \ \ \ -\infty-\infty=-\infty,\ \ \ \ \infty\cdot(\pm\infty)=\pm\infty,\ \ \ \
**Outer measure
Definition 2.8:** Given a set of real numbers, the outer measure of is the extended real number defined by
[TABLE]
where the are countable collections of open intervals that cover , and is the length of the interval .
Observation 2.5: is a set function, , if , and the outer measure of a set consisting of a single point is zero.
Proposition 2.6: if is an interval. Proof in [16].
Proposition 2.7: Countable subadditivity of : for any countable collection of sets of real numbers. Proof in [16].
Corollary 2.2: if is countable.
Observation 2.6: The Cantor set is an example of an uncountable set with outer measure zero. Proof in [18].
Proposition 2.8: is translation invariant, i.e., for any set of real numbers and any number , where .
Proof: If is a countable collection of open intervals that covers , then is a countable collection of open intervals that covers . Since for each , then . Similarly, if is a countable collection of open intervals that covers , then covers , , and therefore . Thus, .
Proposition 2.9: For any set of real numbers and any , there is an open set with and ( if ). In addition, there is a set that is the intersection of a countable collection of open sets with and .
Proof: From the definition of the outer measure there is a countable collection of open intervals that covers with . With , then is open, , and , which proves the first part. Now let be an integer. Then from the first part there is an open set , , with . With , then for any integer we have and therefore . Letting , then . Thus , which proves the second part.
**Measurable sets, Lebesgue measure
Definition 2.9 (Carathéodory’s criterion):** A set of real numbers is said to be (Lebesgue) measurable if for every set of real numbers, then
[TABLE]
the complement of in R, i.e., , R the set of real numbers.
Observation 2.7: Clearly is measurable if and only if is, and and the set R of real numbers are measurable. As for an example of a nonmeasurable set, a rather complex one is presented in [16]. Finally, note that it is always true that , thus is measurable if and only if for every set we have .
Proposition 2.10: If , then is measurable.
Proof: For any set , since , , and , then
[TABLE]
Proposition 2.11: The collection of measurable sets is a -algebra on R. Proof in [16].
Definition 2.10: The Lebesgue measure is the set function obtained by restricting the set function to the collection of (Lebesgue) measurable sets.
Proposition 2.12: Countable subadditivity of : for any countable collection of measurable sets (Proposition 2.7).
Countable additivity of : if the sets in as above are pairwise disjoint. Proof in [16].
Observation 2.8: It is in the proof of countable additivity of the Lebesgue measure that Carathéodory’s criterion plays a major role. On the other hand, the importance of the countable additivity of is immediately apparent in the proofs of the two parts of the following very useful proposition.
**Proposition 2.13 (Nested sequences of measurable sets Lemma):
**1. Given a countable collection of measurable sets with for each , , then
- Given a countable collection of (not necessarily measurable) sets with for each , then
Proof in [16] for the first part. In [14] for the second part using Proposition 2.9. As mentioned above, in the proofs of both parts the countable additivity of (Proposition 2.12) is used.
Proposition 2.14: Every Borel set is measurable. Proof in [16].
Observation 2.9: A rather complex example of a measurable set that is not Borel is presented in [4].
Proposition 2.15 (Equivalent conditions for a measurable set): Let be a set of real numbers. Then the following five conditions are equivalent:
i. is measurable.
ii. Given , there is an open set , with .
iii. Given , there is a closed set , with .
iv. There is a set that is the intersection of a countable collection of open sets, with .
v. There is a set that is the union of a countable collection of closed sets, with .
Proof: We only prove i ii. Proofs of all cases in [17].
i ii: is measurable.
Case 1: .
There exists open such that , (Proposition 2.9). then implies . Accordingly,
[TABLE]
Case 2: .
For each integer let . Then each is measurable, , and . From Case 1 above it follows that there is open such that and . With , then is open, and . Thus,
[TABLE]
ii i: Given , there is an open set , with .
open implies is measurable. Thus, for any set , we have . Accordingly,
[TABLE]
arbitrary implies . Thus, is measurable.
Corollary 2.3: Every (Lebesgue) measurable set is the union of a Borel set and a set of (Lebesgue) measure zero.
Proposition 2.16: The translate of a measurable set is measurable, i.e., if is a measurable set, then is measurable for any number .
Proof: For any set , setting , , and noting , , by Proposition 2.8, then
[TABLE]
Thus, is measurable.
**Measurable functions, Step functions, Simple functions
Definition 2.11:** Let be an extended real-valued function defined on a (Lebesgue) measurable set. Then is said to be (Lebesgue) measurable if the set is (Lebesgue) measurable for every real number .
Proposition 2.17 (Equivalent conditions for a measurable function): Let be an extended real-valued function of measurable domain. Then the following conditions are equivalent:
i. is measurable for every real number .
ii. is measurable for every real number .
iii. is measurable for every real number .
iv. is measurable for every real number .
Observation 2.10: Conditions ii, iii, iv can be used instead of condition i to define a measurable function. We note that if a real-vaued function defined on a closed or open interval is continuous [18], then is measurable since the set in condition i is relatively open in [18]. Also the restriction of a measurable function to a measurable subset of its domain, is measurable.
Definition 2.12: Given real numbers , , , and an integer , by a partition or subdivision of we mean a finite set of points with . A function R is called a step function (on ) if for an integer , there are numbers , , and a partition or subdivision of , such that , , , .
Definition 2.13: Given sets , of real numbers, , the characteristic function of on , , is defined by
[TABLE]
Definition 2.14: Given a measurable set , an integer , and for , nonzero numbers , measurable sets , and characteristic functions of on , a function R defined by for in is called a simple function on .
Observation 2.11: Step functions are measurable and a function is simple if and only if it is measurable and assumes only a finite number of values. We note that the representation of a simple function is not unique. However it does have a so-called canonical representation: for some integer , for in , where is the set of distinct nonzero values of , and , . This representation is characterized by the fact that the ’s are distinct and nonzero, and the ’s are pairwise disjoint.
Proposition 2.18: If is a measurable function, then the function is measurable. Proof in [18].
Proposition 2.19: Let and be measurable real-valued (not extended) functions defined on the same domain , a constant, and a continuous real-valued function on R2. Then the function defined by , , is measurable. In particular , , , , are measurable; is measurable if on . Proofs in [16] and [18].
Observation 2.12: For extended real-valued measurable functions and , the function is still measurable. However in order for to be measurable, must be given the same value at points where it is undefined, unless these points form a set of measure zero in which case it makes no difference which values is given on the set.
Proposition 2.20: Let be a sequence of measurable functions defined on the same domain and let be an integer. The functions defined for each by , , , , , , are all measurable. Proofs in [16] and [18].
Definition 2.15: Given a set of real numbers , a property associated with points in is said to hold almost everywhere (a.e. for short) in if the set of points in where the property fails has measure zero.
Proposition 2.21: Let and be functions defined on the same measurable domain . If is measurable and a.e., then is measurable.
Proof: Let be any real number. a.e. means the set has measure zero. Thus and the set are measurable (Proposition 2.10). must then be measurable and the set is then measurable as is measurable. Thus, since
[TABLE]
it follows that is measurable and therefore is measurable.
Observation 2.13: The definition of a measurable function and 1 of Proposition 2.13 allow the following proposition to be true.
Proposition 2.22 (Egoroff’s Theorem): Let be a sequence of measurable functions on a measurable set , , that converge a.e. to a real-valued (not extended) function on , i.e., there is a set such that , pointwise on . Then for every there is a closed set such that and uniformly on .
Proof: Let be an integer. For each integer let
[TABLE]
and for each integer set
[TABLE]
We note is measurable (Proposition 2.20 and Proposition 2.21). It follows that each is measurable and of finite measure, , and for each there must be some for which , since . Thus and must therefore have measure zero. It follows then that (1 of Proposition 2.13). Hence there exists such that
[TABLE]
Letting , then is measurable, and
[TABLE]
Now let . Then
Given choose integer with . For some and for all then and for all .
Thus, uniformly on .
Finally, let . Clearly is measurable and .
Thus, there exists a closed set , with (Proposition 2.15). It then follows that and uniformly on .
Proof also in [8] for spaces and measures more general than R and the Lebesgue measure.
Observation 2.14: The assumption is necessary in the above proposition. To see this, let R and
[TABLE]
Clearly pointwise on . However, for any integer , , the set is of infinite measure. Thus, the uniform convergence of to [math] as proposed in the proposition can not occur.
Definition 2.16: Given a function defined on a set , the positive part of and the negative part of are the functions defined respectively by , and , .
Proposition 2.23 (Approximation of a measurable function by simple functions): Let be a real-valued (not extended) measurable function on a measurable set . Then there exists a sequence of simple functions on such that pointwise on . Since , and and are measurable because is, then can be chosen so that , where and are simple functions on such that , pointwise on , and and increase monotonically to and , respectively. If is bounded, then can also be chosen to converge uniformly to on . Proof in [18].
Proposition 2.24 (Lusin’s Theorem): Let be a real-valued (not extended) measurable function on a measurable set . Then given , there exists a closed set with such that is continuous.
Proof: First we prove the proposition for a simple function on . Accordingly, for some integer , assume for in , for each , the canonical representation of . In addition let . Clearly the ’s are pairwise disjoint. Given , since each is measurable there exists a closed set such that , (Proposition 2.15). Accordingly, is closed, and
[TABLE]
Now, to show is continuous we show that if , in are such that , then .
We note that for some unique , , it must be that . Thus, since is constant on , it then suffices to show that for some integer , is in for . If this is not the case and since there is a finite number of ’s then for some , , , there is a subsequence of all contained in . But then so that is in , a contradiction.
Now we prove the proposition for a general .
Case 1:
Let be simple functions such that pointwise on (Proposition 2.23). Given , as established above for simple functions on , for each there exists a closed set with such that is continuous. In addition, since , there exists a closed set such that and uniformly on (Proposition 2.22 (Egoroff’s Theorem)).
Finally let . Then is closed and
[TABLE]
Since is continuous so must be . And since uniformly on then must be continuous (proof in [18]).
Case 2: .
For each integer , let and . Then each is measurable, , and . From Case 1 above, given , it follows that there is a closed set with such that is continuous. Let . Then
[TABLE]
We show is closed. Let be a limit point of so that for in , then . Clearly for some integer it must be that . It suffices to show that for some integer , is in for so that is also in . With for , from the definition of the ’s a neighborhood of the point exists that does not intersect , or . Thus, with , for large enough the points can only be in , and . If it is not the case that as described exists, then there must be a subsequence of , all of it contained in either or . But then so that is in either or , a contradiction. (Actually showing that is in the union of , and , would have sufficed).
Now, to show is continuous we show that if , in are such that , then .
We note that for some unique , it must be that . Thus, since is continuous on , it then suffices to show that for some integer , is in for . If this is not the case, again with , an argument, similar to the one used above for proving is closed, can be used to get the same contradiction that is in either or .
**The Riemann integral
Definition 2.17:** Let be an interval and a bounded real-valued function defined on . Given an integer , and , a partition or subdivision of (Definition 2.12), for , we define
[TABLE]
Then we define the lower Riemann integral and the upper Riemann integral of over , respectively, by
[TABLE]
[TABLE]
where the infimum and supremum are taken over all partitions of .
If the two are equal, is said to be Riemann integrable over , and the common value is then called the Riemann integral of over and denoted by
[TABLE]
Observation 2.15: Since is bounded, there exist numbers and , such that , . Thus, for every partition , it must be that , so that the lower and upper Riemann integrals of over are finite numbers.
Proposition 2.25: . Proof in [18].
Observation 2.16: Let R be a step function so that for an integer , there are numbers , , and a partition of , such that , , , . Clearly and since (Proposition 2.25), it must be that is Riemann integrable over and .
From this it is then apparent that
[TABLE]
[TABLE]
where the ’s are all possible step functions on satisfying the given conditions.
Definition 2.18: Given an interval , let be a partition of . The number
[TABLE]
is called the mesh of .
Let be a real-valued function defined on . Given a partition of , a Riemann sum of with respect to is a sum of the form
[TABLE]
where the choice of points , , , is arbitrary. The Riemann sums of are said to converge to a finite number as , i.e.,
[TABLE]
if given , there exists such that for every partition with mesh it must be that
[TABLE]
(obviously for every choice of points , , ).
Proposition 2.26 (Riemann sums of that converge implies is bounded): If exists as , then is bounded on . Proof in [13] and [15].
Proposition 2.27 (Riemann sums of converge if and only is Riemann integrable): Let be an interval and a bounded real-valued function defined on . Then is Riemann integrable over if and only if
[TABLE]
exists. If this is the case, then equals . Proof in [18] and [25].
Observation 2.17: Given an interval and a set , ideally the characteristic function of on , , defined by
[TABLE]
should be (Riemann) integrable over , especially if is measurable, and its integral over should equal the (outer) measure of . However, if is the set of rational numbers in , which is measurable with , we see that and , not the ideal situation.
**The Lebesgue integral
Definition 2.19:** Given a measurable set , let be the canonical representation of a simple function on , where for some integer , is the set of distinct nonzero values of , and , . We define the Lebesgue integral of over as the extended real number
[TABLE]
Observation 2.18: A consequence of the following two propositions is that if is any representation of a simple function on a measurable set , then the Lebesgue integral of over (Definition 2.19) can be computed directly from the representation, i.e., by computing .
Proposition 2.28: Let be a representation of a simple function on a measurable set , with for (not necessarily the canonical representation of ). Then
[TABLE]
Proof in [16] for ’s of finite measure. Same proof for the general case.
Proposition 2.29: Let and be simple functions on a measurable set . Then for any real numbers and we must have
[TABLE]
and, if a.e., then .
Proof in [16] using Proposition 2.28 for ’s of finite measure. Proof essentially the same for the general case.
Corollary 2.4: Let be any representation of a simple function on a measurable set , the ’s not necessarily pairwise disjoint. Then
[TABLE]
Proof: Apply the first part of Proposition 2.29 to .
Definition 2.20: Given a measurable set , let be a measurable nonnegative function on . We define the Lebesgue integral of over as the extended real number
[TABLE]
where the ’s are all possible simple functions on satisfying the given condition.
Definition 2.21: Given a measurable set , let be a measurable function on . With and as the positive and negative parts of (Definition 2.16), we define the Lebesgue integral of over as the extended real number
[TABLE]
if at least one of the integrals , (Definition 2.20) is finite.
If is finite, then is said to be Lebesgue integrable over .
Proposition 2.30: Let and be Lebesgue integrable functions over a measurable set , and a real number. Then
i. is Lebesgue integrable over with .
ii. is Lebesgue integrable over with
[TABLE]
iii. If a.e., then .
iv. If are disjoint measurable sets, then
[TABLE]
Proposition 2.31: A measurable function is Lebesgue integrable over if and only if is Lebesgue integrable over , in which case
[TABLE]
Also, if on and is Lebesgue integrable over , then is Lebesgue integrable over . In particular, if and is Lebesgue integrable, then , and therefore , is Lesbegue integrable over .
Proof: The first part follows from , , and iv of Proposition 2.30. The inequality from , , and i and iii of Proposition 2.30. The rest from Definition 2.20.
Observation 2.19: Let be a measurable function on a measurable set with finite, and let , be real numbers such that for . By looking at and for the different possible signs of and , then it is evident that . Accordingly, if is a measurable and bounded function on a measurable set with finite, since then for some , for , it must be that , and therefore is Lebesgue integrable. However, there is more to this situation as the following proposition shows.
Proposition 2.32 (Integrable equivalent to measurable): Let be a bounded function defined on a measurable set with finite. Let
[TABLE]
where the ’s are all possible simple functions on satisfying the given conditions. Then if and only if is measurable. Whenever then is Lebesgue integrable and . Proof in [16].
Proposition 2.33 (Riemann integrable implies Lebesgue integrable): Let be a bounded function on interval . If is Riemann integrable over , then is measurable and Lebesgue integrable over with
[TABLE]
Proof: Since step functions are simple functions, then
[TABLE]
where the ’s and the ’s are all possible step functions and simple functions on , respectively, satisfying the given conditions. Since is Riemann integrable over , then all the inequalities above are equalities so that must be measurable and Lebesgue integrable over with
[TABLE]
by Proposition 2.32.
Proposition 2.34: Let be a measurable function on a measurable set .
i. If on and , then a.e. on .
ii. If is Lebesgue integrable over , then is finite a.e. on .
Proof: For each integer let .
For each , we note or else .
Let . Then . Thus, so that a.e. on , which proves i.
In order to prove ii, for each integer let .
Then , so that .
Let . Then . Since for each , , then so that , which proves ii.
Proposition 2.35 (Lebesgue’s criterion for Riemann integrability): Let be a bounded function on . Then is Riemann integrable over if and only if is continuous a.e. on . Proof in [18]. It involves Proposition 2.33 and i of Proposition 2.34.
Observation 2.20: Function in Observation 2.17 with equal to the set of rational numbers fails the continuity hypothesis of Proposition 2.35 and thus it is not Riemann integrable over as observed there. Actually, it can be easily shown to be nowhere continuous on .
Proposition 2.36 (Countable additivity of the Lebesgue integral): Let be a countable collection of pairwise disjoint measurable sets. Let , and let be a measurable function on . Assume either on or is Lebesgue integrable over . Then
[TABLE]
Proof in [18].
Observation 2.21: If is a measurable function on a set with , then . Also, if sets , are measurable with , and is Lebesgue integrable over , then it is Lebesgue integrable over . From all this then, if and are functions on a measurable set , a.e. on , Lebesgue integrable over , then so is and . Finally, we note that since integrals over sets of measure zero are zero, throughout these notes, if sets and are measurable with , , and is a function on , possibly not defined on part or all of , Lebesgue integrable over , we say is Lebesgue integrable over with . This makes sense as it is always possible to define arbitrarily for points in so that then is defined on all of and .
Proposition 2.37 (Lebesgue’s Monotone Convergence Theorem): Let be an increasing sequence of nonnegative measurable functions on a measurable set . Let be defined by for . Then
[TABLE]
Proof in [16] and [18]. It involves Proposition 2.13.
Corollary 2.5: Let be a sequence of nonnegative measurable functions on a measurable set . Let be defined by for . Then
[TABLE]
Proof: defined by for is an increasing sequence of nonnegative measurable functions on .
Observation 2.22: Proposition 2.36 can now be proved more easily. It suffices to prove it for on . Let for . Then for and the result follows from Corollary 2.5.
Observation 2.23: The following proposition says that if a nonnegative function is Lebesgue integrable over a measurable set, then the Lebesgue integral of the function over a measurable subset of the set is arbitrarily small if the measure of the subset is small enough. Later we will see that it can be used to show that every indefinite integral is absolutely continuous (indefinite integrals and absolute continuity defined in the next section).
Proposition 2.38 (Absolute continuity of the Lebesgue integral): Let be a nonnegative Lebesgue integrable function over a measurable set . Then given there is such that for each measurable set with , then . Proof in [16]. It involves Lebesgue’s Monotone Convergence Theorem (Proposition 2.37).
Proposition 2.39 (Fatou’s Lemma): Let be a sequence of nonnegative measurable functions on a measurable set . Let be defined by for . Then
[TABLE]
Proof in [16] and [18]. It involves Proposition 2.37.
Proposition 2.40 (Lebesgue’s Dominated Convergence Theorem): Let be a sequence of measurable functions on a measurable set such that there is a function on with pointwise a.e. on . If there is a function that is Lebesgue integrable over such that on for all , then
[TABLE]
Proof in [16] and [18]. It involves Proposition 2.39.
Corollary 2.6 (Bounded Convergence Theorem): Let be a sequence of measurable functions on a measurable set of finite measure such that there is a function on with pointwise a.e. on . If there is a real number such that on for all , then
[TABLE]
**The Spaces
Definition 2.22:** Given a real number , the or space is the space of measurable functions on satisfying: the -th power of the absolute value of each function in the space is Lebesgue integrable over . Thus, a measurable function on is in (the space) if and only if
[TABLE]
Writing instead of for in , we define
[TABLE]
and call the norm, and the norm of .
Finally, the or space is the space of measurable functions on satisfying: each function in the space is bounded on except possibly on a set of measure zero. Thus, a measurable function on is in (the space) if and only if the essential supremum of on is finite, i.e.,
[TABLE]
We also note . Defining
[TABLE]
we call the norm, and the norm of .
Observation 2.24: In the definition of the spaces, the interval was chosen for simplicity. Given a real number , if , then clearly for any real number . In addition, if , since , then . Thus, is a linear space and so is .
Given in , , then the norm of , i.e., (Definition 2.22), equals zero if and only if a.e. on . Accordingly, we think of the elements of as equivalent classes of functions, each class composed of functions that are equal to one another a.e. on , and as noted in Observation 2.21, some functions undefined on subsets of of measure zero. Thus, assuming there is no distinction between two functions in the same equivalence class, we note that given , , then the norm is indeed a norm since clearly for any real number , and as will be seen below, if , then .
Proposition 2.41 (Hölder’s inequality): Given , , with , if and , then and
[TABLE]
with equality for , if and only if a.e. for nonzero constants and . Proof in [16], [19]. Proof in [18] for .
Proposition 2.42 (Minkowski’s inequality): Given , , if , then and
[TABLE]
Proof in [16], [19]. Proof in [18] for .
Observation 2.25: For , Hölder’s inequality becomes Schwarz’s inequality:
[TABLE]
Note all of the above inequalities (Hölder’s, Minkowski’s, Schwarz’s), in which all integrations are over , can be generalized by integrating everywhere over a measurable set instead. Proof in [19].
Definition 2.23: Given a norm on a linear space , we say is a normed linear space with norm . We say this especially if among all the possible norms that can be defined on , our current intent is to associate exclusively with .
A sequence in a normed linear space with norm is said to converge in norm to an element in the space if, given , there is an integer such that for , then .
A sequence in a normed linear space with norm is said to be a Cauchy sequence if, given , there is an integer such that for , then .
A normed linear space with norm is called complete if every Cauchy sequence in the space converges in norm to an element of the space.
Proposition 2.43 (Riesz-Fischer): Given , , then is complete. Moreover, given in , then a subsequence of converges pointwise to a.e. on . Proof of first part in [16], [17]. It involves Proposition 2.37 (Lebesgue’s Monotone Convergence Theorem), Proposition 2.39 (Fatou’s Lemma), Proposition 2.40 (Lebesgue’s Dominated Convergence Theorem) and ii of Proposition 2.34. Proof of last part in [17].
Proposition 2.44 (Density of simple and step functions in space): Given , , then the subspace of simple functions on in is dense in . Given , , then the subspace of step functions on is dense in . Proof in [17].
3 Absolute Continuity and its Connections to
Lebesgue Integration
Definition 3.1: Let be a real-valued function defined on an interval . Given , if for some finite number ,
[TABLE]
then is said to be differentiable at ; a number is defined and said to exist by setting equal to ; and is said to exist at . Accordingly, is a function associated with , called the derivative of , whose domain of definition is the set of points at which exists. If exists at every point of a set , we say is differentiable on or exists on .
Note that given , if the limit defining above equals or then the convention here is to say that is not differentiable at .
Proposition 3.1 (Fundamental Theorem of calculus I): Let be Riemann integrable over an interval . If there is a function differentiable on such that on , then
[TABLE]
Proposition 3.2 (Fundamental Theorem of calculus II): Let be Riemann integrable over an interval . Define a function by
[TABLE]
Then is continuous on , and if is continuous at , then is differentiable at with . Proof in [1] and [18].
**Corollary 3.1 (Differentiability of the Riemann integral - Fundamental Theorem of calculus for continuous functions):
**i. If is Riemann integrable over and , , then a.e. on .
ii. If is continuous on , then there is a differentiable function on such that on , and . If is any differentiable function on such that on , then , a constant, and , .
Proof: i follows from Proposition 3.2 and Proposition 2.35 (Lebesgue’s criterion). First part of ii from Proposition 3.2. Proof in [18] that on implies on , a constant. from Proposition 3.1. Clearly as .
Definition 3.2: Let be a real-valued function defined on an interval . Given , if for some finite number , , , then a number called the left-hand limit of at is defined by setting equal to . Similarly, if for some finite number , , , then a number called the right-hand limit of at is defined by setting equal to .
Observation 3.1: A function is continuous at if and only if and exist and .
Proposition 3.3 (Monotonic functions: continuity): Let be a monotonic real-valued function on an interval . Then and exist for every point , and the set of points of at which is discontinuous is at most countable. Proof in [18].
Corollary 3.2 (Monotonic surjective implies is continuous): If is monotonic from onto , then is continuous on .
Proof: Assume is discontinuous at . Since and exist from Proposition 3.3, it must be that so that exists in between and , . But then can not be in the range of as is monotonic, which contradicts that the range of is all of .
Observation 3.2: A function is described below from into that is strictly increasing on , discontinuous at each rational number in , continuous at each irrational number in and at zero, , .
Let be an enumeration of the rational numbers in .
Given , let , and set .
Define by and
[TABLE]
Given , , then , and since there is a rational number such that , then . Thus, it must be that so that is strictly increasing on .
Since includes every then .
Let be a rational number in . We show is discontinuous at .
For some integer , . Thus, but for every , . then implies .
Thus, is discontinuous at (a rational number in ).
Let be an irrational number in . We show is continuous at .
Given , choose integer such that , and let
[TABLE]
Given , , , then , and if , it must be that so that and thus . Accordingly, .
Finally, given , , , then , and if , it must be that so that and thus . Accordingly, .
Thus, is continuous at (an irrational number in ) and at zero by an argument similar to the one just used for the case .
Proposition 3.4 (Monotonic functions: differentiability): Let be a monotonic real-valued function on an interval . Then is differentiable a.e. on , and is measurable. If, in addition, is increasing on (note where it exists), then is Lebesgue integrable over , and
[TABLE]
where we write instead of . Proof in [3] and [16]. It involves Proposition 2.39 (Fatou’s Lemma) and ii of Proposition 2.34.
Definition 3.3: Let be a real-valued function defined on an interval . Given a partition of , set , , and define
[TABLE]
the supremum taken over all partitions of .
is said to be of bounded variation on if .
Proposition 3.5 (Jordan decomposition): A function is of bounded variation on if and only if it is the difference of two monotonically increasing real-valued functions on . Proof in [16] and [18].
Corollary 3.3: If is of bounded variation on then is differentiable a.e. on , and is measurable and Lebesgue integrable over .
Proof: By Proposition 3.5, on , where and are monotonically increasing on . Thus, by Proposition 3.4, is measurable and exists a.e. on . Since a.e. on , then again by Proposition 3.4,
[TABLE]
and therefore is Lesbegue integrable over (Proposition 2.31).
Definition 3.4: Given a Lebesgue integrable function over , and a real-valued function on such that
[TABLE]
then the function is said to be an indefinite integral of over .
Proposition 3.6 (Indefinite integral of zero everywhere, then is zero a.e.): If is Lebesgue integrable over and for all , then a.e. on . Proof in [16]. It involves Proposition 2.15.
Proposition 3.7 (Differentiability of the indefinite integral): Let be Lebesgue integrable over an interval , and a function such that
[TABLE]
i.e., an indefinite integral. Then a.e. on .
Proof in [16]. It involves Proposition 3.6, Corollary 2.6 (Bounded Convergence Theorem), the inequality in Proposition 3.4, and i of Proposition 2.34.
Definition 3.5: A real-valued function defined on an interval is said to be absolutely continuous on if for every there is such that
[TABLE]
for any integer and any disjoint collection of open intervals , , with
[TABLE]
Proposition 3.8 (Absolutely continuous is constant if is zero a.e.): If is absolutely continuous on with a.e. on , then is constant on , i.e., for all . Proof in [16].
Observation 3.3: Absolutely continuous uniformly continuous [18] continuous. Moreover, a continuous real-valued function of compact domain is uniformly continuous [18]. Accordingly, a function called the Cantor function from onto that is continuous, thus uniformly continuous, but not absolutely continuous is described below. This function is monotonically increasing on and thus differentiable a.e. on . Actually, at points not in the Cantor set (described in Observation 2.4) and does not exist at points in it. Thus, a.e. on , is not constant on , hence can not be absolutely continuous on by Proposition 3.8.
For this purpose, we note that given , can be expressed in its ternary expansion as 0.a_{1}a_{2}a_{3}\,$$\cdot\cdot\cdot so that , . Note is then expressed as 0.222\,$$\cdot\cdot\cdot. Similarly, given , can be expressed in its binary expansion as 0.b_{1}b_{2}b_{3}\,$$\cdot\cdot\cdot so that , . Note is then expressed as 0.111\,$$\cdot\cdot\cdot.
In Observation 2.4 the Cantor set was identified as , where is the union of and obtained by removing the open middle third of , is the union of , , , obtained by removing the open middle thirds of and , and so on. Actually, with , then at stage , open intervals of the form , , are removed from , if contained in it, to obtain . We note that endpoints of any such intervals have two ternary expansions, and in what follows, only the expansion of any such point that contains no 1’s is considered. Fixing one of these removed open intervals, we note it is the open middle third of a closed interval in , all numbers in the closed interval in having the same first digits in their ternary expansions, none of them equal to 1. Finally, we note numbers in the removed open interval have 1 as the digit of their ternary expansions, while numbers in the closed left and right thirds of the closed interval, closed thirds that become part of , have 0 and 2, respectively, as the digit of their ternary expansions. Thus, the Cantor set is exactly the set of numbers in that have no 1’s in their ternary expansions.
An attempt can be made to identify the Cantor function as follows. Recalling that was the open middle third that was removed from to obtain , given in its closure, i.e., in , set . Again, recalling that and were the open middle thirds that were removed from and , respectively, to obtain , given in the closure of , i.e., in , set , and given in the closure of , i.e., in , set . Accordingly, can be identified this way at each stage of the contruction of the Cantor set but this is not enough as it has not been identified for points in “the limit” that are part of the Cantor set.
The Cantor function is properly identified as follows. Given with ternary expansion 0.a_{1}a_{2}a_{3}\,$$\cdot\cdot\cdot so that , , let be the smallest such that equals 1. If such an does not exist, i.e., is in the Cantor set, let . With if , if , and if , let be the number in with binary expansion 0.b_{1}b_{2}b_{3}\,$$\cdot\cdot\cdot so that , and set . The function identified this way is then called the Cantor function.
Proposition 3.9: Let be the Cantor function. Then is continuous, thus uniformly continuous, from onto . In addition, is monotonically increasing on and thus differentiable a.e. on . Actually, at points not in the Cantor set and does not exist at points in it.
Proof: Given , , , we show .
Let 0.a_{1}a_{2}a_{3}$$\cdot\cdot\cdot, 0.c_{1}c_{2}c_{3}$$\cdot\cdot\cdot be , , respectively, in their ternary expansions. Let 0.b_{1}b_{2}b_{3}$$\cdot\cdot\cdot, 0.d_{1}d_{2}d_{3}$$\cdot\cdot\cdot be , , respectively, in their binary expansions.
Let be the smallest such that ; if there is no such .
Let be the smallest such that ; if there is no such .
Let be the smallest such that .
If , since then , , and, in particular, , it must be that so that , , and therefore .
Similarly if , and the case can not be.
If and , since , it must be that so that , , . Therefore, thus .
If and , since , it must be that so that , , , . Therefore, thus .
Finally, if , , since , it must be that , , so that , , , . Therefore, thus . Thus, for all cases and therefore is monotonically increasing.
Given , we show there is with .
Let 0.b_{1}b_{2}b_{3}$$\cdot\cdot\cdot be in its binary expansion.
For each , let . Then for each , is either zero or two.
Let be the point in which in its ternary expansion is 0.a_{1}a_{2}a_{3}$$\cdot\cdot\cdot.
Then is actually a point in the Cantor set and .
Thus, is onto .
That is continuous, thus uniformly continuous, on , now follows from Corollary 3.2.
Finally, given , if is not in the Cantor set, we show . On the other hand, if is in the Cantor set, we show that does not exist.
If is not in the Cantor set, its ternary expansion must contain 1 as one of its digits. Then for some integer , , the digit of the expansion equals 1 with no previous digits equal to 1. It follows that must be contained in an open interval of the form , . Thus, it suffices to show is constant on any such interval. But this follows immediately since all numbers in the interval have the same first digits in their ternary expansions with 1 as the digit and no previous digits equal to 1.
On the other hand, if is in the Cantor set, its ternary expansion consists of 0’s and 2’s. Given an integer , define to be the number in whose ternary expansion is exactly that of except at its digit. Its digit is 0 if the digit of is 2, and it is 2 if that of is 0. It follows then that so that . Also, . Thus, since is monotonically increasing, so that does not exist.
Thus, does not exist at points in the Cantor set and equals zero otherwise.
Corollary 3.4: The Cantor function is not absolutely continuous on .
Proof: Let be the Cantor function and assume it is absolutely continuous on . By Proposition 3.9, a.e. on . Thus, by Proposition 3.8, must be constant on , i.e., for all . But this is a contradiction as for instance and . Thus, is not absolutely continuous on .
Observation 3.4: For the sake of completeness, we analyze the nondifferentiability of the Cantor function on the Cantor set.
Let and be points in the Cantor set that are the left and right endpoints of an open interval removed at the stage of the construction of the Cantor set. It must then be that in their ternary expansions, can be expressed as 0.a_{1}a_{2}$$\cdot\cdot\cdot$$a_{m-1}0\overline{2} (a bar on a digit means the digit is infinitely repeated), and as 0.a_{1}a_{2}$$\cdot\cdot\cdot$$a_{m-1}2\overline{0}, the set with elements equal to [math] or if , empty if . Given in the open interval , it must be that in its ternary expansion the digit is 1, and if , then the first digits are also . Define for each integer , , a number in that in its ternary expansion the first digits are as described above, and all other digits are [math] except the digit which is . Then and for all so that . Since for any sequence in , with , then for all , it follows that has a limit as from the right side of and it is zero. Similarly, define for each integer , , a number in that in its ternary expansion the first digits are as described above, and all other digits are [math] except the digits which are . Then and for all so that . Since for any sequence in , with , then for all , it follows that has a limit as from the left side of and it is zero.
In the proof of Proposition 3.9, given any in the Cantor set, a sequence of points in the Cantor set was identifed with and . We show that with , as above, then has a limit as from the left side of and it is , and has a limit as from the right side of and it is also . Actually, we only show it for as the proof for can be similarly accomplished. Accordingly, let be an integer such that the ternary expansions of and coincide in the first digits and the digit of is 1 or 2. As mentioned above, all digits of after the digit equal 0. Thus, and , so that
[TABLE]
Finally, it is of interest to note that if is any point in the Cantor set, then at stage of the contruction of the Cantor set, is in a closed interval , where if 0.x_{1}x_{2}$$\cdot\cdot\cdot is in its ternary expansion, then is in its ternary expansion, and is in its ternary expansion. It follows that and . Thus, with , we have
[TABLE]
If , as above, then for some , and , as expected. Similarly, if , as above, then for some , and , also as expected. As for a point in the Cantor set that is not an endpoint of an open interval removed at some stage of the construction of the Cantor set, it is easier to see that , and , by looking at the ternary expansions of , and . Actually, we only show it for as the proof for can be similarly accomplished. Accordingly, let be an integer such that the digit of in its ternary expansion, i.e., , equals 2. As mentioned above, the ternary expansions of and coincide in the first digits and all digits of after the digit equal 0. Thus, and , so that
[TABLE]
Note that does not imply that .
Observation 3.5: A function on that is a finite linear combination of absolutely continuous functions on is absolutely continuous on . The proof is analogous to the proof that a finite linear combination of continuous functions is continuous. In addition, the product of two absolutely continuous functions on is absolutely continuous on .
Proposition 3.10 (Absolutely continuous implies is of bounded variation): If is absolutely continuous on , then is of bounded variation on . Proof in [16].
Corollary 3.5: If is absolutely continuous on then is differentiable a.e. on , and is measurable and Lebesgue integrable over .
Proposition 3.11 (Absolute continuity of the indefinite integral): If is an indefinite integral over , then is absolutely continuous on .
Proof: Assume (Definition 3.4) , , is Lebesgue integrable over . By Proposition 2.31, is Lebesgue integrable over . Then by Proposition 2.38, given there is such that for each measurable set with , then .
Given integer and disjoint open intervals , , with , let . Then is measurable and . Thus, . Accordingly, then
[TABLE]
Thus, is absolutely continuous on .
Proposition 3.12 (Equivalent conditions for an absolutely continuous function): Given a real-valued function on , then the following three conditions are equivalent:
i. is absolutely continuous on .
ii. There exists a Lebesgue integrable function over such that
, .
(Note that then by Proposition 3.7, a.e. on ).
iii. exists a.e. on and is Lebesgue integrable over , and
, .
**Proof:
**iii ii:
Take .
ii i:
This is Proposition 3.11.
i iii:
By Corollary 3.5, exists a.e. on and is Lebesgue integrable over .
Let , . Then is an indefinite integral of over and by Proposition 3.11, is absolutely continuous on , and so is the function by Observation 3.5.
By Proposition 3.7, a.e. on . Thus a.e. on , and by Proposition 3.8, is constant on , i.e., on for some constant , i.e., , .
Since , it then follows that , .
Corollary 3.6 (Fundamental Theorem of Lebesgue integral calculus): Given real-valued functions , on , absolutely continuous on and a.e. on , then , .
Proposition 3.13 (Fundamental Theorem of Lebesgue integral calculus (Alternate form)): Given a real-valued function on , if exists for every , and is Lebesgue integrable over , then , . Proof in [19].
Corollary 3.7: Given a real-valued function on , if exists everywhere on and is Lebesgue integrable over , then is absolutely continuous on .
Proof: From Proposition 3.13 and then Proposition 3.12.
Proposition 3.14 (Change of variable for Riemann integral): Given a strictly monotonic continuous function from an interval onto an interval (, if is strictly increasing, , if it is strictly decreasing), with Riemann integrable over , and a real-valued Riemann integrable function over , then
[TABLE]
with if is decreasing. Proof in [1] and [18]. Note that by Proposition 3.4, exists a.e. on .
Proposition 3.15 (Substitution rule for Riemann integral): Given a function from an interval into an interval such that exists for every with Riemann integrable over , and a real-valued continuous function on , then
[TABLE]
with if .
Proof: By Proposition 3.2 (Fundamental Theorem of calculus II), with the left endpoint of , the function defined by , , satisfies for every since is continuous on . From the definition of , given , not necessarily less than , then . In particular,
[TABLE]
Since is differentiable on and is differentiable on , the composite function is differentiable on and by the usual chain rule of calculus, , for every . Thus, since is clearly Riemann integrable over , by Proposition 3.1 (Fundamental Theorem of calculus I), it must be that
[TABLE]
Proposition 3.16 (Substitution rule for Lebesgue integral): Given an absolutely continuous function from an interval into an interval , and a real-valued continuous function on , then
[TABLE]
with if .
Proof: By Proposition 3.2 (Fundamental Theorem of calculus II), with the left endpoint of , the function defined by , , satisfies for every since is continuous on . From the definition of , given , not necessarily less than , then . In particular,
[TABLE]
where the last equation is by Proposition 2.33 (Riemann implies Lebesgue).
Since is differentiable a.e. on and is differentiable on , the composite function is differentiable a.e. on . Indeed it is differentiable exactly at the points where is differentiable. Thus, by the usual chain rule of calculus, , for at which exists.
Finally, we show is absolutely continuous on in order to use Corollary 3.6 (Fundamental Theorem of Lebesgue integral calculus) with as the absolutely continuous function in the hypothesis of the corollary. For this purpose, since is continuous, assume on , for some . Given , let correspond to in the definition of the absolute continuity of . Given integer and disjoint open intervals , , with , then
[TABLE]
Thus, is absolutely continuous and by Corollary 3.6, it must be that
[TABLE]
Observation 3.6: Note that in the proof of Proposition 3.16 above, while proving that is absolutely continuous on , we have actually proved that if , , , are as given there and is Lebesgue integrable over and bounded on , and the function is defined by , , then is absolutely continuous on . At the end of this section, results are presented for carrying out a change of variable in Lebesgue integrals, useful in shape analysis.
Proposition 3.17 (Saks’ inequality [20]): Given a real-valued function on , a real number , and such that for each , then
[TABLE]
Proof: Given , for every integer , and any , define
[TABLE]
Since for all and , then by 2 of Proposition 2.13, . Similarly, since for all and , then again by 2 of Proposition 2.13,
[TABLE]
Given integer , let be a countable collection of open intervals covering , i.e., , with
[TABLE]
Note can be chosen so that for each . Then, for each , given , , , from the definition of , since , it must be that
[TABLE]
Thus,
[TABLE]
Since , then , therefore,
[TABLE]
Thus, since as established above and , it must be that
[TABLE]
Hence, since is arbitrary, it must be that .
Corollary 3.8: Given a real-valued function on , let be a subset of on which . Then .
Proof: By Proposition 3.17, . Thus, .
Corollary 3.9: Given a real-valued function on , and with , such that exists on , then .
Proof: Without any loss of generality assume . Given , let be a countable collection of open intervals covering , i.e., , with , for each .
Given an integer , and an integer , let
[TABLE]
and
[TABLE]
Note so that .
By Proposition 3.17, for each , and therefore,
[TABLE]
Since is arbitrary, then .
Finally, note for each , and .
Thus, by 2 of Proposition 2.13, .
Corollary 3.10 (Saks’ Theorem [20]): Given a real-valued function on , and such that exists on , if a.e. on , then .
Proof: Let , be subsets of , , on and . By Corollary 3.8, . By Corollary 3.9, . Thus, .
Observation 3.7: Let be the Cantor function and the Cantor set. Then a.e. on and . Since , by Saks’ Theorem (Corollary 3.10), it must be that is not differentiable at certain points in , and since , by Corollary 3.9, it must be that is not differentiable at certain points in . Of course we know is not differentiable at any point in and on so that by Corollary 3.8, which makes sense as is countable.
The following proposition is the converse of Saks’ Theorem (Corollary 3.10): implies a.e. on . Here again it is assumed exists everywhere on . However, almost everywhere (a.e.) will suffice.
Proposition 3.18 (Serrin-Varberg’s Theorem [22]): Given , a real-valued function on , and such that exists on , if , then a.e. on .
Proof: Let , and for every integer , and any , define
[TABLE]
Clearly, we need to show , and since , then it suffices to show for each . However, since each can be covered by a countable collection of intervals, each interval of length less than , it then suffices to show that if is any interval of length less than and , then .
For this purpose, given , since so that , let be a countable collection of open intervals covering , i.e., , with . In addition, let . Then , and since for each , , given , , , then , and it must be that
[TABLE]
Thus,
[TABLE]
and then
[TABLE]
Hence, since is arbitrary, it must be that .
Corollary 3.11: Given a real-valued function on , and such that exists on , if is constant on , then a.e. on .
Corollary 3.12 (Serrin-Varberg’s Theorem (Alternate form)): Given a real-valued function on , and such that exists a.e. on , if , then a.e. on . In particular, if is of bounded variation on , and with , then a.e. on .
Proof: Let , be subsets of , , exists on and . Since , then by Proposition 3.18, a.e. on . Thus, since , then a.e. on . If is of bounded variation on , then by Corollary 3.3, is differentiable a.e. on and therefore on any subset of .
Proposition 3.19 (Measurability of the derivative of a measurable function): Let be a real-valued measurable function on , and a measurable subset of . If exists on , then is a measurable function on . Proof in [26].
Proposition 3.20: Let be a real-valued measurable function on , and a measurable subset of . If exists for each , then
[TABLE]
Proof: Given , for each integer , define
[TABLE]
Clearly, the ’s are pairwise disjoint and so that . By Proposition 3.19, is measurable on . Hence, each set must be measurable. Since exists for every , by Proposition 3.17, for each , and given an integer , it must be that by the definition of the Lebesgue integral, so that . Thus,
[TABLE]
where, in the last step, the countable additivity of on measurable sets is used. Since is arbitrary and , then .
Proposition 3.21 (Absolutely continuous maps zero-measure sets to zero-measure sets [20] - Absolutely continuous maps measurable sets to measurable sets): Let be an absolutely continuous function on . If with , then . In addition, given any measurable subset of , then is measurable.
Proof: Without any loss of generality assume . Given , let correspond to in the definition of the absolute continuity of . Since , then by Proposition 2.1, there is a collection of nonoverlapping open intervals covering , i.e., , with , for each .
For each , since is continuous, let and be points in where attains its minimum and maximum, respectively. Assuming without any loss of generality that , then is a collection of nonoverlapping open intervals, and since again is continuous, by the intermediate value theorem [18], it follows that
[TABLE]
Thus,
[TABLE]
Finally, given an integer , then it must be that
[TABLE]
so that . arbitrary then implies . Thus, since is arbitrary.
Assume now is a measurable subset of .
By v of Proposition 2.15, there is a set that is the union of a countable collection of closed sets, with , i.e., , where , , and is closed for each , thus compact (Proposition 2.3). Note then that . Since , then as just proved above. Thus, is measurable. Also since is continuous and is compact for each , it must be that is compact for each [18] and thus measurable (Proposition 2.14). It then follows that is the union of a countable collection of measurable sets and therefore it must be measurable.
Proposition 3.22 (Banach-Zarecki Theorem): Let be a real-valued function on . Then is absolutely continuous on if and only if it satisfies the following three conditions:
i. is continuous on .
ii. is of bounded variation on .
iii. maps sets of measure zero to sets of measure zero.
Proof: The necessity was established in Observation 3.3, Proposition 3.10, and Proposition 3.21. For the sufficiency, assume satisfies all three conditions. Given , we show
[TABLE]
By condition ii, is of bounded variation on , so that by Corollary 3.3, is differentiable a.e. on and therefore on . Accordingly, let , be subsets of , , exists on and . By condition iii, it then must be that .
Assume without any loss of generality that . By condition i, is continuous on , so that by the intermediate value theorem [18], given , , there must be , , with . Thus, , and since is measurable on ( is continuous on ) and is measurable (), by Proposition 3.20, we get
[TABLE]
By Corollary 3.3, since is of bounded variation, it must be that is integrable over and so is by Proposition 2.31. Given , by Proposition 2.38, there is such that if is a measurable set with , then . Accordingly, for any integer and any disjoint collection of open intervals , , with , let . Since , then
[TABLE]
Thus, is absolutely continuous.
Proposition 3.23 (Inverse function theorem): Let be a strictly monotonic continuous function on . Then is a closed interval with endpoints , , and , the inverse function of , exists on , and is strictly monotonic and continuous on . Given such that is differentiable at with , then is differentiable at with
[TABLE]
Proof: Without any loss of generality, assume is increasing on . Since is strictly increasing and continuous, is one-to-one and by the intermediate value theorem [18], its range is . Thus, exists on and is strictly increasing from onto . By Corollary 3.2, is continuous on . With , , by the continuity of , if , it must be that . Thus,
[TABLE]
as , since is differentiable at , and . Hence, exists and equals .
Proposition 3.24 (Zarecki’s criterion for an absolutely continuous inverse [5]): Let be a monotonic continuous function on . Then is a closed interval with endpoints , , and exists and is absolutely continuous on if and only if has measure zero. Whenever is absolutely continuous on the closed interval , then
[TABLE]
Proof: Without any loss of generality, assume is increasing on . If exists or if , then is strictly increasing. Thus, assume is strictly increasing. By Proposition 3.23, is closed, , and exists on and is strictly increasing and continuous on .
Assume has measure zero. As already established, is continuous on , and since it is increasing, it is of bounded variation on . Thus, by Proposition 3.22, it suffices to show that maps sets of measure zero to sets of measure zero. For this purpose, let be of measure zero, and so that . Since is increasing, it is of bounded variation on as well, and by Corollary 3.12, a.e. on . Accordingly, let , be subsets of , , on and . Since , then . Thus, .
Assume now is absolutely continuous on . By Corollary 3.8, since on , then . Thus, by Proposition 3.21, .
Finally, whenever is absolutely continuous on , define , , , disjoint subsets of , , as follows. , , . Since is of bounded variation on , is differentiable a.e. on , thus, . Also, since is absolutely continuous, then as just proved above. Hence, since by Proposition 3.23, for each , is differentiable at with , then a.e. on .
Proposition 3.25 (Composition of absolutely continuous functions): Let be an absolutely continuous monotonic function from an interval into an interval , and let be an absolutely continuous function on . Then the function is absolutely continuous on .
Proof: Let be given. It follows easily that since is absolutely continuous, then there is such that for any integer and for any nonempty subset of it must be that for disjoint open intervals , , with . For as just described, since is also absolutely continuous, then there is such that for any integer it must be that for disjoint open intervals , , with . Accordingly, for any integer let , , be any collection of disjoint open intervals with . Setting , if , then the collection of open intervals , , if is increasing; , , if is decreasing; must be pairwise disjoint by the monoticity of with . Thus, if , it must be that . Setting if , and since for , then
[TABLE]
Thus, is absolutely continuous on .
Proposition 3.26 (Chain rule [22]): Given real-valued functions , on , a.e. on , and a function , and differentiable a.e. on , if maps zero-measure sets to zero-measure sets, then
[TABLE]
Proof: Let , , and . Clearly, . Letting , since is differentiable a.e. on , then it is differentiable a.e. on . Since and is differentiable on , the composite function is differentiable a.e. on . Indeed it is differentiable exactly at the points in where is differentiable. Thus, by the usual chain rule of calculus, , for at which exists, i.e., .
Note that if , then the proof is complete.
Thus, assuming , we show . Note is defined on . Since , then , and since exists a.e. on , then by Corollary 3.12, a.e. on so that a.e. on . In addition, since maps zero-measure sets to zero-measure sets, then , and since exists a.e. on , again by Corollary 3.12, a.e. on . Thus, a.e. on .
Observation 3.8: With the subset of of measure zero on which , and , then for the case in the proof of Proposition 3.26 above it was proved that a.e. on , and since is defined on , then a.e. on as well. Since it was also proved that a.e. on , then it was concluded that a.e. on . However, it can happen that when using the chain rule as described in Proposition 3.26 above and in Corollary 3.13 below, although on , may not be defined everywhere on . Thus, may not be defined on as required in the proof of Proposition 3.26 above when . However, what matters here is that both and are zero a.e. on . Therefore, assuming , when computing with the chain rule as suggested in Proposition 3.26 above and in Corollary 3.13 below, if is set to zero at any point in at which is zero (whether or not is defined there), and computed or left undefined according to the chain rule elsewhere, then so obtained will be correct a.e. on . Accordingly, assuming , one should keep in mind that if is not computed as just suggested, so that might be left undefined at points where is not defined although is zero, one could end up with not defined on a set of nonzero measure in . Actually, instead of computing as just suggested, we do something simpler. Since, as mentioned above, what matters here is that both and are zero a.e. on , without any loss of generality, we simply set equal to 1 at points in where it is not defined and proceed with the chain rule to compute , as is then defined on so that is zero at points in where is zero, thus zero a.e. on . More precisely, we define a new function on by setting equal to at points in where exists, and to 1 where it does not. In what follows, we will refer to as extended to all of . This function is then defined everywhere in , equals a.e. on , and takes the place of in the chain rule although it is still called there. Finally, note that above when we say anything about computing with the chain rule, it is not that is necessarily computed but a function that happens to be equal to a.e. on .
Corollary 3.13 (Chain rule (Alternate form) [22]): Given an absolutely continuous function on , and a real-valued function on , a.e. on , if is a function such that and are differentiable a.e. on , then
[TABLE]
Proof: From Proposition 3.26 and Proposition 3.21.
Proposition 3.27 (Change of variable for Lebesgue integral [22]): Given a function , Lebesgue integrable over , and a function , differentiable a.e. on , then the following two conditions are equivalent, where , :
i. is absolutely continuous on .
ii. is Lebesgue integrable over and for all it must be that
[TABLE]
with if , and if .
**Proof:
**i ii:
Since is absolutely continuous on (Proposition 3.11), a.e. on (Proposition 3.7), is differentiable a.e. on , and , being absolutely continuous on , must be differentiable a.e. on (Corollary 3.5), then by Corollary 3.13 (chain rule), a.e. on (here and in the corollaries that follow, without any loss of generality, is interpreted as extended to all of (Observation 3.8 about the chain rule)). Note, by Corollary 3.5, since is absolutely continuous on , then is Lebesgue integrable over , and by Corollary 3.6 (Fundamental Theorem of Lebesgue integral calculus), applied to the absolutely continuous function , for all it must be that
[TABLE]
ii i:
Since is Lebesgue integrable over , and, in particular, for
[TABLE]
by Proposition 3.12, must be absolutely continuous on .
Corollary 3.14 (Change of variable for Lebesgue integral (Alternate form I) [22]): Given a function , Lebesgue integrable over , and a function , monotonic and absolutely continuous on , then is Lebesgue integrable over and for all it must be that
[TABLE]
Proof: Since is clearly differentiable a.e. on , and , , , is absolutely continuous so that the composition is absolutely continuous on by Proposition 3.25, then by Proposition 3.27, is Lebesgue integrable over and for all it must be that
[TABLE]
Corollary 3.15 (Change of variable for Lebesgue integral (Alternate form II) [22]): Given a function , bounded and measurable on , and a function , absolutely continuous on , then is Lebesgue integrable over and for all it must be that
[TABLE]
Proof: By Proposition 2.32, is Lebesgue integrable over . Since is clearly differentiable a.e. on , and by Observation 3.6, with , , it must be that is absolutely continuous on , then by Proposition 3.27, is Lebesgue integrable over and for all it must be that
[TABLE]
Corollary 3.16 (Change of variable for Lebesgue integral over a measurable set [9]:) Given , a measurable subset of , and a function , absolutely continuous on , a.e. on , , , then exists and is absolutely continuous on , and is a measurable subset of . Accordingly, given a function , Lebesgue integrable over , then is Lebesgue integrable over and
[TABLE]
Proof: Clearly is strictly increasing and thus exists and is absolutely continuous on by Proposition 3.24. By Proposition 3.21, is then a measurable subset of .
Define by if , if , and by if , if .
Note .
Also note is Lebesgue integrable over , since it equals on and [math] on . It follows then by Corollary 3.14 that
[TABLE]
i.e.,
[TABLE]
4 Functional Data and Shape Analysis and its
Connections to Lebesgue Integration and
Absolute Continuity
Observation 4.1: In what follows, we review some important aspects of functional data and shape analysis of the type in [23], while at the same time pointing out its dependence on Lesbesgue integration, absolute continuity and the connections between them. As in [23] where absolutely continuous functions on are generalized to functions of range , R the set of real numbers, a positive integer, we consider absolutely continuous functions on but restrict ourselves to those with range in . We denote by the set of such functions. With two absolutely continuous functions on considered equal if they differ by a constant, we note that the principal goal in [23] is essentially that of presenting tools for analyzing the shapes of absolutely continuous functions and defining a distance metric for computing a distance between any two of them. Specializing to , a crucial aspect of the approach in [23] is then that of identifying a bijective correspondence between functions in and functions in , and taking advantage of this correspondence to compute easily the distance between functions in (the definition of this distance in terms of the so-called Fisher-Rao metric appears below) by computing the distance between the corresponding functions in . Actually, as mentioned above, the goal of this approach is not so much that of computing the distance between functions in but of computing the distance between their shapes. More precisely, in this approach, each function in is associated with its unique (a.e. on ) so-called square-root slope function (SRSF) in , and vice versa, and a distance metric is defined for computing the distance between the shapes of any two functions in in terms of the distances between SRSF’s of reparametrizations of the two functions. This distance, although computed in , is a measure of how much one of the absolutely continuous functions must be reparametrized (with so-called warping functions) to align as much as possible with the other one. Since given two functions in that are not equal, the possibility exists that one function can be reparametrized to align exactly with the other one, i.e., become exactly the other one, the set of reparametrization functions or warping functions then induces a quotient space of . Accordingly, a distance metric is defined in [23] that computes the distance between any two equivalence classes in the quotient space of by the set of warping functions, thus computing the distance between the shapes of the two corresponding functions in .
Definition 4.1 (SRSF representation of functions [23]): Given , the real-valued square-root slope function (SRSF) of , is defined for each at which exists by
[TABLE]
Observation 4.2: By Corollary 3.5, exists a.e. on . Thus is defined a.e. on . We note that , the SRSF of , is the dimensional version of the square-root velocity function (SRVF) of an absolutely continuous function , , defined as follows. Let be the continuous map defined by if , otherwise, the Euclidean norm. Then the SRVF of , , is defined for each at which exists by
[TABLE]
if , [math] (in ) otherwise.
See [10], [23] for a rigorous development of the SRVF.
Proposition 4.1 (Square integrability of SRSF [23]): Given , the SRSF of is square-integrable over , i.e., , with , i.e., = length of .
Proof: By Corollary 3.5, is measurable and Lebesgue integrable over . Note for each at which exists. Thus is measurable and Lebesgue integrable over (Proposition 2.31) so that and .
Observation 4.3: As noted in Observation 2.21, a Lebesgue integrable function over a measurable set can be undefined on a subset of of measure zero. That can be the case above for functions and with which we know exist a.e. on . However, without any loss of generality, in the spirit of Observation 3.8 about the chain rule, and will eventually be interpreted below as and extended to all of . Finally, note the length of above is measured in R, a dimensional space.
Proposition 4.2 (Reconstruction of an absolutely continuous function from its SRSF [23]): Given , let be the SRSF of . Then for each it must be that .
Proof: Note that for each at which exists, then
[TABLE]
By Proposition 3.12, for each it must be that . Thus, for each it must be that .
Proposition 4.3 (’s equivalence with the set of all SRSF’s [23]): Let be in and any real number. Let for each at which exists. Then is defined a.e. on , is measurable and Lebesgue integrable over , and the function defined for each by is absolutely continuous on with equal to the SRSF of a.e. on .
Proof: As is defined a.e. on , then so is . In addition, since is measurable and Lebesgue integrable over , then so is (Proposition 2.31). By Proposition 3.12, is then absolutely continuous on .
Let be the SRSF of . Then for each at which exists it must be that and is defined a.e. on . Since by Proposition 3.7, a.e. on , then it must also be that for almost all .
But for each at which exists and therefore for almost all . Thus, a.e. on .
Definition 4.2: Under the composition of functions operation, the admissible class of warping functions is a semigroup of functions (not every element has an inverse) defined by
[TABLE]
where is the derivative of .
The group of invertible warping functions, , is defined by
[TABLE]
Observation 4.4: The functions in and play an important role in functional data and shape analysis as they are used to reparametrize an absolutely continuous function by warping its domain during the process of aligning its shape to the shape of another absolutely continuous function. As demonstrated in [10], [23], it is and that induce a quotient space of with a well-defined distance metric. More on this below. We note, given , since is continuous, , , , then by the intermediate value theorem [18], . We note, given , is strictly increasing, thus has an inverse which is also in as , , is absolutely continuous on by Proposition 3.24, and a.e. on , also from Proposition 3.24, since (the inverse of ) is absolutely continuous on .
Note, given , , then is absolutely continuous on by Proposition 3.25 and clearly , . Accordingly, if , , in order to conclude that , we prove a.e. on . For this purpose let , , . Clearly, and since is absolutely continuous on as just proved above, then by Proposition 3.21. Let . Accordingly, we only need to prove a.e. on . Clearly, exists (and is positive) a.e. on . Since , and exists (and is positive) on , then exists a.e. on . Indeed it exists exactly at the points in where exists. Thus, by the usual chain rule of calculus, for at which exists. Since as mentioned above exists and is positive for all , and exists and is positive a.e. on , then a.e. on .
Finally, given , , we show . It suffices to show a.e. on . For this purpose let , , . Clearly, . Letting , then we can show that a.e. on G, in the same manner we showed above for , that a.e. on . Thus, in order to complete the proof we show a.e. on . Since , then , and since is absolutely continuous on , then by Proposition 3.21. Note exists a.e. on as is absolutely continuous on . That a.e. on now follows follows from Corollary 3.12.
Proposition 4.4 (SRSF of a warped absolutely continuous function [23]): Given and , then and . With the SRSF of , without any loss of generality, in the spirit of Observation 3.8 about the chain rule, interpreting and as and extended to all of , it then follows that the SRSF of equals a.e. on .
Proof: Clearly, . That follows directly from Proposition 3.25. Accordingly, it then follows from Corollary 3.13 (chain rule) that a.e. on . Thus, the SRSF of which is defined for each at which exists as must equal
[TABLE]
for almost all .
Observation 4.5: Note the SRSF of is defined (Definition 4.1) for each at which exists. However, although the SRSF of equals a.e. on , it is not necessarily true that the SRSF of exists at each for which exists or if it exists it is equal to it.
Observation 4.6: An isometry is a distance-preserving transformation between two metric spaces. Here we describe in a nonrigorous manner isometries (and differentials as well) in the context of differential and Riemannian geometry. Let , be spaces and let be a mapping from into , with , , satisfying certain smoothness properties (in the language of differential geometry, and are smooth or differentiable manifolds which are spaces that locally resemble Euclidean, Hilbert or Banach spaces, and is differentiable (generalized to smooth manifolds); here and in what follows, differentiability in the context of smooth manifolds is assumed to be of all orders). Given , , assume can be defined, , a curve in , differentiable (generalized to smooth manifolds) so that makes sense. Then is considered to be a tangent vector to the curve at , and to at . Accordingly, the set of all tangent vectors to at is called the tangent space of at and denoted by . Similarly, given , the set of all tangent vectors to at is called the tangent space of at and denoted by . With as above, define by . Then , is a curve in , and we assume it is differentiable (generalized to smooth manifolds) so that makes sense and is then in . The mapping given by is a linear mapping called the differential of at . Finally, assume there is a correspondence on , smooth in some manner (see below), that associates to each point in an inner product on the tangent space . Similarly, assume there is a correspondence on , smooth in the same manner, that associates to each point in an inner product on the tangent space . If as above is bijective and satisfies certain smoothness properties (in the language of differential geometry, is a diffeomorphism: is bijective, and and are differentiable (generalized to smooth manifolds)), then is called an isometry if , for all and all , where the inner product on the left is the one on and the inner product on the right is the one on . On the other hand, if is differentiable and satisfies , for all and all , but is not a diffeomorphism, then is called a semi-isometry.
In the language of Riemannian geometry, the smooth correspondence above between points in a smooth manifold and inner products on tangent spaces of the space at the points is called a Riemannian metric or structure. Smooth manifolds equipped with such a structure are called Riemannian manifolds. Using the Riemannian structure, the length of a curve in a Riemannian manifold is computed as follows. Given , a curve or path in , differentiable (generalized to smooth manifolds) on so that makes sense for and is then in the tangent space , the length of the the path is then given by
[TABLE]
where is the inner product on the tangent space , and the smoothness of the Riemannian structure is such that , , is integrable over so that is well defined. In addition, given , , the geodesic distance between them is defined as the minimum of the lengths of all paths in , , differentiable (generalized to smooth manifolds) with and , i.e.,
[TABLE]
If a path exists such that achieves its minimum at , then is called a geodesic in between and . We note that geodesics in Euclidean spaces and are given by straight lines. Thus, for example, given , in , then defined by for , is the geodesic between and and the distance is
[TABLE]
Finally, we note that with the distance as defined above, it then follows that an isometry also as defined above is indeed a distance-preserving transformation. We show this in a nonrigorous manner. Given Riemannian manifolds , , let be a path from to in , , , an isometry. Let . Then , , , and is a path from to in . Since for any the differential is given by , then
[TABLE]
since is an isometry. Similarly, given a path from to in , there is a path from to in with . Thus, .
See [6], [7], [11], [12], [23] for a more rigorous development of the concepts of smooth manifolds, Riemannian manifolds, differentials, isometries, etc.
Observation 4.7: In what follows, given , , we use as short notation for . Here again, without any loss of generality, in the spirit of Observation 3.8 about the chain rule, is interpreted as extended to all of . As it will be shown below, so that without any loss of generality, again in the spirit of Observation 3.8 about the chain rule, can be interpreted as extended to all of , and given , can be interpreted as extended to all of .
Proposition 4.5: Given and , then . In addition, given , then a.e. on , and if , then a.e. on .
Proof: Let for each at which exists. Then is Lebesgue integrable over and by Corollary 3.14, is Lebesgue integrable over . Thus, .
Now, if , then
[TABLE]
a.e. on using Corollary 3.13 (chain rule) as , by interpreting as extended to all of (Observation 3.8 about the chain rule).
Finally, if , then
[TABLE]
a.e. on using Proposition 3.24.
Definition 4.3: The action of on is the operation that takes any element and any element of , and computes . The action of on is similarly defined.
Proposition 4.6 (Action of on is by semi-isometries. Action of on is by isometries [23]): For each , let be defined for by . Then is differentiable and
[TABLE]
for any , , where is the inner product and is the differential of , with and the same at every . Thus, is a semi-isometry and the action of on is said to be by semi-isometries. If , then is a diffeomorphism. Thus, is an isometry and the action of on is said to be by isometries.
Proof: If , from Proposition 4.5 it follows that the range of is indeed in . Since the tangent space of at any point is itself, it follows that is the same at every . Given , , from Proposition 2.41 (Hölder’s inequality), . Let for each at which and exist. By Corollary 3.14 (change of variable),
[TABLE]
as is linear so that it is differentiable and acts on an element of the same way does. Thus, is the same at every , and in addition, is a semi-isometry and the action of on is by semi-isometries. If , then is a bijection and its inverse is linear so that it is differentiable. Thus, is a diffeomorphism and therefore an isometry, and the action of on is by isometries.
Corollary 4.1 (Action of on is distance preserving [23]): Given , , and , then .
Proof: and (Observation 4.6). The action of on is by isometries (Proposition 4.6). Thus, (Observation 4.6), and hence, .
Corollary 4.2 (Action of on is norm preserving [23]): Given , and , then .
Observation 4.8 (Action of on is distance and norm preserving): Corollary 4.1 and Corollary 4.2 can be shown to hold for all of as follows. Given , , and , then and by Corollary 3.14 (change of variable),
[TABLE]
Definition 4.4: Let . The Fisher-Rao metric at any is defined as the inner product
[TABLE]
for any .
Observation 4.9: The integral in the definition of the Fisher-Rao metric at is well defined as , are functions on that are absolutely continuous [21], hence , , exist a.e. on , a.e. on , thus , exist a.e. on and are in (see below), so that is Lebesgue integrable over by Proposition 2.41 (Hölder’s inequality). In addition, this metric, as defined at elements of , is known to have the behavior of a Riemannian metric [23]. In what follows, we assume is endowed with this metric.
Proposition 4.7: Given and , then and .
Proof: That and was established in Proposition 4.4. Accordingly, in order to conclude that we prove a.e. on . For this purpose let , , . Clearly, and since is absolutely continuous on (Observation 4.4), then by Proposition 3.21. Let . Accordingly, we only need to prove a.e. on . Clearly, exists (and is positive) a.e. on . Since , and exists (and is positive) on , then exists a.e. on . Indeed it exists exactly at the points in where exists. Thus, by the usual chain rule of calculus, for at which exists. Since as mentioned above exists and is positive for all , and exists and is positive a.e. on , then a.e. on .
Definition 4.5: The action of on is the operation that takes any element and any element of , and computes .
Observation 4.10: In what follows, two functions in are considered equal if they differ by a constant. Simpler yet, we assume all functions in have the same value at zero. Since by Proposition 4.4, if , , then and , and since in addition the SRSF of is the same for any constant , the latter is a reasonable assumption.
Proposition 4.8 (Action of on with Fisher-Rao metric is by isometries [23]): For each , let be defined for by . Then is a diffeomorphism and
[TABLE]
for any , , where is the inner product that defines the Fisher-Rao metric at , is the inner product that defines it at , and is the differential of at . Thus, is an isometry and the action of on is said to be by isometries.
Proof: If , from Proposition 4.7, the range of is indeed in . As noted in Observation 4.9, given , , , then , are functions on that are absolutely continuous [21], and is Lebesgue integrable over . By Corollary 3.14 (change of variable), Corollary 3.13 (chain rule) as , , , by interpreting , , , as , , , extended to all of (Observation 3.8 about the chain rule), and noting that all denominators below are greater than zero a.e. on (Proposition 4.7 and its proof), then
[TABLE]
as is linear so that it is differentiable and acts on an element of the same way does on an element of . Since , then is a bijection and its inverse is linear so that it is differentiable. Thus, is a diffeomorphism and therefore an isometry, and the action of on is by isometries.
Proposition 4.9 (Fisher-Rao metric on under SRSF representation becomes metric [23]): Given and the SRSF of , define a mapping by . Then is differentiable, and for any , it must be that , where is the differential of at . Given , , then , where is the inner product and is the inner product that defines the Fisher-Rao metric at .
Proof: Let .
Given , define a mapping by .
In addition, given , define a mapping (the derivative mapping) by .
With as defined above, then .
Given , then , where is the differential of at , as is linear so that it is differentiable and acts on an element of the same way acts on an element of .
Let be the mapping defined by , , . Then is differentiable for , and for any , where is the differential of . From this, following closely the definition of the differential of a differentiable function [11, 23], it then follows that is differentiable and given , then , where is the differential of at .
Thus, is differentiable and its differential at is [11].
Accordingly, given , then .
Finally, given , , then
[TABLE]
Observation 4.11 (Distance between functions in ): Given , , let , be the SRSF’s of , , respectively. We note that computing the distance between and with the Fisher-Rao metric as defined above may not be possible as a path in from to might contain functions whose derivatives are not positive a.e. on . Even if this was not the case, the minimization involved would be nontrivial. Accordingly, motivated by Proposition 4.9 above, the convention is to say that the Fisher-Rao distance between and is , i.e., the distance between and . In addition, since the geodesic from to is a straight line, given , then is a function in this geodesic, and by Proposition 4.3, a function can be computed for each by , where , with the SRSF of equal to a.e. on . Doing this for enough functions on the straight line joining and , a collection of functions can be obtained in that are then said to approximate a geodesic (based on the Fisher-Rao metric) from to .
Definition 4.6: Given , define the orbit of under by [0,1]. Denote by the closure in of .
Observation 4.12: In what follows, given , , so that a.e. on for some , without any loss of generality we may simply say . Accordingly, given , , so that for some , then it follows (Proposition 4.5) that , and so that and thus . Using similar arguments, given , , an equivalence relation can be defined and justified on for which if and are in the same orbit under . Accordingly, with this equivalence relation a quotient space is obtained which is the set of all orbits of elements of under and which we denote by . An attempt then can be made as follows to define a distance function between elements of that would make a metric space. Given , , let
[TABLE]
where the bottom equations follow from Corollary 4.1 (action of on is distance preserving) again using Proposition 4.5 where appropriate. Of the properties that must satisfy to be a distance function all have been established [23] except one: if and only if . Unfortunately, as demonstrated in [10], the orbits as defined are not closed in , which allows for examples with but .
Proposition 4.10 ([10]): Given , , then if and only if . In particular, if so that , then .
Proof: If , fix and note (Observation 4.12) so that . Then given integer , there is such that . Thus, . Since is arbitrary in then , thus . Similarly, , thus .
Assume . Then, in particular, so that given integer , there is with . Thus, .
Observation 4.13: Using arguments similar to those in the proof of Proposition 4.10 above, given , , an equivalence relation can be defined and justified on for which if and are in the closure of the same orbit under . Accordingly, with this equivalence relation a quotient space is obtained which is the set of all closures of orbits of elements of under and which we denote by . In what follows, we extend the function above to the quotient space .
Corollary 4.3 (Distance between equivalence classes in [10], [23]): Given , , let
[TABLE]
Then , and is a distance function between elements of , so that is a metric space with this distance function.
Proof: Note
[TABLE]
Thus, , as previously noted in Observation 4.12.
That is a distance function follows from Proposition 4.10 and results about properties of this distance function in [23].
Observation 4.14: Given , , and , , the SRSF’s of , , respectively, we note that and remain unchanged after translations of and (by translations we mean and become and , respectively, for constants , ) so that the distance between the equivalence classes of and , defined by above, is the same before and after the translations. That this is true follows from the definition of the SRSF. For scalar multiplications of and , the distance between the equivalence classes of and before and after the scalar multiplications can be approximated or computed exactly, if possible, by the same elements of as the following proposition shows. Accordingly, it is customary to normalize and so that and then compute the distance between their equivalence classes with as above, as from the comments just made doing so is compatible with the requirement that the shapes of and be invariant under translation and scalar multiplication.
Proposition 4.11 ([23]): Given , , and , for which , then , for any .
Proof: With as the inner product, note
[TABLE]
and
[TABLE]
Thus, and , , imply .
Accordingly, since , then
[TABLE]
so that .
Observation 4.15: Figure 1 illustrates an instance of approximately computing as expressed in Corollary 4.3 above. Here , are the SRSF’s of functions , , respectively, plotted in the lefmost diagram, in red, in blue, , normalized so that . The distance (about 0.1436) was approximately computed (in about 154 seconds) with adapt-DP [2], a fast linear Dynamic Programming algorithm. The resulting warping function that approximately minimizes is plotted in the rightmost diagram, and and are plotted in the middle diagram in which they appear essentially aligned. The functions and were given in the form of sets of 19,693 and 19,763 points, respectively, with nonuniform domains in . A copy of adapt-DP with usage instructions and data files for the same example in Figure 1 can be obtained using links: https://doi.org/10.18434/T4/1502501 http://math.nist.gov/~JBernal /Fast_Dynamic_Programming.zip
Definition 4.7: Given , define the orbit of under by [0,1].
Observation 4.16: In what follows, we present results found mostly in [10] for the purpose of showing that given , then there exist , , such that , constant a.e. on , so that , and thus . We note that this result doesn’t change how in Corollary 4.3 is computed for , . It should still be done by computing or as implied by Corollary 4.3.
Proposition 4.12: has closure in equal to .
Proof: Clearly . Let be given. Given , then a measurable subset of exists, , on which . Let . Then a.e. on and .
Choose , with , and set .
Define a function on by on and on . Then a.e. on and so that .
Note = so that is in the closure of in and this is true for every in .
Finally, if , we show is not in the closure of in . If , then clearly is not in the closure. Thus, assume . Since , then a measurable subset of exists, , on which . Thus, (i of Proposition 2.34) so that for any . Thus, can not be in the closure of in and must then be the closure of in .
Corollary 4.4 (SRSF’s of functions in and ; orbit of the constant function equal to 1 [10]): has closure in equal to . In addition, with , , and the constant function equal to 1 on , then and .
Proof: If and a.e. on , then . Also a.e. on since so that . Thus, . On the other hand, if , then a.e. on , , . By Proposition 4.3, defined for each by is absolutely continuous on with equal to the SRSF of a.e. on . Clearly , , a.e. on , thus and a.e. on so that . Thus . Similarly, so that the closure of in is by Proposition 4.12. Finally, , and since, as just proved, the closure of in is , then .
Corollary 4.5 ([10]): With the constant function equal to 1 on , given , , , if either (i) a.e. on and a.e. on , or (ii) a.e. on and a.e. on , then in the case of (i) it must be that , and in the case of (ii) it must be that . In both cases a sequence exists in with in .
Proof: With , if (i) is true, then , (Corollary 4.4) so that by Proposition 4.10, . On the other hand, if (ii) is true, then using similar arguments as above with taking the place of , it then follows that . In both cases implies the existence of .
Corollary 4.6 ([10]): Given , , and a sequence of numbers , such that for each , , , and either and a.e. on , or and a.e. on , then .
Proof: Given , , then a sequence exists of absolutely continuous functions, , a.e. on , , for each such that in . Here is understood to be and the set of square-integrable functions over . Proof of the existence of along the lines of that of Corollary 4.5 with taking the place of and the value of not necessarily equal to 1.
Finally, define a sequence of functions , , by setting if for each . It follows is absolutely continuous, , , a.e. on for each . Thus and since in for each , then in . Thus, and by Proposition 4.10, then .
Corollary 4.7 ([10]): Given , , and two sequences of numbers , , such that for each , , , and either a.e. on and a.e. on , or a.e. on and a.e. on , then .
Proof: Let be the piecewise linear element of for which , , and let . It then follows by Corollary 3.14 (change of variable) that for each , , , and since a.e. on if a.e. on , and a.e. on if a.e. on , then and satisfy the hypothesis of Corollary 4.6 for the sequence so that . Since , , then so that by Observation 4.12, and therefore .
Proposition 4.13 ([10]): Given , then .
Proof: The proposition is first proved for step functions on . Accordingly, we assume is a step function and .
Let be the set of numbers that define the partition associated with as a step function. For each , , let be such that with and . Note , as is a nondecreasing function from onto .
Let . It then follows by Corollary 3.14 (change of variable) that for each , , , and either a.e. on and a.e. on , or a.e. on and a.e. on . Thus, by Corollary 4.7, so that, in particular, and therefore, since is arbitrary in , then .
Finally, we assume is any function in and . Given , by Proposition 2.44 (density of step functions in ), there is a step function on such that . As just proved above, so that for some it must be that . Thus, by Corollary 4.1 and Observation 4.8 (action of and is distance preserving)
[TABLE]
so that and therefore, since is arbitrary in , then .
Proposition 4.14 (Constant-speed parametrization of an absolutely continuous function [24]): Given , then there exist , , such that (the length of ) a.e. on and on .
Proof: Given , let . If then is constant on (i of Proposition 2.34, Proposition 3.8). Otherwise, define by for each . Accordingly, , , by Proposition 3.11, and a.e. on by Proposition 3.7 so that a.e. on . Thus .
Given , then for some it must be that . Define by . The function is well defined for if , , then . Thus, by i of Proposition 2.34, a.e. on so that by Proposition 3.8 is constant on and, in particular, .
Clearly for each . Note for , , then , , , , , and
[TABLE]
From this inequality it follows clearly that (Definition 3.5). Accordingly, is differentiable a.e. on and a.e. on also from the inequality. Note that by Corollary 3.14 (change of variable) and Corollary 3.13 (chain rule), then
[TABLE]
By i of Proposition 2.34, then a.e. on .
Corollary 4.8: Given , then there exist , , such that a.e. on and a.e. on , where (the length of ), , the SRSF of equal to a.e. on . In particular, if so that , then a.e. on .
Definition 4.8: A function , is said to be in standard form if for measurable subsets , of , with , , then
[TABLE]
Clearly, if is in standard form, then .
Let
Proposition 4.15 ([10]): Given , , if in , i.e., if , then . Thus .
Proof in [10] using Corollary 3.16 (Change of variable for Lebesgue integral over a measurable set) and Observation 2.25 (Schwarz’s inequality over a measurable set).
Corollary 4.9: (Uniqueness of constant-speed parametrization): Given , , if for , , and , , and , then a.e. on .
Proof: By Proposition 4.13, and . Thus, so that by Proposition 4.15, a.e. on .
Proposition 4.16 ([10]): Given , then .
Proof: From Proposition 4.13, we know . Thus, it suffices to show . For this purpose, let be in . Clearly , and by Corollary 4.8, for some , and some , it must be that a.e. on . By Proposition 4.13, . Thus, so that by Proposition 4.15, a.e. on , and therefore is in . Thus .
Corollary 4.10 ([10]): Given , if a.e. on , then .
Proof: If , then by Corollary 4.8, for some , and some , it must be that a.e. on . Since a.e on , then a.e. on , and therefore a.e. on . Thus, so that and a.e. on (Proposition 4.5). Accordingly, (Proposition 4.16). Given , then for some , a.e. on (Proposition 4.5), and since (Observation 4.4), then . On the other hand, given , then for some , a.e. on (Proposition 4.5), and since (Observation 4.4), then . Thus and therefore .
If , then clearly , a.e. on , and as just proved . Given , then for a sequence , in . Thus in implying for some , and therefore so that . On the other hand, given , then for some , . Thus implying for a sequence , in , and therefore in so that . Thus .
Observation 4.17: As noted in [10], given , , and their SRSF’s , , respectively, if , exist such that , assuming without any loss of generality that a.e. on , a.e. on (Corollary 4.8), then by Corollary 4.10 above there exist , , such that and . The pair , is called an optimal matching for , . In particular, it is proved in [10] that if at least one of , contains the SRSF of a piecewise linear function, then , exist as above and therefore there is an optimal matching for , . This is actually proved in [10] for absolutely continuous functions , with range .
**Summary
**In order to understand the theory of functional data and shape analysis as presented in Srivastava and Klassen’s textbook “Functional and Shape Data Analysis” [23], it is important to understand the basics of Lebesgue integration and absolute continuity, and the connections between them. In this paper of the survey type, we have tried to provide a way to do exactly that. We have reviewed fundamental concepts and results about Lebesgue integration and absolute continuity, some results connecting the two notions, most of the material borrowed from Royden’s “Real Analysis” [16] and Rudin’s “Principles of Mathematical Analysis” [18]. Additional important material was obtained from Saks’ [20], and Serrin and Varberg’s [22] seminal papers. In addition, we have presented fundamental concepts and results about functional data and shape analysis in 1-dimensional space, in the process shedding light on its dependence on Lebesgue integration and absolute continuity, and the connections between them, most of the material borrowed from Srivastava and Klassen’s aforementioned textbook. Additional material presented at the end of the paper was obtained from Lahiri, Robinson and Klassen’s outstanding manuscript [10].
Acknowledgements
I am most grateful to Professor James F. Lawrence of George Mason University and the National Institute of Standards and Technology for the many insightful conversations on the subjects of Lebesgue integration and absolute continuity, and to Professor Eric Klassen of Florida State University for his generosity in always providing answers to my questions about his remarkable work on shape analysis.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Apostol, T. M.: Mathematical Analysis, 2nd edition. Reading, Massachusetts: Addison-Wesley Publishing Company. (1974)
- 2[2] Bernal, J., Dogan, G., Hagwood, C. R.: Fast Dynamic Programming for Elastic Registration of Curves. Proceedings of DIFF-CVML workshop, CVPR 2016, Las Vegas, Nevada. (2016)
- 3[3] Bruckner, A. M., Bruckner, J. B., Thomson, B. S.: Real Analysis, 1st edition. Upper Saddle River, New Jersey: Prentice-Hall. (1997)
- 4[4] Burk, F.: Lebesgue Measure and Integration. An Introduction, 1st edition. New York: John Wiley & Sons. (1998)
- 5[5] Cabada, A., Pouso, R. L.: On First Order Discontinuous Scalar Differential Equations. Nonlinear Studies 2 (1999) 161–170.
- 6[6] do Carmo, M. P.: Differential Geometry of Curves and Surfaces. Upper Saddle River, New Jersey: Prentice-Hall. (1976)
- 7[7] do Carmo, M. P.: Riemannian Geometry. Boston: Birkhäuser. (1992)
- 8[8] Halmos, P. R.: Measure Theory. New York: Springer-Verlag. (1974)
