On the local geometry of definably stratified sets
David Trotman, Guillaume Valette

TL;DR
This paper extends Pawlucki's theorem on Whitney regularity and stratified sets from subanalytic to definable sets in polynomially bounded o-minimal structures, providing new insights into their local geometry and counterexamples.
Contribution
It generalizes Pawlucki's theorem to o-minimal structures, introduces a quantified Whitney (b)-regularity, and analyzes the continuity of density and normal cones in definably stratified sets.
Findings
Pawlucki's theorem applies to polynomially bounded o-minimal structures.
A refined version of the theorem with quantified Whitney (b)-regularity is established.
Counterexamples show limitations of extending the theorem to all o-minimal structures.
Abstract
We prove that a theorem of Pawlucki, showing that Whitney regularity for a subanalytic set with a smooth singular locus of codimension one implies the set is a finite union of differentiable manifolds with boundary, applies to definable sets in polynomially bounded o-minimal structures. We give a refined version of Pawlucki's theorem for arbitrary o-minimal structures, replacing Whitney (b)-regularity by a quantified version, and we prove related results concerning normal cones and continuity of the density. We analyse two counterexamples to the extension of Pawlucki's theorem to definable sets in general o-minimal structures, and to several other statements valid for subanalytic sets. In particular we give the first example of a Whitney (b)-regular definably stratified set for which the density is not continuous along a stratum.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
full title
David Trotman
Aix Marseille Univ., CNRS, Centrale Marseille, Institut Mathématique de Marseille, 13453 Marseille, France.
and
Guillaume Valette
Instytut Matematyczny PAN, ul. Św. Tomasza 30, 31-027 Kraków, Poland
On the local geometry of definably stratified sets
David Trotman
Aix Marseille Univ., CNRS, Centrale Marseille, Institut Mathématique de Marseille, 13453 Marseille, France.
and
Guillaume Valette
Instytut Matematyczny PAN, ul. Św. Tomasza 30, 31-027 Kraków, Poland
Abstract.
We prove that a theorem of Pawłucki, showing that Whitney regularity for a subanalytic set with a smooth singular locus of codimension one implies the set is a finite union of manifolds with boundary, applies to definable sets in polynomially bounded o-minimal structures. We give a refined version of Pawłucki’s theorem for arbitrary o-minimal structures, replacing Whitney (b)-regularity by a quantified version, and we prove related results concerning normal cones and continuity of the density. We analyse two counterexamples to the extension of Pawłucki’s theorem to definable subsets in general o-minimal structures, and to several other statements valid for subanalytic sets. In particular we give the first example of a Whitney -regular definably stratified set such that the density is not continuous along a stratum.
2000 Mathematics Subject Classification:
Primary
2010 Mathematics Subject Classification:
Primary 03C64, 32S15, 53B25, 58A35; Secondary 32S60
Visits to the Jagiellonian University in Krakow and the University of Provence in Marseille, during which this work developed, were supported by a PHC Polonium project. The research began while both authors were resident at the Fields Institute in Toronto during the thematic program, “O-minimal Structures and Real Analytic Geometry”. We gratefully acknowledge the support of the French Ministry of Foreign and European Affairs (MAEE), the French Ministry of Higher Education and Research (MESR), the Fields Institute and the French Embassy in Ottawa.
1. Introduction
We recall the statement of a striking and useful theorem of W. Pawłucki.
Theorem 1.1**.**
(Pawłucki [Pa]) A subanalytic stratified set with a smooth singular locus of codimension is Whitney -regular if and only if is a finite union of manifolds-with-boundary each of which has boundary .
Pawłucki used this theorem to prove a version of Stokes’ theorem for subanalytic sets, later generalised by Łojasiewicz [Loj] and by Valette [Va4]. It has also been used in various ways in papers of Bernig [Be], Chossat-Koenig [CK], Comte [C], Jeddi [J], Orro-Pelletier [OP] and Valette [Va3], among others.
It is natural to consider possible generalisations of Pawłucki’s theorem to definable sets in o-minimal structures. We prove in section 3 that Pawłucki’s theorem applies to definable sets in polynomially bounded o-minimal structures (Corollary 3.11). Furthermore we give in Corollary 3.10 a refined version of Pawłucki’s theorem which applies to arbitrary o-minimal structures, replacing Whitney -regularity by a quantified version first described by the second author in his thesis [Va1] (directed by the first author). We also generalise a theorem of Hironaka [H] stating that Whitney regularity of an analytic variety controls the normal cone structure, and a theorem of Comte [C] stating that Kuo’s ratio test ensures continuity of the density for subanalytic sets.
In section 4 we analyse two counterexamples to the natural generalisation of Pawłucki’s theorem for definable subsets in o-minimal structures which are not polynomially bounded. These also provide counterexamples to several classical results describing relations between well-known equisingularity conditions for subanalytic strata, including the above theorem of Hironaka and a result of Navarro Aznar and the first author [NT]. We also obtain the first example of a Whitney -regular definable stratified set for which the density is not continuous along each stratum; note that the density is continuous along strata of a -regular definable stratified set when the o-minimal structure is polynomially bounded [Va2], [NV].
2. Definitions.
Let be an integer. Let be a closed stratified subset of , such that the strata are differentiable submanifolds of class . For each stratum of denote by the normal cone of along , i.e. the restriction to of the closure of the set , where is the local canonical retraction onto (recall that this is defined on a neighbourhood of a differentiable manifold of class by taking the unique nearest point on ), is the unit vector , and denotes the vector , where and are points of . In fact is a union of normal cones , where the are the strata of whose closures contain . The following two properties of the normal cone express that behaves well along the stratum (at the point ).
Definition 2.1**.**
Condition : The fibre of at a point of equals the tangent cone to the fibre of at .
Definition 2.2**.**
Normal pseudo-flatness [H]: The stratified set is said to be normally pseudo-flat along when the projection is open.
When a stratification satisfies simultaneously two regularity conditions, say Whitney -regularity and , we write that it is -regular. Subanalytic stratifications satisfying or have normal cones with good behaviour from the point of view of the dimension of the fibres. In fact they satisfy the condition
[TABLE]
This is obvious for , while for it follows from [OT2]. For differentiable stratifications one may not always be able to define the dimension. Despite the bound , the tangent cone to the fibre (hence the fibre of the normal cone, assuming ) can be quite arbitrary : work of Ferrarotti, Fortuna and Wilson [FFW] shows that each closed semi-algebraic cone of codimension is realised as the tangent cone at a point of a certain real algebraic variety, while Kwieciński and the first author showed that every closed cone is realised as the tangent cone at an isolated singularity of a certain -regular stratified set [KT].
Hironaka proved in [H] that Whitney -regular stratifications of any analytic set (real or complex) satisfy condition and are normally pseudo-flat along each stratum. Twenty years later Henry et Merle [HM2] obtained with replaced by when and are two adjacent strata of a sub-analytic Whitney stratification of . In [OT3] Orro and the first author introduced a metric invariant of Kuo’s ratio test (introduced by Kuo [K] in 1971), denoted by , for . Every -regular stratification satisfies automatically and , i.e. . Here as usual refers to the Kuo-Verdier condition [Ve] which implies trivially Kuo’s ratio test . Recall that implies Whitney -regularity for subanalytic strata [K]. In Proposition 3.2 below we show that implies for definable sets in any o-minimal structure, showing that also implies . This is not the case for general stratified sets. For subanalytic strata it was observed in [OT3] that the combination is equivalent to Kuo’s ratio test , and the proof goes through without difficulty for definable stratifications in polynomially bounded o-minimal structures; by [T1] we know that is strictly weaker than in the semi-algebraic case, and there are even real algebraic examples ([BrT], [T3], [N]).
The equivalence of and for complex analytic stratifications is a consequence of Teissier’s programme of characterising -regularity by equimultiplicity of polar varieties, completed in 1982 ([Te1], [HM1]). One can consult [Te2] and [Me] for detailed surveys of the complex equisingularity theory.
In [OT2] it was proved that every -regular stratification is normally pseudo-flat and satisfies condition , without subanalyticity. Hence for -regular stratifications which are definable in a polynomially bounded o-minimal structure, and hold. We shall show in section 4 that this is not the case for o-minimal structures which are not polynomially bounded.
We recall below, for the convenience of the reader, the definitions of the conditions and of Whitney, of Kuo [K], of Orro-Trotman and of Kuo-Verdier [Ve]. We also recall Teissier’s notion of where is any equisingularity criterion.
Let and be two submanifolds of such that , and let be a local retraction onto . Following Hironaka [H], we denote by the distance of to , which is
[TABLE]
and we denote by the angle of to expressed as
[TABLE]
where is the scalar product on . For , the distance of the vector to a plane is
[TABLE]
Set
[TABLE]
so that in particular . Set also
[TABLE]
Definition 2.3**.**
The pair of strata satisfies, at :
condition if, for in ,
[TABLE]
condition if, for in ,
[TABLE]
condition if, for in ,
[TABLE]
condition if, for in ,
[TABLE]
condition if, for in and in , is bounded near [math].
In [OT2] P. Orro and the first author introduced the following condition of Kuo-Verdier type.
Definition 2.4**.**
Let . One says that satisfies condition at if, for , the quantity
[TABLE]
is bounded near [math].
This condition is a diffeomorphism invariant. It is Verdier’s condition when , hence implies for all . But, unlike , condition when does not imply condition : a counter-example which is a semi-algebraic surface can be obtained by pinching a half-plane of , with boundary the -axis in a cuspidal region , where is an odd integer such that , such that in there are sequences tending to [math] for which condition fails. Such an example will be -regular.
Theorem 2.5**.**
[OT3]**. Every -regular stratification is normally pseudo-flat and satisfies condition .
Corollary 2.6**.**
For -regular stratifications which are definable in a polynomially bounded o-minimal structure, and hold.
In section 4 we give a counterexample to the corollary for any non-polynomially bounded o-minimal structure.
Now we recall the definition of -regularity for an equisingularity condition, as in [OT1]. This notion came from the discussion of B. Teissier in his 1974 Arcata lectures [Te]. Teissier stated that one requirement for an equisingularity condition to be good is that it be preserved after intersection with generic linear spaces containing a given linear stratum. Various equisingularity conditions have been shown to have this property, notably Whitney -regularity for complex analytic stratifications ([Te1], [HM1]), and Kuo’s ratio test , the Kuo-Verdier condition [NT], and Mostowski’s -regularity for subanalytic stratifications [JTV] .
Definition 2.7**.**
Let be a -manifold. Let be a -submanifold of and . Let be a -submanifold of such that , and . Let denote an equisingularity condition (for example or ). Then is said to be -regular at () if there is an open dense subset of the Grassmann manifold of codimension subspaces of containing such that if is a submanifold of with near , and , then is transverse to near , and is -regular at .
Definition 2.8**.**
is said to be -regular at if is -regular for all .
Theorem 2.9**.**
[NT]** For subanalytic stratifications, implies and implies .
In this sub-analytic case, because implies over -dimensional strata, and always implies , we deduce the following corollary.
Corollary 2.10**.**
[NT]** For subanalytic -regular stratifications, holds over every -dimensional stratum.
In section 4 we give counterexamples to the above Theorem and Corollary in any non-polynomially bounded o-minimal structure.
3. Normal pseudo-flatness in the non-polynomially bounded case
In this section we give several theorems indicating for which o-minimal structures the definably stratified sets have similar properties to sub-analytic sets, thus avoiding the pathologies exhibited by the functions and described in section 4. These theorems are based on earlier work of the second author in [Va1].
In the final section of this paper we shall show that condition is too weak to ensure normal pseudo-flatness in non-polynomially bounded o-minimal structures. In this section we explain how to overcome this problem: we introduce a slightly stronger condition which is enough to entail normal pseudo-flatness. We will also show that the density is continuous along the strata of a stratification satisfying this condition.
We prove in the following proposition (3.1) that one can extend the result of Kuo [K] for semianalytic stratifications that implies along strata of dimension one (extended by Verdier [Ve] to subanalytic stratifications), to all stratified sets definable in polynomially bounded o-minimal structures. The result of Proposition 3.1 is sharp: the example in section 4 below is the first case known of an o-minimal structure with a -regular definable stratification which does not satisfy Kuo’s ratio test . Moreover by Miller’s dichotomy [M] every non polynomially bounded o-minimal structure has such an example.
Recall that Kuo’s ratio test holds for at if and only if
[TABLE]
as tends to on . For and vector subspaces of , the function is defined by:
[TABLE]
Proposition 3.1**.**
Let and be disjoint submanifolds which are definable in a polynomially bounded o-minimal structure with , and . If the pair satisfies the Whitney condition then it also fulfills Kuo’s ratio test .
Proof.
Take such satisfying Whitney’s condition at . After a local change of coordinates we may assume that is a line. We have to show that the Kuo ratio tends to zero along any definable arc with . We may assume that is parameterized by arc-length. We denote by the orthogonal projection onto , and by the orthogonal projection onto . As is Whitney regular:
[TABLE]
By L’Hospital’s rule and the definability of (which yields existence of the limits) we have
[TABLE]
It follows that:
[TABLE]
Because is a definable map in a polynomially bounded o-minimal structure, there must be a positive real number such that
[TABLE]
(This is not true for an o-minimal structure which is not polynomially bounded, by Miller’s dichotomy [M]. See the analysis of the example below. Or consider , which extends continuously at [math] by , and calculate so that which tends to [math] as tends to [math].)
It is easy to see that if is not tangent to at [math] then by -regularity, the ratio test holds. Thus we may assume that is tangent to . Because also is parametrised by arc-length, it follows that and tend to 1 as tends to [math].
Consequently, because lies on , and is definable and thus may be assumed to be of class on , it follows that , and we have:
[TABLE]
[TABLE]
which tends to zero by (3.2). ∎
The converse implication, that implies , this time for of all dimensions, was also proved by Kuo [K]. Actually Kuo treated the semi-analytic case as his paper predates the introduction of subanalytic sets. Verdier [Ve] confirmed that Kuo’s proof works also for subanalytic stratifications. Here we show the new result that the implication is actually valid for definable sets in any o-minimal structure, not only for those which are polynomially bounded.
Proposition 3.2**.**
Kuo’s ratio test for at implies Whitney’s condition at [math] for any o-minimal structure, and for of any dimension.
Proof.
Fix a pair satisfying at . To prove that holds, take a definable with .
We may assume that is parameterized by arc-length.
Then because ( lies on ) we may write using (3.3):
[TABLE]
[TABLE]
using the mean-value theorem, and local monotonicity (due to definability and cell decomposition [DM], cf. the observation of Proposition 1.10 in [Loi]) of to prove the strict inequality. But tends to zero in virtue of our hypothesis that holds. This shows that the angle between and tends to zero as goes to zero. By (3.1), the angle between and must tend to zero as well. This establishes Whitney’s condition at [math] for the pair . ∎
The previous proposition has as an immediate corollary that the Kuo-Verdier condition (which trivially implies ) also implies Whitney’s condition for definable stratifications in any o-minimal structure, a result previously proved by Ta Lê Loi as Proposition 1.10 in [Loi]. We remark that does not imply for general stratified sets - consider the topologist’s sine curve in the plane, , taking the two strata and its complement.
Let be a pair of strata such that . As we may work with a coordinate system we shall identify with a neighborhood of the origin in . Denote by the orthogonal projection.
Define for positive small enough:
[TABLE]
It is clear that the Kuo-Verdier condition is equivalent to the boundedness of for small . Moreover the ratio test is equivalent to the conjunction of and the property that tends to zero as goes to zero.
Definition 3.3**.**
Let and be two strata with . We will say that satisfies the condition at if .
We shall see that, combined with -regularity, implies local topological triviality, normal pseudo-flatness and the continuity of the density, in the case where the strata are definable.
Definition 3.4**.**
An -approximation of the identity is a homeomorphism of type with:
[TABLE]
[TABLE]
Given a definable set we set:
[TABLE]
where denotes the Hausdorff dimension of and the -dimensional Hausdorff measure. Recall that the density (or Lelong number) of at the origin is then defined as:
[TABLE]
where stands for the volume of the unit ball in .
Theorem 3.5**.**
(Theorem of [Va2]) Let and be two definable (in some o-minimal structure) families of sets of dimension of . Let be a function with , for all , and let be an -approximation of the identity and let be a compact subset of .
There is a constant such that for every we have for small enough:
[TABLE]
The next result is a generalisation of a theorem of Fukui and Paunescu [FP].
Proposition 3.6**.**
Let be a definable stratified set and assume that is a stratum. If all pairs of strata satisfy conditions and then there exist neighbourhoods and of the origin in and and a topological trivialization
[TABLE]
* such that is an -approximation of the identity with .*
Proof.
For simplicity, we will assume that is one dimensional. We construct an isotopy by integration of vector fields as in Thom-Mather isotopy lemma [Ma].
Thanks to the condition the tangent spaces satisfy the following estimate:
[TABLE]
(where is the orthogonal projection onto ) in a sufficiently small neighborhood of the origin.
By standard arguments [Ve, Ma, OT2] we may obtain a stratified unit vector field defined in a neighbourhood of the origin in , tangent to and to the strata, smooth on every stratum, and satisfying (where generates ) as well as:
[TABLE]
for some constant .
Denote by the one-parameter group generated by this vector field. Let ; we also have by (3.4) (see [OT3] Lemma ) a positive constant such that:
[TABLE]
for . Existence of integral curves is proved as in [OT2] (see Lemma of the latter article).
The desired trivialization in then given by for , . By (3.5), it is an -approximation of the identity with . ∎
The following theorem is a generalisation of Comte’s theorem [C].
Theorem 3.7**.**
Let be a definable stratified set and assume that is a stratum. If all pairs of strata satisfy conditions and then the density of is continuous along
Proof.
Set
[TABLE]
This defines a family of sets (parameterized by ) such that the germ of at is the germ of at . It is thus enough to prove that the function is continuous along the stratum
Apply Theorem 3.6 to get an approximation of the identity with . Observe that the family maps onto . We claim that it is an -approximation of the identity with .
Take in . In particular . Thus
[TABLE]
In particular, this shows that belongs to (for and sufficiently small). Therefore, as is an -approximation of the identity:
[TABLE]
Together with the preceding estimate this implies the desired inequality. A similar computation holds for .
By theorem 3.5 we have for any and small enough:
[TABLE]
where is the dimension of and is a positive constant. Dividing by and passing to the limit as tends to zero we get:
[TABLE]
which tends to zero as tends to zero. ∎
Theorem 3.8**.**
If a stratification, definable in some o-minimal structure (not necessarily polynomially bounded), satisfies both and then it satisfies conditions (npf) and .
Proof.
Fix a stratum of a -regular stratification. Up to a coordinate system, we may assume that is , . By Proposition 3.6, there exists a neighborhood of the origin (in ) and a topological trivialization
[TABLE]
such that is an approximation of the identity with . This shows that the variation of the secant line (in the projective space) tends to zero as goes to zero. ∎
The following proposition can be thought of as a generalisation of Pawłucki’s theorem [Pa], valid for subanalytic sets and without the criterion, which is a consequence of for subanalytic strata, by a theorem of Orro and Trotman [OT3].
Proposition 3.9**.**
Let and be two strata which are definable in an o-minimal structure. Assume that and that is connected for any small enough. Then, satisfies and if and only if is a manifold with boundary.
Proof.
and are invariants. Hence, the if part is clear. Assume that these conditions hold and let us show that is a manifold with boundary. We can identify with .
We first show that at any point , exists. As the Whitney condition implies the Whitney condition, we know that any limit of tangent space contains . By the Whitney condition, it also has to contain the limit of secant lines. Therefore, given a sequence tending to , (if it exists) is characterized by the limit in the projective space of (where is the orthogonal projection onto ).
Set . for , and . As is a definable set of dimension , we have:
[TABLE]
Moreover, if we set
[TABLE]
then, by the above inequality, Therefore, a generic fiber of the map defined by cannot have dimension bigger than [math].
By , is an open map. Hence, must be of dimension [math] as well. As it is connected (since is), it must be reduced to one single point. Hence, at any point of there is a unique limit of tangent space , as claimed.
The limiting secant being unique at every point of , it must vary continuously along . Consequently, varies continuously as well. As a matter of fact, for a generic projection, the stratum is the graph of a function whose derivative extends continuously. The couple thus constitutes a manifold with boundary near the origin (due to topological triviality it must satisfy the frontier condition). ∎
It follows that Theorem 3.8 admits the following corollaries.
Corollary 3.10**.**
Let and be two (connected) strata which are definable in an o-minimal structure. Assume that and that satisfies and . Then is a manifold with boundary.
Proof.
By Proposition 3.2, satisfies the Whitney condition. Moreover, by Theorem 3.8, is normally pseudo-flat. The result follows from the preceding proposition. ∎
Corollary 3.11**.**
Let and be two (connected) strata which are definable in a polynomially bounded o-minimal structure. Assume that and that satisfies . Then is a manifold with boundary.
Proof.
By the proof of [OT2] that implies in the subanalytic case, one may reduce to the case of -dimensional . But then holds, by Proposition 3.1. By Theorem 3.8, is normally pseudo-flat, because in the polynomially bounded case implies . The result follows from the preceding proposition. ∎
Corollary 3.11 is also a generalisation of Pawłucki’s theorem [Pa].
4. Pawłucki’s example.
In this section we study geometric properties of the closure of the graph in of the function
[TABLE]
and compare these with the geometric properties of the closure of the graph of a function previously studied by the first author and L. Wilson,
[TABLE]
The natural stratification with two strata of was shown by the first author and Wilson in [TW] to be a counterexample in o-minimal geometry to several statements known to be true for sub-analytic sets, for example that Kuo’s -regular stratified sets [K] are normally pseudo-flat (proved by Orro and the first author in [OT3]), and satisfy -regularity (proved by Navarro Aznar and the first author in [NT]).
The set was used in a 1985 paper by Pawłucki in [Pa] as a counterexample to a possible generalisation of his useful and striking theorem concerning sub-analytic stratified sets with a smooth singular locus of codimension : such a stratified set is Whitney -regular if and only if it is locally a finite union of manifolds with boundary (equal to the singular locus). For the natural two-strata stratification of , -regularity holds and the set is homeomorphic to a closed half-plane, however is not a manifold with boundary. We shall show here that the graph of is also a counterexample to the geometric statements proved for sub-analytic sets in [OT3], as well as having worse properties than the graph of . For example although the graph of is Whitney -regular over the -dimensional stratum , it does not satisfy Kuo’s ratio test , providing the first such example in -minimal geometry. Kuo [K] proved that no such example exists among semi-analytic stratified sets, and the same proof is valid for subanalytic stratified sets. In Proposition 3.1 below we give a proof for definable sets in any polynomially bounded o-minimal structure. Moreover we show that can be used to define the first example of a definable stratification in an o-minimal structure which is Whitney -regular but whose density (as defined by Kurdyka and Raby [KR], generalising the Lelong number [L]) is not continuous along strata.
Note that by Miller’s dichotomy [M] these examples exist in every o-minimal structure which is not polynomially bounded.
In denote by the graph of the function , for and and small, and denote by the graph of the function , for and and small. Denote the -axis by .
Remark 4.1*.*
, i.e. is an odd function of , while is obviously an even function of .
Remark 4.2*.*
, because
Proof. Obviously,
[TABLE]
If , then , so that
[TABLE]
By remark 1 we do not need to study the case of .
If both and tend to [math], consider the two cases :
(i) Then
[TABLE]
(ii) is bounded. Then
[TABLE]
Thus . Clearly so that also . ∎
Consider the closed stratified set with two strata , and the closed stratified set with two strata .
In [TW] the following five properties were shown to hold for stratified by .
(1) and fail for at ,
(2) Kuo’s ratio test holds for along ,
(3) Whitney’s condition holds for along ,
(4) and fail for along at ,
(5) the density of is constant, hence continuous, along .
Note that by (1) and (3), a general theorem of [OT1] stating that implies and , implies in turn that the Kuo-Verdier condition fails for at . Here refers to the weak Whitney condition introduced by Bekka and the first author (see [BT1] and [BT2]), which follows from (as its name suggests).
Note also that (1) and (3) show that provides another (complicated) counterexample to Pawłucki’s Theorem 0.1 above.
We shall prove the following five properties for stratified by .
(1) and fail for at ,
(2) Kuo’s ratio test fails for along at ,
(3) Whitney’s condition holds for along ,
(4) and fail for along at ,
(5) while the density of is constant along at , the density of the -dimensional stratified set defined by the convex hull of and the upper half plane is not continuous along at .
In particular Property 5 for shows that the theorems of Comte [C] and of the second author [Va1, Va2], proved for subanalytic sets, do not hold for general o-minimal structures. This is a surprise: it gives the first counterexample to continuity of the density along strata of Whitney regular stratified sets definable in some o-minimal structure. This answers negatively a question posed explicitly by the first author and L. Wilson on page 464 of [TW].
Property 1. * and fail for at . *
**Proof. **
We will show that the limits of secants from to as tends to are the straight lines which in the -plane have equations
However, for the secants from to as tends to [math], the limiting secant is . Hence fails (the tangent cone to does not equal the fibre at [math] of the normal cone). Moreover fails since for the fibre at of the normal cone is [math]-dimensional, while the fibre at [math] is -dimensional.
Proof of (1.1). First observe that, for all , the secant from to has slope
[TABLE]
Take and let tend to . The slope of the secant from to is
[TABLE]
which tends to [math] as tends to [math] and tends to .
By symmetry (Remark 1), when the limiting slope is also [math].
Now suppose tends to .
By symmetry (Remark 1 again) it will be enough to study the case and to show that all the values are realised. So we must show that the limits of take all values in as and tend to [math] when .
Let .
On the curve , i.e. , so in particular the limit as tends to is .
On the curve , with limit [math] as tends to [math].
This completes the proof of (1.1), and hence the proof of Property 1. ∎
Next we shall study Property 2, which is Kuo’s ratio test . We show that fails for at , the condition failing along flat curves of the form . That such an example exists is surprising, because we shall see below that Property 3 - Whitney’s condition - does hold, and this is enough to ensure in the subanalytic case along strata of dimension one, as was first shown in 1970 by Tzee-Char Kuo [K]. Along strata of higher dimension it is not the case that follows from -regularity as was illustrated by the semi-algebraic examples constructed by the first author during the Nordic Summer School at Oslo in August 1976 [T1]. Real algebraic examples were given in the first author’s 1977 Warwick thesis [T2] and can be found with other real algebraic examples in a joint paper by the first author with Brodersen [BrT]. The systematic calculations of -regularity by the first author in his 1977 thesis [T2], completed in [T3] and of -regularity in the 1996 thesis of Noirel [N] provide infinitely many real algebraic examples.
Property 2. * fails for the pair of strata at . *
Proof.
Recall that Kuo’s ratio test holds when
[TABLE]
as tends to on .
[TABLE]
Calculating, using ,
[TABLE]
which tends to zero as tends to [math], because tends to [math] as tends to [math], while is bounded above by 1 as and tend to [math]. Further,
[TABLE]
which is bounded between [math] and as and both tend to zero.
[TABLE]
[TABLE]
[TABLE]
We need to check whether this tends to zero as tends to [math].
If dominates , then because tends to zero as tends to zero, we can deduce that also goes to zero.
There remains the case where dominates to consider. In this case will be equivalent to . Because has values running from [math] to as and tend to zero, we need to study the function for . This takes the value [math] when , and also tends to [math] as tends to . However we can also choose and tending to [math] so that tends to a constant , . In particular one may find and tending to zero on the curve , i.e. . Such a curve is flat, tangent to the -axis, and the associated curve
lies on . The limit of restricted to such a curve is clearly equivalent to , so that the ratio test will fail to hold at for the pair . ∎
Note. Condition holds. As above, and we saw that tends to [math] as tends to [math], giving -regularity.
By the main theorem of [OT2], the condition (defined in [OT2]) must fail for at the origin, because holds, while and fail.
Property 3. * holds for at .*
Proof. We have just seen that holds. Thus we need only prove that holds.
By remark 1, we need only treat the case .
Suppose , and , for small.
To prove that Whitney holds at we must show that
[TABLE]
tends to zero as tends to .
Now
which is equivalent to , which tends to zero as and tend to [math].
This implies that holds, and hence that holds for on a neighborhood of in . ∎
Property 4. * and fail for at . *
Proof. We intersect with planes to obtain
[TABLE]
which becomes
[TABLE]
Hence , , and .
This curve in the -plane passes through if , since contains curves passing through . It follows that cannot be -regular, and then by definition is not -regular and fails. Note that holds for , as does , and thus holds. However fails because fails at . ∎
Property 5. While the density of is continuous along at , the density of the dimensional stratified set , defined by the convex hull of the union of with the upper half plane , is not continuous along at .
Proof. By the proof of Property 1, together with -regularity, we see that the pure tangent cone at each , where , is . The density of at such points is thus according to the definition and results of Kurdyka and Raby [KR], while the density of at such points on is [math].
The set of limiting secants to from the origin (defining the tangent cone to at ) is precisely , so that by the formula for the density of Kurdyka and Raby in terms of the pure tangent cone [KR], we see that the density at the origin of is , while the density at the origin of is (the area of the part of the sector between and inside the unit ball centred at the origin, divided by the area of the unit disk). It follows that the density of is constant along , and the density of along jumps at . ∎
Remark 4.3*.*
The natural stratification of by dimension is Whitney -regular, with one connected stratum of dimension , two strata of dimension - the graph of and the upper half-plane - and a single stratum of dimension , namely the -axis. Using the same technique as above to obtain a -dimensional stratified set equal to the convex hull of the union of and the upper half-plane , we find that its natural stratification by dimension has two strata of dimension , namely the -axis and the half-line , so forcing the origin to be a stratum. Hence the density of is continuous along strata.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[BT 1] K. Bekka and D. Trotman, Propriétés métriques de familles Φ Φ \Phi -radiales de sous-variétés différentiables , C. R. Acad. Sci. Paris, série I, t. 308 (1987), 389-392.
- 2[BT 2] K. Bekka and D. Trotman, Weakly Whitney stratified sets , Real and complex singularities (Proceedings, Sao Carlos 1998, edited by J.W. Bruce and F. Tari), Chapman and Hall/CRC (2000), 1-15.
- 3[Be] A. Bernig, Curvature bounds on subanalytic spaces , preprint, 2003.
- 4[Br T] H. Brodersen and D. Trotman, Whitney (b)-regularity is strictly weaker than Kuo’s ratio test for real algebraic stratifications , Math. Scand., 45 (1979), 27-34.
- 5[CK] P. Chossat and M. Koenig, Characterization of bifurcations for vector fields which are equivariant under the action of a compact Lie group , C. R. Acad. Sci. Paris, série I, t. 318 (1994), 31-36.
- 6[C] G. Comte, Equisingularité réelle : nombres de Lelong et images polaires , Ann. Sci. École Norm. Sup., Paris (4) 33 (2000), 757-788.
- 7[CM] G. Comte and M. Merle, Equisingularité réelle. II. Invariants locaux et conditions de régularité , Ann. Sci. École Norm. Sup., Paris (4) 41 (2008), 221-269.
- 8[DM] L. van den Dries and C. Miller, Geometric categories and o-minimal structures , Duke Math. Journal 84 (1996), 497-540.
