Optimal order Jackson type inequality for scaled Shepard approximation
Steven Senger, Xingping Sun, and Zongmin Wun

TL;DR
This paper introduces a modified Shepard approximation with a dilation factor, achieving optimal error estimates for continuous functions on convex domains and improving bounds on well-separated points in annuli.
Contribution
It presents a novel variation of Shepard approximation with an explicit optimal Jackson-type error bound and enhances existing bounds on point separation in annuli.
Findings
Established an optimal order Jackson type error estimate with explicit constant.
Improved bounds on the number of well-separated points in thin annuli.
Demonstrated applicability to bounded continuous functions on convex domains.
Abstract
We study a variation of the Shepard approximation scheme by introducing a dilation factor into the base function, which synchronizes with the Hausdorff distance between the data set and the domain. The novelty enables us to establish an optimal order Jackson \cite{jackson} type error estimate (with an explicit constant) for bounded continuous functions on any given convex domain. We also improve en route an upper bound estimate due to Narcowich and Ward for the numbers of well-separated points in thin annuli, which is of independent interest.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Numerical Methods in Computational Mathematics · Mathematical Approximation and Integration · Numerical Methods and Algorithms
Optimal order Jackson type inequality for scaled Shepard approximation
Steven Senger, Xingping Sun, and Zongmin Wu
Abstract
We study a variation of the Shepard [13] approximation scheme by introducing a dilation factor into the base function, which synchronizes with the Hausdorff distance between the data set and the domain. The novelty enables us to establish an optimal order Jackson [10] type error estimate (with an explicit constant) for bounded continuous functions on any given convex domain. We also improve en route an upper bound estimate due to Narcowich and Ward [12] for the numbers of well-separated points in thin annuli, which is of independent interest.
Key Words and Phrases: Hausdorff distance, Jackson type error estimate, quasi-interpolation operator, quasi-uniformity, rational formations, well-separateness.
AMS Subject Classification 2010: 41A17, 41A35, 41A36, 41A46.
1 Introduction
When dealing with real world problems with high degrees of complexity, scientists often observe that unknown target functions are imprecise and elusive, and that data acquired on them do not always reflect their true nature. This can be caused by a host of known and unknown reasons. To name just a few, one may encounter reading and interpreting errors, lost in translation, instrument failures or malfunctions. In the literature, this is often referred to as the “noisy data” phenomenon ([3]). Under these circumstances, models established by computationally-expensive algorithms often do not survive the test of cross validation and sometimes fail outright to reflect reality in ways they are designed for. Long and hard work devoted to the establishment of the models is quickly rendered worthless. To make meaningful decisions, one needs to use the best available data to build multiple models and test them against newly acquired data. The process is often repeated numerous times, as the so called “best available data” and model selection criteria may also subject to uncertainty of various degrees.
The challenging computing environment has ruled out the employability of most of the interpolation methods and many of the quasi-interpolation methods. An interpolation procedure entails solving a large linear system, which is often expensive and slow. In addition, interpolating “noisy data” is like playing a meaningless hide-and-seek game during which one seldom knows the boundary between “over-fitting” and “under-fitting”. Many quasi-interpolation schemes rely on elaborated mathematical procedures to find the values of the parameters, which is unpractical in reality.
Shepard [13] proposed in the following approximation scheme. Suppose function values are available at the scattered sites in a domain . Then a function of the form:
[TABLE]
is constructed to approximate the target function in . Here , and , in which denotes the Euclidean norm of . This procedure has since become known as “Shepard approximation”, and variations of it have been studied in [2], [4], [7], [14], [15], [16], [17], [18], and the references therein.
In a nutshell, a Shepard approximation scheme employs rational formations of shifts of an appropriately-selected base function to approximate a target function, and its efficiency epitomizes in the reproduction of constants. Because of the singularity of the base function at zero, the original Shepard approximant interpolates values of the target function at . That is, . However, for most other choices of base functions, the interpolation feature is lost, and the resulted approximants are called “quasi-interpolants” in the literature; see [4], [17], [18]. Except for the cases in which the base function is compactly supported (see [16], [17], [18]), deriving optimal order error estimates for a Shepard approximation scheme has been uncommon. In this paper, we study a new variation of Shepard approximation by introducing a dilation factor into the base function, which synchronizes with the Hausdorff distance between the data set and the domain. The novelty enables us to establish an optimal order Jackson [10] type error estimate (with an explicit constant) for bounded continuous functions. The proof requires decomposing the domain as the union of concentric thin annuli with no common interior. This is a standard technique in many branches of analysis. Notably, the technique has recently been applied by authors of [8] and [9] in bounding the -norms of interpolation operators and the least square operators associated with radial basis functions. The following question arises naturally: how many well-separated points can be put inside a specified annulus? For the special case in which the annuli have thickness and inner radius , where is the separation radius of the data set, Narcowich and Ward [12] gave the upper bound estimate: , where is the dimension of the ambient space. In our situation, however, the annuli have thickness precisely the Hausdorff distance between the data set and the domain, which is usually larger than the separation radius of the data set. Adapting their method in this setting has resulted in an unexpected large constant that has a fast-growing exponential rate with respect to the dimension. In order to refine this, we employ the Gauss hypergeometric functions, and engage in a more labor-intensive procedure to obtain a tighter estimate (Proposition 2.2). We also derive a new upper bound estimate for the above special case (Corollary 2.3). Besides their utility in this paper to obtain optimal order Jackson type error estimate, these upper bound estimates provide information on the minimal densities of packing spheres or spherical wedges in annuli of dimensional space. Therefore, their asymptotic behaviors with respect to both and need to be closely watched. The results of Proposition 2.2 and Corollary 2.3 show that in packing spheres or spherical wedges in annuli, both the size of the spheres (or spherical wedges) and that of the annuli are sensitive matters. This is in contrast to density results from conventional sphere packings in Euclidean spaces; see [6] and [5]. Details of the above discussion will be given in Section 2. The main result of the paper (Jackson type error estimate) and its proof will be given in Section 3. A focus of the current paper is to provide an readily-implementable and yet efficient approximation method. As such, we write the paper in a style catering to the needs of practitioners in the field. Among other efforts devoted to obtain the results, we derive all the constants explicitly in closed forms.
2 Numbers of well-separated points in thin annuli
To be savvy with using notations, we adopt the notations: (i) for the absolute value of a real number ; (ii) for the cardinality of a finite set ; (iii) the Euclidean distance between ; and (iv) for the Lebesgue measure of a bounded Lebesgue-measurable set . Readers can easily tell each individual meaning from the mathematical context therein. Let be a convex domain. Let be a sequence of discrete point sets. If there is a constant independent of , such that
[TABLE]
then we say that the points of are well-separated, or equivalently that the point set is well-separated. We will use to denote half of the above infimum. Let be the Hausdorff distance ([11]) between the two sets and . That is
[TABLE]
If is well-separated, and if in addition there is a constant, , independent of , such that
[TABLE]
then we say that is quasi-uniformly distributed in . In the literature, is often called the “fill-distance” of the set in the set , and the separation radius of the point set . It is obvious that . Thus, the two constants as in Inequalities (2.1) and (2.3) satisfy . In the current paper, we will reserve the two constants exclusively for the purposes as dictated in (2.1) and (2.3). An interesting example for such a set is the hexagonal lattice in with the generating matrix
[TABLE]
In this example, we have , and . If is bounded, then a quasi-uniformly distributed set is necessarily finite. In this case, the quasi-uniformity can be equivalently defined as follows. There exists a constant , depending only on , such that
[TABLE]
The above inequality is equivalent to that there are two constants , depending only on , such that
[TABLE]
We are interested in finding an upper bound for the number , where is an annulus of outer radius and thickness . Our basic approach in answering the above question is to use the pigeonhole principle. Let . Select any two points, and from . Let denotes the ball centered at and having radius . Notice that, as points from are -separated, the intersection has empty interior. Therefore, it is tempting to get an upper bound on the number of points in the annulus, , by packing spheres [6] of radius in . We would proceed by using the pigeonhole principle to get:
[TABLE]
where is a ball in of radius . However, independent of , it is possible for points of to lie on or close to the boundary of . These points do not enjoy a full measurement of volumes of their associated balls contributing to the calculation above based on the pigeonhole principle. This is illustrated in Figure 1.
To correct the estimate in (2.4), we need to estimate the minimal possible volume of the intersection (with the annulus) of a small ball whose center lies in the annulus. The correct version of (2.4) is therefore the following:
[TABLE]
where is the minimal intersection of any ball of radius centered at a point in the annulus, or
[TABLE]
We are therefore packing spherical wedges of two different sizes in a specified annulus. We illustrate the situation for the case in Figure 2. A simple convexity argument shows that the above minimum is attained by a ball centered at a point on the outer boundary of . It stands to reason that finding a tight lower bound for the quantity has become the center piece of the puzzle.
To this goal, we will utilize the Gauss hyper-geometric function defined by
[TABLE]
where is the (rising) Pochhammer symbol, which is defined by:
[TABLE]
We will need Euler’s integral representation formula for hyper-geometric function; see [1]:
[TABLE]
While there is a wealth of literature devoted to hyper-geometric functions, we refer readers to [1] for a proof of the above Euler’s integral representation formula for hyper-geometric function.
Proposition 2.1**.**
The volume of intersection of a -dimensional ball of radius and a smaller -dimensional ball of radius centered at a point in the larger ball is at least
[TABLE]
where
Proof: First, recall the following formula for the volume of a -dimensional ball of radius , which we denote , is:
[TABLE]
We center the small ball (with radius ) at the origin, and the big ball (with radius ) at the point , which gives rise to a situation where minimal intersection occurs. We denote the intersection of the two balls by , and write down:
[TABLE]
in which . We have illustrated the cases , respectively, in Figures 2 and 3. To calculate we write
[TABLE]
We now use the Gauss hyper-geometric function to evaluate the integral on the right hand side of the above equation. First we write
[TABLE]
We then use the substitution
[TABLE]
to reduce the integral. We have
[TABLE]
We use Euler’s integral representation (Eq. (2)) for the hypergeometric function to write
[TABLE]
Combining Equations (2.10), (2), and (2.12), we have
[TABLE]
Similarly, we can find a closed formula for in terms of the Gauss hyper-geometric function. However, the following crude estimate shows that
[TABLE]
Since we are mostly concerned with relatively large values of in comparison to , we drop from contention to derive the desired estimate. ∎
Suppose that we are given a collection of concentric annuli with the same thickness . Without loss of generality we assume that the center of these annuli is at the origin. We enumerate them from inside out: (The first one is a ball centered at and having radius ). For each fixed , has outer radius . It follows that the volume of is,
[TABLE]
Proposition 2.2**.**
Let be a discrete subset of consisting of well-separated points that satisfy (2.1). Then the following inequality holds true:
[TABLE]
where
[TABLE]
We select this format (as in the above estimate) to facilitate the telescoping technique as in the proof of Theorem 3.3.
Proof: Setting
[TABLE]
and using Equations (2.5), (2.14), and the result of Proposition 2.1, we have
[TABLE]
Here we have
[TABLE]
which satisfy the inequalities
[TABLE]
To develop a more accessible upper bound for the constant on the right hand side of Inequality (2), we use the inequality on the left hand side of Inequality (2.16) to write
[TABLE]
Furthermore, we denote
[TABLE]
and use Equation (2) to write
[TABLE]
Here we have used the following two formulas on Beta functions:
[TABLE]
Substituting Inequalities (2.17) and (2) into the right hand side of Inequality (2), and using the following formula
[TABLE]
to reduce the expression involving the Gamma-function values, we obtain
[TABLE]
This is the desired estimate. ∎
In the remainder of this section, we discuss the special case in which an annulus has thickness and outer radius . This case was studied by Narcowich and Ward [12] as early as in 1991. Let be a discrete subset of with separation radius . That is
[TABLE]
We have the following tighter estimate, which shows that for sufficiently large , the exponential growth (with respect to the dimension ) of the constant can be mitigated.
Corollary 2.3**.**
Let be a discrete subset of with separation radius . Let be an annulus with thickness and inner radius . Then the following inequality holds true:
[TABLE]
Proof: The proof is similar to that of Proposition 2.2. In the process, however, some parameters must be adjusted, and pertinent inequalities tightened. Using the same argument leading to Inequality (2.5), we have
[TABLE]
where is the minimal intersection of any ball of radius centered at a point in the annulus . Gong through a similar process as in the proof of Proposition 2.1, which entails replacing by and by , and consequently in Proposition 2.1 being here, we have
[TABLE]
It follows from Inequalities (2.20) and (2.21) that
[TABLE]
As in the last part of the proof of Proposition 2.2, we show that
[TABLE]
We estimate the remaining pieces involving on the right hand of Inequality (2.22) as follows.
[TABLE]
[TABLE]
Substituting inequalities (2.23), (2.24), and (2.25) into the right hand side of Inequality (2.22), we get the desired estimate. ∎
3 Optimal order Jackson type error estimate
We are interested in the class of functions that satisfy the following conditions:
(i) is continuous on .
(ii) .
(iii) For a fixed , there holds , where is a constant independent of .
When the scaling factor is introduced, the decay condition in (iii) can be equivalently written as the following:
[TABLE]
This is the form we will be using the most often throughout this paper. Suppose that values of a function are available at every point of a discrete set . Assume that is quasi-uniformly distributed, and satisfy Inequalities (2.1) and (2.3). We study the operator on :
[TABLE]
where , and . We employ the “rational formation”:
[TABLE]
to approximate a bounded and continuous function on , and derive an optimal order Jackson type error estimate (Theorem 3.3) with an explicit constant. (We refer readers to the historically-important result of Jackson [10].) The construction of approximants here is reminiscent of the original Shepard approximation. The new contribution here is the incorporation of the scaling factor , which is crucial for the optimality of the approximation order. The feasibility of this approximation scheme depends on the condition: , which we will address in Lemma 3.2. It is worth noting that the above rational formations of shifts of the basis function give rise to a linear operator on . In the literature, these are called “quasi-interpolation operators.”
Let be a convex domain. Let denote the normed linear space consisting of bounded and continuous functions on . Here the norm of is defined by
[TABLE]
Proposition 3.1**.**
Assume that the points in are quasi-uniformly distributed satisfying Inequalities (2.1) and (2.3), and that for . Then the operator sequence is uniformly bounded on . More precisely, we have
[TABLE]
where and is a constant depending only on and . The explicit expression of is given in Proposition 2.2.
Proof: It suffices to show that
[TABLE]
Fix an . For , let , which are concentric annuli centered at and having thickness . Denote . For each fixed , we have
[TABLE]
which induces a decomposition of ,
[TABLE]
We use the decay condition in Inequality (3.1) to write
[TABLE]
Making use of the upper bound estimate for ( Proposition 2.2), we have
[TABLE]
It is easy to see that is an upper bound for the expression inside the parenthesis above. Since is arbitrarily chosen, the proof is complete. ∎
Lemma 3.2**.**
Let be a convex domain in . Suppose is quasi-uniformly distributed in satisfying Inequalities (2.1) and (2.3), and that . Then we have
[TABLE]
Proof: Recall that . Since , the Hausdorff distance between the two sets and , is less than or equal to , for any fixed , there is at least one such that . It follows that
[TABLE]
The proof is complete. ∎
Let . We consider approximating by the function :
[TABLE]
The function is constructed using a rational formation of shifts of the base function .
To gauge the order of approximation, we make use of the modulus of continuity of which is a function from to , defined by:
[TABLE]
The function satisfies the following property often referred to as “sub-additivity”:
[TABLE]
We have the following Jackson-type approximation error estimate.
Theorem 3.3**.**
Let be a convex subset of . Suppose that is quasi-uniformly distributed in satisfying Inequalities (2.1) and (2.3), and that for . Then, for every , we have
[TABLE]
in which
[TABLE]
Proof: For a given , we write
[TABLE]
Fix an . Let be as defined in the proof of Proposition 3.1. Fix a , join and by a straight line segment, on which we take points , and let and so that . By the sub-additivity property of , we have
[TABLE]
By Proposition 2.2, Inequalities (3.1), (3.5), we have
[TABLE]
It is easy to see that is an upper bound for the expression inside the curly braces above. Since the above estimate is true for an arbitrary , the desired result follows. ∎
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] G. E. Andrews, R. Askey, and R. Roy, Special Functions, Encyclopedia of Mathematics and its Applications (No. 71), Cambridge University Press, 1999.
- 2[2] B. Bede, E. D. Schwab, H. Nobuhara, and I. J. Rudas, Approximation by Shepard type pseudo-linear operators and applications to Image Processing, International Journal of Approximate Reasoning 50(1) (2009), 21 - 36.
- 3[3] S. Beheshti, and M.A. Dahleh, Noisy Data and Impulse Response Estimation, IEEE Transactions on Signal Processing 58 (2010), no. 2, 510 - 521.
- 4[4] Z. Chen and F. Cao, Spherical scattered data quasi-interpolation by Gaussian radial basis function, Chin. Ann. Math. Ser. B 36 (2015), no. 3, 401 - 412.
- 5[5] H. Cohn and N. Elkies, New upper bounds on sphere packings I, Ann. Math. 157 (2003), 689 - 714.
- 6[6] J. H. Conway and N. J. A. Sloane, Sphere Packings, Lattices and Groups, 2nd ed., Springer-Verlag, New York, 1993.
- 7[7] F. A. Costabile, F. Dell’Accio, and F. D. Tommaso, Enhancing the approximation order of local Shepard operators by Hermite polynomials, Computers & Mathematics with Applications 64 (11) (2012), 3641 - 3655.
- 8[8] T. Hangelbroek, F.J. Narcowich, and J. D. Ward, Kernel approximation on manifolds I: bounding the Lebesgue constant, SIAM J. Math. Anal. 42 (2010), 1732 - 1760.
