Extending Mercer's expansion to indefinite and asymmetric kernels
Sungwoo Jeong, Alex Townsend

TL;DR
This paper extends Mercer's expansion to continuous, indefinite, and asymmetric kernels, providing theoretical foundations, convergence conditions, and an algorithm for practical computation.
Contribution
It offers a rigorous extension of Mercer's theorem to a broader class of kernels, including indefinite and asymmetric ones, with convergence analysis and computational methods.
Findings
Mercer's expansion may not be pointwise convergent for indefinite kernels
Under bounded variation, the expansion converges almost everywhere and unconditionally
An algorithm for computing Mercer's expansion for general kernels is proposed
Abstract
Mercer's expansion and Mercer's theorem are cornerstone results in kernel theory. While the classical Mercer's theorem only considers continuous symmetric positive definite kernels, analogous expansions are effective in practice for indefinite and asymmetric kernels. In this paper we extend Mercer's expansion to continuous kernels, providing a rigorous theoretical underpinning for indefinite and asymmetric kernels. We begin by demonstrating that Mercer's expansion may not be pointwise convergent for continuous indefinite kernels, before proving that the expansion of continuous kernels with bounded variation uniformly in each variable separably converges pointwise almost everywhere, almost uniformly, and unconditionally almost everywhere. We also describe an algorithm for computing Mercer's expansion for general kernels and give new decay bounds on its terms.
Peer Reviews
Decision·ICLR 2025 Poster
1. The theoretical analysis in this paper is comprehensive and rigorous. 2. The paper establishes a theoretical foundation for Mercer’s expansion applied to non-regular kernels, such as indefinite and asymmetric kernels, potentially offering fundamental tools for future research in the theory of kernel-based method. 3. A sufficient condition of uniformly bounded variation is proposed to ensure the validity of Mercer’s expansion.
The parameter $\alpha$ first appears in Theorem 2 (maybe I missed something) before it is introduced (in Line 303). I suggest the authors make the writing more self-contained.
The authors claim to have established some fundamental results for ``Mercer's decomposition'' for indefinite, asymmetric kernels. The following points seem novel to me: 1. It is generally expected that ``Mercer's decomposition'' does not behave well when the kernel \( K \) is not positive definite and asymmetric. The authors provide several examples of this behavior: - 1. It does not converge pointwise. - 2. It converges pointwise but not absolutely. - 3. It converges pointwise but no
The concern regarding the mathematical novelty of this paper is that most of the results in this manuscript are anticipated. Since it is not fair to judge an ICLR paper solely based on its mathematical novelty, it would be beneficial if the authors could explore the necessity of studying Mercer's decomposition for indefinite, asymmetric kernels more thoroughly. 1.Could the authors discuss why the utilization of asymmetric kernels is necessary in data analysis? 2.Could the authors provide examp
The paper is written in a rigorous manner where the proof of the main theorem is stated clearly in the appendix. Also, the authors explain the importance of this paper as filling the gap in the literature on general asymmetric and non-positive definite kernels.
However, the contribution of the paper seems limited. The kernel needs to be defined on two (different) intervals in the theorem, which is too simple for practical implications. And the proof of the main theorem is more or less the result from Rademacher–Menchov Theorem and Hölder inequality. I think that the authors could have extended the proof to kernels with high-dimensional compact input spaces, or explain why it is difficult to perform such an extension.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural Networks and Applications
