Adaptive Geometric Regression for High-Dimensional Structured Data

TL;DR

This paper introduces a geometric regression framework for high-dimensional structured data that leverages intrinsic geometry through iterative heat diffusion and response coherence to improve estimation accuracy.

Contribution

It proposes a novel geometric approach that shifts analysis from ambient space to intrinsic data structures, enhancing regression in high-dimensional low-intrinsic-dimension datasets.

Findings

Effective in microbiome data analysis

Improves regression accuracy by respecting intrinsic geometry

Handles complex high-dimensional structured data

Abstract

We present a geometric framework for regression on structured high-dimensional data that shifts the analysis from the ambient space to a geometric object capturing the data's intrinsic structure. The method addresses a fundamental challenge in analyzing datasets with high ambient dimension but low intrinsic dimension, such as microbiome compositions, where traditional approaches fail to capture the underlying geometric structure. Starting from a k-nearest neighbor covering of the feature space, the geometry evolves iteratively through heat diffusion and response-coherence modulation, concentrating mass within regions where the response varies smoothly while creating diffusion barriers where the response changes rapidly. This iterative refinement produces conditional expectation estimates that respect both the intrinsic geometry of the feature space and the structure of the response.