Minimax density estimation for growing dimension
Daniel J. McDonald

TL;DR
This paper investigates the limits of density estimation as data dimension increases with sample size, establishing minimax rates and demonstrating that kernel estimators can achieve these bounds.
Contribution
It provides the first non-asymptotic minimax lower bounds for high-dimensional density estimation with growing dimension and shows kernel estimators attain these optimal rates.
Findings
Established non-asymptotic minimax lower bounds for growing dimension
Kernel density estimators achieve the minimax rates
Derived the maximum growth rate of dimension for consistent estimation
Abstract
This paper presents minimax rates for density estimation when the data dimension is allowed to grow with the number of observations rather than remaining fixed as in previous analyses. We prove a non-asymptotic lower bound which gives the worst-case rate over standard classes of smooth densities, and we show that kernel density estimators achieve this rate. We also give oracle choices for the bandwidth and derive the fastest rate can grow with to maintain estimation consistency.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStatistical Methods and Inference · Markov Chains and Monte Carlo Methods · Bayesian Methods and Mixture Models
