A note on the quasiconvex Jensen divergences and the quasiconvex Bregman divergences derived thereof
Frank Nielsen, Ga\"etan Hadjeres

TL;DR
This paper introduces and studies quasiconvex Jensen and Bregman divergences, proposing methods to address their pseudo-divergence issues and demonstrating their applications in probability density comparisons.
Contribution
It defines quasiconvex Jensen and Bregman divergences, proposes $ ext{delta}$-averaged versions to ensure proper divergence properties, and links these divergences to probability density comparisons.
Findings
Quasiconvex Jensen divergences are asymmetric distances.
$ ext{delta}$-averaged quasiconvex Bregman divergences are proper divergences.
These divergences relate to Kullback-Leibler divergences for nested distributions.
Abstract
We first introduce the class of strictly quasiconvex and strictly quasiconcave Jensen divergences which are oriented (asymmetric) distances, and study some of their properties. We then define the strictly quasiconvex Bregman divergences as the limit case of scaled and skewed quasiconvex Jensen divergences, and report a simple closed-form formula which shows that these divergences are only pseudo-divergences at countably many inflection points of the generators. To remedy this problem, we propose the -averaged quasiconvex Bregman divergences which integrate the pseudo-divergences over a small neighborhood in order obtain a proper divergence. The formula of -averaged quasiconvex Bregman divergences extend even to non-differentiable strictly quasiconvex generators. These quasiconvex Bregman divergences between distinct elements have the property to always have one…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStatistical Mechanics and Entropy · Mathematical Inequalities and Applications
