A note on bounded entropies
Pierre-Olivier Amblard, Christophe Vignat

TL;DR
This paper explores the relationship between non-additive and bounded entropies through an axiomatic group-based approach, revealing connections to Re9nyi and Tsallis entropies and linking to deformed logarithms.
Contribution
It introduces a novel axiomatic framework for bounded entropies based on group theory, unifying various entropy types including Re9nyi, Shannon, and Tsallis.
Findings
Identifies nonlinear transforms of Re9nyi entropies as additive entropies in a group context.
Shows Tsallis-Havrda-Charvat entropy fits within the proposed entropy family.
Establishes a connection between the developed approach and deformed logarithm theory.
Abstract
The aim of the paper is to study the link between non additivity of some entropies and their boundedness. We propose an axiomatic construction of the entropy relying on the fact that entropy belongs to a group isomorphic to the usual additive group. This allows to show that the entropies that are additive with respect to the addition of the group for independent random variables are nonlinear transforms of the R\'enyi entropies, including the particular case of the Shannon entropy. As a particular example, we study as a group a bounded interval in which the addition is a generalization of the addition of velocities in special relativity. We show that Tsallis-Havrda-Charvat entropy is included in the family of entropies we define. Finally, a link is made between the approach developed in the paper and the theory of deformed logarithms.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
