A Formulation of R\'enyi Entropy on $C^*$-Algebras
Farrukh Mukhamedov, Kyouhei Ohmura, Noboru Watanabe

TL;DR
This paper extends the concept of Renyi entropy to $C^*$-algebras using Ohya's $\\mathcal{S}$-mixing entropy, establishing inequalities for state uncertainties in different systems.
Contribution
It introduces a formulation of Renyi entropy on $C^*$-algebras based on $\\mathcal{S}$-mixing entropy, advancing the mathematical framework of quantum information theory.
Findings
Established inequalities for uncertainties of states in various reference systems.
Extended Renyi entropy formulation to $C^*$-algebras.
Provided mathematical tools for analyzing quantum state uncertainties.
Abstract
The entropy of probability distribution defined by Shannon has several extensions. R\'enyi entropy is one of the general extensions of Shannon entropy and is widely used in engineering, physics, and so on. On the other hand, the quantum analogue of Shannon entropy is von Neumann entropy. Furthermore, the formulation of this entropy was extended to on -algebras by Ohya (-mixing entropy). In this paper, we formulate Renyi entropy on -algebras based on -mixing entropy and prove several inequalities for the uncertainties of states in various reference systems.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
A Formulation of Rényi Entropy on -Algebras
Farrukh Mukhamedov
Department of Mathematical Sciences,
United Arab Emirates University,
15551 Al-Ain, United Arab Emirates
E-mail: [email protected], [email protected]
Kyouhei Ohmura
Department of Information Sciences,
Tokyo University of Science,
Noda City, Chiba 278-8510, Japan
E-mail: [email protected], [email protected]
Noboru Watanabe
Department of Information Sciences,
Tokyo University of Science,
Noda City, Chiba 278-8510, Japan
E-mail: [email protected]
Abstract
The entropy of probability distribution defined by Shannon has several extensions. Rényi entropy is one of the general extensions of Shannon entropy and is widely used in engineering, physics, and so on. On the other hand, the quantum analogue of Shannon entropy is von Neumann entropy. Furthermore, the formulation of this entropy was extended to on -algebras by Ohya (-mixing entropy). In this paper, we formulate Renyi entropy on -algebras based on -mixing entropy and prove several inequalities for the uncertainties of states in various reference systems.
Keywords: Quantum Information Theory; Quantum Entropy; -mixing entropy; Rényi Entropy; Quantum Statistical Mechanics; Operator Algebras.
Contents
1 Introduction
Shannon introduced the entropy as the information amount of information systems represented by probability spaces [13]. Rényi defined a general extension of Shannon entropy on probability spaces which is called Rényi entropy [11]. Rényi entropy is more general than Shannon entropy in the sense of a positive number , and it corresponds to Shannon entropy when . This entropy is useful and widely used in physics, engineering, and so on [3], [4].
On the other hand, von Neumann entropy measures the complexity (or the information amount) of a quantum system [15]. In 1984, Ohya formulated the general extension of von Neumann entropy which is called -mixing entropy on -algebras [6],[7], [8], [16]. -mixing entropy depends on choosing subset (reference system) of the set of all states on the -algebra. Thanks to the property, one can measures the uncertainty of the state depending on reference systems. Mukhamedov and Watanabe formulated an extension of -mixing entropy by taking the set of all quantum channels as the reference system. Moreover, they showed that the entropy can apply to detect entangled states and calculated the complexities of qubit and phase-damping channels [5].
In this paper, we formulate Rényi entropy on -algebras based on -mixing entropy and show that the introduced entropy corresponds to -mixing entropy when . Furthermore, we prove that our Rényi entropy is a general extension of quantum Rényi entropy [9], [14] if . Moreover, by using our Rényi entropy, we investigate the uncertainties of states measured from various reference systems.
We organize the paper as follows: In Section 2, we recall the notations and some properties of the Rényi entropy on probability spaces. Furthermore, we review the decomposition theory of states on -algebras and the definition of -mixing entropy. In Section 3, we formulate Rényi entropy on -algebras based on the definition of -mixing entropy and show several properties of it. Furthermore, by using the introduced entropy, we prove the equalities or inequalities of the complexities of states measured from different reference systems.
2 Preliminaries
In this section, we review the definitions of Rényi entropy and -mixing entropy, and those several properties.
2.1 Rényi Entropy
In this chapter, denotes the logarithm of base .
Definition 1
Let be the probability distribution of a random variable . The Rényi entropy is defined by
[TABLE]
This entropy corresponds to the Shannon entropy when . Namely, the following theorem holds.
Theorem 1
Under the above assumptioms,
[TABLE]
is satisfied.
Furthermore, Rényi entropy has the additivity.
Theorem 2
If and are independent random variables,
[TABLE]
Moreover, since
[TABLE]
one can see that this entropy is a decreasing function with respect to the parameter .
Rényi entropy has important roles for the coding theory. For instance, the following theorem exists for the entropy [2], [9].
Let be a finite alphabet set and be a rondam variable of . Let be a source code, that is, a map from to the set of finite-length strings of symbols of a binary alphabet. Then denotes the codeword of and denotes the length of . Now we define the cost of the coding:
[TABLE]
where is the pbability of and .
Theorem 3
Let . For a uniquely decodable code, the following inequality holds:
[TABLE]
Furthermore, there exists a uniquely decodable code satisfying
[TABLE]
2.2 Decomposition Theory
A quantum state can be decomposed into simpler components. In this section, we recall the mathematical theory on the decompositions of states [1], [14] that we need as follows.
Let be a -dynamical system, that is, is a -algebra, is the set of all states on , and is the set of all *-automorphisms on associated with a group . The triplet describes the dynamics of a quantum system [14].
Moreover, let be the set of all -invariant states (i.e. ), and be the set of all states satisfying KMS condition with respect to ().
Definition 2
The decomposition from an -invariant state into extremal -invariant states is called ergodic decomposition.
Since and are weak*-compact and convex subset of , we deal with the case where spaces have such conditions.
Let be a compact and convex subspace of a locally convex Hausdorff space. Moreover, let be the set of all extreme points of . According to the Krein-Mil’man theorem [10], and the weak*-closure of convex hull of equals to , i.e. .
Definition 3
The decomposition from into is called extremal decomposition.
Let be the set of all normal Borel measures on . Furthermore, define
[TABLE]
Definition 4
For any ,
[TABLE]
is called the barycenter of .
Moreover, let be the set of all real continuous functions on and
[TABLE]
For two measures , define “” as follows :
[TABLE]
Then gives an ordering on . Let us denote as the set of all maximal elements with respect to the ordering.
Furthermore, we recall the following theorems.
Theorem 4
If is a metricable compact convex set ;
* is a set.* 2. 2.
* iff .* 3. 3.
For any , there exist such that .
Theorem 5
If is a compact convex set ;
Any has as their pseudo-support (i.e. for any Bair sets such that , ). 2. 2.
For any , there exist which satisfy (1) such that .
Moreover, we have the following theorem for uniqueness of maximal measure .
Let be a locally convex Hausdorff space, be a compact convex subset of , and be a convex cone whose vortex is 0. Furthermore, let be the base of , i.e.
[TABLE]
Then is the convex cone generated by . Defining
[TABLE]
then gives an ordering on .
Definition 5
If is the lattice with respect to the above , is called Choquet simplex.
Theorem 6
If is compact convex, the following are equivalent:
* is a Choquet simplex.* 2. 2.
For any , there exists a unique maximal probability measure .
Let be the set of all which is its barycenter equals to the state on the -algebra, i.e.
[TABLE]
For satisfying (8), one obtains the integral representation of :
[TABLE]
It is called the barycentric decomposition of . According to Theorem 6, this dcomposition is not unique unless is a Choquet simplex.
Furthermore, we review the orthogonality of states. Let be the GNS representation defined by . For , set . Then the following are euivalent:
Let . If and , . 2. 2.
There exists a projection such that
[TABLE] 3. 3.
, , .
Definition 6
The states , satisfying the above conditions are called mutually orthogonal and denoted by .
Definition 7
For any Borel sets (i.e. ), satisfying
[TABLE]
is called orthogonal measure on .
We define as the set of all orthogonal probability measures whose barycenters are .
2.3 -Mixing Entropy
If has countable supports, that is, (9) can be written as
[TABLE]
where ; and , we denote the set of all such measures as .
Definition 8
Under the above assumptions, the entropy of is given by
[TABLE]
The above entropy is called -mixing entropy. Since one can regard that the complexity of the system is if has uncountable states, Ohya defined .
depends on the set chosen, thus it represents the amount of complexity of the state measured from the reference system . That is, this entropy takes measuring the uncertainty of states from various reference systems into account.
Furthermore, if is faithful normal and , this entropy corresponds to von Neumann entropy [6], [14].
By the way, since one can regard that the complexities of real physical systems are finite, we denote the subset of as
[TABLE]
Since , the following proposition holds.
Proposition 1
[TABLE]
3 Rényi Entropy on -Algebras
In this section, we define Rényi entropy on -algebras based on -mixing entropy and show that the introduced entropy includes -mixing entropy and quantum Rényi entropy as the special cases. Furthermore, by using our Rényi entropy, we investigate the uncertainty of states in different reference systems.
Definition 9
Under the same assumptions and notations with Definition 8, we define:
[TABLE]
where the infimum is taken over all . Moreover, if , .
We call (13) -mixing Rényi entropy.
From the analogue of classical case, one can see the following theorem:
Theorem 7
* is monotone decreasing with respect to the parameter .*
Furthermore, in analogy with the classical case, we have the following theorem.
Theorem 8
For any ,
[TABLE]
holds.
**Proof **
According to the classical case, for ,
[TABLE]
holds. We shall denote , . Then we have
[TABLE]
[TABLE]
[TABLE]
Due to (15), the right hand sides of (16) and (17) go to [math] when . Therefore we obtain the theorem.
Now we prove that our -mixing Rényi entropy includes the density case [9], [14]. Let be the set of all trace class operators on a Hilbert space , and .
Definition 10
For any and any , the quantum Rényi entropy is defined by
[TABLE]
Lemma 1
Let be the decomposition into pure states (i.e. ). For any ,
[TABLE]
holds. If , one obtains the equality.
**Proof **
Let be the Schatten decomposition [12] of . Then for any ,
[TABLE]
is satisfied [14]. Therefore we have (). Moreover, according to the monotonicity of ,
[TABLE]
Since (resp. ), there exists the limit : (resp. ). Thus we have
[TABLE]
*This gives the inequality (19).
Moreover, if , becomes the Schatten decomposition of . Thus . Therefore*
[TABLE]
Using this lemma, we prove the following theorem.
Theorem 9
Let be a -algebra. If a state can be written as ,
[TABLE]
where is the set of all states on .
**Proof **
Let be the decomposition into pure states (i.e. ). Denoting
[TABLE]
then is the extremal decomposition. Furthermore, if , is a pure state (i.e. ). Therefore according to Lemma 1,
[TABLE]
holds.
Therefore, if , -mixing Rényi entropy includes the quantum Rényi entropy as the special case. If , the following inequality holds.
Theorem 10
Under the above settings, for any ,
[TABLE]
**Proof **
If , there holds
[TABLE]
This result induces the inequality (21).
3.1 Density Case
Since -mixing Rényi entropy depends on , we can consider the complexity of the state measured from the reference system . In this chapter, we study the complexities of density operators by taking different reference systems.
Let be the set of all compact operators on . Then is a -algebra. Now let be the set of all 1-parameter strongly continuous automorphisms on and let
[TABLE]
where is a unitary operator on .
Furthermore, when , we simply denote by .
Theorem 11
If is faithful and -invariant, and if eigenvalues of are non-degenerate,
[TABLE]
holds.
**Proof **
*Since , for any and unitaries , holds. Moreover, if is faithful, is satisfied. Furthermore, since the eigenvalues of are non-degenerate, we can put where are any eigenvectors of .
Therefore, for any and any ,*
[TABLE]
holds. Hence . Thus we obtain the following inequality:
[TABLE]
Next, we show the opposite inequality. Let be the ergodic decomposition (i.e. ), and be a density adjusted . Then is a pure state. Therefore . Hence
[TABLE]
Theorem 12
If , .
**Proof **
Let be a Hamiltonian of a physical system, and ( ; the Boltzmann constant, ; the temperature). Denote
[TABLE]
and
[TABLE]
Then is a unique KMS state for and (). Therefore, if , from uniqueness of a state,
[TABLE]
3.2 General Case
In this section, we study the complexities of general states by taking different .
Theorem 13
For any KMS states , the following inequalities hold:
. 2. 2.
.
**Proof **
1. The decomposition from into is unique [1]. We put the decomposition . Then holds. On the other hand, since , can be decomposed into the elements of , that is, ergodic states. Let () be the ergodic decomposition. Because of the uniqueness of the decomposition into , we can regard as the constant. Furthermore, holds. Therefore we have
[TABLE]
*By taking the infimum over all , we obtain .
2. Since , we obtain the inequality in the same way as 1.
Moreover, in order to investigate the inequality between and , we need -commutativity of . Thus, we recall the definition.
Let be the -representation defined by and be the strongly continuous unitary group on .
Definition 11
Let be a projection from to the set of -invariant vectors. If is a commutative von Neumann algebra, is called G-commutative for .
Furthermore, we mention the following theorem.
Theorem 14
For , the following are satisfied:
There exists whose pseudo-support is . 2. 2.
If is -commutative, is a Choquet simplex. Therefore, then the above is a unique maximal measure.
Now we prove the following inequalities.
Theorem 15
If is -commutative for ,
[TABLE]
**Proof **
According to Theorem 14, the ergodic decomposition of is unique. Hence the first inequality is satisfied. The second one holds from Theorem 13.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] O. Bratteli, D. W. Robinson : Operator Algebras and Quantum Statistical Mechanics I, Springer, New York (1981).
- 2[2] L. L. Campbell : A coding theorem and Rényi entropy, Information and Control, 8 , 429-523 (1965).
- 3[3] M. S. Hughes, J. N. Marsh, J. M. Arbeit, R. G. Neumann, R. W. Fuhrhop, K. D. Wallace, L. Thomas, J. Smith, K. Agyem, G. M. Lanza, S. A. Wickline, and J. E. Mc Carthy : Application of Renyi entropy for ultrasonic molecular imaging, J. Acoust. Soc. Am., 125 (5), 3141-3145 (2007).
- 4[4] Y. Kusaki, T. Takayanagi : Renyi entropy for local quenches in 2D CFT from numerical conformal blocks, J. High Energy Physics, 01 (2018) 115.
- 5[5] F. Mukhamedov, N. Watanabe : On S 𝑆 S -mixing entropy of quantum channels, Quantum Inf. Process, 17 , 148-168 (2018).
- 6[6] M. Ohya : Entropy transmission in C ∗ superscript 𝐶 C^{*} -dynamical systems, J. Math. Anal. Appl. 100 , 222-235 (1984).
- 7[7] M. Ohya, D. Petz : Quantum Entropy and its Use, Springer, Berlin (1993).
- 8[8] M. Ohya, N. Watanabe : Foundation of Quantum Communication Theory, Makino Pub. Co., Tokyo (1998).
