Variational representations related to Tsallis relative entropy
Guanghua Shi, Frank Hansen

TL;DR
This paper develops variational representations for deformed logarithmic and exponential functions, extending quantum Tsallis relative entropy and trace inequalities to new deformation parameter ranges, enriching the mathematical framework of quantum information theory.
Contribution
It introduces new variational representations for deformed functions and extends the Golden-Thompson inequality to additional parameter ranges, broadening theoretical tools in quantum information.
Findings
Extended Golden-Thompson inequality to q in [0,1]
Provided variational representations for Tsallis relative entropy
Enhanced mathematical understanding of deformed exponential functions
Abstract
We develop variational representations for the deformed logarithmic and exponential functions and use them to obtain variational representations related to the quantum Tsallis relative entropy. We extend Golden-Thompson's trace inequality to deformed exponentials with deformation parameter thus complementing the second author's previous study of the cases with deformation parameter or
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Variational representations related to Tsallis relative entropy
Guanghua Shi
School of Mathematical Sciences, Yangzhou University, Yangzhou, Jiangsu, China. [email protected]
Frank Hansen
Institute for Excellence in Higher Education, Tohoku University, Sendai, Japan. [email protected]
Abstract
We develop variational representations for the deformed logarithmic and exponential functions and use them to obtain variational representations related to the quantum Tsallis relative entropy. We extend Golden-Thompson’s trace inequality to deformed exponentials with deformation parameter thus complementing the second author’s previous study of the cases with deformation parameter or
MSC2010: 94A17; 81P45; 47A63; 52A41.
Keywords: Gibbs variational priciple; Golden-Thompson inequality; Lieb’s concavity theorem; Tsallis relative entropy; variational representations.
1 Introduction
The well-known concavity theorem by Lieb [9, Theorem 6] states that the map
[TABLE]
for a fixed self-adjoint matrix is concave in positive definite matrices. This theorem is the basis for the proof of strong subadditivity of the quantum mechanical entropy [10], and it is also very important in random matrix theory [12].
Lieb’s concavity theorem is also closely related to the Golden-Thompson trace inequality. Recently, the second author [5, Theorem 3.1] proved concavity of the trace function
[TABLE]
in positive definite matrices, if is a contraction. This result led to multivariate generalisations of the Golden-Thompson trace inequality. Likewise, the second author [6, Theorem 3.1] studied convexity/concavity properties of the trace function
[TABLE]
for where denotes the deformed exponential function, respectively denotes the deformed logarithmic function, for the deformation parameter This analysis led to a generalization of Golden-Thompson trace inequality for -exponentials with
There is furthermore a close relationship between Lieb’s concavity theorem (1.1) and entropies. In [11], Tropp formulated a variational representation
[TABLE]
where denotes the quantum relative entropy. This variational representation, together with convexity of the quantum relative entropy, enabled Tropp to give an elementary proof of Lieb’s concavity theorem [9, Theorem 6]. Tropp’s variational representation can easily be inverted to obtain a variational representation
[TABLE]
of the quantum relative entropy. The well-known Gibbs variational principle for the quantum entropy states that
[TABLE]
and for and
[TABLE]
where is self-adjoint. Other variational representations in terms of the quantum relative entropy were given by Hiai and Petz [8, Lemma 1.2]:
[TABLE]
and for and
[TABLE]
See [15] for the various relations between the above variational representations. Furuichi [3] extended the two representations above to the deformed logarithmic and exponential functions with parameter :
[TABLE]
and if and
[TABLE]
where is self-adjoint and denotes the Tsallis relative quantum entropy with parameter
In section 2, we consider variational representations related to the deformed exponential and logarithmic functions by making use of the tracial Young’s inequalities. In section 3 we then derive variational representations related to the Tsallis relative entropies, which may be considered extensions of equation In section 4, we consider the generalization of the Gibbs variational representations and then tackle the variational representations related to the Tsallis relative entropy under the conditions and Finally, in section 5, we extend Golden-Thompson’s trace inequality to deformed exponentials with deformation parameter
Throughout this paper, the deformed logarithm denoted is defined by setting
[TABLE]
The deformed logarithm is also denoted the -logarithm. The deformed exponential function or the -exponential is defined as the inverse function to the -logarithm. It is denoted by and is given by the formula
[TABLE]
The Tsallis relative entropy is for positive definite matrices and defined, see [13], by setting
[TABLE]
This expression converges for to the relative quantum entropy introduced by Umegaki [14]. It is known that the Tsallis relative entropy is non-negative for states [4, Proposition 2.4], see also [7, Lemma 1] for a direct proof of the non-negativity.
2 Variational representations for some trace functions
We consider variational representations related to the deformed logarithm functions.
Lemma 2.1**.**
For positive definite operators and we have
[TABLE]
Proof.
For positive definite operators and the tracial Young inequality states that
[TABLE]
As for the reverse tracial Young inequalities, we refer the readers to the proof of [1, Lemma 12] from which we extracted the inequality
[TABLE]
Replacing by and then replacing by and by it follows for that
[TABLE]
It is also easy to see that the above inequality holds for Thus it follows that
[TABLE]
and
[TABLE]
For the above inequalities become equalities, hence
[TABLE]
Setting we obtain
[TABLE]
∎
Theorem 2.2**.**
Let be a contraction. For a positive definite operator we have the variational representations
[TABLE]
Proof.
Since is contraction, it follows for that
[TABLE]
By setting in Lemma 2.1, we obtain the conclusions in the case For we have
[TABLE]
Setting in Lemma 2.1, we obtain the conclusions for ∎
Corollary 2.3**.**
Let be a contraction and consider the map
[TABLE]
defined in positive definite operators. The following assertions are valid:
- (i)
* is concave for * 2. (ii)
* is concave for * 3. (iii)
* is convex for *
Proof.
By calculation we obtain
[TABLE]
Under the assumption in we have
[TABLE]
By Ando’s convexity theorem, the trace function is thus jointly convex in We also realize that is convex in Therefore,
[TABLE]
is jointly concave in Hence, by Theorem 2.2 and [2, Lemma 2.3] we obtain that is concave for Under the assumption in we have
[TABLE]
By Lieb’s concavity theorem, the trace function is jointly concave in The expression
[TABLE]
is therefore also jointly concave in By Theorem 2.2 and [2, Lemma 2.3] we obtain that is concave for Under the assumption in we have
[TABLE]
By Ando’s convexity theorem, the trace function is jointly convex in Since obviously is convex in we obtain that
[TABLE]
is jointly convex in Hence is convex for by Theorem 2.2 and [2, Lemma 2.3]. ∎
Remark 2.4**.**
The second author [6] proved the cases and in the above corollary by another method. The case may be similarly proved by using that the trace function
[TABLE]
is concave for
Proposition 2.5**.**
Let be a contraction.
- (i)
If then for positive definite and self-adjoint such that
[TABLE]
we have the equality
[TABLE] 2. (ii)
If then for positive definite and self-adjoint such that
[TABLE]
we have the equality
[TABLE] 3. (iii)
If then for positive definite and self-adjoint such that
[TABLE]
we have the equality
[TABLE]
Proof.
Under the assumptions of and the expression is well-defined and positive definite. By setting in Lemma 2.1, we obtain and ∎
Corollary 2.6**.**
Let be a contraction, and let be positive definite. The map
[TABLE]
defined in positive definite operators, is concave for and convex for The map
[TABLE]
defined in positive definite operators, is concave for
Proof.
If the map is concave. By an argument similar to the proof of Corollary 2.3 (ii), we obtain that the expression
[TABLE]
is jointly concave in Then obviously
[TABLE]
is jointly concave in By Proposition 2.5 (i) and [2, Lemma 2.3] we then conclude that
[TABLE]
is concave in for The case for can be proved by a similar argument as above. If then the map is convex. By an argument similar to the proof of Corollary 2.3(i), we obtain that the expression
[TABLE]
is jointly concave in Thus,
[TABLE]
is jointly concave in By Proposition 2.5 (iii) and [2, Lemma 2.3], we then obtain that
[TABLE]
is concave in for ∎
Setting in Corollary 2.6 we obtain:
Corollary 2.7**.**
Let be a contraction, and let be self-adjoint. The map
[TABLE]
is concave in positive definite operators.
Proposition 2.8**.**
Let be a contraction, and let be positive definite. The map
[TABLE]
is convex in positive definite operators for with
Proof.
Since is a contraction and we obtain the inequalities
[TABLE]
We may thus apply the deformed exponential and set in Lemma 2.1 to obtain
[TABLE]
where by the assumptions
[TABLE]
By Ando’s convexity theorem and [2, Lemma 2.3] we then get the desired conclusions. ∎
3 Variational expressions related to Tsallis relative entropy
Theorem 3.1**.**
Let be a contraction. For positive definite operators and the following assertions hold:
- (i)
For we have the equality
[TABLE] 2. (ii)
For we have the equality
[TABLE] 3. (iii)
For we have the equality
[TABLE]
Proof.
Under the assumptions in and the natural condition
[TABLE]
ensuring that makes sense, we set
[TABLE]
and obtain that is concave. By Proposition 2.5 (i), we then obtain the inequality
[TABLE]
Inserting yields
[TABLE]
such that attains its maximum in Thus we obtain
[TABLE]
which proves The case can be proved by a similar argument. Under the assumptions in and the condition
[TABLE]
we set
[TABLE]
and obtain that is concave. By Proposition 2.5 (iii), we then obtain the inequality
[TABLE]
Inserting yields
[TABLE]
such that attains its maximum in Hence
[TABLE]
which proves ∎
Setting we obtain in particular
Corollary 3.2**.**
The equality
[TABLE]
holds for
Corollary 3.2 may be considered as a variational representation of the Tsallis relative entropy. For we recover the well-known representation
[TABLE]
where the supremum is taken over self-adjoint
4 Variant representations related to Tsallis relative entropy
In this section, we generalize the Gibbs variational representations and the variational representations in terms of the quantum relative entropy obtained by Hiai and Petz [8]. We recall the Peierls-Bogolyubov type inequalities for deformed exponentials and quote from [7, Theorem 7].
Lemma 4.1**.**
Let and be self-adjoint matrices. The following assertions hold:
- (i)
If and both and are bounded from above by then
[TABLE] 2. (ii)
If and both and are bounded from below by then
[TABLE] 3. (iii)
If and both and are bounded from below by then
[TABLE]
Using these Peierls-Bogolyubov type inequalities we obtain:
Theorem 4.2**.**
The following variational representations hold:
- (i)
If then for
[TABLE]
and for with
[TABLE] 2. (ii)
If then for
[TABLE]
and for with
[TABLE] 3. (iii)
If then for
[TABLE]
and for with
[TABLE]
Proof.
We just prove the case of For with and setting we have By of Lemma 4.1 we thus obtain
[TABLE]
which holds for with and with Replacing with yields
[TABLE]
which is valid for with and It is easy to see that for a fixed there is equality in for We thus obtain
[TABLE]
By an elementary calculation we obtain the equalities
[TABLE]
and
[TABLE]
for Therefore,
[TABLE]
It follows that
[TABLE]
For a fixed we therefore have equality in for Hence,
[TABLE]
for The cases for and are proved by similar reasoning. ∎
By setting in Theorem 4.2 we obtain:
Theorem 4.3**.**
Assume The following assertions hold:
- (i)
If then for we have the equality
[TABLE]
and for with the equality
[TABLE] 2. (ii)
If then for we have the equality
[TABLE]
and for with the equality
[TABLE] 3. (iii)
If then for we have the equality
[TABLE]
and for the equality
[TABLE]
Remark 4.4**.**
We note that the cases in Theorem 4.2 and with in Theorem 4.3 was first obtained by Furuichi in [3], who gave a different proof. Note also that when we recover Gibbs’ variational principle for the von Neumann entropy together with the variational representations related to the quantum relative entropy obtained by Hiai and Petz, when is self-adjoint. Moreover, we can derive convexity or concavity of the map
[TABLE]
by using the joint convexity or concavity of the Tsallis entropy type functionals
[TABLE]
which in turn recovers the Peierls-Bogolyubov type inequalities for deformed exponentials. Note that the joint convexity or concavity for the Tsallis entropy type functionals can be traced back to Lieb’s concavity theorem and Ando’s convexity theorem, as demonstrated in Corollary 2.3.
Now we consider two types of variational expressions with and without the restriction A special case of Theorem 2.2 states that for positive numbers and
[TABLE]
and
[TABLE]
which may be viewed as Legendre-Fenchel type dualities for deformed exponentials. The inequalities and may also easily be obtained from the scalar Young’s inequality and its reverse inequality. We now recover Theorem 2.2 from Theorem 4.3 and the above scalar Legendre-Fenchel dualities. For and by using Theorem 4.3 we obtain
[TABLE]
where the last equality follows from The cases for and are proved by similar reasoning.
5 Golden-Thompson’s inequality for deformed exponentials
The second author generalized Golden-Thompson’s trace inequality to -exponentials with deformation parameter We will now address the same question for parameter values The following result is an easy consequence of Corollary 2.3.
Corollary 5.1**.**
Let be matrices with The function
[TABLE]
defined in -tuples of positive definite matrices, is concave for
The second author [6, Theorem 3.1] proved that is positively homogeneous of degree one. Since is concave for and by appealing to [6, Lemma 2.1], we may reason as in [6, Corollary 3.4] to obtain:
Corollary 5.2**.**
The function defined in satisfies the inequality
[TABLE]
for
Theorem 5.3**.**
Let and be negative definite matrices. The inequality
[TABLE]
then holds for
Proof.
In Corollary 5.2 we set and We then obtain the inequality
[TABLE]
for Furthermore, we set for To fixed negative definite matrices and we may choose and such that
[TABLE]
By inserting these operators in inequality (5.2) we obtain
[TABLE]
Since we obtain
[TABLE]
Finally, by replacing and with and the assertion follows. ∎
For we recover the Golden-Thompson inequality
[TABLE]
firstly only for negative definite operators. However, by adding suitable constants to and we obtain the trace inequality for arbitrary self-adjoint operators.
Acknowledgements. The first author acknowledges support from the Natural Science Foundation of the Jiangsu Higher Education Institutions of China, Grant No: 18KJB110033. The second author acknowledges support from the Japanese government Grant-in-Aid for scientific research 17K05267.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] E. A. Carlen, R. L. Frank, E. H. Lieb, Inequalities for Quantum Divergences and the Audenaert-Datta conjecture. ar Xiv: 1806.03985 v 1.
- 2[2] E. A. Carlen, E. H. Lieb, A Minkowsky type trace inequality and strong subadditivity of quantum entropy II: Convexity and concavity. Lett. Math. Phys., 2008, 83(2): 107-126.
- 3[3] S. Furuichi, Trace inequalities in nonextensive statistical mechanics. Linear Algebra Appl., 418 821-827, 2006.
- 4[4] S. Furuichi, K. Yanagi, K. Kuriyama, Fundamental properties of Tsallis relative entropy. J. Math. Phys. 45(12): 4868-4877, 2004.
- 5[5] F. Hansen, Multivariate extensions of the Golden-Thompson inequality. Ann. Funct. Anal., Volume 6, Number 4, 301-310, 2015.
- 6[6] F. Hansen, Golden-Thompson’s inequality for deformed exponentials. J. Stat. Phys., 159(5): 1300-1305, 2015.
- 7[7] F. Hansen, J. Liang, G. Shi, Peierls-Bogolyubov’s inequality for deformed exponentials. Entropy, 19(6), 271, 2017.
- 8[8] F. Hiai, D. Petz, The Golden-Thompson trace inequality is complemented, Linear Algebra Appl., 153-185, 1993.
