Generalized Holevo theorem and distinguishability notions
Diego G. Bussandri, Pedro W. Lamberti

TL;DR
This paper generalizes the Holevo theorem using various distinguishability measures, introducing new inequalities and exploring their implications for qubit ensembles, including cases where different notions of distinguishability coincide or reveal ensemble properties.
Contribution
It extends the Holevo theorem framework by incorporating generalized distinguishability measures, providing new inequalities and insights into qubit ensemble properties.
Findings
Generalized Holevo information and accessible information are introduced.
For two-qubit ensembles, Kolmogorov distinguishability yields equal generalized quantities.
Bhattacharyya distinguishability captures non-commutativity and purity of ensembles.
Abstract
We present a generalization of the Holevo theorem by means of distances used in the definition of distinguishability of states, showing that each one leads to an alternative Holevo theorem. This result involves two quantities: the generalized Holevo information and the generalized accessible information. Additionally, we apply the new inequalities to qubits ensembles showing that for the Kolmogorov notion of distinguishability (for the case of an ensemble of two qubits) the generalized quantities are equal. On the other hand, by using a known example, we show that the Bhattacharyya notion captures not only the non-commutativity of the ensemble but also its purity.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Generalized Holevo theorem and distinguishability notions
D. G. Bussandri1,2, P. W. Lamberti1,2
1Facultad de Matemática, Astronomía, Física y Computación, Universidad Nacional de Córdoba, Av. Medina Allende s/n, Ciudad Universitaria, X5000HUA Córdoba, Argentina
2Consejo Nacional de Investigaciones Científicas y Técnicas de la República Argentina, Av. Rivadavia 1917, C1033AAJ, CABA, Argentina
Abstract
We present a generalization of the Holevo theorem by means of distances used in the definition of distinguishability of states, showing that each one leads to an alternative Holevo theorem. This result involves two quantities: the distance based Holevo quantity and the generalized accessible information. Additionally, we apply the new inequalities to qubits ensembles showing that for the Kolmogorov notion of distinguishability (for the case of an ensemble of two qubits) the generalized quantities are equal. On the other hand, by using a known example, we show that the Bhattacharyya notion captures not only the non-commutativity of the ensemble but also its purity.
Distinguishability measures and Holevo Bound and Quantum Communication and Accessible information
I Introduction
One of the fundamental results of quantum information theory is the so-called Holevo theorem, which establishes an upper bound for the accessible information (the amount of classical information which can be reliably encoded into a collection of quantum states) Holevo ; Nielsen&Chuang ; Jaeger ; ZeroError .
A natural measure of “quantumness” for a quantum ensemble is the non-commutativity (measured by Guo ) and it connects the accessible information with the Holevo bound . Specifically, if the elements of the ensemble commute then the non-commutativity is null and it holds , otherwise, the inequality is strict: Tan . Additionally, although the Holevo quantity can be achieved through measurements on a large number of copies, it is regularly not tight in the single-copy measurements case RuiHan . Some authors have raised the question of whether the Holevo bound can be improved, by setting an alternative inequality which has a better performance Zycowsky2010 ; Giovannetti . To give a closed answer to the previous question exceeds the goal of this work; instead we focus on showing that the Holevo bound is a particular case of a more general ones.
The proof of the Holevo bound uses the strong subaditivity of the quantum entropy, which can be established from the monotonicity of the quantum relative entropy. Further the Holevo quantity can be expressed in terms of the generalized Jensen-Shannon divergence among the elements of the ensemble used in the communication protocol Majtey2005 , insinuating a close relation between the Holevo bound and the notion of distances between quantum states. Besides, in Tamir a Holevo-type bound was obtained using the Hilbert-Schmidt distance measure and in Sharma2013 ; Wilde2014 was proposed and studied a generalized Holevo information using a geometrical approach involving generalized divergences between quantum states. These facts motivated us to seek to generalize the Holevo theorem employing distance measures as mathematical objects with specific properties, obtaining new inequalities between the distance based Holevo quantity (DBHQ) and the generalized accessible information (GAI) [cf. Sec. III].
In quantum mechanics the states of a system are not observable. Therefore, the only way to distinguish two quantum states is through the measurements of physical quantities. Thus, a criterion to distinguish quantum states by using measurement procedures requires a measure of distinguishability Fusch . In the present work, we consider the main notions of distinguishability used in the field of quantum cryptography Fusch , obtaining for each of them a version of the Holevo theorem [cf. Sec. IV] which involves new quantities (DBHQ and GAI) with different interpretations and behaviors.
In the particular case of qubits ensembles, we show that the DBHQ and GAI coincide for every ensemble of two elements for the Kolmogorov notion of distinguishability [cf. Sec. V]. Besides, we have studied the behavior of the previous quantities for Bhattacharyya notion of distinguishability in a well known example [cf. Sec. V.1] showing a richer behavior than and .
II Theoretical framework
This section is divided into two parts. In the first one we set the general communication framework while in the second we enunciate the properties of the different distances measures used.
We will always consider quantum systems associated with finite-dimensional Hilbert spaces. The states will be described by density matrices belonging to (namely, the set of bounded, positive-semidefinite operators with unit trace) where denotes a Hilbert space.
II.1 Communication scheme and related quantities
Let us consider a quantum system associated with the Hilbert space . This system is shared by two entities, commonly referred to as Alice and Bob. In a communication scheme, the former has a classical information source , , and the probability of occurrence of the value . If at random it turns Alice prepares a quantum state belonging to a fix ensemble . The central aim is to communicate the result to the other part by mean of the states . Accordingly, Bob makes a measurement over the system described by the POVM (Positive-Operator Valued Measure) , .
The measurement results constitute a new random variable with probability of occurrence given by being .
The conditional probability of obtaining the measurement result given that is ; therefore, the joint probability of the variables and is given by .
Reasonably, the information that Bob gains about depends on the particular measurement and it is quantified by the mutual information Sasaki :
[TABLE]
being
[TABLE]
The accessible information is defined as the maximum of over the possible measurements:
[TABLE]
The Holevo theorem Holevo ; Nielsen&Chuang establishes:
[TABLE]
being the von Neumann entropy and the Holevo bound or Holevo information.
II.2 Distance Measures
A central issue of this work is the concept of distance measure. Particularly, we are interested in the closeness of quantum states, namely, static measures Nielsen&Chuang . There exist many distance measures used in different quantum information areas and frameworks. This variety generally is due to the arbitrariness in the distance measures definition Nielsen&Chuang ; Fusch .
A distance measure is a functional with the following properties:
- a)
Non-negativity: For any , 2. b)
Identity of indiscernibles: if and only if
It is important to note that if the functional satisfies also the symmetry property
- c)
Symmetry: For any ,
then sometimes it is called quantum distance.
In this paper, we are interested in a set of distance measures with two additional properties which will allow us to establish the new inequalities [cf. Sec. III]. These requirements are:
- d)
is non-increasing under the action of a completely positive trace-preserving map ,
[TABLE]
It is important to note that if a distance measure fulfil the previous property then it satisfied the following requirement Wilde2014 :
Restricted Additivity:
where , and .
As we shall see, if fulfils the following requirement Bussandri19 then the new inequalities (see Sec. III) can be expressed in a clearer way.
- e)
Additional Property:
[TABLE]
being an orthonormal basis of , a probability distribution and elements of such that . and are finite dimensional Hilbert spaces.
Some examples of well-known distance measures fulfilling the previous conditions are the trace distance, the squared Bures/Hellinger distance, the quantum Jensen-Shannon divergence (QJSD) and the relative entropy Nielsen&Chuang ; Majtey2005 ; Vedral2002 ; ZycowskyLibro .
III New inequalities
A well-known result about the mutual information between two random variables and is the intrinsic connection with the (Shannon) relative entropy . Specifically, in our communication context, we can rewrite (1) in the form:
[TABLE]
where is the (Shannon) relative entropy between the joint probability distribution and his uncorrelated counterpart . Also, is a measure of distance between the former probabilities distributions Vedral2002 . Therefore, the equality (3) point out a connection between distinguishability and the information shared by the random variables and . The Holevo quantity can also be rewritten using the von Neumann relative entropy Vedral2002 , resulting:
[TABLE]
with . Therefore, the Holevo theorem takes the following expression:
[TABLE]
In other words, the distinguishability between the joint probability distribution and is lower or equal than the mean distinguishability between the states , but here the distance measure used is solely the von Neumann relative entropy. We shall now generalize the previous inequality for general distance measures within a particular set. To do this, we will deal with two auxiliary Hilbert spaces and with orthonormal basis and , respectively.
Theorem III.1
Consider a distance measure , verifying the properties a), b), d) and e) (see Sec. II.2). Then:
[TABLE]
being
[TABLE]
where
[TABLE]
We will call to the distance based Holevo quantity.
Digression about notation: For any reasonable distance measure constitutes a statistical distance (or divergence) between the probability distributions and (on the grounds that the states and commute and are diagonal states in the orthonormal base of ). Therefore, we choose to emphasize that. On the other hand, depends on the measurement , while depends only on the ensemble . Therefore, bearing in mind (2), we choose:
[TABLE]
We will call to the generalized accessible information. The interpretation of the previous quantity clearly hinges on the distance measure used.
- Proof
Consider now the communication scheme established in Sec. II.1 and the Hilbert spaces and previously introduced.
Let us connect each result of with an element of the orthonormal basis of , . On the other hand, such events are associated with a specific preparation, e.g. if then (the state of the shared system ). These links are represented in the state:
[TABLE]
Furthermore, Bob makes a measurement represented by the POVM and his results are stored on the subsystem under the following prescriptions: When no measurement was made, he chooses the state . On the contrary, if Bob obtains the measurement result then he associates this with an element of the orthonormal basis of : . These two prescriptions have associated the states::
[TABLE]
The state can be obtained from the application of a trace-preserving quantum operation i.e. Nielsen&Chuang .
The state that describes the information acquired by Bob about the variable is:
[TABLE]
The uncorrelated counterparts of the states (6), (7), (8) and (9) respectively are:
[TABLE]
[TABLE]
[TABLE]
[TABLE]
Let us consider now a distance measure which fulfils the properties a), b), d) and e). Then, due to the restricted additivity property (see Sec. Restricted Additivity:), it is direct to see that
[TABLE]
By using d), we have
[TABLE]
and, taking into account that the trace operation over a subsystem is a trace preserving-quantum operation per se Nielsen&Chuang , it follows:
[TABLE]
Finally, combining (10)-(14) and using the additional property e) we obtain:
[TABLE]
It is important to remark that the Holevo theorem is recovered if we choose as distance measure the relative entropy .
On the other hand, it is easy to prove that if the states commutes between them, then for any reasonable distance measure the equality in (4) is achieved. On the contrary, it depends on the distance measure considered if an equality in (4) implies the commutation of the states . This is a point that deserves to be remarked: the implications of the inequality depend markedly on the distance used.
IV Cryptographic distinguishability measures
As we have seen in Sec. II.2, a distance measure is a mathematical object with specific properties, but it is well known that not all of them can be considered as distinguishability measures. The reason is that the only physical way to distinguish two quantum states is through a measurement process. In quantum mechanics, the events are intrinsically stochastic and therefore the measurement results are associated with a probability distribution. In consequence, if one has a criterion for distinguishing two probability distributions then it is possible to obtain a measure of distinguishability between two quantum states measuring and optimizing over the possible measurements Nielsen&Chuang ; Fusch .
The main purpose of this section is to use the new inequality (4) and apply it to specific distinguishability notions.
Following Fusch , we shall consider three different notions of distinguishability that are of interest to quantum cryptography: Kolmogorov distance (K), Probability of error (PE) and Bhattacharyya coefficient (B). We will not include in this analysis the Shannon distinguishability mainly because of it does not have a closed expression in the quantum realm.
The Kolmogorov distance (K) between two probability distributions and is defined by
[TABLE]
On the other hand, the Kolmogorov distance between two density matrices and results equal to the trace distance:
[TABLE]
Consequently, the corresponding inequality for the Kolmogorov notion of distinguishability is
[TABLE]
It is noteworthy that even when the states in the set do not commute, it is possible to reach the equality in (16), as will be shown in section (V.1), by analysing the case of an ensemble of qubits. This a quite different behavior with respect to the conventional Holevo bound.
The probability of error between two distributions and is
[TABLE]
and it is related to the Kolmogorov notion through:
[TABLE]
therefore, the probability of error between quantum states is
[TABLE]
Then, we have an alternative interpretation of the inequality (16) within the probability of error notion:
[TABLE]
Finally, it remains to consider Bhattacharyya coefficient between two distributions and is defined by
[TABLE]
wich in extended in the quantum realm as
[TABLE]
being the quantum fidelity ZycowskyLibro ; Fusch . At the same time, this coefficient is related to the squared Bures/Hellinger distance:
[TABLE]
The Bures distance satisfies the conditions established in Theorem III.1, driving to an inequality::
[TABLE]
Bearing in mind that it is easy to see that
[TABLE]
with the purity of the state which is (a priori) delivered to Bob.
V Qubits ensembles
Now, we shall consider an ensembles of states of qubits, i.e., [cf. Sec. II.1] and we shall restrict our calculations to von Neumann measurements. Our purpose here is to identify the difference between usual quantities given by the relative entropy, i.e. and , and the generalized quantities DBHQ and GAI. The von Neumann measurements have an advantage mainly because of their Bloch representation.
Let be a unitary operator given by
[TABLE]
with , and the Pauli matrices. The Bob measurements over the system are given by
[TABLE]
being , and the computational basis Luo08b .
So the Bloch vector of the events are given by being where
[TABLE]
Thus,
[TABLE]
The direction given by characterizes the measurement . It is easy to see that overspreads the Bloch sphere, i.e., it is possible to measure in any direction.
Now, if the states of the ensemble are given by
[TABLE]
where and therefore , it can be seen that the probabilities and [cf. Sec. II.1] are given by:
[TABLE]
Given an ensemble of operators , with probability each of ones, the non-commutativity is defined as Guo :
[TABLE]
where is the Hilbert-Schmidt norm. After some algebra, we have:
[TABLE]
In the case of the state (26), the purity results:
[TABLE]
Now, we are in position of obtaining the generalized expressions for the distance based Holevo quantity and for the cryptographic distinguishability measures considered in Sec. IV. We have omitted the probability of error (PE) because the expressions are totally analogous to the Kolmogorov notion (K).
For the Kolmogorov distance
[TABLE]
and for the Bhattacharyya coefficient
[TABLE]
In the case of the Relative entropy, the Holevo bound and take the form
[TABLE]
where is minus the binary Shannon entropy.
Thus, once obtained the analytical expressions for the Kolmogorov notion, we can establish the following result:
Theorem V.1
For any two qubit ensemble (see (25) and (26), with ) it holds:
[TABLE]
- Proof
By definition, we have
[TABLE]
Choosing where it follows
[TABLE]
Therefore, .
Finally, we will study the behavior of and (for Kolmogorov and Bhattacharyya notions) in contrast with the known quantities and , using the non-commutativity measure and the purity as figure of merit for the ensemble properties.
V.1 Example
Consider an ensemble composed by two pure states , being Nielsen&Chuang ; ZeroError ; ZycowskyLibro
[TABLE]
[TABLE]
with probabilities and . For , and for , the states commute. The corresponding Bloch vectors are [cf. (25) and (26)]
[TABLE]
Consequently, the non-commutativity measure and the purity take the following analytical forms [cf. (27) and (28)]:
[TABLE]
[TABLE]
Additionally, the expression for (also for ) is
[TABLE]
The remaining cases, i.e. and for relative entropy and Bhattacharyya coefficient , constitute a more interesting case. We evaluate the generalized accessible information for each cases [cf. (32) and (34)] (with ) for . On the other hand, inserting (37)-(39) in (31) and (33) we can obtain the analytic expressions for the distance based Holevo quantity.
Figure 1 shows the behavior of and . The difference between these quantities increases and decreases as the non-commutativity measure does.
Figure 2 displays and . In this case, the difference does not have the same behavior than . By plotting it is straightforward to conclude that also contains information about the purity of the ensemble.
VI Concluding remarks
In this work, we have proposed a generalization of the Holevo theorem by means of distance measures, focusing our study in cryptographic notions of distinguishability. In particular, we have obtained the corresponding new inequalities to the notions of Kolmogorov, Bhattacharyya coefficient and probability of error. To explore the behaviors of the generalized quantities (DBHQ and GAI) in these three cases, we have calculated the corresponding analytical expressions for the qubit case, using the von Neumann measurements, proving that DBHQ and GAI are equal for the Kolmogorov notion of distinguishability () for any qubit ensemble of two elements. We have also obtained the analytical expressions for the non-commutativity (measured by ) and purity (measured by ) of the ensemble as a function of the Bloch vectors of the states composing the ensemble. Finally, we have considered an ensemble of two pure states in which we have numerically computed the accessible information and GAI for the Bhattacharyya notion of distinguishability. By using the non-commutativity and the purity as figure of merit of the ensemble properties, we found that that: 1) increase and decrease if the non-commutativity does and 2) the difference of the generalized quantities for the Bhattacharyya notion, i.e. , captures not only the non-commutativity of the ensemble but also the purity showing a richer behavior that the relative entropy case.
It would be further interesting to deepen the study of GAI and DBHQ meaning, the tightness of the bounds and his operational uses, for different distance measures and different distinguishability notions.
Acknowledgements.
The authors acknowledge Secyt-UNC-Argentina for financial support. D. G. Bussandri is a fellowship holder from CONICET.
References
- (1) Holevo A S Holevo 1973 Bounds for the quantity of information transmitted by a quantum communication channel Probl Peredachi Inf 9 177
- (2) Nielsen M A and Chuang I L 2000 Quantum Computation and Quantum Information (Cambridge University Press)
- (3) Jaeger G 2007 Quantum Information An Overview (Springer)
- (4) Guedes E B, de Assis F M, Medeiros R A 2016 Quantum zero-Error Information Theory (Springer)
- (5) Guo Y 2016 Non-commutativity measure of quantum discord Sci. Rep. 6 25241
- (6) Tan Y-g, Hu Y-H, Liu Q, Lu H 2014 Distinguishing quantum states with holevo bound and its applications to spatially separated Bell states Int J Theor Phys 53:1040-1045
- (7) Han R, Leuchs G, Grassl M 2018 Residual and destroyed accessible information after measurements Phys Rev Lett 120 160501
- (8) Roga W, Fannes M, and Życzkowski K Universal Bounds for the Holevo Quantity, Coherent Information, and the Jensen-Shannon Divergence Phys Rev Lett 105 040505
- (9) Giovannetti V, Lloyd S, and Maccone L 2012 Achieving the Holevo Bound via sequential measurements Phys Rev A 85 012302
- (10) Majtey A P, Lamberti P W, and Prato D P 2005 Jensen-Shannon divergence as a measure of distinguishability between mixed quantum states Phys. Rev. A 72, 052310
- (11) Tamir B and Cohen E 2015 A Holevo-Type Bound for a Hilbert Schmidt Distance Measure Journal of Quantum Information Science 5 127-133
- (12) Sharma, Naresh, and Naqueeb Ahmad Warsi 2013 Fundamental bound on the reliability of quantum information transmission Phys Rev Lett 110 080501
- (13) Wilde, Mark M., Andreas Winter, and Dong Yang 2014 Strong converse for the classical capacity of entanglement-breaking and Hadamard channels via a sandwiched Rényi relative entropy. Communications in Mathematical Physics 331 593-622
- (14) Fuchs C A and van de Graaf J 1999 Cryptographic distinguishability measures for quantum-mechanical states * IEEE Transactions on Information Theory * 45 4
- (15) Sasaki M, Barnett M S, Jozsa R, Osaki M, and Hirota O 1999 Accessible information and optimal strategies for real symmetrical quantum sources Phys Rev A 59 5
- (16) Bussandri D G, Majtey A P, Lamberti P W, Osán T M 2019 Generalized approach to quantify correlations in bipartite quantum systems Quantum Inf Process 18 57
- (17) Vedral V 2002 The role of relative entropy in quantum information theory Rev Mod Phys 74 197
- (18) Bengtsson I and Zyczkowski K 2006 Geometry of Quantum States An Introduction to Quantum Entanglement (Cambridge University Press)
- (19) Luo S 2008 Quantum discord for two-qubit systems Phys. Rev. A 77, 042303
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) Holevo A S Holevo 1973 Bounds for the quantity of information transmitted by a quantum communication channel Probl Peredachi Inf 9 177
- 2(2) Nielsen M A and Chuang I L 2000 Quantum Computation and Quantum Information (Cambridge University Press)
- 3(3) Jaeger G 2007 Quantum Information An Overview (Springer)
- 4(4) Guedes E B, de Assis F M, Medeiros R A 2016 Quantum zero-Error Information Theory (Springer)
- 5(5) Guo Y 2016 Non-commutativity measure of quantum discord Sci. Rep. 6 25241
- 6(6) Tan Y-g, Hu Y-H, Liu Q, Lu H 2014 Distinguishing quantum states with holevo bound and its applications to spatially separated Bell states Int J Theor Phys 53 :1040-1045
- 7(7) Han R, Leuchs G, Grassl M 2018 Residual and destroyed accessible information after measurements Phys Rev Lett 120 160501
- 8(8) Roga W, Fannes M, and Życzkowski K Universal Bounds for the Holevo Quantity, Coherent Information, and the Jensen-Shannon Divergence Phys Rev Lett 105 040505
