Reachable Sets from Toy Models to Controlled Markovian Quantum Systems
Gunther Dirr, Frederik vom Ende, Thomas Schulte-Herbr\"uggen

TL;DR
This paper characterizes the reachable states of controlled open quantum systems, especially at zero temperature, using a framework involving permutations and dissipative contractions, advancing understanding of quantum controllability.
Contribution
It introduces a novel approach to analyze reachable sets in controlled Markovian quantum systems using simple control operations and provides a complete characterization at zero temperature.
Findings
Complete characterization of reachable sets at T=0.
Inclusions for reachable sets at T>0.
Framework connecting toy models to complex quantum systems.
Abstract
In the framework of bilinear control systems, we present reachable sets of coherently controllable open quantum systems with switchable coupling to a thermal bath of arbitrary temperature . The core problem boils down to studying points in the standard simplex amenable to two types of controls that can be used interleaved: (i) permutations within the simplex, (ii) contractions by a dissipative one-parameter semigroup. Our work illustrates how the solutions of the core problem pertain to the reachable set of the original controlled Markovian quantum system. We completely characterize the case and present inclusions for .
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Reachable Sets from Toy Models to Controlled Markovian Quantum Systems*
Gunther Dirr1, Frederik vom Ende2,3 and Thomas Schulte-Herbrüggen2,3
date: * * This work was supported in part by the Bavarian excellence network enb via the International PhD Programme of Excellence Exploring Quantum Matter (exqm).1G.D. is with the Faculty of Mathematics, University of Würzburg, Emil-Fischer-Strasse 40, 97074 Würzburg, Germany 2F.v.E. and T.S-H. are with the Department of Chemistry, Technische Universität München, Lichtenbergstrasse 4, 85747 Garching and with the3*Munich Centre for Quantum Science and Technology (MCQST), Schellingstrasse 4, 80799 München, Germany [email protected]
Abstract
In the framework of bilinear control systems, we present reachable sets of coherently controllable open quantum systems with switchable coupling to a thermal bath of arbitrary temperature . The core problem boils down to studying points in the standard simplex amenable to two types of controls that can be used interleaved:
- (i)
permutations within the simplex,
- (ii)
contractions by a dissipative one-parameter semigroup.
Our work illustrates how the solutions of the core problem pertain to the reachable set of the original controlled Markovian quantum system. We completely characterize the case and present inclusions for .
I INTRODUCTION
Quantum systems theory and control engineering is a corner stone to unlock the potential of many quantum devices in view of emerging technologies [1, 2].
To ensure well-posedness of a large class of control tasks, it is advisable to check first whether the desired target state is within the reachable set of the dynamic system. Here we show how reachability problems of (finite-dimensional) Markovian open quantum systems can be reduced to studying hybrid control systems on the standard simplex of . Our starting point is a bilinear control system [3] of the form
[TABLE]
where as usual denotes an uncontrolled drift, while the control terms consist of (piecewise constant) control amplitudes and control operators . The state may be thought of as (vectorized) density operator. The corresponding system Lie algebra, which provides the crucial tool for analysing controllability and accessibility questions, reads .
For “closed” quantum systems, i.e. systems which do not interact with their environment, the matrices and involved are skew-hermitian and thus it is known [4, 5, 6, 7, 8] that the reachable set of (1) is given by the orbit of the initial state under the action of the dynamical systems group , provided is a compact subgroup of the unitary group.
More generally, for “open” systems undergoing Markovian dissipation, the reachable set takes the form of a (Lie) semigroup orbit [9]. – Here we address an intermediate scenario with coherent controls and a bang-bang switchable dissipator , the latter being motivated by recent experimental progress [10, 11, 12, 13] as described in [14].
II Specification of the Toy Model
Under these assumptions and some further invariance condition one can simplify the reachability analysis of (1) to a core problem (dubbed ‘toy model’ henceforth) on the standard simplex
[TABLE]
In order to make the main features match the quantum dynamical context (described in Sec. IV below), let us fix the following stipulations for the toy model: Its controls shall amount to permutation matrices acting instantaneously on the entries of and a continuous-time one-parameter semigroup of stochastic maps with a unique fixed point in . As results from the restriction of the bang-bang switchable dissipator , with abuse of notation we will denote its infinitesimal generator again by . The ‘equilibrium state’ will be defined explicitly in Eq. (11) by the system parameters and the absolute temperature of an external bath.
Altogether, this yields what we call the ‘toy model’ in the sequel. More precisely, these stipulations suggest the following hybrid/impulsive toy model on , cf. [15, 16, 17]:
[TABLE]
where the upper line describes the continuous-time evolution and the lower line the discrete-time part. The switching sequence and the permutation matrices are regarded as controls for (2). For simplicity, we assume that the switching points do not accumulate on finite intervals. The reachable sets of
[TABLE]
allow for the following characterisation
[TABLE]
where is the contraction semigroup generated by and the set of all permutation matrices .
III Main Results
Henceforth, let stand for a gksl-operator acting on complex matrices, see Eq. (3). Then in Eq. (1) can be regarded as its matrix representation (obtained, e.g., via the Kronecker formalism [18, Chap. 4]). If leaves the set of diagonal matrices invariant—a case we are primarily interested in—we denote by abuse of notation the corresponding matrix representation (obtained via ) again by . If different are involved we write to avoid confusion. — Within this picture, our main results can be sketched as follows.
For , consider the -level toy model (cf. Sec. II) with controls by permutations as above and an infinitesimal generator which results from a dissipative coupling to a bath of temperature (i.e. is generated by a single , cf. Eq. (9)).
Theorem 1**.**
Then the closure of the reachable set of any initial state under the dynamics of exhausts the full standard simplex, i.e.
[TABLE]
Moving from a single -level system (qudit) to a tensor product of such -level systems gives diagonal states . If the bath of temperature is coupled to just one (say the last) of the qudits, is generated by in Eq. (3) and one obtains the following generalization.
Theorem 2**.**
The statement of Theorem 1 holds analogously for all initial states .
In the sequel we refer to the standard concept and notation () of majorisation [19, 20] and denote by the unique attractive fixed point of the evolution generated by the dissipator for temperature (see Sec. V with comprising the generators and as in Prop. 1).
Theorem 3**.**
Again allowing for permutations as controls interleaved with dissipation resulting from one obtains for the reachable set of the corresponding toy model
[TABLE]
The current results extend the qubit picture of [14] to -level systems, and even more generally to systems of qudits.
For some mathematical statements contained within this manuscript we shall only sketch the ideas of how to prove them (denoted by “Sketch of Proof”).
IV Relation of Controlled Quantum Systems to Toy Models
Before proving the main theorems, we interpret our toy model in terms of open quantum systems. Let denote the set of all density matrices (positive semi-definite matrices of trace 1) and the set of all linear operators acting on complex -matrices. Then with
[TABLE]
and arbitrary will be called Gorini-Kossakowski-Sudarshan-Lindblad (gksl) operator [21, 22]. It induces a linear ordinary differential equation (ode)
[TABLE]
whose solution reads for all . As is of gksl-form, constitutes a one-parameter semigroup of completely positive, trace-preserving linear maps acting on , cf. [21, Thm. 2.2]. This implies that is a contraction semigroup which leaves invariant. In particular, for all when is equipped with the trace norm [23, Thm. 2.1].
Next, let us extend (4) by coherent controls to a control system of the form
[TABLE]
where all are (traceless) hermitian and is a bang-bang switching function, i.e. . In general, an analytic description of the reachable sets of (5) is rather challenging and in higher-dimensional cases almost impossible. However, there are a few scenarios which allow partial results or even a complete characterization:
- •
If (which is equivalent to being a semigroup of unital quantum channels), then for any density matrix one has the estimate [20, 24]
[TABLE]
- •
If is of Kraus rank one, i.e. is generated by a single , and moreover if is normal, then one has (up to closure) equality in (6) whenever the following assumption is satisfied:
Assumption UC+S: The unitary part of (5) is unitarily controllable, i.e. and the switching function acts as additional control. Here denotes the Lie algebra of all (traceless) skew-hermitian matrices.
Alternatively, the assumption (FUC) below—which is unrealistic from the point of view of physics—leads to the same result.
Assumption FUC: The unitary part of (5) is fully Hamiltonian controllable [9], i.e. the Lie algebra generated by the control operators (without the drift ) satisfies , there are no restrictions on the controls , and for all .
Recall that “controllability of the unitary part” is meant in the sense that the (lifted) bilinear system
[TABLE]
is controllable on (i.e. the special unitary group). Clearly, this implies111If one does require controllability of the unitary orbit for all initial states then it is actually equivalent [25]. that one can control (5) on the unitary orbit of if dissipation is switched off. A necessary and sufficient condition for unitary controllability is the well-known Lie-algebra rank condition [4, 5, 6, 26] reading
[TABLE]
To properly connect this quantum control model with the initial toy model, we will need yet another assumption.
Assumption IN: The set of diagonal density matrices
[TABLE]
is invariant under the semiflow and thus is also invariant under the semiflow .
Since is positive and trace preserving by construction, the invariance of under boils down to the obvious condition that maps diagonal matrices to diagonal matrices.
Conclusion for Quantum Systems: Finally, by means of UC+S (or FUC) and IN, it is easy to verify that the closure of the unitary orbit of (more precisely, the image of under the operator ) is contained in the closure of the reachable set . We elaborate this idea further in Cor. 1 below.
Other authors used quite similar ideas to investigate reachable sets of quantum-dynamical control systems [27, 24, 28]. In particular, in [28] the authors restrict themselves to a subsimplex of the standard simplex (which results from a Weyl-chamber type of construction) in order to eliminate ambiguities which result from different orderings of the eigenvalues of a density matrix. Moreover, their setting is more general as they avoid the invariance condition IN. However, the resulting conditions are hard to verify for higher-dimensional systems.
V Toy Models with
Unique Attractive Fixed Point
Models with a unique attractive fixed point are of particular interest for applications. Thus we introduce the terminology relaxing for , if there exists a such that
[TABLE]
for all .
Our first results show that there exists a rich class of physically relevant models motivated by quantum dynamical qubit systems [14, Eq. (B30)] which are relaxing and satisfy the invariance condition IN.
Lemma 1**.**
Let be arbitrary and consider
[TABLE]
with arbitrary and being the standard basis of . Then the operator induced by and via (3) satisfies the following:
- (i)
* fulfills IN. Moreover, its matrix representation on diagonal matrices (with respect to the standard identification ) is given by*
[TABLE]
- (ii)
If then is relaxing on , i.e. there exists a unique , such that for all .
Proof.
Let and . A straightforward computation yields
[TABLE]
This readily implies (i). Statement (ii) can be shown via the Perron-Frobenius theorem as follows. Let be arbitrary. By (8) there exists such that all entries of are non-negative (denoted by . This is still true if we take any power of and due to , evidently, (positive entries) so
[TABLE]
and thus . Furthermore, has spectral radius one—this follows from [29, Thm. 8.1.22] due to which implies , i.e. leaves invariant. Moreover, one can show [29, Thm. 8.2.11] that [math] is a simple eigenvalue and every other eigenvalue of has strictly negative real part. Using the Jordan canonical form of this readily implies convergence of to a matrix of rank one as . By an argument similar to the one given in Lemma 2 there exists , such that as , cf. [29, Thm. 8.2.11]. ∎
Equivalent to (ii) of the previous lemma is the statement that is relaxing on . In fact, one can show (cf. [30]) that is actually relaxing on all of .
Here and henceforth, let
[TABLE]
be the ladder operators in spin- representation giving rise to levels for half-integer (fermionic) and integer (bosonic) spin quantum numbers .
Proposition 1**.**
Let and , . Moreover,
[TABLE]
and
[TABLE]
where
[TABLE]
for . Then induced by and via (3) satisfies IN and the generated semigroup is relaxing on into .
Proof.
Obviously, we can apply Lemma 1 with
[TABLE]
for all . Now the only thing left to prove is which implies that is the unique attractive fixed point of . By means of (8) one immediately gets . ∎
Fixed Points for Given (Bath) Temperatures
Recall how the temperature given as a macroscopic parameter of a bath relates to the equilibrium state (henceforth called Gibbs state) of an -level quantum system with Hamiltonian once the system is ‘opened’ by coupling it to the bath and letting it equilibrate.
In equilibrium, the quantum system is assumed to adopt the bath temperature in the sense that the Gibbs state exhibits the same eigenbasis as and its corresponding eigenvalues can be interpreted as populations of the energy levels of following the Boltzmann distribution:
[TABLE]
for and . This obviously leads to
[TABLE]
(see, e.g., [31]). If is diagonal (which we will assume in the following w.l.o.g.) this boils down to with Gibbs vector
[TABLE]
Note that different and may lead to the same Gibbs state/vector.
The equilibration itself can be described as a Markovian relaxation process following the gksl-equation (3) with and given in Prop. 1. To this end, and are designed to guarantee that is the unique fixed point222Of course, if and thus are not diagonal one has to adjust the construction of and by replacing by the corresponding eigenvector to . of the equilibration. Roughly speaking, can be interpreted to model the transition rates between neighbouring energy levels. For this to work without “physically” forbidden jumps we have to require that the energy levels of and thus the resulting Gibbs vector are ordered: w.l.o.g. we assume to be increasing and therefore to be decreasing.
In the sequel, we want to analyse how (cf. Prop. 1) behaves for different choices of the Gibbs vector, i.e. for different and at different temperatures . The following scenarios are of special interest:
Equidistant energy levels: If the neighbouring ratios are constant for all (which obviously corresponds to equidistant energy levels ) so in (10), then the generators become , .
High-temperature limit: The case (obtained via taking the limit in (11)) yields for all so the generators become (up to a global factor).
Low-temperature limit: If the entries of are sorted and distinct, i.e. , then becomes when taking the limit in (11)—hence and so it is enough to consider only one generator.
VI Proof of Main Results
VI-A Reachability Results in the Low-Temperature Limit
VI-A1 Global Noise
In this section, we consider noise on a single qudit in the low-temperature limit, i.e. a single -level system with generator in (3).
Theorem 1. Let be arbitrary and consider induced by a single generator via (3). Then for the toy model from Sec. II with , the closure of the reachable set of any initial state exhausts the whole standard simplex, i.e.
[TABLE]
To prove this, we first need the following auxiliary results.
Lemma 2**.**
Let and . Then for
[TABLE]
one has , so the resulting matrix has ones in the first row and all other entries are zero.
Proof.
Obviously the above statement is related to, but not a special case of Lemma 1. Consider the following block-decomposition
[TABLE]
and note that satisfies the ode with . Now decomposing in the same way as and taking into account that satisfies the above ode readily yields the following representation
[TABLE]
with and . Finally, via the variation of parameters formula we obtain
[TABLE]
As is obviously a Hurwitz matrix we conclude
[TABLE]
and the identity implies the desired result. ∎
Lemma 3**.**
Let be arbitrary and let be given by (12) for some . Then for any there exist and permutation matrices such that
[TABLE]
Sketch of Proof.
Note that guarantees that the hyperplane is invariant under the flow . Moreover, due to the upper triangular structure of , lower-dimensional faces of of the form
[TABLE]
are left invariant, too. Now, for one can consider the backward evolution of and check that, eventually, the trajectory hits a face of which can be rotated into via some permutation . Applying this procedure inductively times concludes the proof. ∎
Sketch of the Proof of Thm. 1.
By Lemma 1
[TABLE]
so we may apply Lemma 2 and 3 to . The former one, in particular, implies that for arbitrary one has
[TABLE]
and thus we find such that
[TABLE]
Now, let and . The remaining proof consists of the following two steps shown here:
[TABLE]
We have to find s.t. . Step 1 is about relaxation of the diagonal system to the ground state by applying in the limit , cf. (14) and (15). Step 2 exploits the fact that from the ground state , one can reach any other diagonal state via and suitable permutations in finite time (i.e. within ), cf. Lemma 3. This is sufficient to perform the scheme suggested in (16) with arbitrary precision so . ∎
Remark 1*.*
Be aware that Step 2 in the proof of Thm. 1 is “exact” in the sense that starting from the ground state (in the model ), one can reach every element of in finite time, cf. Lemma 3.
VI-A2 Local Noise Coupling
In this section, we consider local noise of temperature zero and a finite number of qudits, i.e. a “chain” of -level systems (of length ) with generators of the form in (3).
Theorem 2. Let be arbitrary and let be solely generated by via (3). Then for toy model from Section II with , the closure of the reachable set of any initial state exhausts the whole standard simplex, i.e.
[TABLE]
For the proof of this theorem, the following auxiliary result is of importance.
Lemma 4**.**
Let , and for . Consider the toy models obtained from Section II by replacing by , respectively, and assume the following:
- (a)
Starting from the ground state of the individual systems, every other state can be reached (in finite time). More precisely, for all .
- (b)
* for all .*
Then the toy model from Sec. II with
[TABLE]
admits
[TABLE]
Sketch of Proof.
We only have to prove this for as the general case can be obtained by induction.
First, note that starting from one can reach every state of the form with . This is easily achieved via (a) and appropriate permutations.
Secondly, consider an arbitrary target which of course can be decomposed into with . Again by (a) we know that there exits switching sequences and permutations such that the dissipation operator interlaced with these permutations drives to in time for . Assume w.l.o.g. .
Then starting from the control scheme goes as follows: Run on the switching sequence which steers to in time . Stay in till which is possible by (b) and then, for the remaining time, run in parallel on the second system the (shifted) switching sequence which steers to . Thus at time we reach which concludes the proof. ∎
Proof of Thm. 2.
The case is covered by Thm.1 so we may assume .
Let and . We have to find such that . The proof, similar to that of Thm. 1, consists of the following steps:
[TABLE]
For applying Lemma 4 in Step 2 check that from (13) for satisfies conditions (a) and (b), which obviously hold due to Thm. 1, Remark 1 and Eq. (13)333Here we use which for any (when decomposed into ) implies and thus as is readily verified..
Thus we know and in particular . For the first step in (18), we may decompose into with . Then
[TABLE]
by (14). Then applying an appropriate permutation yields
[TABLE]
Repeating this scheme times in total leaves us with
[TABLE]
because so . Clearly, above limits (for ) cannot be reached exactly, yet again by (14), for every we find such that
[TABLE]
for all . This yields with
[TABLE]
as each of the relaxation steps has precision . ∎
Let us quickly describe how the previous theorems pertain to the quantum realm.
Corollary 1**.**
*Let be a coherently controlled quantum system of the form (5), which satisfies Assumption UC+S or FUC, as well as IN. Moreover, let or be given as above. Then one can (approximately) reach every other state, i.e. *
[TABLE]
Sketch of Proof.
Starting from any , due to Assumption UC+S (where the gksl noise is switched off) or FUC we can unitarily transform such that it is diagonal in an eigenbasis of . This in particular means so we are in the diagonal case (cf. footnote 2) with effectively no coherent drift but only dissipation and coherent controls, i.e. in the realm of the toy model via the obvious one-to-one correspondence . Here one can (approximately) reach every other diagonal state which by finally rotating back gives the desired result for the respective control system . ∎
VI-B Reachability Results for Non-Zero Temperature
Now for all temperatures , in the qubit case (bath coupling with UC+S or FUC) the closure of the reachable set for any initial state equals
[TABLE]
as can be seen easily, cf. [32]. One might hope that this extends to general -level systems with at finite temperatures. However, this is not true even if the above is taken as an upper bound for the reachable set, as the following example shows.
Example 1**.**
Let
[TABLE]
Then for and the semigroup (cf. Prop. 1) one gets for
[TABLE]
Evidently, and .
To obtain some analytic results we restrict ourselves to the case of equidistant energy levels (cf. Sec. V). Thus is of the form
[TABLE]
for some . This includes the so-called diagonal spin case.
Theorem 3. Let and such that is constant for . Also let be induced by (cf. Prop. 1). Then the reachable set for the toy model with satisfies
[TABLE]
Note that is the unique fixed point of .
Lemma 5**.**
Let with and let be any permutation on . Then there exist unique non-empty subsets (henceforth called “blocks”) with the following properties.
- (i)
The blocks yield a disjoint partition of , i.e. for and .
- (ii)
The blocks are the “connected components” of . More precisely, for each there exist such that
[TABLE]
and so the nearest neighbours of the blocks are not in .
Instead of proving the above lemma, let us quickly illustrate what is going on here by considering an example. Then a proof will be evident.
Example 2**.**
Let be the permutation (in cycle notation) on . First, consider so . The connected block-components of this set are , which satisfy
[TABLE]
and neither of their neighbouring numbers (i.e. ) are contained within . To finish off this example, for one gets . Here, the blocks obviously are , .
Proof of Thm. 3.
[TABLE]
with . In order to show that is upper bounded by one has to show that the latter
- (a)
contains the initial state.
- (b)
is invariant under permutation channels.
- (c)
is invariant under the semigroup .
As (a) and (b) are evident we only have to show (c). As is linear and the set is a convex set, it suffices to prove that the semigroup acts contractively on its extreme points , where denotes any permutation matrix.
Thus, we have to show that for every permutation matrix there exists such that
[TABLE]
Again the fact that is a compact, convex polytope implies that (21) can be replaced by the tangential condition
[TABLE]
Let be arbitrary and consider the “connected components” of the set , cf. Lemma 5. Then via (19) and due to the -th majorization condition (partial sum condition) entails
[TABLE]
where can be any permutation matrix. The respective partial sum of is given by
[TABLE]
If we can show that every -sum individually yields something non-negative, then applying (for sufficiently small) to can make the sum in (23) only smaller and thus (22) holds.
Using (20) and the properties of the (cf. Lemma 5),
[TABLE]
We know that so the degrees of the involved -monomials satisfy a strict inequality, i.e. (and similarly for the other one) using (19). Because of and for all , the summands involved in (24) and (25) are non-negative which concludes the proof. ∎
One might wonder whether it is necessary to restrict oneself to Hamiltonians with equidistant eigenvalues. The following example gives a positive answer.
Example 3**.**
Let
[TABLE]
so the semigroup (cf. Prop. 1) acts like
[TABLE]
Therefore majorization is violated (the largest eigenvalue grows) and the set is not left invariant by , although satisfies the “physical” ordering condition of Sec. V.
VII CONCLUSIONS
Within the framework of bilinear control systems, we have described reachable sets for coherently controllable Markovian quantum systems in two scenarios: either (i) with switchable Markovian dissipation on top of unitary control or (ii) with (arbitrarily) fast full unitary control and constant Markovian noise as drift. In either scenario, the dissipation can be thought of as coupling to a bath of temperature .
For we have shown that the reachable set encompasses the set of all states (density operators) no matter what the initial state is. The result thus generalises previous findings for qubits [14] to general -level systems on one hand or general -qudit systems on the other.
For coupling to baths of finite temperatures , we have given an inclusion for the reachable set in a certain class of initial states. This generalises results on unital dissipative quantum systems [24], where the bath can be thought of as being in the high-temperature limit .
Extending the current results on finite temperatures to further classes of initial states is an obvious yet challenging idea to follow-up.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] J. P. Dowling and G. Milburn, “Quantum Technology: The Second Quantum Revolution,” Phil. Trans. R. Soc. Lond. A , vol. 361, pp. 1655–1674, 2003.
- 2[2] S. Glaser, U. Boscain, T. Calarco, C. Koch, W. Köckenberger, R. Kosloff, I. Kuprov, B. Luy, S. Schirmer, T. Schulte-Herbüggen, D. Sugny, and F. Wilhelm, “Training Schröodinger’s Cat: Quantum Optimal Control,” Eur. Phys. J. D , vol. 69, p. 279, 2015.
- 3[3] D. Elliott, Bilinear Control Systems: Matrices in Action . Springer, London, 2009.
- 4[4] H. Sussmann and V. Jurdjevic, “Controllability of Nonlinear Systems,” J. Diff. Equat. , vol. 12, pp. 95–116, 1972.
- 5[5] V. Jurdjevic and H. Sussmann, “Control Systems on Lie Groups,” J. Diff. Equat. , vol. 12, pp. 313–329, 1972.
- 6[6] R. W. Brockett, “System Theory on Group Manifolds and Coset Spaces,” SIAM J. Control , vol. 10, pp. 265–284, 1972.
- 7[7] D. D’Alessandro, Introduction to Quantum Control and Dynamics . Chapman & Hall/CRC, Boca Raton, 2008.
- 8[8] G. Dirr and U. Helmke, “Lie Theory for Quantum Control,” GAMM-Mitteilungen , vol. 31, pp. 59–93, 2008.
