ManQala: Game-Inspired Strategies for Quantum State Engineering
Onur Danaci, Wenlei Zhang, Robert Coleman, William Djakam, Michaela, Amoo, Ryan T. Glasser, Brian T. Kirby, Moussa N'Gom, Thomas A. Searles

TL;DR
This paper introduces ManQala, a game-inspired quantum control strategy that simplifies high-dimensional state preparation, improving efficiency and precision in quantum engineering tasks relevant to emerging quantum technologies.
Contribution
ManQala recasts quantum state preparation as a game-inspired pre-processing step, reducing search space and enhancing control protocol design for quantum systems.
Findings
ManQala strategies match or outperform existing methods in state variance reduction.
Effective in small-scale quantum state engineering problems.
Provides a platform for designing control protocols for near-term quantum technologies.
Abstract
The ability to prepare systems in specific target states through quantum engineering is essential for realizing the new technologies promised by a second quantum revolution. Here, we recast the fundamental problem of state preparation in high-dimensional Hilbert spaces as ManQala, a quantum game inspired by the West African sowing game mancala. Motivated by optimal gameplay in solitaire mancala, where nested nearest-neighbor permutations and actions evolve the state of the game board to its target configuration, ManQala acts as a pre-processing approach for deterministically arranging particles in a quantum control problem. Once pre-processing with ManQala is complete, existing quantum control methods are applied, but now with a reduced search space. We find that ManQala-type strategies match, or outperform, competing approaches in terms of final state variance even in small-scale…
| Strategy | Zeno-lock | Parallel | |||
|---|---|---|---|---|---|
| ManQala | ✓ | ✓ | ✓ | ✓ | ✓ |
| modified-ManQala | ✓ | ✓ | ✓ | ✓ | |
| FUMES | ✓ | ||||
| Z-FUMES | ✓ | ✓ |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsQuantum Computing Algorithms and Architecture · Quantum Information and Cryptography · Quantum Mechanics and Applications
ManQala: Game-Inspired Strategies for Quantum State Engineering
Onur Danaci
IBM-HBCU Quantum Center, Howard University, Washington, DC 20059, USA
Instituut-Lorentz, Universiteit Leiden, 2300 RA Leiden, The Netherlands
Wenlei Zhang
Department of Physics & Engineering Physics, Tulane University, New Orleans, LA 70118, USA
Robert Coleman
IBM-HBCU Quantum Center, Howard University, Washington, DC 20059, USA
William Djakam
Department of Electrical & Computer Engineering, University of Alabama-Birmingham, Birmingham, AL 35233, USA
Michaela Amoo
IBM-HBCU Quantum Center, Howard University, Washington, DC 20059, USA
Ryan T. Glasser
Department of Physics & Engineering Physics, Tulane University, New Orleans, LA 70118, USA
Brian T. Kirby
Department of Physics & Engineering Physics, Tulane University, New Orleans, LA 70118, USA
DEVCOM Army Research Laboratory, Adelphi, MD 20783, USA
Moussa N’Gom
Department of Physics, Applied Physics, and Astronomy, Rensselaer Polytechnic Institute, Troy, NY 12180, USA
Thomas A. Searles
Department of Electrical & Computer Engineering, University of Illinois Chicago, Chicago, IL 60607, USA
(February 29, 2024)
Abstract
The ability to prepare systems in specific target states through quantum engineering is essential for realizing the new technologies promised by a second quantum revolution. Here, we recast the fundamental problem of state preparation in high-dimensional Hilbert spaces as ManQala, a quantum game inspired by the West African sowing game mancala. Motivated by optimal gameplay in solitaire mancala, where nested nearest-neighbor permutations and actions evolve the state of the game board to its target configuration, ManQala acts as a pre-processing approach for deterministically arranging particles in a quantum control problem. Once pre-processing with ManQala is complete, existing quantum control methods are applied, but now with a reduced search space. We find that ManQala-type strategies match, or outperform, competing approaches in terms of final state variance even in small-scale quantum state engineering problems where we expect the slightest advantage, since the relative reduction in search space is the least. These results suggest that ManQala provides a rich platform for designing control protocols relevant to near-term intermediate-scale quantum technologies.
††preprint: APS/123-QED
I Introduction
Quantum engineering applies traditional principles of engineering such as design and control to quantum phenomena, devices and systems. In particular, quantum state engineering (the application of control methods to quantum state preparation problems [1, 2]), or QSE, is of interest for quantum computing [3, 4], networking [5, 6], and sensing [7, 8] applications. In general, one can separate QSE into three classes: preparation [9, 10, 11], stabilization [12, 13] and purification [14, 15] of quantum states. Primarily, QSE strategies to prepare a target state in a high-dimensional Hilbert space make use of two techniques, and combinations thereof. The first is based on unitary time evolution with respect to some known control Hamiltonian(s). This evolution is deterministic and known as coherent control, or unitary control [2, 16]. The second technique uses measurement back-action to steer the quantum state stochastically and is known as incoherent control, or control-free [17, 16].
Two examples employing both methods in their QSE strategies are FUMES (fixed unitary evolution and measurements) [18] and Zeno-locked FUMES (Z-FUMES) [19]. The FUMES strategy is based on unitarily evolving a state with respect to a known Hamiltonian up to a point where the fidelity between the state in hand and the target state is maximized, , then making a probabilistic projective measurement [18]. The Z-FUMES strategy implements the same search algorithm, but makes use of the quantum Zeno effect [20, 21, 22, 23], to “lock”, i.e. halt the evolution of, certain subspaces of the system to gradually shrink the total search space [24, 25, 26]. Example applications of measurement back-action methods include the control of qubits for quantum computing [27, 28, 29, 17], in control of quantum optical systems [30, 23], and in control of critical behaviour of quantum gases [31, 32, 33].
Recently, parallels between control problems and games have emerged as demonstrated by the application of AlphaZero [34], which was initially developed for playing games like Go and chess, to the optimal control of inverted pendulums [35]. Furthermore, both control problems and games are concerned with selecting actions while interacting with some environment to change the system’s state; typically based on some rules and signals from the environment [36]. A substantial amount of interest has been focused on using games in quantum information science not only as a pedagogical tool to develop intuition, but also as a legitimate way to solve problems. For example, a quantum version of sudoku, referred to as SudoQ, was found to be closely related to the topic of mutually unbiased bases [37]. Many quantum analogues to games have been studied, such as Go [38], tic-tac-toe [39, 40], chess [41], blackjack [42], roulette [43], and sudoku [44, 37], with various motivations. In general, a game merges with principles of quantum mechanics by associating game pieces with quantum states and defining operators that evolve the game in analogous ways to the original gameplay.
Noticeably, a missing link exists between the emerging fields of QSE and quantum games. For example, experimental implementations of quantum games and associated gameplay require extensive control of the underlying quantum systems and rely on QSE. However, as we will focus on in this paper, the reverse relationship is also meaningful: the development of QSE strategies inspired by games.
Here, we introduce a quantum version of the traditional West African sowing game mancala, which we refer to as ManQala, and explore its applicability as a framework for state engineering. We present QSE strategies inspired by the game that match or surpass the performance of traditional unitary or measurement-based strategies. In particular, the advantages persist even when considering small systems and two-site interactions where one could expect the slightest advantage. Importantly, ManQala-inspired strategies show promise at scaling to higher dimensions better than (Z-)FUMES due to small search spaces and the parallelizability associated with their divide-and-conquer approach. Hence, the strategies presented in this paper represent a potential path toward developing game-based QSE techniques with improved scaling properties compared to leading alternatives.
This paper is organized as follows. In Section II, we provide an overview of the ManQala game and relate it to the basic goals of QSE. From these results, we present useful methods for developing game-inspired strategies for QSE and compare and contrast these to the strategies outlined by FUMES and Z-FUMES. In Section III, we provide numerical simulations of ManQala, FUMES, and Z-FUMES algorithms for the scenario where the former has the least advantage against the latter. However, clear advantages for ManQala are demonstrated with respect to parallelization and variance. Finally, Section IV concludes the paper.
II ManQala Quantum State Engineering Strategy
II.1 Overview
Mancala is the generic name for a collection of related games played worldwide for over a thousand years. Mancala games consist of pieces called stones (or seeds) and a game board that includes a set of valid locations, referred to as pits, for game piece placement. Additionally, mancala game boards have a special pit, or pits, called the Ruma. Various rule sets exist, but mancala is generally a turn-based game where players alternate moving, or “sowing,” stones in counter-clockwise or leftward direction from pit-to-pit in a series of chained operations to collect the stones in a Ruma.
This Section develops techniques to play quantum mancala, or ManQala, that can be applied to any variation of the traditional game, including multiplayer iterations. However, we have found that even the most basic solitaire versions of mancala have a rich enough game structure to reveal significant and uniquely quantum features of ManQala. For this reason, throughout the rest of this paper, we will focus on Tchoukaillon, a solitaire version of mancala which is particularly amenable to mathematical analysis.
Tchoukaillon was developed by Deledicq et al. [45] in 1977 and is itself a derivative of another, much older mancala variant called Tchouka [46]. Game boards in Tchoukaillon are linear and consist of only a single Ruma, which we assume is the left-most pit by convention. The sowing rules state that when a player picks stones up from a pit, they leave that pit empty to sow all those stones to the pit on the left-hand side. Then, they proceed by picking up stones from that pit and sowing them to the next pit on the left, and so on until there are no stones remaining in their hands. In Tchoukaillon, a player must end each round of sowing by placing the final stone in the Ruma, with under- and over-shooting resulting in losing the game. The win conditions for Tchoukaillon are, in fact, so restrictive that the initial game board ultimately determines whether a win is possible and, if so, prescribes the unique series of moves needed to win [47, 48].
Assuming we begin with a Tchoukaillon board for which winning is possible, then the series of moves that will result in winning can be described succinctly. In particular, the stones from the pits nearest to the Ruma (empty pit at the edge) need to be picked and sowed first, with this strategy repeated, moving to the next non-empty pit until the game board is cleared. In Figure 1(a), we visually present an example of this strategy for a winning board with a Ruma and two additional pits.
The game play in Figure 1(a) consists of two movements; the first is equivalent to a permutation, such as in the first step when sowing into an empty pit, and the second is the merging movements that combine seeds from two pits. This distinction is significant as we consider a quantum version of the game since permutation can be performed deterministically with unitary evolution, while merging operations are nondeterministic. Notably, permutation movements alone bring the board “closer” to the final configuration. This observation that deterministic permutation operations can significantly reduce the number of tunneling events needed to achieve the target state and effectively reduce board size will be the primary strategy we will use throughout this paper as we develop ManQala. Furthermore, even as we move away from problems that have direct analogies with mancala, we will see that pre-processing in this fashion reduces the problem space making the application of search-based quantum control approaches (e.g., Z-FUMES) more efficient.
In this paper, we aim to devise a family of QSE strategies, termed ManQala, that mimic the mechanics of a traditional Tchoukaillon game. For context, in Figure 1(b) we include a simple example of the same game shown in Figure 1(a) but where “stones” are replaced with bosonic states and “pits” by system modes. This now constitutes a quantum system where we can apply ManQala. In this simple ManQala example, “sowing” is performed with unitary operations , for . Even in this basic example, with only three modes and three bosons, the gameplay diverges from mancala in two important ways. First, since the quantum version manipulates amplitudes of quantum systems and avoids “collapse,” the game does not result in a “winning” configuration with certainty. Secondly, the coherent evolution of the system potentially violates the directionality rules implied by all mancala games: there are projective measurement outcomes where “stones” move “backwards” in this quantum version. This phenomenon appears in certain outcomes shown in the last step of Figure 1(b).
Similar to other state engineering strategies, such as FUMES [18] and the Zeno-locked FUMES (Z-FUMES) [19], ManQala uses two different methods to direct the evolution of a state: coherent unitary evolution and projective measurements. Unlike FUMES and Z-FUMES, ManQala starts by driving the system deterministically to a point where random search via projective measurements is more feasible. Once the deterministic strategy is complete, a stochastic approach, such as (Z-)FUMES, is adopted on one or more subsets of the board while the rest remains Zeno-locked. Additionally, ManQala can also be implemented in a parallel fashion where a given lattice can be fragmented into sublattices, each of which is evolved independently.
As stated, the goal in ManQala is similar to Tchoukaillon or any other mancala variant; to end the game with all of the seeds in the Ruma. Thus, our aim in ManQala is to engineer a quantum state such that final state of the board mimics the end of a mancala game. While this goal appears restrictive, in the Appendix, we describe an approach for leveraging ManQala for quantum control problems with completely general target states.
II.2 Formulation for systems with two-site bosonic hopping
We now discuss the realization of ManQala-inspired QSE methods for controlling physical systems that exhibit two-site bosonic hopping due to their prevalence in practical situations. Bosonic hopping occurs in a variety of physical systems, including coupled optical cavities [49], coupled waveguides [50], transmons coupled to superconducting cavities [51], and ultracold atoms in optical lattices that obey the Bose-Hubbard (B-H) model [52]. Implementation of the last two systems enable non-demolition measurement [53, 54, 55] of bosonic populations [56, 51, 57]. However, we restrict our states of interest to bosons on a lattice that evolve according to the one dimensional B-H model due to its simplicity in measurement [57], and intuitive similarity to a traditional mancala game.
Here, each lattice site that carries bosonic modes is analogous to a pit on a mancala board such that the quantum analogue of the sowing operation can be implemented by boson hopping. Therefore, the B-H Hamiltonian governing this scenario is given by,
[TABLE]
Here, and are bosonic creation and annihilation operators such that gives the number of particles on site and denotes summation over all neighboring sites . The hopping amplitude describes the coupling strength between neighboring sites and the parameters and represent the on-site interaction and the chemical potential, respectively.
By following the lead of Sørensen et al. [19], we restrict our method to quantum systems described solely by the quadratic hopping part of the B-H Hamiltonian as the self-interaction potential and the chemical potential are set to and . Our motivation in doing so is two-folds. First, removing the terms that prevent tunneling aids the search for the target state, similar to using high temperature parameters in initial stages of simulated annealing algorithms [58]. Second, the quadratic B-H model is exactly diagonalizable in the Heisenberg picture resulting in closed-form, analytic solutions for unitary evolution once those terms are omitted [59, 50].
In general, the engineering of a quantum state is an optimization problem where the controller interacts with the given system via time-dependent actuation, , for times . Hence, the goal of ManQala is to specify at all times using strategies derived from the game as shortcuts to optimization. In ManQala, the control actions at any given time are constrained to a set of unitaries and projective measurements, . Here, a control action of pure coherent evolution, , implements the time evolution operator of the total Hamiltonian that drives the state from the initial time, , to the final, , segment as the measurement projection operator is just the identity . Similarly, an action of pure projective number state measurements has the effect of probabilistically collapsing the state. Here denotes the tensor product of the projective measurement operators at each site , ranging from [math] to . And, combining those, the action exerts coherent time evolution on all the sites except the sites at (for ), unless those obscure inter-site tunneling, via Zeno-locked time-evolution, [24, 26, 19].
If, for the given Bose-Hubbard model, the task in hand is steering an initial state, , towards a target state, , then the control problem can be formulated as a combinatorial optimization problem of finding the actions that would minimize a distance metric between states, [60]. Here this distance metric, , to be minimized could be coming from Schrödinger, as in the quantum fidelity , or Heisenberg picture dynamics for a series of actions or actuators implemented in time, . Also, this metric can be combined with other goal functions within a cost function to be minimized, . Here denotes a Lagrange multiplier for a metric or goal , and these multipliers can be chosen to make the cost function a convex sum, .
For our system of interest, a 1-D bosonic lattice governed by a Bose-Hubbard Hamiltonian, we can define a distance metric based on the number of tunneling events. Pedersen et al. initially proposed such a metric for Fock states to judge the performance of the FUMES algorithm [18]. We can generalize the Pedersen metric to any site population via the following compact form. Given the M dimensional particle number expectation value vectors , and, for states (or density matrices) and , the number of tunneling events is given by
[TABLE]
The global optimum of the number of tunneling events and the fidelity are the same when steering a system from an initial state to a target state. The same cannot be said for the intermediate steps. If we are given specific initial and target states, or their particle number expectation value vectors ( and , respectively), we can define a bosonic distance akin to quantum (in-)fidelity for the particle number expectation value vector, , of a (probably unknown) state, , using the number of tunneling events given above, as the following,
[TABLE]
In this current form, the bosonic distance metric starts from zero for and takes on the maximum value of unity when due to scaling with the number of tunneling events between the initial and target states.
ManQala initially tries to minimize a cost function
[TABLE]
Here the term denotes site populations after the actions were implemented on the initial populations and denotes the number of projective measurements we apply to our system as actions. Assuming a high , we try to avoid stochastic methods (e.g, Z-FUMES) while minimizing , but use deterministic unitary actions (site population permutations) instead. Also, if we want to be consistent with mancala, we can penalize the actions that are inconsistent with it via a term . For example, we can penalize the unitary actions that do not follow the mancala’s sowing rule. On the other hand, this condition can be relaxed by tuning , or dropped altogether () as a modified-ManQala (mod-ManQala) algorithm without losing any generality, while converging faster. This is considered in appendix D and can be achieved by Zeno-locking all other sites.
Of note, a target board to be reached (e.g, winning condition) can be decomposed into sub-boards where each sub-board population can be thought of as a pit. For example, for the three pit board configuration we examine here, the target board can be decomposed into sub-boards (sub-lattices) of . For such segmentation of the board, the target board is demarcated into sub-board populations . Using that, we can also split our initial board configuration in hand the same way . Both in the traditional and the quantum game, bringing the board into the winning condition first requires bringing it to the target sub-board ( in our example). The winnable board configurations enable the player to move the stones from the pits with small number of stones right away into the target sub-board, effectively decoupling from the move of the pits with larger number of stones that could overshoot the Ruma. In ManQala, whether or not mimicking each traditional move, this winnable board intuition is actualized by moving the particles from the sites with a few number of particles right away to their designated smaller sub-lattices deterministically only via unitary evolution so that we can Zeno-lock them. This way we can move the particles from sites with many particles to their designated, larger, target sub-lattice. Having locked the (sub)-lattices with few particles, and moved the rest to their sub-lattice, we can use probabilistic search methods via measurement back-action on this previously unlocked sublattice to find the right set of actions that would steer our system to the target state.
To help clarify the differences between ManQala, FUMES, and Z-FUMES we include Table 1. A more detailed description of these differences in available in Appendix B.
III Numerical Simulations and Performance Comparisons
In the previous section, we presented the theoretical framework for a game-inspired quantum state engineering (QSE) strategy we call ManQala. Here, we provide numerical simulations of the performance of ManQala and compare them against FUMES and Z-FUMES. For clarity, we will consider in this section the same problem illustrated in Figure 1(b). Here, the initial state is given by and the target state by where each ket represents, for example, modes in a bosonic lattice. The Hilbert space dimension is for sites and particles. Thus, in this configuration, there are possible Fock states.
Assuming prior knowledge of the total number of particles in the system, we can deduce the state of the entire lattice by measuring only of the sites. Hence, for the problem we consider here with , we can represent the state of the system as a sequence of two numbers, in this case, the number of particles in the leftmost site (Ruma) and the next nearest site. We denote all ten possible configurations as . In the particular example shown in Figure 1(b), and are the initial and target states respectively.
The FUMES protocol uses unitary evolution to maximize the fidelity with the final state followed by a single projective measurement. To find these unitary evolutions, we first identify the distance between all possible states and the target state. For each state in , there is a corresponding unitary time-evolution duration that maximizes the probability of observing the target state and can be also written in a vector form. We write these times again in a vector of the form . For the target state we obtain these values using QuTiP [61] by numerically solving Schrödinger’s equation via exact diagonalization. The resulting time scales are given by .
If we instead consider situations where we Zeno-lock certain sites, such as in Z-FUMES, the optimal time-evolution values change. Zeno-locking only occurs in this example when the site has the targeted number of particles (in this case zero particles) in it, , and not the others, and . Locking the (Ruma) site when it has zero particles would be counterproductive as the target state has nonzero particles in that site. However, one may be tempted to lock the intermediate site () when it has the target number of particles (zero), but this would obstruct the tunneling between the sites and . Zeno-locking the site when it has zero particles in it reduces the set of possible configurations to the subset . Designated time durations become the following for this case, , where the designated time duration vector for the states to be evolved while Zeno-locking is replaced with the ones from the usual FUMES while keeping the rest same.
Hilbert space reduction using Zeno-locking, as shown in the difference in the dimensionality between and , is precisely why Z-FUMES outperforms FUMES in general. Note, however, that Z-FUMES only applies Zeno locking in a stochastic fashion. For example, if Z-FUMES encounters a [math] on the second site and Zeno-locks it so that the two-site sublattice to the left has the correct amount of particles, the search space reduces to for (). In comparison, ManQala and its variants drive the system deterministically exactly to this configuration instead of waiting to encounter it during the random search. Finally, we note that since FUMES does not use Zeno-locking at all the algorithm searches the entire dimensional space. Hence, intuitively, we expect both ManQala and Z-FUMES to outperform FUMES in terms of resources required to reach the target state.
To reach the target state using ManQala, that is limiting the ability to permute to two-sites at a time while adhering to the sowing rules of mancala, we begin by driving our system to the subspace and Zeno-locking the mode. To achieve this we use three two-site unitaries of . Here each unitary permutes the particle population of adjacent Fock states of sites and carrying particles, . In the case given in Figure 1, we need a total deterministic evolution time of to drive the system into the Zeno-locked configuration of . Once there we apply the aforementioned Z-FUMES with time durations .
Alternatively, if we instead use mod-ManQala, we require only one three-site unitary of duration to deterministically reach the Zeno-locked configuration due to relaxing the need to imitate mancala. Here each unitary acting on Fock states of sites permutes the populations of sites and , while leaving untouched. The three-site unitary given by implements the permutation . To be more specific, consider a demarcation of the three-dimensional lattice in sub-lattices , i.e, . The initial site population for this sub-lattice segmentation is . ManQala tries to be as consistent as possible with the winning strategy of the analogous classical Tchoukaillon board and hence drives the system into populations with respect to segmentation and corresponding permutation . The permutation to drive the initial populations into the Zeno-locked sub-lattice is the following:
[TABLE]
Here denote the site population permutations for both the ManQala and mod-ManQala strategies, i.e, exchanging sites [math] and while keeping site the same. Its corresponding matrix representations is a column-reversed identity matrix. In the segmentation , both of these representations yield . In practice, we first identify these permutation operators and then compile them into two and three-site unitaries (i.e, “moves” in the previous section) based on the traditional game constraints or lack thereof.
Figure 2 shows the comparison of expected bosonic distance between different quantum state engineering strategies for initial state and target state over a thousand stochastic, Monte-Carlo trajectories. In terms of the bosonic distance, FUMES, Z-FUMES, and mod-ManQala start with a steep linear ramp as they all implement a three-site interaction. When the fidelity between the state in hand and the target state is maximized at both (Z-)FUMES apply a projective measurement, leading to different stochastic trajectories (green and red coloring in the Figure 2 representing the standard deviation of these). Both (mod-)ManQala aim to achieve deterministically, and their bosonic distances ascend during the course of their time-evolution, albeit slowly for ManQala due to constraints. Once ManQala achieves a local peak at and mod-ManQala achieves the same at , they make a downward turn as they are both optimizing for fidelity now (using Z-FUMES) by both evolving for in the Zeno-locked space (i.e, the second element of ), and make projective measurements at those spots (leading to blue and purple coloring for their respective variances).
In this Zeno-locked space mod-ManQala follows the designated measurement times based on measurement results, while ManQala, following the rules of the traditional game, always brings the system back to the and repeats. Because of this, the mean (expected) trajectory progresses differently in time for ManQala, and mod-ManQala converges to a much faster (), although they achieve the same exact statistics given in part of Figure 2. Since we are driving the system into Zeno-locked subspaces determinisitically, and querying a smaller search space (mod)-ManQala has much less variance. In Figure 2(a) each protocol is repeated indefinitely until achieving a unity fidelity such that FUMES has an average standard deviation of , while Z-FUMES has , mod-ManQala has , and ManQala has in bosonic distance until observing bosonic distance. This phenomenon is much more pronounced in Figure 2(b) as just a small number of protocol repetitions is enough to achieve near unity fidelities with the target state. For completeness, we provide results related to the repeated application of all three protocols in Appendix C.
To further illustrate the difference between these quantum-state engineering strategies, we compare the expected particle numbers at each site with the same aforementioned initial and target states, as shown in Figure 3. This figure shows individual (randomly chosen but representative) evolutions for FUMES, Z-FUMES and mod-ManQala as compared to Figure 2 which averages many such evolutions to find averages. While not as useful to understanding the general behavior of each protocol, Figure 3 provides an intuitive understanding of how (Z-)FUMES and mod-MaQala strategies differ in their overall approach to solving the same problem. Note that the dashed lines in Figure 3 indicate projective measurements. (Z-)FUMES implements a measurement each time the probability of observing the target state is maximized in a given (Zeno-locked) configuration. Alternatively (mod-)ManQala strategies evolve the sites deterministically towards states where Zeno-locking can be used to reduce the Hilbert space (in this case making the population in the mode [math]). As pictured in Figure 3, this particular stochastic run is successful at projecting to the correct state in panel (c) on the first projection, however, if this were not the case mod-ManQala would again try to maximize fidelity before repeating the projective measurement. Note that (Z-)FUMES evolves the states in time for the next projective measurement even when the particle expectation numbers, as well as the bosonic distance we defined , are frozen in time. In parts a) and b) of Figure 3, the first measurement represented by a dashed line projects the system into a Mott-Insulator state , where particle expectations are not changing in time under the effect of unitary evolution. The second projective measurement, represented by a second dashed line, takes them out of this state.
In this section, we have considered scenarios where the target state mimics the end state of the original solitaire mancala game, meaning all bosons end up in a single mode. However, we note that ManQala can be applied more generally to problems with arbitrary target states. These general approaches require us to loosen our adherence to mancala (game rules, directions). For concreteness, in Appendix D we describe how ManQala can be applied to two important physical systems, those of superfluids and Mott-insulator systems with site and particle numbers of five. In particular, we show in Appendix D how the ManQala framework can divide more significant, hard-to-tackle problems into small, manageable, and parallelizable ones.
IV Conclusion
In this paper, we devised a quantum engineering strategy that we term ManQala, inspired by the traditional solitaire game Tchoukaillon and illustrated the differences between our approach and other competing strategies. In particular, we provided numerical comparisons of ManQala and ManQala-inspired strategies against FUMES and Z-FUMES. In all cases we found that ManQala strategies ultimately match or outperform FUMES and Z-FUMES.
ManQala augments existing quantum state engineering strategies by adding a preprocessing stage that consists of deterministic unitary permutations. These permutations reduce the Hilbert space of the problem, improving the performance of search-based strategies such as FUMES and Z-FUMES. More specifically, FUMES is a greedy, stochastic algorithm that optimizes the fidelity between the initial and target state through unitary evolution of the whole Hamiltonian followed by the collapse of the state by observation. On the other hand, Z-FUMES uses the same stochastic and greedy algorithm as FUMES but with the additional feature that if we end up in subspaces of the target state during probabilistic jumps, we can Zeno-lock these subspaces and only evolve the remaining sites. By contrast, ManQala-based strategies intentionally drive the system into target subspaces/sublattices of the overall state through deterministic unitary evolution into configurations that allow for an overall reduction in Hilbert space size through the Zeno-locking of certain modes. Then, once demarcated, ManQala strategies use local algorithms to control each subspace/sublattice to minimize the bosonic hopping distance. ManQala’s use of subspaces and sublattices naturally lends itself to parallelization, which would further improve the performance of ManQala over existing strategies as problem spaces increase in dimension.
In our formulation of ManQala, we have chosen to use the bosonic hopping distance to inform the algorithm’s actions instead of overall fidelity. Since ManQala focuses on sublattices, within the execution of the protocol, the overall fidelity may decrease before rapid improvement. This decrease in fidelity is due to the algorithm focusing on bosonic distances between sublattices at any individual step and not the global fidelity. Ultimately our quantum version of a mancala game has provided a helpful framework for thinking about state engineering in quantum systems. The observed performance advantages of ManQala over competing strategies suggest an exciting connection between games and quantum systems engineering, and future work should continue exploring this relationship.
Acknowledgements.
We acknowledge the primary support of this work from the IBM-HBCU Quantum Center at Howard University. Additionally, the views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the Army Research Laboratory or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation herein. Additionally, this material is based upon work supported by, or in part by, the Army Research Laboratory and the Army Research Office under contract/grant numbers W911NF-19-2-0087 and W911NF-20-2-0168. TAS’s contribution is based upon work supported by the U.S. Department of Energy, Office of Science, National Quantum Information Science Research Centers, Co-design Center for Quantum Advantage (C2QA) under contract number DE-SC0012704.
Appendix A Algorithm
Appendix B Details of the comparison between ManQala, FUMES, and Z-FUMES
We now describe the general differences between the ManQala strategy and the FUMES and Z-FUMES strategies. The FUMES strategy unitarily evolves an initial quantum state to the point where the probability of observing the target quantum state is maximized, then performs projective measurement in an attempt to collapse the system to the desired target [18]. The experimenter stores the classical information of the measurement read-out (e.g, in a classical register), and checks whether the observed measurement sequence , a member of all the possible measurement sequences , matches the one of the target state. If the said projective measurement does not collapse the state onto the target state, then the process is repeated by evolving the state via unitary evolution for a designated duration, , based upon the measurement results until convergence [18]. These durations are computed ahead of the experiment by solving the deterministic Schrödinger equation for each possible intermediate state, upon which system could collapse onto, with respect to the target state [18]. The FUMES strategy is indirect and always tries to go to the nearest, optimal solution.
The Z-FUMES strategy makes use of the Zeno subspaces to demarcate the bosonic lattice into sub-lattices. If the sublattices and bosonic sites have the targeted number of particles, they are Zeno locked from tunneling into adjacent sites through frequent application of projective, non-demolition, particle number measurements [19, 24, 26]. Just like FUMES, there is a designated time-evolution duration, , for each particle number measurement sequence of within the set of possible measurement sequences . On the other hand, some of the states (or their corresponding sequences) within the warrants Zeno locking of specific sites, then evolving the lattice for . Conversely, if a sequence , which does not require Zeno locking any sites, is observed, usual FUMES is implemented for the designated time duration . FUMES is a greedy algorithm as it chooses the “shortest visible path” in minimizing a cost function at given time . Z-FUMES is also a greedy algorithm, but it puts a Zeno-locking constraint on the actions based on the site-population measurement outcome, , right before the implementation at . That Zeno-locking constraint can be represented in the Z-FUMES cost function via a Lagrange multiplier, at given time . Here denotes the Zeno-locking constraint on the unitary actions to be taken if the outcome of the projective measurements finds sub-lattice populations that satisfy Zeno-locking condition (i.e, having target state populations, and no tunneling boundary).
Both ManQala and modified-ManQala strategies begin by optimizing via unitary actions. However, in modified-ManQala, those two or three-site unitary actions do not necessarily need to follow each mancala move (i.e, ). Once they reach a plateau where can no longer be improved via those unitary actions (permutations), i.e, a plateau where we can Zeno-lock some site populations, both of these strategies employ Z-FUMES in parallel, or in sequence at different sub-lattices. In other words, they optimize multiple . These site population permutations are implemented through two-site unitary time evolutions with duration and the three-site ones with duration (again via selective Zeno-locking). We drive the system into Zeno-locked sub-lattices through those permutations implemented by unitary evolution. We restrict the strategy to 2 & 3 site interactions because they yield site population permutations for characteristic time durations. Thus, the problem of finding permutations, , between site populations, and demarcating the lattice sites into sub-lattices to be Zeno-locked are equivalent problems and tackled at the same time. Given the initial state and target state populations, and , the problem can be reduced into classically solving the following combinatorial optimization problem before applying any controls,
[TABLE]
If we get the answer for this optimization problem, we would acquire sub-lattices , and permutations that will be decomposed into designated unitary operators with time durations. Here denotes a permutation (group), denotes the matrix representation of the said permutation (group), and super-scripts denote the solutions found [62]. We want to find permutations such that we could split into different sets of adjacent sites based on a condition on the vector . We could split it, if and only if, sum of the elements of each set is equal to zero. The trivial example is when we have sub-lattices such that , and the corresponding trivial representation is . Here denotes the dimensional identity matrix corresponding to the matrix representation of the permutation, , of site populations. The general solution to this problem is marked with the DemarcateSubLattices function in the ManQala pseudo-code (see Alg. 1, also in the Appendix). Similarly, we marked the task of compiling these permutations into designated unitaries with specific time durations with the function ManQalaMoves.
In Z-FUMES, we passively search for these Zeno-locked sublattices to narrow our search space while randomly searching for the target state actions. However, those are random encounters. In ManQala we designate the target sub-lattices to demarcate the lattice into, then we actively and deterministically drive our system to them via two and/or three site unitary evolution. To do so, we search for these unitary moves that take less time while minimizing the bosonic distance between the particle expectations of the sub-lattices of the state in hand, and the ones of the target state. Once we drive them, we can Zeno-lock and/or run a Z-FUMES probabilistic search on these sub-lattices. Note, in the main text we consider problems with , which is the smallest scale problem where Zeno locking can be applied. Even at this small scale an observable difference in performance between ManQala and (Z-)FUMES, which we expect to only increase for larger problems where shrinking the search space is more important.
Appendix C Repetitions
To better understand the impact of repeated applications of each protocol we check the quasi-probability (or the probability density histogram) of the states obtained after the repetition of the protocol multiple times, in order to assess how reliably a protocol steers the quantum state with limited physical & computational resources. Figure 4 shows the success probabilities of the quantum state engineering strategies under different numbers of repetitions. With a single application, the three strategies have roughly the same probability () of measuring the target state . However, after 3 repetitions, this probability for ManQala increases to near unity (95%), in contrast to limited performance increases with FUMES (61%) and Z-FUMES (83%). This results from the avoidance of early onset use of measurement-based probabilistic control and dealing with small search spaces when using it in ManQala type strategies. On the other hand, (Z-)FUMES need to re-compute a time duration and apply probabilistic measurement many times. This is tractable for . However with the growing Hilbert space size, the computational complexity constraints necessitate the usage of sophisticated Tensor Network-based calculations in large computer clusters [63], and random search is much less reliable.
Appendix D Generalization of Mancala Inspired Quantum State Engineering
In this section, we will give two example implementations of the (modified) ManQala quantum state engineering strategy. Importantly, in this section, we are focusing on the generalized version of ManQala which can begin to significantly diverge from the gameplay of mancala. In particular, we will show two cases that exemplify how any Fock state, which is not restricted to winnable game configurations, be generated using the algorithm given in Appendix 1. In addition, we will loosen our adherence to the mancala game (game rules, direction) in order to further optimize the evolution of the system toward the target state.
The first example has the initial state , and the unity occupancy Mott-insulator state as the target state , on the five site, 1D bosonic lattice (see Figure 5). Here the underlying physics is implemented through Bose-Hubbard Hamiltonian with self-interaction potential.
In our case, both the initial and target states have the same average occupancy of . However, the former is a superposition state with a high variance in population, while the latter is a product (Fock) state with no variance. Because of this fact, optimizing for the bosonic distance, see the equation (3) for , in such superposition states is impractical, and mod-ManQala starts by collapsing the initial state right away. We start by doing such a projective measurement to collapse the state into with the probability 2/3 or to the state with the probability 1/3. In either case, we first designate a target particle number excitation vector of a set of sublattices of the target state.
In this problem, the nearest reachable, Zeno-lockable set of sublattices of the target state is the one with three sublattices, and with unity particles on the edge and three particles on the middle sublattice (composed of three sites in the middle), . In other words, the lattice is segmented into sublattices. For that designated set of sublattices, the former state is . While the same sublattice segmentation results in the following sublattice populations for the latter state, .
In order to minimize the bosonic distance between the particle numbers of the target sublattices, , and the ones of the states, and we may choose coherent, deterministic, unitary actions, , that takes the least amount of time. For the former state, one particle needs to hop from the middle sublattice to the right via a two-site unitary evolution of time between sites three and four. In other words, an initial projector is chosen to acquire a two-site unitary . Then, two particles need to hop from the leftmost sublattice to the middle. This is implemented by another two-site unitary of time between sites zero and one, i.e, . And, for the latter state, only a single particle needs to hop from the middle sublattice to the right. This is again implemented via a two-site unitary of time between sites three and four. Once the bosonic distance between the number vectors of the state sublattices and the target state’s sublattice, we can Zeno-lock the sublattices on the edge, then run a Z-FUMES subroutine on the middle sublattice to reach the target state as shown in Figure 5. In the end, a list of (non)unitary actions are taken, . Here at the end of the list corresponds to the set of actions implemented by the latest Z-FUMES step on the state, including the two and three site unitaries and projective, global site population measurements.
Next, we examine a case similar to that analyzed in [19] where Sørensen et al. consider a superfluid initial state with and steer it towards a Mott-insulator state. We will consider the dimensional version of this same problem, pictured in Figure (6). Note that the initial state is in a superposition while the particle number expectation at all sites is unity.
To perform this control problem using the mod-ManQala algorithm, we again first project the state into one of its constituents either immediately, or after an iteration of FUMES. Then, for each of these possible states, we identify a set of sublattices, to which we minimize the bosonic distance, , between the given state and target state’s sublattices by moving particles via unitary moves. Once the bosonic hopping distance between the segmented sublattice populations of the target and the pre-processed state is zero , we lock the particles in their sites through Zeno-locking (frequent measurements), and run Z-FUMES independently or in parallel in each of these sublattices. Some possible control paths are pictured in Figure (6). One of the possible projected states, is split into a two-site sublattice to the left edge, a single site sublattice on the middle, and another two-site sublattice to the right edge, as . As the four-site sublattice on the left already contains the correct number of particles in it, we could have Zeno-locked it and run Z-FUMES immediately. However the search space would be , and it would take much longer for Z-FUMES to converge. On the other hand, when we split it into two sublattices each carrying two particles and two sites, we are searching in parallel within two dimensional spaces for the target sublattice using Z-FUMES.
If two sublattices that require further processing by Z-FUMES are side-by-side then there is no barrier to tunneling. To avoid this we can use the unitary time evolution of the three sites of sites 2, 3, and 4 for a duration of to move the rightmost particle to the center. This three-site unitary is implemented via the projector, . That way the distance between the demarcated sublattice particle numbers of the new state, and the target state is zero, as shown on the left-hand side in Figure (6). Therefore two Z-FUMES operations can be implemented to the left and rightmost two-site sublattices in parallel. The list of actions for this mod-ManQala scenario would be a concatenation of deterministic permutations (just in this case), and the actions from two Z-FUMES in parallel (one acting left-most, the other right-most sublattices, see Figure 6), .
The last example among these projected Fock states is . For this example, a sublattice demarcation is chosen. In that segmentation, the target particle numbers vector is and the state particle number vector is . To minimize the bosonic distances between the sublattices of these particle numbers , a two-site unitary of duration is chosen between sites 1 and 2 by designating the Zeno-locking projector , to move one particle from right most sublattice to the middle. Here the action given after the semi-colon in , represents the site-population permutations applied to the initial state represented by the initial site populations, , such that the distance metric yields the bosonic distance between the transformed and the target states (Figure 6). The remaining actions in this scenario are coming from Z-FUMES acting on the sublattice, .
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1d’Alessandro [2021] D. d’Alessandro, Introduction to quantum control and dynamics (Chapman and hall/CRC, 2021).
- 2Wiseman and Milburn [2009] H. M. Wiseman and G. J. Milburn, Quantum measurement and control (Cambridge university press, 2009).
- 3Ramakrishna and Rabitz [1996] V. Ramakrishna and H. Rabitz, Relation between quantum computing and quantum controllability, Physical Review A 54 , 1715 (1996).
- 4Ball et al. [2021] H. Ball, M. J. Biercuk, A. R. Carvalho, J. Chen, M. Hush, L. A. De Castro, L. Li, P. J. Liebermann, H. J. Slatyer, C. Edmunds, et al. , Software tools for quantum control: Improving quantum computer performance through noise and error suppression, Quantum Science and Technology 6 , 044011 (2021).
- 5Duan et al. [2001] L.-M. Duan, M. D. Lukin, J. I. Cirac, and P. Zoller, Long-distance quantum communication with atomic ensembles and linear optics, Nature 414 , 413 (2001).
- 6Müller et al. [2013] M. Müller, A. Kölle, R. Löw, T. Pfau, T. Calarco, and S. Montangero, Room-temperature rydberg single-photon source, Physical Review A 87 , 053412 (2013).
- 7Rembold et al. [2020] P. Rembold, N. Oshnik, M. M. Müller, S. Montangero, T. Calarco, and E. Neu, Introduction to quantum optimal control for quantum sensing with nitrogen-vacancy centers in diamond, AVS Quantum Science 2 , 024701 (2020).
- 8Poggiali et al. [2018] F. Poggiali, P. Cappellaro, and N. Fabbri, Optimal control for one-qubit quantum sensing, Physical Review X 8 , 021059 (2018).
