First-principle construction of U(1) symmetric matrix product states
Mykhailo V. Rakov

TL;DR
This paper presents an algorithm for constructing U(1) symmetric matrix product states, highlighting differences between boundary conditions and extending the approach to PEPS, enhancing the understanding of symmetry in tensor network states.
Contribution
It introduces a new algorithm for calculating symmetry sectors in U(1) symmetric MPS and extends the methodology to PEPS, addressing boundary condition differences.
Findings
Algorithm effectively computes symmetry sectors for U(1) symmetric MPS.
Differences between open and periodic boundary conditions are clarified.
Extension to PEPS broadens applicability of the method.
Abstract
The algorithm to calculate the sets of symmetry sectors for virtual indices of U(1) symmetric matrix product states (MPS) is described. Principal differences between open (OBC) and periodic (PBC) boundary conditions are stressed, and the extension of PBC MPS algorithm to projected entangled pair states (PEPS) is outlined.
| -1.5 | 0 | -3.5660045862287 | 1 | -3.5660584980874 | ||
| -1 | 0 | -2.75 | 0 | 1 | -2.75 | 0 |
| 0 | 0 | -3.6481149052794 | 1 | -3.5275782250239 | ||
| 1 | 0 | -5.1420906328405 | 1 | -4.8611479370363 | 0 | |
| 1.5 | 0 | -6.0501401477104 | 0 | 1 | -5.6734344275326 |
| -1.5 | 0 | -8.2704792249323 | 1 | -8.2741234280340 | ||
| -1 | 0 | -7 | 0 | 1 | -7 | 0 |
| 0 | 0 | -8.0204395954077 | 1 | -7.9059982071590 | ||
| 1 | 0 | -10.124637222358 | 1 | -9.9227585483187 | ||
| 1.5 | 0 | -12.409314862832 | 1 | -11.689887124543 | 0 |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
First-principle construction of U(1) symmetric matrix product states
Mykhailo V. Rakov
Faculty of Physics, Kyiv National University, 64/13 Volodymyrska st., 01601 Kyiv, Ukraine
Abstract
The algorithm to calculate the sets of symmetry sectors for virtual indices of U(1) symmetric matrix product states (MPS) is described. Principal differences between open (OBC) and periodic (PBC) boundary conditions are stressed, and the extension of PBC MPS algorithm to projected entangled pair states (PEPS) is outlined.
I Introduction
In the last few decades extremely low temperatures have become routinely feasible, and various quantum systems have become possible to manipulate at such temperatures in mesoscopic and microscopic scale. The thermal degrees of freedom in these systems are ‘frozen’, however, they may be quantum mechanically strongly correlated.
One kind of such systems are low-dimensional quantum magnets, such as: quasi-one-dimensional compounds based on ions of various metals Mikeska2004 ; spin ladders Brenig1995 ; high-temperature superconductors and frustrated antiferromagnets PhysRevB.82.155138 . Another kind are ultracold atomic gases: the simplest example is Bose-Einstein condensate (BEC) RevModPhys.71.463 ; however, quantum models with topological order Kitaev2006 ; Wen1990 have also been realized with cold atoms PhysRevLett.91.090402 ; Micheli2006 .
Remarkably, low-dimensional quantum magnets can be modeled by various spin Hamiltonians (e.g., a variety of Heisenberg Hamiltonians). Frustrated antiferromagnetic state can be partly understood on the basis of the 2D Hubbard model in the limit auerbach for spin-1/2 fermions. The dynamics of a Bose gas exposed to an optical lattice potential PhysRevLett.81.3108 ; PhysRevLett.95.040402 ; Greiner2002 realizes a variety of Bose-Hubbard (BH) models at various conditions essler . But remarkably, the Hubbard models also reduce to various spin models in certain limits. As a consequence, quantum spin models are very important for understanding of the physics of low-dimensional systems at low temperatures.
The interactions between particles in the low-dimensional quantum systems can be versatile, and the ‘strength’ of each interaction is determined by so-called control parameters that can be tuned experimentally. The system in its ground state is characterized by presence of specific correlation functions in different ranges of control parameters (these ranges are called ‘quantum phases’, and the transitions between them are called quantum phase transitions (QPTs)). Therefore it is important to calculate the properties of the ground state of the system as functions of control parameters (sometimes also the properties of the leading excitations are useful).
It often happens that the Hamiltonian of a one-dimensional (1D) quantum system is U(1) symmetric (like Hubbard or Heisenberg Hamiltonians). In this case any eigenstate of this system is also U(1) symmetric due to Mermin-Wagner theorem PhysRevLett.17.1133 even in the thermodynamic limit. This holds for any temperature, including absolute zero. The same also holds for two-dimensional (2D) systems for finite temperatures. Therefore it is natural to utilize such a property of an eigenstate if is to be determined in the variational algorithms.
The states of a quantum system are typically represented by an ansatz called projected entangled pair states (PEPS) Orus2014 . The states of a one-dimensional system are thus represented as the simplest case of PEPS - the matrix product states (MPS) Schollwoeck2011 .
Let us restrict (without loss of generality) our discussion to spin systems. I stress that I consider only finite systems. The U(1) symmetric eigenstate of a spin system has a well-defined total spin projection . To ensure this, the elements of the MPS/PEPS tensors must have specific values. More precisely, the tensor elements whose positions do not satisfy certain ‘selection rules’ equal zero. Therefore, it is desirable to represent the MPS/PEPS in an appropriate form from the outset, from both physical and numerical (computational) reasons.
The block structure of each local PEPS (MPS in 1D) tensor is determined by Wigner-Eckart theorem PhysRevB.83.115125 . However, the Wigner-Eckart theorem concerns only quantum numbers (spin projections for a spin system) but not their degeneracies. Furthermore, the set of quantum numbers at each virtual (bond) dimension and their degeneracies are not dictated by the symmetry. The task is to calculate them, and it appears that in case of MPS for open boundary conditions (OBC) these sets can be calculated from first principles.
In this manuscript I outline the general way how the U(1) symmetric MPS for OBC may be constructed. The relation to well-known OBC implementations (e.g., McCulloch2007 ) will be stressed. Analogous idea can be used for construction of the U(1) symmetric MPS for periodic boundary conditions (PBC), as well as for U(1) symmetric PEPS. This material goes beyond the scope of the current manuscript. Only principal differences between OBC and PBC in 1D will be shown here, as well as between 1D MPS and 2D PEPS (on a square lattice) with OBC.
II Origin of the symmetry sectors
Let us denote the local physical index (a spin projection of a spin at site ) as . The local MPS tensor at position is rank-3 with and the left and the right virtual index, respectively. Analogously, the local PEPS tensor at position is rank-5 with the left, the right, the bottom and the top virtual indices.
Accordingly, the MPS for a 1D system of spins has the form
[TABLE]
while the PEPS for a spin square lattice is
[TABLE]
[TABLE]
Obviously, the sum over all virtual indices is taken in these two expressions, with physical indices remaining open.
The U(1) symmetry in tensor networks is treated so that each of the indices is decomposed into a quantum number (spin projection in this case) and its degeneracy index. For instance, in MPS. This decomposition may be understood best if one considers 1D OBC system and follows Ref. Schollwoeck2011 . The virtual indices label the states of an appropriate left/right subsystem, which in turn is obtained by adding sites one by one (thus enlarging the system). The number of states covered by a particular is thus determined by the size of the Hilbert space of the subsystem. In case of no symmetries (as in Ref. Schollwoeck2011 ) the number of states is a power of for any . Also it is obvious that physical (spin) indices can be decomposed trivially in the same way: .
If the eigenstate of a spin system is U(1) symmetric, the states of the Hilbert space of any subsystem need to be structured with regard to their total spin projection (see also Chapter III of Ref. PhysRevB.83.115125 ). It is easy for U(1) symmetry, as the basis of the Hilbert space of each spin is initially chosen as eigenbasis of the spin projection operator. Since the same spin projection of a subsystem can be created by many combinations of spin projections of local spins, the quantum numbers of a virtual (bond) index become degenerate.
In case of total spin projection the degeneracies of the quantum numbers at each are multinomial coefficients. Determination of the sets of quantum numbers + their degeneracies for non-trivial case is not obvious, but an appropriate algorithm exists, and the solution for is naturally derived as its special case. This is the essence of the next section.
III Evaluation of degeneracy sets for OBC
The MPS for OBC has dummy ends, i.e., leftmost and rightmost virtual indices and have size 1. The way to obtain the global total spin projection is generally outlined in many papers (see, e.g., Refs. PhysRevB.83.115125 ; McCulloch2007 ). One needs to ‘place’ the quantum numbers [math] and at the ends. I.e., dummy indices and decompose into U(1) symmetric form as: , . (The physical reason for this is that on the one hand and it is required to equal on the other hand)
The task is to determine the degeneracy sets at the virtual indices . The solution is hidden in the usual back-and-forth ‘sweeping’ DMRG manner Schollwoeck2011 . The system is split into left and right parts of and sites, respectively, and, as mentioned before, in the case of U(1) symmetry each part of the system has a set of possible spin projections, and , respectively. They have to satisfy the condition , that may exclude some of the and from the start (for example, if for spin-1 system, only and are acceptable).
One can notice that, in fact, , and therefore, . Obviously, the degeneracy of each and equals the degeneracy of ( and are non-degenerate) and it has be the same. However, it appears that the degeneracies of ’s created when constructing left part site by site are usually different from those created when constructing right part site by site. Therefore the procedure is: such degeneracies in the left and in the right part must be calculated for each , and their intersection should be taken. This procedure is demonstrated in the Appendix for reader’s convenience.
The block structure of the MPS is determined by a Wigner-Eckart theorem, which takes a very simple form in the case of U(1) symmetry. One obtains for MPS that nonzero elements would be for such combinations that
[TABLE]
These conditions plus the determined degeneracy sets for each virtual index are sufficient to construct the MPS (see two examples in Appendix).
Remark. Exactly the same algorithm can be applied also to SU(2) symmetric MPS for OBC, except that the representations of the spin projection will be replaced by representations of the total spin.
IV The algorithm of MPS evaluation
The previous section represents the most of what U(1) symmetry consideration can provide. The sizes of the MPS tensors at each site as well as the positions of their nonzero elements can be determined. These nonzero elements must be determined explicitly now.
The most advantageous way to do this is to represent the 1D Hamiltonian in the form of matrix product operator (MPO):
[TABLE]
(explicit example of the MPO for the XXZ model is given in Sec. 6.1 of Schollwoeck2011 ). Then the MPS elements can be evaluated by optimization algorithm described on page 67 of Ref. Schollwoeck2011 . Consecutive minimization of the Lagrangian with respect to each conjugated tensor leads to the eigenvalue problem:
[TABLE]
Vector contains the elements of , and the effective Hamiltonian contains the entire MPO and the MPS elements at all sites except (which are fixed at the current iteration). One ‘sweeps’ the system back and forth, thus varying MPS parameters site-by-site, and the quantity eventually converges to the real eigen-energy.
The aforementioned algorithm is self-contained, therefore I do not review it here. I only refer to two peculiarities that arise for our MPS ansatz:
After the matrix for the eigenvalue problem is constructed at current site , its rows and columns which correspond to zero elements of have to be discarded. 2. 2.
Left- and right-normalization routine. After new tensor is obtained from the eigenvalue problem, it is regauged in such way that (right sweep) or (left sweep), which keeps the wavefunction normalized.
Some of the zero entries of the matrix are obtained only from zero MPS elements, therefore appropriate equalities are satisfied automatically (). Still, the other entries of (which are either 1 or 0) impose a number of conditions on nonzero MPS elements they are calculated of. Remarkably, the number of independent MPS elements is thus exactly the same as if the state under consideration was represented in the usual form . This fact clearly shows that the approach is exact, and it is also demonstrated in Appendix.
V The advantages of the approach
The way how the proposed approach is connected to well-known OBC DMRG implementations (e.g., Ref. McCulloch2007 ) helps to understand its advantages.
Obviously, the essence of both methods is the same. The thing which differs is the initial MPS ansatz to be optimized. The degeneracy sets are not pre-computed in McCulloch’s approach, but they have to be initially set to something. Typically only 2-3 sectors with degeneracy 1 are taken, and such MPS (despite having the required ) is typically very far from the real eigenstate of the Hamiltonian. The degeneracy sets have to expand throughout the algorithm, otherwise the wrong initial guess makes the algorithm stuck in the local minimum. To avoid this, specific DMRG-like perturbation is applied to the reduced density matrix of the system during MPS regauging. It creates new quantum numbers and changes their degeneracies dynamically throughout the algorithm. Therefore McCulloch’s algorithm finally comes to an eigenstate with a good precision (it may be even exact, if the computer can handle the maximal needed MPS size).
Obviously, the crucial quantity that determines the performance of the algorithm is the maximum MPS size . The largest that can be handled by nowadays computer powers is roughly 20000. Therefore there are two possibilities:
The MPS size that arises in the proposed algorithm can be handled by the computer:
In this case the proposed algorithm does not need any perturbations (unlike McCulloch’s algorithm). The degeneracy sets are known from the start, and they do not need to be changed throughout the algorithm. The MPS is determined exactly, and it happens already within one sweep. McCulloch’s algorithm also determines the eigenstate exactly, but it requires bigger number of sweeps and larger computational time. The time ratio for two algorithms was checked for various cases, and it varied from 1.5 to 4. 2. 2.
The MPS size that arises in the proposed algorithm exceeds the ‘critical’ number (this happens in a large enough system):
In this case the MPS size has to be cut in both algorithms. The perturbation to the reduced density matrix becomes crucial in both implementations (our ‘cut’ guess for the degeneracy sets may also be ‘not very good’). This perturbation enables to judge which quantum numbers to keep (i.e., which are most relevant) and with what degeneracies (the degeneracies of some of the kept quantum numbers have to be reduced). I conclude from my experience as well as the experience of other authors that the ‘relevant’ degeneracy sets become strongly dependent on the Hamiltonian under consideration (roughly said, on the value(s) of the control parameter(s)). The timing of both approaches becomes approximately the same.
VI Test of the algorithm
The algorithm was checked on a XXZ model with OBC
[TABLE]
with the spin- SU(2) matrix representations (in case of they are Pauli matrices divided by 2). is called the anisotropy parameter.
The tests were performed on small systems, so that the obtained results can be easily checked by exact diagonalization. Namely, I took spin-1/2 XXZ chain of 12 sites (largest possible MPS size is 64) and spin-1 XXZ chain of 8 sites (largest possible MPS size is 81). The appropriate energies of the lowest and states in the range are given in Tables 1, 2. The results clearly indicate the correctness of the approach. As a matter of fact, many of the relative errors presented there are extremely tiny but negative numbers, therefore they are most probably ‘numerical noise’. It is also checked that the variance per site that shows the ‘eigen-ness’ of the state is always on the level of ‘numerical noise’.
It should again be noted that the degeneracy sets do not depend on the Hamiltonian in most cases. The (advantageous) deviation from this rule was found only in the vicinity of a highly entangled point . The reason is: at many coefficients in the expansion have integer ratio. Therefore, such a state is represented by effectively less parameters than the general state. Accordingly, some elements that were supposed to be nonzero become 0 after optimization. This does not change the sets of quantum numbers, but all their degeneracies effectively reduce to 1 in this case.
VII Difference between OBC and PBC
In the case of periodic boundary conditions the calculations are often made using MPS for OBC, just adding one term to the Hamiltonian. On the other hand, special ansatz was introduced PhysRevLett.93.227205 for this purpose, with all the virtual indices equal in rights. Now again, but these indices are not dummy. Therefore it seems somewhat nonphysical to attach different quantum numbers to these indices (unlike OBC). Instead there will be usually more than one quantum number, but the same degeneracy set must be attached to (let us call it a ‘boundary index’).
The construction and operation of U(1) symmetric MPS for PBC is discussed in detail in Ref. PhysRevB.93.054417 . However, the degeneracy sets are chosen by ‘trial and error’ there. If the choice is ‘bad’, the convergence is slow and the precision of the result is badly affected. The algorithm presented here (when properly adapted to PBC) would help to make this choice ‘wisely’. This would speed-up the convergence significantly (by reduction of the number of optimization steps) and simultaneously improve the precision. It will be demonstrated in a further publication Rakov-unpublished . I only stress the main differences between MPS for OBC and MPS for PBC in the current manuscript:
Boundary quantum number is non-degenerate and has well-defined value (0 or ) for OBC, while boundary quantum numbers and their degeneracies must be prescribed for PBC, 2. 2.
The quantum numbers in OBC are well-defined for any virtual index, while in PBC they can be calculated only up to a constant. Thus, in MPS for OBC the quantum numbers carry physical meaning, while in MPS for PBC they do not, 3. 3.
In MPS for OBC the degeneracy sets grow from the edges to the centre, thus they are unequal. In MPS for PBC unequal degeneracy sets appear only in non-translation invariant Hamiltonians, 4. 4.
A specific issue for fermionic systems. In MPS for OBC the quantum numbers of the virtual indices have step 1 (e.g., -3/2, -1/2, 1/2, 3/2), but in MPS for PBC numerical experience shows that the step must be 1/2 (e.g., -1, -1/2, 0, 1/2, 1).
VIII Difference between 1D (MPS) and 2D (PEPS) cases
The 2D quantum Hamiltonians with continuous symmetries were investigated, e.g., in Refs. PhysRevB.83.125106 ; PhysRevB.95.235107 . Infinite-size systems were discussed in both publications, and the degeneracy sets were determined by trial and error. Imaginary-time evolution was applied for calculation of local tensors instead of the variational algorithm in PhysRevB.95.235107 .
Explicit treatment of continuous symmetries in 2D quantum Hamiltonians offers substantial speed-up of the calculations, as it reduces the number of parameters within the same PEPS size. In this section I outline basic ideas for the future publication on this issue Rakov-unpublished . Again, the task is to determine the degeneracy sets for the virtual indices. Let us discuss U(1) symmetric PEPS by example of 2D finite-size square lattice with OBC.
The ‘selection rule’ for the 5-index combination
is
[TABLE]
with dummy indices .
It is obvious from Fig. 1(b,c) that lattice with OBC is equivalent to a 1D system of 4 sites with PBC. Its PEPS can therefore be handled similarly to MPS for PBC. The degeneracy sets for virtual dimensions are easy to calculate here, and they slightly depend on the Hamiltonian under consideration. In this simple case one can also use the largest degeneracy set which occurs in the OBC system of size 4.
The situation becomes more complicated for lattice size larger than 2. Total spin projection was ensured by attaching quantum numbers 0 and to two boundary virtual indices in 1D. These numbers have to be split in two equal portions in 2D. Therefore, one should attach quantum number 0 to the left as well as to the bottom virtual index of the (corner) bottom left site () and quantum number to the right as well as to the top virtual index of the (corner) top right site (). I.e., , . The algorithm for the determination of the degeneracy sets combines the features of 1D OBC and 1D PBC cases, and this will be discussed elsewhere Rakov-unpublished .
IX Conclusions
The algorithm for calculation (from first principles) of the sets of symmetry sectors for virtual indices of U(1) symmetric matrix product states (MPS) for open boundary conditions is described. Principal difference between open (OBC) and periodic (PBC) boundary conditions is stressed. Similar algorithm for PBC will be outlined in a further publication. The extension to 2D case, i.e., to U(1) symmetric projected entangled pair states (PEPS), appears to be more like in MPS for PBC.
Exactness and correct performance of the algorithm is demonstrated on the eigenstates of spin-1/2 and spin-1 systems with various spin projections . It can be checked both analytically and numerically that the predicted degeneracy sets are sufficient to calculate any Hamiltonian of such systems up to 12-14 significant digits. Two explicit examples of the MPS construction are given in the Appendix for reader’s convenience.
X Appendix
X.1 Example of symmetry sector construction: spin-1/2 case
The MPS for a spin-1/2 system of sites with total spin projection is constructed here. According to the algorithm, we set a priori: , .
Let us now construct all possibilities by adding sites one by one from the left, starting from . Each site can give , so we get:
, ,
,
,
, ,
.
Let us now construct all the possibilities by adding sites one by one from the right, starting from . We get:
, ,
,
,
,
.
The intersection gives the needed degeneracy sets: (in line with a priori setting),
, ,
, , ,
(again - in line with a priori setting).
In accordance to the selection rule one obtains the block structure of MPS matrices as follows:
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
Here, ‘x’ denote nonzero matrix elements (which are usually different even inside the same matrix). These nonzero elements are determined in the optimization procedure outlined in Section 4.
It is interesting to show that the number of independent MPS parameters exactly covers the necessary basis to construct the state with required . We have 4 spins ‘up’ and 2 spins ‘down’, therefore there are 15 relevant basis states . The normalization condition makes the number of independent parameters .
Our MPS ansatz contains 42 nonzero elements. After the optimization all 6 MPS tensors are right-normalized. One can calculate the number of conditions that would make satisfied for through 6. For our MPS ansatz the matrices are
[TABLE]
[TABLE]
There are conditions overall. The number of independent MPS parameters is therefore as expected.
X.2 Example of symmetry sector construction: spin-1 case
The MPS for a spin-1 system of sites with total spin projection is constructed here. According to the algorithm, we set a priori: , .
Let us calculate all possible combinations by adding sites one by one from the left, starting from . Each site can give , so we get:
, ,
,
,
.
Let us calculate all possible combinations by adding sites one by one from the right, starting from . We get: ,
,
,
.
The intersection gives appropriate sets for each virtual index: (in line with a priori setting), , , , (again - in line with a priori setting).
In accordance to the selection rule one obtains the block structure of MPS matrices as follows:
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
Again ‘x’ denote nonzero matrix elements to be determined in the optimization procedure outlined in Section 4.
Let us show again that the number of independent MPS parameters covers the necessary basis to construct the state with required . In this case we have either 3 spins with and 1 spin with , or 2 spins with and 2 spins with . Therefore there are 10 possible basis states , and the normalization condition reduces the number of independent parameters by 1: .
There are 22 nonzero elements in our MPS ansatz. After the optimization all 4 MPS tensors are right-normalized. The conditions must be satisfied for through 4. For our MPS ansatz the matrices are
[TABLE]
[TABLE]
It gives equations overall. The number of independent MPS parameters is therefore as expected.
Acknowledgements.
Useful discussions with Ian P. McCulloch are highly appreciated. The author also thanks Physikalisch-Technische Bundesanstalt (Braunschweig, Germany) for provision of Mathematica software during guest visits.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) H.J. Mikeska, A.K. Kolezhuk, in Quantum Magnetism , Lecture Notes in Physics , vol. 645, ed. by U. Schollwöck, J. Richter, D.J.J. Farnell, R.F. Bishop (Springer Berlin Heidelberg, 2004), pp. 1–83.
- 2(2) W. Brenig, Phys. Rep. 251 , 153 (1995).
- 3(3) X. Chen, Z.C. Gu, X.G. Wen, Phys. Rev. B 82 , 155138 (2010).
- 4(4) F. Dalfovo, S. Giorgini, L.P. Pitaevskii, S. Stringari, Rev. Mod. Phys. 71 , 463 (1999).
- 5(5) A. Kitaev, Ann. Phys. 321 , 2 (2006).
- 6(6) X.G. Wen, Int. J. Mod. Phys. B 4 , 239 (1990).
- 7(7) L.M. Duan, E. Demler, M.D. Lukin, Phys. Rev. Lett. 91 , 090402 (2003).
- 8(8) A. Micheli, G.K. Brennen, P. Zoller, Nature Physics 2 , 341 (2006).
