-
Expressive power of tensor-network factorizations for probabilistic modeling, with applications from hidden Markov models to quantum machine learning
Authors:
Ivan Glasser,
Ryan Sweke,
Nicola Pancotti,
Jens Eisert,
J. Ignacio Cirac
Abstract:
Tensor-network techniques have enjoyed outstanding success in physics, and have recently attracted attention in machine learning, both as a tool for the formulation of new learning algorithms and for enhancing the mathematical understanding of existing methods. Inspired by these developments, and the natural correspondence between tensor networks and probabilistic graphical models, we provide a ri…
▽ More
Tensor-network techniques have enjoyed outstanding success in physics, and have recently attracted attention in machine learning, both as a tool for the formulation of new learning algorithms and for enhancing the mathematical understanding of existing methods. Inspired by these developments, and the natural correspondence between tensor networks and probabilistic graphical models, we provide a rigorous analysis of the expressive power of various tensor-network factorizations of discrete multivariate probability distributions. These factorizations include non-negative tensor-trains/MPS, which are in correspondence with hidden Markov models, and Born machines, which are naturally related to local quantum circuits. When used to model probability distributions, they exhibit tractable likelihoods and admit efficient learning algorithms. Interestingly, we prove that there exist probability distributions for which there are unbounded separations between the resource requirements of some of these tensor-network factorizations. Particularly surprising is the fact that using complex instead of real tensors can lead to an arbitrarily large reduction in the number of parameters of the network. Additionally, we introduce locally purified states (LPS), a new factorization inspired by techniques for the simulation of quantum systems, with provably better expressive power than all other representations considered. The ramifications of this result are explored through numerical experiments. Our findings imply that LPS should be considered over hidden Markov models, and furthermore provide guidelines for the design of local quantum circuits for probabilistic modeling.
△ Less
Submitted 29 November, 2019; v1 submitted 8 July, 2019;
originally announced July 2019.
-
NetKet: A Machine Learning Toolkit for Many-Body Quantum Systems
Authors:
Giuseppe Carleo,
Kenny Choo,
Damian Hofmann,
James E. T. Smith,
Tom Westerhout,
Fabien Alet,
Emily J. Davis,
Stavros Efthymiou,
Ivan Glasser,
Sheng-Hsuan Lin,
Marta Mauri,
Guglielmo Mazzola,
Christian B. Mendl,
Evert van Nieuwenburg,
Ossian O'Reilly,
Hugo Théveniaut,
Giacomo Torlai,
Alexander Wietek
Abstract:
We introduce NetKet, a comprehensive open source framework for the study of many-body quantum systems using machine learning techniques. The framework is built around a general and flexible implementation of neural-network quantum states, which are used as a variational ansatz for quantum wave functions. NetKet provides algorithms for several key tasks in quantum many-body physics and quantum tech…
▽ More
We introduce NetKet, a comprehensive open source framework for the study of many-body quantum systems using machine learning techniques. The framework is built around a general and flexible implementation of neural-network quantum states, which are used as a variational ansatz for quantum wave functions. NetKet provides algorithms for several key tasks in quantum many-body physics and quantum technology, namely quantum state tomography, supervised learning from wave-function data, and ground state searches for a wide range of customizable lattice models. Our aim is to provide a common platform for open research and to stimulate the collaborative development of computational methods at the interface of machine learning and many-body physics.
△ Less
Submitted 29 March, 2019;
originally announced April 2019.
-
From probabilistic graphical models to generalized tensor networks for supervised learning
Authors:
Ivan Glasser,
Nicola Pancotti,
J. Ignacio Cirac
Abstract:
Tensor networks have found a wide use in a variety of applications in physics and computer science, recently leading to both theoretical insights as well as practical algorithms in machine learning. In this work we explore the connection between tensor networks and probabilistic graphical models, and show that it motivates the definition of generalized tensor networks where information from a tens…
▽ More
Tensor networks have found a wide use in a variety of applications in physics and computer science, recently leading to both theoretical insights as well as practical algorithms in machine learning. In this work we explore the connection between tensor networks and probabilistic graphical models, and show that it motivates the definition of generalized tensor networks where information from a tensor can be copied and reused in other parts of the network. We discuss the relationship between generalized tensor network architectures used in quantum physics, such as string-bond states, and architectures commonly used in machine learning. We provide an algorithm to train these networks in a supervised-learning context and show that they overcome the limitations of regular tensor networks in higher dimensions, while keeping the computation efficient. A method to combine neural networks and tensor networks as part of a common deep learning architecture is also introduced. We benchmark our algorithm for several generalized tensor network architectures on the task of classifying images and sounds, and show that they outperform previously introduced tensor-network algorithms. The models we consider also have a natural implementation on a quantum computer and may guide the development of near-term quantum machine learning architectures.
△ Less
Submitted 3 December, 2019; v1 submitted 15 June, 2018;
originally announced June 2018.
-
Neural-Network Quantum States, String-Bond States, and Chiral Topological States
Authors:
Ivan Glasser,
Nicola Pancotti,
Moritz August,
Ivan D. Rodriguez,
J. Ignacio Cirac
Abstract:
Neural-Network Quantum States have been recently introduced as an Ansatz for describing the wave function of quantum many-body systems. We show that there are strong connections between Neural-Network Quantum States in the form of Restricted Boltzmann Machines and some classes of Tensor-Network states in arbitrary dimensions. In particular we demonstrate that short-range Restricted Boltzmann Machi…
▽ More
Neural-Network Quantum States have been recently introduced as an Ansatz for describing the wave function of quantum many-body systems. We show that there are strong connections between Neural-Network Quantum States in the form of Restricted Boltzmann Machines and some classes of Tensor-Network states in arbitrary dimensions. In particular we demonstrate that short-range Restricted Boltzmann Machines are Entangled Plaquette States, while fully connected Restricted Boltzmann Machines are String-Bond States with a nonlocal geometry and low bond dimension. These results shed light on the underlying architecture of Restricted Boltzmann Machines and their efficiency at representing many-body quantum states. String-Bond States also provide a generic way of enhancing the power of Neural-Network Quantum States and a natural generalization to systems with larger local Hilbert space. We compare the advantages and drawbacks of these different classes of states and present a method to combine them together. This allows us to benefit from both the entanglement structure of Tensor Networks and the efficiency of Neural-Network Quantum States into a single Ansatz capable of targeting the wave function of strongly correlated systems. While it remains a challenge to describe states with chiral topological order using traditional Tensor Networks, we show that Neural-Network Quantum States and their String-Bond States extension can describe a lattice Fractional Quantum Hall state exactly. In addition, we provide numerical evidence that Neural-Network Quantum States can approximate a chiral spin liquid with better accuracy than Entangled Plaquette States and local String-Bond States. Our results demonstrate the efficiency of neural networks to describe complex quantum wave functions and pave the way towards the use of String-Bond States as a tool in more traditional machine-learning applications.
△ Less
Submitted 7 March, 2018; v1 submitted 11 October, 2017;
originally announced October 2017.
-
Lattice effects on Laughlin wave functions and parent Hamiltonians
Authors:
Ivan Glasser,
J. Ignacio Cirac,
Germán Sierra,
Anne E. B. Nielsen
Abstract:
We investigate lattice effects on wave functions that are lattice analogues of bosonic and fermionic Laughlin wave functions with number of particles per flux $ν=1/q$ in the Landau levels. These wave functions are defined analytically on lattices with $μ$ particles per lattice site, where $μ$ may be different than $ν$. We give numerical evidence that these states have the same topological properti…
▽ More
We investigate lattice effects on wave functions that are lattice analogues of bosonic and fermionic Laughlin wave functions with number of particles per flux $ν=1/q$ in the Landau levels. These wave functions are defined analytically on lattices with $μ$ particles per lattice site, where $μ$ may be different than $ν$. We give numerical evidence that these states have the same topological properties as the corresponding continuum Laughlin states for different values of $q$ and for different fillings $μ$. These states define, in particular, particle-hole symmetric lattice Fractional Quantum Hall states when the lattice is half-filled. On the square lattice it is observed that for $q\leq 4$ this particle-hole symmetric state displays the topological properties of the continuum Laughlin state at filling fraction $ν=1/q$, while for larger $q$ there is a transition towards long-range ordered anti-ferromagnets. This effect does not persist if the lattice is deformed from a square to a triangular lattice, or on the Kagome lattice, in which case the topological properties of the state are recovered. We then show that changing the number of particles while keeping the expression of these wave functions identical gives rise to edge states that have the same correlations in the bulk as the reference lattice Laughlin states but a different density at the edge. We derive an exact parent Hamiltonian for which all these edge states are ground states with different number of particles. In addition this Hamiltonian admits the reference lattice Laughlin state as its unique ground state of filling factor $1/q$. Parent Hamiltonians are also derived for the lattice Laughlin states at other fillings of the lattice, when $μ\leq 1/q$ or $μ\geq 1-1/q$ and when $q=4$ also at half-filling.
△ Less
Submitted 2 December, 2016; v1 submitted 8 September, 2016;
originally announced September 2016.
-
Quasielectrons as inverse quasiholes in lattice fractional quantum Hall models
Authors:
Anne E. B. Nielsen,
Ivan Glasser,
Ivan D. Rodriguez
Abstract:
From an experimental point of view, quasielectrons and quasiholes play very similar roles in the fractional quantum Hall effect. Nevertheless, the theoretical description of quasielectrons is known to be much harder than the one of quasiholes. The problem is that one obtains a singularity in the wavefunction if one tries to naively construct the quasielectron as the inverse of the quasihole. Here,…
▽ More
From an experimental point of view, quasielectrons and quasiholes play very similar roles in the fractional quantum Hall effect. Nevertheless, the theoretical description of quasielectrons is known to be much harder than the one of quasiholes. The problem is that one obtains a singularity in the wavefunction if one tries to naively construct the quasielectron as the inverse of the quasihole. Here, we demonstrate that the same problem does not arise in lattice fractional quantum Hall models. This result allows us to make detailed investigations of the properties of quasielectrons, including their braiding statistics and density distribution on lattices on the plane and on the torus. We show that some of the states considered have high overlap with certain fractional Chern insulator states. We also derive few-body Hamiltonians, for which various states containing quasielectrons are exact ground states.
△ Less
Submitted 19 April, 2018; v1 submitted 8 September, 2016;
originally announced September 2016.
-
Exact parent Hamiltonians of bosonic and fermionic Moore-Read states on lattices and local models
Authors:
Ivan Glasser,
J. Ignacio Cirac,
Germán Sierra,
Anne E. B. Nielsen
Abstract:
We introduce a family of strongly-correlated spin wave functions on arbitrary spin-1/2 and spin-1 lattices in one and two dimensions. These states are lattice analogues of Moore-Read states of particles at filling fraction 1/q, which are non-Abelian Fractional Quantum Hall states in 2D. One parameter enables us to perform an interpolation between the continuum limit, where the states become contin…
▽ More
We introduce a family of strongly-correlated spin wave functions on arbitrary spin-1/2 and spin-1 lattices in one and two dimensions. These states are lattice analogues of Moore-Read states of particles at filling fraction 1/q, which are non-Abelian Fractional Quantum Hall states in 2D. One parameter enables us to perform an interpolation between the continuum limit, where the states become continuum Moore-Read states of bosons (odd q) and fermions (even q), and the lattice limit. We show numerical evidence that the topological entanglement entropy stays the same along the interpolation for some of the states we introduce in 2D, which suggests that the topological properties of the lattice states are the same as in the continuum, while the 1D states are critical states. We then derive exact parent Hamiltonians for these states on lattices of arbitrary size. By deforming these parent Hamiltonians, we construct local Hamiltonians that stabilize some of the states we introduce in 1D and in 2D.
△ Less
Submitted 19 May, 2015;
originally announced May 2015.
-
Construction of spin models displaying quantum criticality from quantum field theory
Authors:
Ivan Glasser,
J. Ignacio Cirac,
Germán Sierra,
Anne E. B. Nielsen
Abstract:
We provide a method for constructing finite temperature states of one-dimensional spin chains displaying quantum criticality. These models are constructed using correlators of products of quantum fields and have an analytical purification. Their properties can be investigated by Monte-Carlo simulations, which enable us to study the low-temperature phase diagram and to show that it displays a regio…
▽ More
We provide a method for constructing finite temperature states of one-dimensional spin chains displaying quantum criticality. These models are constructed using correlators of products of quantum fields and have an analytical purification. Their properties can be investigated by Monte-Carlo simulations, which enable us to study the low-temperature phase diagram and to show that it displays a region of quantum criticality. The mixed states obtained are shown to be close to the thermal state of a simple nearest neighbour Hamiltonian.
△ Less
Submitted 23 July, 2014; v1 submitted 16 May, 2014;
originally announced May 2014.
