Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3406325.3451035acmconferencesArticle/Chapter ViewAbstractPublication PagesstocConference Proceedingsconference-collections
research-article
Public Access

Optimal mixing of Glauber dynamics: entropy factorization via high-dimensional expansion

Published: 15 June 2021 Publication History

Abstract

We prove an optimal mixing time bound for the single-site update Markov chain known as the Glauber dynamics or Gibbs sampling in a variety of settings. Our work presents an improved version of the spectral independence approach of Anari et al. (2020) and shows O(nlogn) mixing time on any n-vertex graph of bounded degree when the maximum eigenvalue of an associated influence matrix is bounded. As an application of our results, for the hard-core model on independent sets weighted by a fugacity λ, we establish O(nlogn) mixing time for the Glauber dynamics on any n-vertex graph of constant maximum degree Δ when λ<λc(Δ) where λc(Δ) is the critical point for the uniqueness/non-uniqueness phase transition on the Δ-regular tree. More generally, for any antiferromagnetic 2-spin system we prove O(nlogn) mixing time of the Glauber dynamics on any bounded degree graph in the corresponding tree uniqueness region. Our results apply more broadly; for example, we also obtain O(nlogn) mixing for q-colorings of triangle-free graphs of maximum degree Δ when the number of colors satisfies q > α Δ where α ≈ 1.763, and O(mlogn) mixing for generating random matchings of any graph with bounded degree and m edges.
Our approach is based on two steps. First, we show that the approximate tensorization of entropy (i.e., factorizing entropy into single vertices), which is a key step for establishing the modified log-Sobolev inequality in many previous works, can be deduced from entropy factorization into blocks of fixed linear size. Second, we adapt the local-to-global scheme of Alev and Lau (2020) to establish such block factorization of entropy in a more general setting of pure weighted simplicial complexes satisfying local spectral expansion; this also substantially generalizes the result of Cryan et al. (2019).

References

[1]
Vedat Levi Alev and Lap Chi Lau. 2020. Improved analysis of higher order random walks and applications. In Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing (STOC). 1198–1211.
[2]
Nima Anari, Kuikui Liu, and Shayan Oveis Gharan. 2020. Spectral Independence in High-Dimensional Expanders and Applications to the Hardcore Model. In Proceedings of the 61st Annual IEEE Symposium on Foundations of Computer Science (FOCS). 1319–1330.
[3]
Nima Anari, Kuikui Liu, Shayan Oveis Gharan, and Cynthia Vinzant. 2019. Log-Concave Polynomials II: High-Dimensional Walks and an FPRAS for Counting Bases of a Matroid. In Proceedings of the 51st Annual ACM SIGACT Symposium on Theory of Computing (STOC). 1–12.
[4]
Mohsen Bayati, David Gamarnik, Dimitriy Katz, Chandra Nair, and Prasad Tetali. 2007. Simple Deterministic Approximation Algorithms for Counting Matchings. In Proceedings of the 39th Annual ACM SIGACT Symposium on Theory of Computing (STOC). 122–127.
[5]
Antonio Blanca, Pietro Caputo, Zongchen Chen, Daniel Parisi, Daniel \vStefankovi\vc, and Eric Vigoda. 2021. On Mixing of Markov Chains: Coupling, Spectral Independence, and Entropy Factorization. ArXiv preprint, arXiv:2103.07459 (2021).
[6]
Antonio Blanca, Pietro Caputo, Daniel Parisi, Alistair Sinclair, and Eric Vigoda. 2021. Entropy decay in the Swendsen-Wang dynamics. In Proceedings of the 53rd Annual ACM Symposium on Theory of Computing (STOC).
[7]
Sergey G Bobkov and Prasad Tetali. 2006. Modified logarithmic Sobolev inequalities in discrete settings. Journal of Theoretical Probability 19, 2 (2006), 289–336.
[8]
Christian Borgs, Jennifer Chayes, Jeff Kahn, and László Lovász. 2013. Left and right convergence of graphs with bounded degree. Random Structures & Algorithms 42, 1 (2013), 1–28.
[9]
Russ Bubley and Martin E. Dyer. 1997. Path Coupling: A Technique for Proving Rapid Mixing in Markov Chains. In Proceedings of the 38th Annual IEEE Symposium on Foundations of Computer Science (FOCS). 223–231.
[10]
Pietro Caputo, Georg Menz, and Prasad Tetali. 2015. Approximate tensorization of entropy at high temperature. In Annales de la Faculté des sciences de Toulouse: Mathématiques, Vol. 24. 691–716.
[11]
Pietro Caputo and Daniel Parisi. 2020. Block factorization of the relative entropy via spatial mixing. ArXiv preprint, arXiv:2004.10574 (2020).
[12]
Filippo Cesi. 2001. Quasi-factorization of the entropy and logarithmic Sobolev inequalities for Gibbs random fields. Probability Theory and Related Fields 120, 4 (2001), 569–584.
[13]
Sitan Chen, Michelle Delcourt, Ankur Moitra, Guillem Perarnau, and Luke Postle. 2019. Improved Bounds for Randomly Sampling Colorings via Linear Programming. In Proceedings of the 30th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA). 2216–2234.
[14]
Zongchen Chen, Andreas Galanis, Daniel \vStefankovi\vc, and Eric Vigoda. 2021. Rapid Mixing for Colorings via Spectral Independence. In Proceedings of the 32nd Annual ACM-SIAM Symposium on Discrete Algorithms (SODA). 1548–1557.
[15]
Zongchen Chen, Kuikui Liu, and Eric Vigoda. 2020. Optimal Mixing of Glauber Dynamics: Entropy Factorization via High-Dimensional Expansion. Full version at https://arxiv.org/pdf/2011.02075.pdf (2020).
[16]
Zongchen Chen, Kuikui Liu, and Eric Vigoda. 2020. Rapid Mixing of Glauber Dynamics up to Uniqueness via Contraction. In Proceedings of the 61st Annual IEEE Symposium on Foundations of Computer Science (FOCS). 1307–1318.
[17]
Mary Cryan, Heng Guo, and Giorgos Mousa. 2019. Modified log-Sobolev inequalities for strongly log-concave distributions. In Proceedings of the 60th Annual IEEE Symposium on Foundations of Computer Science (FOCS). 1358–1370.
[18]
Persi Diaconis and Laurent Saloff-Coste. 1996. Logarithmic Sobolev inequalities for finite Markov chains. The Annals of Applied Probability 6, 3 (1996), 695–750.
[19]
Irit Dinur and Tali Kaufman. 2017. High Dimensional Expanders Imply Agreement Expanders. In Proceedings of the 58th Annual IEEE Symposium on Foundations of Computer Science (FOCS). 974–985.
[20]
R. L. Dobrushin. 1970. Prescribing a System of Random Variables by Conditional Distributions. Theory of Probability and its Applications 15, 3 (1970), 458–486.
[21]
John Duchi. 2019. Information Theory and Statistics. Lecture Notes for Statistics 311 and Electrical Engineering 377 (2019), 304.
[22]
Martin E. Dyer, Alan M. Frieze, Thomas P. Hayes, and Eric Vigoda. 2013. Randomly coloring constant degree graphs. Random Struct. Algorithms 43, 2 (2013), 181–200.
[23]
Weiming Feng, Heng Guo, Yitong Yin, and Chihao Zhang. 2021. Rapid mixing from spectral independence beyond the Boolean domain. In Proceedings of the 32nd Annual ACM-SIAM Symposium on Discrete Algorithms (SODA). 1558–1577.
[24]
Andreas Galanis, Daniel \vStefankovi\vc, and Eric Vigoda. 2015. Inapproximability for Antiferromagnetic Spin Systems in the Tree Nonuniqueness Region. J. ACM 62, 6 (2015), 1–60.
[25]
Andreas Galanis, Daniel \vStefankovi\vc, and Eric Vigoda. 2016. Inapproximability of the Partition Function for the Antiferromagnetic Ising and Hard-Core Models. Combinatorics, Probability and Computing 25, 4 (2016), 500–559.
[26]
David Gamarnik, Dmitriy Katz, and Sidhant Misra. 2015. Strong spatial mixing of list coloring of graphs. Random Structures & Algorithms 46, 4 (2015), 599–613.
[27]
A. Guionnet and B. Zegarlinksi. 2003. Lectures on Logarithmic Sobolev Inequalities. Springer, Berlin, 1–134.
[28]
Heng Guo and Pinyan Lu. 2018. Uniqueness, Spatial Mixing, and Approximation for Ferromagnetic 2-Spin Systems. ACM Transactions on Computation Theory 10, 4, Article 17 (2018).
[29]
Thomas P. Hayes and Alistair Sinclair. 2007. A general lower bound for mixing of single-site dynamics on graphs. The Annals of Applied Probability 17, 3 (2007), 931–952.
[30]
Mark Jerrum. 1995. A very simple algorithm for estimating the number of $k$-colorings of a low-degree graph. Random Structures & Algorithms 7, 2 (1995), 157–165.
[31]
Mark Jerrum. 2003. Counting, Sampling and Integrating: Algorithms and Complexity. Birkhäuser Basel.
[32]
Mark Jerrum and Alistair Sinclair. 1989. Approximating the Permanent. SIAM J. Comput. 18, 6 (1989), 1149–1178.
[33]
Mark Jerrum and Alistair Sinclair. 1993. Polynomial-time approximation algorithms for the Ising model. SIAM J. Comput. 22, 5 (1993), 1087–1116.
[34]
Mark Jerrum, Leslie G. Valiant, and Vijay V. Vazirani. 1986. Random generation of combinatorial structures from a uniform distribution. Theoretical Computer Science 43 (1986), 169–188.
[35]
Tali Kaufman and David Mass. 2017. High Dimensional Random Walks and Colorful Expansion. In Proceedings of the 8th Innovations in Theoretical Computer Science Conference (ITCS). 4:1–4:27.
[36]
Tali Kaufman and David Mass. 2020. Local-To-Global Agreement Expansion via the Variance Method. In Proceedings of the 11th Innovations in Theoretical Computer Science Conference (ITCS). 74:1–74:14.
[37]
Tali Kaufman and Izhar Oppenheim. 2020. High Order Random Walks: Beyond Spectral Gap. Combinatorica 40 (2020), 245–281.
[38]
Vladimir Kolmogorov. 2018. A Faster Approximation Algorithm for the Gibbs Partition Function. In Proceedings of the 31st Conference On Learning Theory (COLT), Vol. 75. 228–249.
[39]
Liang Li, Pinyan Lu, and Yitong Yin. 2013. Correlation Decay Up to Uniqueness in Spin Systems. In Proceedings of the 24th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA). 67–84.
[40]
Fabio Martinelli. 1999. Lectures on Glauber Dynamics for Discrete Spin Models. Springer, Berlin, 93–191.
[41]
Fabio Martinelli, Alistair Sinclair, and Dror Weitz. 2003. The Ising model on trees: boundary conditions and mixing time. In Proceedings of the 44th Annual IEEE Symposium on Foundations of Computer Science (FOCS). 628–639.
[42]
Katalin Marton. 2019. Logarithmic Sobolev inequalities in discrete product spaces. Combinatorics, Probability & Computing 28, 6 (2019), 919–935.
[43]
Ravi Montenegro and Prasad Tetali. 2006. Mathematical aspects of mixing times in Markov chains. Foundations and Trends in Theoretical Computer Science 1, 3 (2006), 236–236.
[44]
Elchanan Mossel and Allan Sly. 2013. Exact thresholds for Ising-Gibbs samplers on general graphs. The Annals of Probability 41, 1 (2013), 294–328.
[45]
Izhar Oppenheim. 2018. Local spectral expansion approach to high dimensional expanders part I: Descent of spectral gaps. Discrete and Computational Geometry 59, 2 (2018), 293–330.
[46]
Yuval Peres and Peter Winkler. 2013. Can Extra Updates Delay Mixing? Communications in Mathematical Physics 323 (2013), 1007–1016.
[47]
Shuai Shao and Yuxin Sun. 2020. Contraction: A Unified Perspective of Correlation Decay and Zero-Freeness of 2-Spin Systems. In Proceedings of the 47th International Colloquium on Automata, Languages, and Programming (ICALP). 96:1–15.
[48]
Allan Sly. 2010. Computational Transition at the Uniqueness Threshold. In Proceedings of the 51st Annual IEEE Symposium on Foundations of Computer Science (FOCS). 287–296.
[49]
Allan Sly and Nike Sun. 2014. The Computational Hardness of Counting in Two-Spin Models on $d$-Regular Graphs. The Annals of Probability 42, 6 (2014), 2383–2416.
[50]
Daniel \vStefankovi\vc, Santosh Vempala, and Eric Vigoda. 2009. Adaptive simulated annealing: A near-optimal connection between sampling and counting. J. ACM 56, 3 (2009), 1–36.
[51]
Eric Vigoda. 1999. Improved Bounds for Sampling Colorings. In Proceedings of the 40th Annual Symposium on Foundations of Computer Science (FOCS). 51–59.
[52]
Dror Weitz. 2005. Combinatorial criteria for uniqueness of Gibbs measures. Random Structures & Algorithms 27, 4 (2005), 445–475.
[53]
Dror Weitz. 2006. Counting Independent Sets Up to the Tree Threshold. In Proceedings of the 38th Annual ACM Symposium on Theory of Computing (STOC). 140–149.

Cited By

View all
  • (2024)Fundamentals of partial rejection samplingProbability Surveys10.1214/24-PS2921:noneOnline publication date: 1-Jan-2024
  • (2024)Entropy inequalities for random walks and permutationsAnnales de l'Institut Henri Poincaré, Probabilités et Statistiques10.1214/22-AIHP126760:1Online publication date: 1-Feb-2024
  • (2024)Complexity of High-Dimensional Identity Testing with Coordinate Conditional SamplingACM Transactions on Algorithms10.1145/3686799Online publication date: 21-Aug-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
STOC 2021: Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing
June 2021
1797 pages
ISBN:9781450380539
DOI:10.1145/3406325
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Glauber dynamics
  2. high-dimensional expander
  3. modified log-Sobolev inequality
  4. spectral independence
  5. spin system

Qualifiers

  • Research-article

Funding Sources

Conference

STOC '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,469 of 4,586 submissions, 32%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)191
  • Downloads (Last 6 weeks)25
Reflects downloads up to 21 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Fundamentals of partial rejection samplingProbability Surveys10.1214/24-PS2921:noneOnline publication date: 1-Jan-2024
  • (2024)Entropy inequalities for random walks and permutationsAnnales de l'Institut Henri Poincaré, Probabilités et Statistiques10.1214/22-AIHP126760:1Online publication date: 1-Feb-2024
  • (2024)Complexity of High-Dimensional Identity Testing with Coordinate Conditional SamplingACM Transactions on Algorithms10.1145/3686799Online publication date: 21-Aug-2024
  • (2024)Fast and Perfect Sampling of Subgraphs and Polymer SystemsACM Transactions on Algorithms10.1145/363229420:1(1-30)Online publication date: 22-Jan-2024
  • (2024)Fast Sampling via Spectral Independence Beyond Bounded-degree GraphsACM Transactions on Algorithms10.1145/363135420:1(1-26)Online publication date: 22-Jan-2024
  • (2024)Rapid Mixing of Glauber Dynamics via Spectral Independence for All DegreesSIAM Journal on Computing10.1137/22M1474734(FOCS21-224-FOCS21-298)Online publication date: 13-Jun-2024
  • (2024)Boolean Function Analysis on High-Dimensional ExpandersCombinatorica10.1007/s00493-024-00084-544:3(563-620)Online publication date: 18-Mar-2024
  • (2023)Towards derandomising Markov chain Monte Carlo2023 IEEE 64th Annual Symposium on Foundations of Computer Science (FOCS)10.1109/FOCS57990.2023.00120(1963-1990)Online publication date: 6-Nov-2023
  • (2023)Optimal mixing of the down-up walk on independent sets of a given size2023 IEEE 64th Annual Symposium on Foundations of Computer Science (FOCS)10.1109/FOCS57990.2023.00101(1665-1681)Online publication date: 6-Nov-2023
  • (2023)From Grassmannian to Simplicial High-Dimensional Expanders2023 IEEE 64th Annual Symposium on Foundations of Computer Science (FOCS)10.1109/FOCS57990.2023.00099(1639-1648)Online publication date: 6-Nov-2023
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media