We prove a version of McDiarmid’s bounded differences inequality for Markov chains, with constants proportional to the mixing time of the chain. We also show variance bounds and Bernstein-type inequalities for empirical averages of Markov chains. In the case of non-reversible chains, we introduce a new quantity called the “pseudo spectral gap”, and show that it plays a similar role for non-reversible chains as the spectral gap plays for reversible chains. Our techniques for proving these results are based on a coupling construction of Katalin Marton, and on spectral techniques due to Pascal Lezaud. The pseudo spectral gap generalises the multiplicative reversiblication approach of Jim Fill.
References
Adamczak, Radosław. A tail inequality for suprema of unbounded empirical processes with applications to Markov chains. Electron. J. Probab. 13 (2008), no. 34, 1000–1034.Adamczak, Radosław. A tail inequality for suprema of unbounded empirical processes with applications to Markov chains. Electron. J. Probab. 13 (2008), no. 34, 1000–1034.
Adamczak, Radosław and Bednorz, Witold (2012). Exponential concentration inequalities for additive functionals of Markov chains. arXiv:1201.3569. 1201.3569 1364.60028 10.1051/ps/2014032Adamczak, Radosław and Bednorz, Witold (2012). Exponential concentration inequalities for additive functionals of Markov chains. arXiv:1201.3569. 1201.3569 1364.60028 10.1051/ps/2014032
Boucheron, Stéphane, Lugosi, Gábor and Massart, Pascal (2013). Concentration Inequalities: A Nonasymptotic Theory of Independence. OUP Oxford. 1279.60005Boucheron, Stéphane, Lugosi, Gábor and Massart, Pascal (2013). Concentration Inequalities: A Nonasymptotic Theory of Independence. OUP Oxford. 1279.60005
Chazottes, Jean-Rene; Redig, Frank. Concentration inequalities for Markov processes via coupling. Electron. J. Probab. 14 (2009), no. 40, 1162–1180. 1191.60023 10.1214/EJP.v14-657Chazottes, Jean-Rene; Redig, Frank. Concentration inequalities for Markov processes via coupling. Electron. J. Probab. 14 (2009), no. 40, 1162–1180. 1191.60023 10.1214/EJP.v14-657
Chazottes, J.-R.; Collet, P.; Kulske, C.; Redig, F. Concentration inequalities for random fields via coupling. Probab. Theory Related Fields 137 (2007), no. 1-2, 201–225. 1111.60070 10.1007/s00440-006-0026-1Chazottes, J.-R.; Collet, P.; Kulske, C.; Redig, F. Concentration inequalities for random fields via coupling. Probab. Theory Related Fields 137 (2007), no. 1-2, 201–225. 1111.60070 10.1007/s00440-006-0026-1
Devroye, Luc; Lugosi, Gábor. Combinatorial methods in density estimation. Springer Series in Statistics. Springer-Verlag, New York, 2001. xii+208 pp. ISBN: 0-387-95117-2Devroye, Luc; Lugosi, Gábor. Combinatorial methods in density estimation. Springer Series in Statistics. Springer-Verlag, New York, 2001. xii+208 pp. ISBN: 0-387-95117-2
Diaconis, Persi; Holmes, Susan; Montgomery, Richard. Dynamical bias in the coin toss. SIAM Rev. 49 (2007), no. 2, 211–235. 05167724 10.1137/S0036144504446436Diaconis, Persi; Holmes, Susan; Montgomery, Richard. Dynamical bias in the coin toss. SIAM Rev. 49 (2007), no. 2, 211–235. 05167724 10.1137/S0036144504446436
Djellout, H.; Guillin, A.; Wu, L. Transportation cost-information inequalities and applications to random dynamical systems and diffusions. Ann. Probab. 32 (2004), no. 3B, 2702–2732. 1061.60011 10.1214/009117904000000531 euclid.aop/1091813628Djellout, H.; Guillin, A.; Wu, L. Transportation cost-information inequalities and applications to random dynamical systems and diffusions. Ann. Probab. 32 (2004), no. 3B, 2702–2732. 1061.60011 10.1214/009117904000000531 euclid.aop/1091813628
Doeblin, Wolfang (1938). Exposé de la théorie des chaines simples constantes de Markova un nombre fini d'états. Mathématique de l'Union Interbalkanique 78–80.Doeblin, Wolfang (1938). Exposé de la théorie des chaines simples constantes de Markova un nombre fini d'états. Mathématique de l'Union Interbalkanique 78–80.
Douc, Randal; Moulines, Eric; Olsson, Jimmy; van Handel, Ramon. Consistency of the maximum likelihood estimator for general hidden Markov models. Ann. Statist. 39 (2011), no. 1, 474–513. 1209.62194 10.1214/10-AOS834 euclid.aos/1297779854Douc, Randal; Moulines, Eric; Olsson, Jimmy; van Handel, Ramon. Consistency of the maximum likelihood estimator for general hidden Markov models. Ann. Statist. 39 (2011), no. 1, 474–513. 1209.62194 10.1214/10-AOS834 euclid.aos/1297779854
Dvoretzky, A.; Kiefer, J.; Wolfowitz, J. Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. Ann. Math. Statist. 27 (1956), 642–669. 0073.14603 10.1214/aoms/1177728174 euclid.aoms/1177728174Dvoretzky, A.; Kiefer, J.; Wolfowitz, J. Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. Ann. Math. Statist. 27 (1956), 642–669. 0073.14603 10.1214/aoms/1177728174 euclid.aoms/1177728174
Fiebig, Doris. Mixing properties of a class of Bernoulli-processes. Trans. Amer. Math. Soc. 338 (1993), no. 1, 479–493. 0783.60038 10.1090/S0002-9947-1993-1102220-0Fiebig, Doris. Mixing properties of a class of Bernoulli-processes. Trans. Amer. Math. Soc. 338 (1993), no. 1, 479–493. 0783.60038 10.1090/S0002-9947-1993-1102220-0
Fill, James Allen. Eigenvalue bounds on convergence to stationarity for nonreversible Markov chains, with an application to the exclusion process. Ann. Appl. Probab. 1 (1991), no. 1, 62–87. 0726.60069 10.1214/aoap/1177005981 euclid.aoap/1177005981Fill, James Allen. Eigenvalue bounds on convergence to stationarity for nonreversible Markov chains, with an application to the exclusion process. Ann. Appl. Probab. 1 (1991), no. 1, 62–87. 0726.60069 10.1214/aoap/1177005981 euclid.aoap/1177005981
Gillman, David. A Chernoff bound for random walks on expander graphs. SIAM J. Comput. 27 (1998), no. 4, 1203–1220. 0911.60016 10.1137/S0097539794268765Gillman, David. A Chernoff bound for random walks on expander graphs. SIAM J. Comput. 27 (1998), no. 4, 1203–1220. 0911.60016 10.1137/S0097539794268765
Glynn, Peter W.; Ormoneit, Dirk. Hoeffding's inequality for uniformly ergodic Markov chains. Statist. Probab. Lett. 56 (2002), no. 2, 143–146. 0999.60019 10.1016/S0167-7152(01)00158-4Glynn, Peter W.; Ormoneit, Dirk. Hoeffding's inequality for uniformly ergodic Markov chains. Statist. Probab. Lett. 56 (2002), no. 2, 143–146. 0999.60019 10.1016/S0167-7152(01)00158-4
Goldstein, Sheldon. Maximal coupling. Z. Wahrsch. Verw. Gebiete 46 (1978/79), no. 2, 193–204. MR516740 0398.60097 10.1007/BF00533259Goldstein, Sheldon. Maximal coupling. Z. Wahrsch. Verw. Gebiete 46 (1978/79), no. 2, 193–204. MR516740 0398.60097 10.1007/BF00533259
Hu, ShuLan. Transportation inequalities for hidden Markov chains and applications. Sci. China Math. 54 (2011), no. 5, 1027–1042. 1225.60031 10.1007/s11425-011-4178-9Hu, ShuLan. Transportation inequalities for hidden Markov chains and applications. Sci. China Math. 54 (2011), no. 5, 1027–1042. 1225.60031 10.1007/s11425-011-4178-9
Janson, Svante. Large deviations for sums of partly dependent random variables. Random Structures Algorithms 24 (2004), no. 3, 234–248. 1044.60021 10.1002/rsa.20008Janson, Svante. Large deviations for sums of partly dependent random variables. Random Structures Algorithms 24 (2004), no. 3, 234–248. 1044.60021 10.1002/rsa.20008
Kontorovich, Leonid. Measure concentration of strongly mixing processes with applications. Thesis (Ph.D.) - Carnegie Mellon University. ProQuest LLC, Ann Arbor, MI, 2007. 79 pp. ISBN: 978-0549-19078-3 http://www.cs.bgu.ac.il/~karyeh/thesis.pdfKontorovich, Leonid. Measure concentration of strongly mixing processes with applications. Thesis (Ph.D.) - Carnegie Mellon University. ProQuest LLC, Ann Arbor, MI, 2007. 79 pp. ISBN: 978-0549-19078-3 http://www.cs.bgu.ac.il/~karyeh/thesis.pdf
Kontorovich, Leonid; Ramanan, Kavita. Concentration inequalities for dependent random variables via the martingale method. Ann. Probab. 36 (2008), no. 6, 2126–2158. 1154.60310 10.1214/07-AOP384 euclid.aop/1229696598Kontorovich, Leonid; Ramanan, Kavita. Concentration inequalities for dependent random variables via the martingale method. Ann. Probab. 36 (2008), no. 6, 2126–2158. 1154.60310 10.1214/07-AOP384 euclid.aop/1229696598
Kontorovich, A. Obtaining measure concentration from Markov contraction. Markov Process. Related Fields 18 (2012), no. 4, 613–638. MR3051655 1286.60073Kontorovich, A. Obtaining measure concentration from Markov contraction. Markov Process. Related Fields 18 (2012), no. 4, 613–638. MR3051655 1286.60073
Ledoux, Michel. The concentration of measure phenomenon. Mathematical Surveys and Monographs, 89. American Mathematical Society, Providence, RI, 2001. x+181 pp. ISBN: 0-8218-2864-9 0995.60002Ledoux, Michel. The concentration of measure phenomenon. Mathematical Surveys and Monographs, 89. American Mathematical Society, Providence, RI, 2001. x+181 pp. ISBN: 0-8218-2864-9 0995.60002
Leon, Carlos A.; Perron, Francois. Optimal Hoeffding bounds for discrete reversible Markov chains. Ann. Appl. Probab. 14 (2004), no. 2, 958–970. MR2052909 1056.60070 10.1214/105051604000000170 euclid.aoap/1082737118Leon, Carlos A.; Perron, Francois. Optimal Hoeffding bounds for discrete reversible Markov chains. Ann. Appl. Probab. 14 (2004), no. 2, 958–970. MR2052909 1056.60070 10.1214/105051604000000170 euclid.aoap/1082737118
Levin, David A.; Peres, Yuval; Wilmer, Elizabeth L. Markov chains and mixing times. With a chapter by James G. Propp and David B. Wilson. American Mathematical Society, Providence, RI, 2009. xviii+371 pp. ISBN: 978-0-8218-4739-8 1160.60001Levin, David A.; Peres, Yuval; Wilmer, Elizabeth L. Markov chains and mixing times. With a chapter by James G. Propp and David B. Wilson. American Mathematical Society, Providence, RI, 2009. xviii+371 pp. ISBN: 978-0-8218-4739-8 1160.60001
Lezaud, Pascal. Chernoff-type bound for finite Markov chains. Ann. Appl. Probab. 8 (1998), no. 3, 849–867. 0938.60027 10.1214/aoap/1028903453 euclid.aoap/1028903453Lezaud, Pascal. Chernoff-type bound for finite Markov chains. Ann. Appl. Probab. 8 (1998), no. 3, 849–867. 0938.60027 10.1214/aoap/1028903453 euclid.aoap/1028903453
Lezaud,P.P. (1998b). Etude quantitative des cha^ines de Markov par perturbation de leur noyau. Thèse doctorat mathématiques appliquées de l'Université Paul Sabatier de Toulouse, Available at http://pom.tls.cena.fr/papers/thesis/these_lezaud.pdf.Lezaud,P.P. (1998b). Etude quantitative des cha^ines de Markov par perturbation de leur noyau. Thèse doctorat mathématiques appliquées de l'Université Paul Sabatier de Toulouse, Available at http://pom.tls.cena.fr/papers/thesis/these_lezaud.pdf.
Lezaud, Pascal. Chernoff and Berry-Esseen inequalities for Markov processes. ESAIM Probab. Statist. 5 (2001), 183–201. MR1875670 0998.60075 10.1051/ps:2001108Lezaud, Pascal. Chernoff and Berry-Esseen inequalities for Markov processes. ESAIM Probab. Statist. 5 (2001), 183–201. MR1875670 0998.60075 10.1051/ps:2001108
Lindvall, Torgny. Lectures on the coupling method. Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics. A Wiley-Interscience Publication. John Wiley & Sons, Inc., New York, 1992. xiv+257 pp. ISBN: 0-471-54025-0 0850.60019Lindvall, Torgny. Lectures on the coupling method. Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics. A Wiley-Interscience Publication. John Wiley & Sons, Inc., New York, 1992. xiv+257 pp. ISBN: 0-471-54025-0 0850.60019
Lubetzky, E. and Sly,A. (2009). Cutoff for the Ising model on the lattice. Inventiones Mathematicae 1–37. MR3020173 1273.82014 10.1007/s00222-012-0404-5Lubetzky, E. and Sly,A. (2009). Cutoff for the Ising model on the lattice. Inventiones Mathematicae 1–37. MR3020173 1273.82014 10.1007/s00222-012-0404-5
Marton, Katalin. Bounding d-distance by informational divergence: a method to prove measure concentration. Ann. Probab. 24 (1996), no. 2, 857–866. 0865.60017 10.1214/aop/1039639365 euclid.aop/1039639365Marton, Katalin. Bounding d-distance by informational divergence: a method to prove measure concentration. Ann. Probab. 24 (1996), no. 2, 857–866. 0865.60017 10.1214/aop/1039639365 euclid.aop/1039639365
Marton, Katalin. A measure concentration inequality for contracting Markov chains. Geom. Funct. Anal. 6 (1996), no. 3, 556–571. 0856.60072 10.1007/BF02249263Marton, Katalin. A measure concentration inequality for contracting Markov chains. Geom. Funct. Anal. 6 (1996), no. 3, 556–571. 0856.60072 10.1007/BF02249263
Marton, Katalin. Measure concentration for a class of random processes. Probab. Theory Related Fields 110 (1998), no. 3, 427–439. MR1616492 0927.60050 10.1007/s004400050154Marton, Katalin. Measure concentration for a class of random processes. Probab. Theory Related Fields 110 (1998), no. 3, 427–439. MR1616492 0927.60050 10.1007/s004400050154
Marton, Katalin. Measure concentration and strong mixing. Studia Sci. Math. Hungar. 40 (2003), no. 1-2, 95–113. MR2002993 1027.60011 10.1556/SScMath.40.2003.1-2.8Marton, Katalin. Measure concentration and strong mixing. Studia Sci. Math. Hungar. 40 (2003), no. 1-2, 95–113. MR2002993 1027.60011 10.1556/SScMath.40.2003.1-2.8
Massart, Pascal. The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality. Ann. Probab. 18 (1990), no. 3, 1269–1283. 0713.62021 10.1214/aop/1176990746 euclid.aop/1176990746Massart, Pascal. The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality. Ann. Probab. 18 (1990), no. 3, 1269–1283. 0713.62021 10.1214/aop/1176990746 euclid.aop/1176990746
Merlevede, Florence; Peligrad, Magda; Rio, Emmanuel. A Bernstein type inequality and moderate deviations for weakly dependent sequences. Probab. Theory Related Fields 151 (2011), no. 3-4, 435–474. MR2851689 1242.60020 10.1007/s00440-010-0304-9Merlevede, Florence; Peligrad, Magda; Rio, Emmanuel. A Bernstein type inequality and moderate deviations for weakly dependent sequences. Probab. Theory Related Fields 151 (2011), no. 3-4, 435–474. MR2851689 1242.60020 10.1007/s00440-010-0304-9
Ollivier, Yann. Ricci curvature of Markov chains on metric spaces. J. Funct. Anal. 256 (2009), no. 3, 810–864. 1181.53015 10.1016/j.jfa.2008.11.001Ollivier, Yann. Ricci curvature of Markov chains on metric spaces. J. Funct. Anal. 256 (2009), no. 3, 810–864. 1181.53015 10.1016/j.jfa.2008.11.001
Paulin, Daniel. (2014a) Mixing and Concentration by Ricci Curvature. 2014. arXiv:1404.2802. 1404.2802 1335.60135 10.1016/j.jfa.2015.12.010Paulin, Daniel. (2014a) Mixing and Concentration by Ricci Curvature. 2014. arXiv:1404.2802. 1404.2802 1335.60135 10.1016/j.jfa.2015.12.010
Rio, Emmanuel. Inegalites de Hoeffding pour les fonctions lipschitziennes de suites dependantes. (French) [Hoeffding inequalities for Lipschitz functions of dependent sequences] C. R. Acad. Sci. Paris Ser. I Math. 330 (2000), no. 10, 905–908. MR1771956 0961.60032 10.1016/S0764-4442(00)00290-1Rio, Emmanuel. Inegalites de Hoeffding pour les fonctions lipschitziennes de suites dependantes. (French) [Hoeffding inequalities for Lipschitz functions of dependent sequences] C. R. Acad. Sci. Paris Ser. I Math. 330 (2000), no. 10, 905–908. MR1771956 0961.60032 10.1016/S0764-4442(00)00290-1
Roberts, Gareth O.; Rosenthal, Jeffrey S. General state space Markov chains and MCMC algorithms. Probab. Surv. 1 (2004), 20–71. 1189.60131 10.1214/154957804100000024Roberts, Gareth O.; Rosenthal, Jeffrey S. General state space Markov chains and MCMC algorithms. Probab. Surv. 1 (2004), 20–71. 1189.60131 10.1214/154957804100000024
Rosenthal, Jeffrey S. Faithful couplings of Markov chains: now equals forever. Adv. in Appl. Math. 18 (1997), no. 3, 372–381. MR1436487 0872.60050 10.1006/aama.1996.0515Rosenthal, Jeffrey S. Faithful couplings of Markov chains: now equals forever. Adv. in Appl. Math. 18 (1997), no. 3, 372–381. MR1436487 0872.60050 10.1006/aama.1996.0515
Samson, Paul-Marie. Concentration of measure inequalities for Markov chains and Phi-mixing processes. Ann. Probab. 28 (2000), no. 1, 416–461. 1044.60061 10.1214/aop/1019160125 euclid.aop/1019160125Samson, Paul-Marie. Concentration of measure inequalities for Markov chains and Phi-mixing processes. Ann. Probab. 28 (2000), no. 1, 416–461. 1044.60061 10.1214/aop/1019160125 euclid.aop/1019160125
Wintenberger, Olivier (2012). Weak transport inequalities and applications to exponential inequalities and oracle inequalities. arXiv:1207.4951 1207.4951 1328.60057 10.1214/EJP.v20-3558Wintenberger, Olivier (2012). Weak transport inequalities and applications to exponential inequalities and oracle inequalities. arXiv:1207.4951 1207.4951 1328.60057 10.1214/EJP.v20-3558
