Abstract
A reversible jump algorithm for Bayesian model determination among generalised linear models, under relatively diffuse prior distributions for the model parameters, is proposed. Orthogonal projections of the current linear predictor are used so that knowledge from the current model parameters is used to make effective proposals. This idea is generalised to moves of a reversible jump algorithm for model determination among generalised linear mixed models. Therefore, this algorithm exploits the full flexibility available in the reversible jump method. The algorithm is demonstrated via two examples and compared to existing methods.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.References
Bartolucci, F., Scaccia, L., Mira, A.: Efficient Bayes factor estimation from the reversible jump output. Biometrika 93, 41–52 (2006)
Brooks, S.P., Giudici, P., Roberts, G.O.: Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions. J. R. Stat. Soc. (B) 65, 3–55 (2003)
Cai, B., Dunson, D.B.: Bayesian covariance selection in generalized linear mixed models. Biometrics 6, 446–457 (2006)
Dellaportas, P., Forster, J.J.: Markov chain Monte Carlo model determination for hierarchical and graphical log-linear models. Biometrika 86, 615–633 (1999)
Dellaportas, P., Forster, J.J., Ntzoufras, I.: Bayesian variable selection using the Gibbs sampler. In: Dey, D.K., Ghosh, S.K., Mallick, B.K. (eds.) Generalized Linear Models: A Bayesian Perspective. Dekker, New York (2000)
Edwards, D., Havranek, T.: A fast procedure for model search in multidimensional contingency tables. Biometrika 72, 339–351 (1985)
Fan, Y., Sisson, S.: Reversible jump Markov chain Monte Carlo. In: Brooks, S.P., A. Gelman, G. Jones, Meng, X.L. (eds.) MCMC Handbook (2010)
Fan, Y., Peters, G.W., Sisson, S.A.: Automating and evaluating reversible jump MCMC proposal distributions. Stat. Comput. 19, 402–421 (2009)
Fletcher, R.: Practical Methods of Optimization. Wiley, New York (2000)
Godsill, S.J.: On the relationship between Markov chain Monte Carlo methods for model uncertainty. J. Comput. Graph. Stat. 10, 1–19 (2001)
Green, P.J.: Reversible jump MCMC computation and Bayesian model determination. Biometrika 82, 711–732 (1995)
Green, P.J.: Trans-dimensional Markov chain Monte Carlo. In: Green, P.J., Hjort, N.L., Richardson, S. (eds.) Highly Structured Stochastic Systems. Oxford University Press, Oxford (2003)
Green, P.J., Han, X.L.: Metropolis methods, Gaussian proposals and antithetic variables. In: Figressi, A., Barone, P., Piccioni, M. (eds.) Stochastic Models, Statistical Methods and Algorithms in Image Analysis. Lecture Notes in Statistics, vol. 74, pp. 142–164. Springer, Berlin (1992)
Joe, H.: Accuracy of Laplace approximation for discrete response mixed models. Comput. Stat. Data Anal. 52, 5066–5074 (2008)
Muirhead, R.J.: Aspects of Multivariate Statistical Theory. Wiley, New York (1982)
Myers, R.H., Montgomery, D.C., Vining, G.G.: Generalized Linear Models with Applications in Engineering and Sciences. Wiley, New York (2002)
Natarajan, R., Kass, R.E.: Reference Bayesian methods for generalized linear mixed models. J. Am. Stat. Assoc. 95, 227–237 (2000)
Nott, D.J., Green, P.J.: Bayesian variable selection and the swendsen-wang algorithm. J. Comput. Graph. Stat. 13, 141–157 (2004)
Nott, D.J., Leng, C.: Bayesian projection approaches to variable selection in generalized linear models. Comput. Stat. Data Anal. 54, 3227–3241 (2010)
Nott, D.J., Leonte, D.: Sampling schemes for bayesian variable selection in generalized linear models. J. Comput. Graph. Stat. 13, 362–382 (2004)
Ntzoufras, I., Dellaportas, P., Forster, J.J.: Bayesian variable and link determination for generalised linear models. J. Stat. Plan. Inference 111, 165–180 (2003)
O’Hagan, A., Forster, J.J.: Kendall’s Advanced Theory of Statistics: 2B Bayesian Inference. Arnold, London (2004)
Overstall, A., Forster, J.J.: Default Bayesian model determination methods for generalised linear mixed models. Comput. Stat. Data Anal. 54, 3269–3288 (2010)
Papathomas, M., Dellaportas, P., Vasdekis, V.G.S.: A novel reversible jump algorithm for generalized linear models. Biometrika (2010, to appear)
Sinharay, S., Stern, H.: An empirical comparison of methods for computing Bayes factors in generalised linear mixed models. J. Comput. Graph. Stat. 14, 415–435 (2005)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Forster, J.J., Gill, R.C. & Overstall, A.M. Reversible jump methods for generalised linear models and generalised linear mixed models. Stat Comput 22, 107–120 (2012). https://doi.org/10.1007/s11222-010-9210-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11222-010-9210-3