Statistics > Computation
[Submitted on 21 Apr 2016 (v1), revised 20 May 2016 (this version, v2), latest version 7 Jun 2018 (v4)]
Title:Efficient mode jumping MCMC for Bayesian variable selection in GLMM
View PDFAbstract:Generalized linear mixed models (GLMM) are addressed for inference and prediction in a wide range of different applications providing a powerful scientific tool for the researchers and analysts coming from different fields. In most of these fields more and more sources of data are becoming available introducing a variety of hypothetical explanatory variables for these models to be considered. Selection of an optimal combination of these variables is thus becoming crucial in a Bayesian setting. The posterior distribution of the models can be viewed as a relevant measure for the model evidence, based on the observed data. The number of models to select from is exponential in the number of candidate variables, moreover the search space in this context is often extremely non-concave and has numerous local extrema or statistically speaking modes. Hence efficient search algorithms have to be adopted for evaluating the posterior distribution within a reasonable amount of time. In this paper we introduce and implement efficient mode jumping MCMC algorithms for calculating posterior probabilities of the models for generalized linear models with a random effect. Marginal likelihoods of models, given the specific choice of priors and any choice of covariates, can be efficiently calculated using the integrated nested Laplace approximations approach (INLA) for the class of models addressed, however for some particular cases exact results are also available. We further apply the suggested algorithm to some simulated data, the famous U.S. crime data, protein activity data and real epigenetic data and compare its performance to some of the existing approaches like BAS, RS or $\text{MC}^3$.
Submission history
From: Aliaksandr Hubin [view email][v1] Thu, 21 Apr 2016 17:47:23 UTC (680 KB)
[v2] Fri, 20 May 2016 16:16:04 UTC (680 KB)
[v3] Wed, 12 Apr 2017 17:04:41 UTC (898 KB)
[v4] Thu, 7 Jun 2018 09:51:26 UTC (1,067 KB)
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.