A general proposal construction for reversible jump MCMC
نویسندگان
چکیده
We propose a general methodology to construct proposal densities in reversible jump MCMC algorithms so that consistent mappings across competing models are achieved. Unlike nearly all previous approaches our proposals are not restricted to operate to moves between local models, but they are applicable even to models that do not share any common parameters. We focus on linear regression models and produce concrete guidelines on proposal choices for moves between any models. These guidelines can be immediately applied to any regression models after applying some standard data transformations to near-normality. We illustrate our methodology by providing concrete guidelines for model determination problems in logistic regression and log-linear graphical models. Two real data analyses illustrate how our suggested proposal densities together with the resulting freedom to propose moves between any models improve the mixing of the reversible jump Metropolis algorithm.
منابع مشابه
Automating and evaluating reversible jump MCMC proposal distributions
The reversible jump Markov chain Monte Carlo (MCMC) sampler (Green 1995) has become an invaluable device for Bayesian practitioners. However, the primary difficulty with the sampler lies with the efficient construction of transitions between competing models of possibly differing dimensionality and interpretation. We propose use of a marginal density estimator to construct between-model proposa...
متن کاملOn the automatic choice of reversible jumps
The major implementational problem for reversible jump MCMC is that there is commonly no natural way to choose jump proposals since there is no Euclidean structure to guide our choice. In this paper we will consider a mechanism for guiding the proposal choice by analysis of acceptance probabilities for jumps. Essentially the method involves an approximation for the acceptance probability around...
متن کاملOn the Relationship Between Markov Chain Monte Carlo Methods for Model Uncertainty
This article considers Markov chain computational methods for incorporating uncertainty about the dimension of a parameter when performing inference within a Bayesian setting. A general class of methods is proposed for performing such computations, based upon a product space representation of the problem which is similar to that of Carlin and Chib. It is shown that all of the existing algorithm...
متن کاملDetection and estimation of signals by reversible jump Markov chain Monte Carlo computations
Markov Chain Monte Carlo (MCMC) samplers have been a very powerful methodology for estimating signal parameters. With the introduction of the reversible jump MCMC sampler, which is a Metropolis-Hastings method adapted to general state spaces, the potential of the MCMC methods has risen to a new level. Consequently, the MCMC methods currently play a major role in many research activities. In thi...
متن کاملSimultaneous Sampling and Multi-Structure Fitting with Adaptive Reversible Jump MCMC
Multi-structure model fitting has traditionally taken a two-stage approach: First, sample a (large) number of model hypotheses, then select the subset of hypotheses that optimise a joint fitting and model selection criterion. This disjoint two-stage approach is arguably suboptimal and inefficient — if the random sampling did not retrieve a good set of hypotheses, the optimised outcome will not ...
متن کامل