Sequential Markov Chain Monte Carlo
نویسندگان
چکیده
Abstract: We propose a sequential Markov chain Monte Carlo (SMCMC) algorithm to sample from a sequence of probability distributions, corresponding to posterior distributions at different times in on-line applications. SMCMC proceeds as in usual MCMC but with the stationary distribution updated appropriately each time new data arrive. SMCMC has advantages over sequential Monte Carlo (SMC) in avoiding particle degeneracy issues. We provide theoretical guarantees for the marginal convergence of SMCMC under various settings, including parametric and nonparametric models. The proposed approach is compared to competitors in a simulation study. We also consider an application to on-line nonparametric regression.
منابع مشابه
Generalised linear mixed model analysis via sequential Monte Carlo sampling
We present a sequential Monte Carlo sampler algorithm for the Bayesian analysis of generalised linear mixed models (GLMMs). These models support a variety of interesting regression-type analyses, but performing inference is often extremely difficult, even when using the Bayesian approach combined with Markov chain Monte Carlo (MCMC). The Sequential Monte Carlo sampler (SMC) is a new and general...
متن کاملPopulation Based Particle Filtering
This paper proposes a novel particle filtering strategy by combining population Monte Carlo Markov chain methods with sequential Monte Carlo chain particle which we call evolving population Monte Carlo Markov Chain (EP MCMC) filtering. Iterative convergence on groups of particles (populations) is obtained using a specified kernel moving particles toward more likely regions. The proposed techniq...
متن کاملInference and Filtering for Partially Observed Diffusion Processes via Sequential Monte Carlo
Diffusion processes observed partially or discretely, possibly with observation error, arise when constructing stochastic models in continuous time. The method of Sequential Monte Carlo provides an alternative to Markov Chain Monte Carlo methods, and can be effective in complex models at the cutting edge of scientific research. This paper introduces Sequential Monte Carlo approaches to inferenc...
متن کاملSequentially Interacting Markov Chain Monte Carlo Methods
We introduce a novel methodology for sampling from a sequence of probability distributions of increasing dimension and estimating their normalizing constants. These problems are usually addressed using Sequential Monte Carlo (SMC) methods. The alternative Sequentially Interacting Markov Chain Monte Carlo (SIMCMC) scheme proposed here works by generating interacting non-Markovian sequences which...
متن کامل