Stability of Sequential Markov Chain Monte Carlo Methods
نویسندگان
چکیده
Sequential Monte Carlo Samplers are a class of stochastic algorithms for Monte Carlo integral estimation w.r.t. probability distributions, which combine elements of Markov chain Monte Carlo methods and importance sampling/resampling schemes. We develop a stability analysis by funtional inequalities for a nonlinear flow of probability measures describing the limit behavior of the methods as the number of particles tends to infinity. Stability results are derived both under global and local assumptions on the generator of the underlying Metropolis dynamics. This allows us to prove that the combined methods sometimes have good asymptotic stability properties in multimodal setups where traditional MCMC methods mix extremely slowly. For example, this holds for the mean field Ising model at all temperatures.
منابع مشابه
Convergence of Sequential Markov Chain Monte Carlo Methods: I. Nonlinear Flow of Probability Measures
Sequential Monte Carlo Samplers are a class of stochastic algorithms for Monte Carlo integral estimation w.r.t. probability distributions, which combine elements of Markov chain Monte Carlo methods and importance sampling/resampling schemes. We develop a stability analysis by functional inequalities for a nonlinear flow of probability measures describing the limit behavior of the algorithms as ...
متن کاملSequential Monte Carlo samplers for Bayesian DSGE models
Bayesian estimation of DSGE models typically uses Markov chain Monte Carlo as importance sampling (IS) algorithms have a difficult time in high-dimensional spaces. I develop improved IS algorithms for DSGE models using recent advances in Monte Carlo methods known as sequential Monte Carlo samplers. Sequential Monte Carlo samplers are a generalization of particle filtering designed for full simu...
متن کاملInference and Filtering for Partially Observed Diffusion Processes via Sequential Monte Carlo
Diffusion processes observed partially or discretely, possibly with observation error, arise when constructing stochastic models in continuous time. The method of Sequential Monte Carlo provides an alternative to Markov Chain Monte Carlo methods, and can be effective in complex models at the cutting edge of scientific research. This paper introduces Sequential Monte Carlo approaches to inferenc...
متن کاملSequentially Interacting Markov Chain Monte Carlo Methods
We introduce a novel methodology for sampling from a sequence of probability distributions of increasing dimension and estimating their normalizing constants. These problems are usually addressed using Sequential Monte Carlo (SMC) methods. The alternative Sequentially Interacting Markov Chain Monte Carlo (SIMCMC) scheme proposed here works by generating interacting non-Markovian sequences which...
متن کامل