The Nonparametric Kernel Bayes Smoother
نویسندگان
چکیده
Recently, significant progress has been made developing kernel mean expressions for Bayesian inference. An important success in this domain is the nonparametric kernel Bayes’ filter (nKB-filter), which can be used for sequential inference in state space models. We expand upon this work by introducing a smoothing algorithm, the nonparametric kernel Bayes’ smoother (nKB-smoother) which relies on kernel Bayesian inference through the kernel sum rule and kernel Bayes’ rule. We derive the smoothing equations, analyze the computational cost, and show smoothing consistency. We summarize the algorithm, which is simple to implement, requiring only matrix multiplications and the output of the nKB-filter. Finally, we report experimental results that compare the nKB-smoother to previous parametric and nonparametric approaches to Bayesian filtering and smoothing. In the supplementary materials, we show that the combination of the nKB-filter and the nKB-smoother allows marginal kernel mean computation, which gives an alternative to kernel belief propagation.
منابع مشابه
Two semi parametric empirical Bayes estimators
Parametric empirical Bayes PEB may perform poorly when the assumed prior distribution is seriously invalid Nonparametric empirical Bayes NEB is more robust since it imposes no restric tion on the prior But compared with the PEB the NEB may be ine cient for small to medium samples due to the large variation and under dispersion of the NPMLE of the prior Using Monte Carlo simulations we compare t...
متن کاملKernel Bayes' Rule
A nonparametric kernel-based method for realizing Bayes’ rule is proposed, based on kernel representations of probabilities in reproducing kernel Hilbert spaces. The prior and conditional probabilities are expressed as empirical kernel mean and covariance operators, respectively, and the kernel mean of the posterior distribution is computed in the form of a weighted sample. The kernel Bayes’ ru...
متن کاملA Bayesian View on Detecting Drifts by Nonparametric Methods
We study a nonparametric sequential detection procedure, which aims at detecting the first time point where a drift term appears in a stationary process, from a Bayesian perspective. The approach is based on a nonparametric model for the drift, a nonparametric kernel smoother which is used to define the stopping rule, and a performance measure which determines for each smoothing kernel and each...
متن کاملNonparametric Kernel Regressionsubject to Monotonicity
We suggest a biased-bootstrap method for monotonising general linear, kernel-type estimators, for example local linear estimators and Nadaraya-Watson estimators. Attributes of our approach include the fact that it produces smooth estimates, that is applicable to a particularly wide range of estimator types, and that it can be employed after the smoothing step has been implemented. Therefore , a...
متن کاملMultivariate Local Polynomial Kernel Estimators: Leading Bias and Asymptotic Distribution∗
Masry (1996b) provides estimation bias and variance expression for a general local polynomial kernel estimator in a general multivariate regression framework. Under smoother conditions on the unknown regression and by including more refined approximation terms than that in Masry (1996b), we extend the result of Masry (1996b) to obtain explicit leading bias terms for the whole vector of the loca...
متن کامل