Nonparametric Estimation of Conditional Information and Divergences
نویسندگان
چکیده
In this paper we propose new nonparametric estimators for a family of conditional mutual information and divergences. Our estimators are easy to compute; they only use simple k nearest neighbor based statistics. We prove that the proposed conditional information and divergence estimators are consistent under certain conditions, and demonstrate their consistency and applicability by numerical experiments on simulated and on real data as well.
منابع مشابه
Nonparametric Estimation of Spatial Risk for a Mean Nonstationary Random Field}
The common methods for spatial risk estimation are investigated for a stationary random field. Because of simplifying, lets distribution is known, and parametric variogram for the random field are considered. In this paper, we study a nonparametric spatial method for spatial risk. In this method, we model the random field trend by a local linear estimator, and through bias-corrected residuals, ...
متن کاملLocal quasi-likelihood with a parametric guide.
Generalized linear models and quasi-likelihood method extend the ordinary regression models to accommodate more general conditional distributions of the response. Nonparametric methods need no explicit parametric specification and the resulting model is completely determined by the data themselves. However nonparametric estimation schemes generally have a slower convergence rate such as the loc...
متن کاملMaximum likelihood estimation for semiparametric density ratio model.
In the statistical literature, the conditional density model specification is commonly used to study regression effects. One attractive model is the semiparametric density ratio model, under which the conditional density function is the product of an unknown baseline density function and a known parametric function containing the covariate information. This model has a natural connection with g...
متن کاملOn the Estimation of alpha-Divergences
We propose new nonparametric, consistent Rényi-α and Tsallis-α divergence estimators for continuous distributions. Given two independent and identically distributed samples, a “naïve” approach would be to simply estimate the underlying densities and plug the estimated densities into the corresponding formulas. Our proposed estimators, in contrast, avoid density estimation completely, estimating...
متن کاملبرآورد تابع بقای شرطی زمان شکست بهشرط یک متغیر کمکی زمانمتغیر با مشاهدات سانسورشدهی بازهای
In this paper, we propose an approach for the nonparametric estimation of the conditional survival function of a time to failure‎ ‎given a time-varying covariate under interval-censoring for the failure time. Our strategy consists in‎ ‎modeling the covariate path with a random effects model, ‎as is done in the degradation and joint longitudinal and survival data modeling&lrm...
متن کامل