Analysis of KNN Density Estimation
نویسندگان
چکیده
We analyze the convergence rates of $k$ nearest neighbor density estimation method, under notation="LaTeX">$\ell _{\alpha} $ norm with notation="LaTeX">$\alpha \in [1,\infty]$ . Our analysis includes two different cases depending on whether support set is bounded or not. In first case, probability function has a support. show that if known, then kNN estimator minimax optimal both \big[1,\infty\big)$ and =\infty If unknown, still _{1}$ , but suboptimal for >1$ not consistent _\infty second unbounded smooth everywhere. Moreover, Hessian assumed to decay values. For this our result shows error nearly optimal. The original consistent. To address issue, we design new adaptive estimator, which can select samples. Using bound comparison, popular kernel case.
منابع مشابه
Point Localization and Density Estimation from Ordinal Knn Graphs Using Synchronization
We consider the problem of embedding unweighted, directed k-nearest neighbor graphs in low-dimensional Euclidean space. The k-nearest neighbors of each vertex provide ordinal information on the distances between points, but not the distances themselves. Relying only on such ordinal information, along with the low-dimensionality, we recover the coordinates of the points up to arbitrary similarit...
متن کاملTheoretical Analysis of Density Ratio Estimation
Density ratio estimation has gathered a great deal of attention recently since it can be used for various data processing tasks. In this paper, we consider three methods of density ratio estimation: (A) the numerator and denominator densities are separately estimated and then the ratio of the estimated densities is computed, (B) a logistic regression classifier discriminating denominator sample...
متن کاملHydrodynamics Analysis of Density Currents
Density Current is formed when a fluid with heavier density than the surrounding fluid flows down an inclined bed. These types of flows are common in nature and can be produced by; salinity, temperature inhomogeneities, or suspended particles of silt and clay. Driven by the density difference between inflow and clear water in reservoirs, density current plunges clear water and moves towards a d...
متن کاملIndependent Components Analysis through Product Density Estimation
We present a simple direct approach for solving the ICA problem, using density estimation and maximum likelihood. Given a candidate orthogonal frame, we model each of the coordinates using a semi-parametric density estimate based on cubic splines. Since our estimates have two continuous derivatives , we can easily run a second order search for the frame parameters. Our method performs very favo...
متن کاملKNN-kernel density-based clustering for high-dimensional multivariate data
Density-based clustering algorithms for multivariate data often have difficulties with high-dimensional data and clusters of very different densities.A new density-based clustering algorithm, called KNNCLUST, is presented in this paper that is able to tackle these situations. It is based on the combination of nonparametric k-nearest-neighbor (KNN) and kernel (KNN-kernel) density estimation. The...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 2022
ISSN: ['0018-9448', '1557-9654']
DOI: https://doi.org/10.1109/tit.2022.3195870