Rapid parametric density estimation
نویسنده
چکیده
Parametric density estimation, for example as Gaussian distribution, is the base of the field of statistics. Machine learning requires inexpensive estimation of much more complex densities, and the basic approach is relatively costly maximum likelihood estimation (MLE). There will be discussed inexpensive density estimation, for example literally fitting a polynomial (or Fourier series) to the sample, which coefficients are calculated by just averaging monomials (or sine/cosine) over the sample. Another discussed basic application is fitting distortion to some standard distribution like Gaussian analogously to ICA, but additionally allowing to reconstruct the disturbed density. Finally, by using weighted average, it can be also applied for estimation of non-probabilistic densities, like modelling mass distribution, or for various clustering problems by using negative (or complex) weights: fitting a function which sign (or argument) determines clusters. The estimated parameters are approaching the optimal values with error dropping like 1/ √ n, where n is the sample size.
منابع مشابه
تخمین احتمال بزرگی زمینلغزشهای رخداده در حوزه آبخیز پیوهژن (استان خراسان رضوی)
Knowing the number, area, and frequency of landslides occurred in each area has a prominent role in the long-term evolution of area dominated by landslides and can be used for analyzing of susceptibility, hazard, and risk. In this regard, the current research is trying to consider identified landslides size probability in the Pivejan Watershed, Razavi Khorasan Province. In the first step, lands...
متن کاملNotes On Nonparametric Density Estimation
Univariate Density Estimation via Numerical Derivatives Consider the problem of estimating the density function f(x) of a scalar, continuously-distributed i.i.d. sequence xi at a particular point x. If the density f is in a known parametric family (e.g., Gaussian), estimation of the density reduces to estimation of the finite-dimensional parameters that characterize that particular density in t...
متن کاملKernel bandwidth estimation for non-parametric density estimation: a comparative study
We investigate the performance of conventional bandwidth estimators for non-parametric kernel density estimation on a number of representative pattern-recognition tasks, to gain a better understanding of the behaviour of these estimators in high-dimensional spaces. We show that there are several regularities in the relative performance of conventional kernel bandwidth estimators across differen...
متن کاملMerging Information for Semiparametric Density Estimation
KONSTANTINOS FOKIANOS Abstra t. The density ratio model specifies that the likelihood ratio of m 1 probability density functions with respect to the m’th is of known parametric form without reference to any parametric model. We study the semiparametric inference problem related to the density ratio model by appealing to the methodology of empirical likelihood. The combined data from all the sam...
متن کاملParametric Data Processing for Health and Usage Monitoring Systems
The new health and usage monitoring systems will out perform the current ones in term of accuracy and computing time. The data therefore need to be better processed. Data in frequency domain, or spectra, are widely used thank for the richness of information. To estimate the spectrum such methods as non parametric and parametric ones may be used. This paper discusses about parametric signal spec...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1702.02144 شماره
صفحات -
تاریخ انتشار 2017