Optimal global rates of convergence for noiseless regression estimation problems with adaptively chosen design

نویسنده

  • Michael Kohler
چکیده

Given the values of a measurable function m : Rd → R at n arbitrarily chosen points in Rd the problem of estimating m on whole Rd, such that the L1 error (with integration with respect to a fixed but unknown probability measure) of the estimate is small, is considered. Under the assumption that m is (p, C)-smooth (i.e., roughly speaking, m is p-times continuously differentiable) it is shown that the optimal minimax rate of convergence of the L1 error is n−p/d, where the upper bound is valid even if the support of the design measure is unbounded but the design measure satisfies some moment condition. Furthermore it is shown that this rate of convergence cannot be improved even if the function is not allowed to change with the size of the data. AMS classification: Primary 62G08; secondary 62G05.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Convergence Rates of Efficient Global Optimization Algorithms

In the efficient global optimization problem, we minimize an unknown function f , using as few observations f (x) as possible. It can be considered a continuum-armed-bandit problem, with noiseless data, and simple regret. Expected-improvement algorithms are perhaps the most popular methods for solving the problem; in this paper, we provide theoretical results on their asymptotic behaviour. Impl...

متن کامل

Optimal Rates of Convergence for Noisy Sparse Phase Retrieval via Thresholded Wirtinger Flow

This paper considers the noisy sparse phase retrieval problem: recovering a sparse signal x ∈ R from noisy quadratic measurements yj = (ajx) + j , j = 1, . . . ,m, with independent sub-exponential noise j . The goals are to understand the effect of the sparsity of x on the estimation precision and to construct a computationally feasible estimator to achieve the optimal rates. Inspired by the Wi...

متن کامل

On the Minimax Optimality of Block Thresholded Wavelets Estimators for ?-Mixing Process

We propose a wavelet based regression function estimator for the estimation of the regression function for a sequence of ?-missing random variables with a common one-dimensional probability density function. Some asymptotic properties of the proposed estimator based on block thresholding are investigated. It is found that the estimators achieve optimal minimax convergence rates over large class...

متن کامل

RATEWISE EFFICIENT ESTIMATION OF REGRESSION COEFFICIENTS BASED ON Lp PROCEDURES

We consider the problem of estimation of regression coefficients under general classes of error densities without assuming classical regularity conditions. Optimal orders of convergence rates of regression-equivariant estimators are established and shown to be attained in general by Lp estimators based on judicious choices of p. We develop a procedure for choosing p adaptively to yield Lp estim...

متن کامل

On the Asymptotic Theory of

For regression analysis, some useful information may have been lost when the responses are right censored. To estimate nonparametric functions, several estimates based on censored data have been proposed and their consistency and convergence rates have been studied in the literature, but the optimal rates of global convergence have not been obtained yet. Because of the possible information loss...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • J. Multivariate Analysis

دوره 132  شماره 

صفحات  -

تاریخ انتشار 2014