De-biasing the lasso with degrees-of-freedom adjustment
نویسندگان
چکیده
This paper studies schemes to de-bias the Lasso in sparse linear regression with Gaussian design where goal is estimate and construct confidence intervals for a low-dimensional projection of unknown coefficient vector preconceived direction a0. Our analysis reveals that previously analyzed propositions require modification order enjoy nominal coverage asymptotic efficiency full range level sparsity. takes form degrees-of-freedom adjustment accounts dimension model selected by Lasso. The (a) preserves success de-biasing methodologies regimes previous proposals were successful, (b) repairs provides produce spurious inferences provably fail achieve coverage. Hence our theoretical simulation results call implementation this methodologies. Let s0 denote number nonzero coefficients true ? population Gram matrix. unadjusted scheme may as soon s0?n2/3 if known. If unknown, grants contrast general a0 when s0logp n+min{s?logp n,???1 ?1 logp ? ??1/2 ?2 n}+min(s?,s0)logp n?0 s?=? ??1a0?0. dependence s0,s? ???1a0?1 optimal closes gap upper lower bounds. construction estimated score novel methodology handle dense directions Beyond adjustment, proof techniques yield sharp ?? error bound which independent interest.
منابع مشابه
Degrees of Freedom of the Group Lasso
This paper studies the sensitivity to the observations of the block/group Lasso solution to an overdetermined linear regression model. Such a regularization is known to promote sparsity patterns structured as nonoverlapping groups of coefficients. Our main contribution provides a local parameterization of the solution with respect to the observations. As a byproduct, we give an unbiased estimat...
متن کاملDegrees of freedom in lasso problems
We derive the degrees of freedom of the lasso fit, placing no assumptions on the predictor matrix X. Like the well-known result of Zou et al. (2007), which gives the degrees of freedom of the lasso fit when X has full column rank, we express our result in terms of the active set of a lasso solution. We extend this result to cover the degrees of freedom of the generalized lasso fit for an arbitr...
متن کاملOn the “degrees of Freedom” of the Lasso By
We study the effective degrees of freedom of the lasso in the framework of Stein’s unbiased risk estimation (SURE). We show that the number of nonzero coefficients is an unbiased estimate for the degrees of freedom of the lasso—a conclusion that requires no special assumption on the predictors. In addition, the unbiased estimator is shown to be asymptotically consistent. With these results on h...
متن کاملOn the “Degrees of Freedom” of the Lasso
We study the degrees of freedom of the Lasso in the framework of Stein’s unbiased risk estimation (SURE). We show that the number of non-zero coefficients is an unbiased estimate for the degrees of freedom of the Lasso—a conclusion that requires no special assumption on the predictors. Our analysis also provides mathematical support for a related conjecture by Efron et al. (2004). As an applica...
متن کاملDe-biasing the Lasso: Optimal Sample Size for Gaussian Designs
Performing statistical inference in high-dimensional models is an outstanding challenge. A major source of difficulty is the absence of precise information on the distribution of high-dimensional regularized estimators. Here, we consider linear regression in the high-dimensional regime p n and the Lasso estimator. In this context, we would like to perform inference on a high-dimensional paramet...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Bernoulli
سال: 2022
ISSN: ['1573-9759', '1350-7265']
DOI: https://doi.org/10.3150/21-bej1348