The sparsity of LASSO-type minimizers
نویسندگان
چکیده
This note extends an attribute of the LASSO procedure to a whole class related procedures, including square-root LASSO, square LAD-LASSO, and instance generalized LASSO. Namely, under assumption that input matrix satisfies ℓ p -restricted isometry property (which in some sense is weaker than standard 2 assumption), it shown if vector comes from exact measurement sparse vector, then minimizer any such LASSO-type has sparsity comparable measured vector. The result remains valid presence moderate error when regularization parameter not too small.
منابع مشابه
Sparsity and the Lasso Statistical
1.1 A bit of background • If `2 was the norm of the 20th century, then `1 is the norm of the 21st century ... OK, maybe that statement is a bit dramatic, but at least so far, there’s been a frenzy of research involving the `1 norm and its sparsity-inducing properties. Why? Where did this come from? • In short, the `1 norm provides a computationally attractive, theoretically well-justified form ...
متن کاملthe investigation of the relationship between type a and type b personalities and quality of translation
چکیده ندارد.
The Trimmed Lasso: Sparsity and Robustness
Nonconvex penalty methods for sparse modeling in linear regression have been a topic of fervent interest in recent years. Herein, we study a family of nonconvex penalty functions that we call the trimmed Lasso and that offers exact control over the desired level of sparsity of estimators. We analyze its structural properties and in doing so show the following: 1. Drawing parallels between robus...
متن کاملSparsity oracle inequalities for the Lasso
This paper studies oracle properties of !1-penalized least squares in nonparametric regression setting with random design. We show that the penalized least squares estimator satisfies sparsity oracle inequalities, i.e., bounds in terms of the number of non-zero components of the oracle vector. The results are valid even when the dimension of the model is (much) larger than the sample size and t...
متن کاملSparsity and smoothness via the fused lasso
The lasso penalizes a least squares regression by the sum of the absolute values (L1-norm) of the coefficients. The form of this penalty encourages sparse solutions (with many coefficients equal to 0).We propose the ‘fused lasso’, a generalization that is designed for problems with features that can be ordered in some meaningful way. The fused lasso penalizes the L1-norm of both the coefficient...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied and Computational Harmonic Analysis
سال: 2023
ISSN: ['1096-603X', '1063-5203']
DOI: https://doi.org/10.1016/j.acha.2022.10.004