Robust Estimation in Linear Regression with Molticollinearity and Sparse Models
Authors
Abstract:
One of the factors affecting the statistical analysis of the data is the presence of outliers. The methods which are not affected by the outliers are called robust methods. Robust regression methods are robust estimation methods of regression model parameters in the presence of outliers. Besides outliers, the linear dependency of regressor variables, which is called multicollinearity, the large number of regressor variables with respect to sample size, specially in high dimensional sparse models, are problems which result in efficiency reduction of inferences in classical regression methods. In this paper, we first study the disadvantages of classical least squares regression method, when facing with outliers, multicollinearity and sparse models. Then, we introduce and study robust and penalized regression methods, as a solution to overcome these problems. Furthermore, considering outliers and multicollinearity or sparse models, simultaneously, we study penalized-robust regression methods. We examine the performance of different estimators introdused in this paper, through three different simulation studies. A real data set is also analyzed using the proposed methods.
similar resources
Robust Estimation in Linear Regression Model: the Density Power Divergence Approach
The minimum density power divergence method provides a robust estimate in the face of a situation where the dataset includes a number of outlier data. In this study, we introduce and use a robust minimum density power divergence estimator to estimate the parameters of the linear regression model and then with some numerical examples of linear regression model, we show the robustness of this est...
full textSparse Quantile Huber Regression for Efficient and Robust Estimation
We consider new formulations and methods for sparse quantile regression in the high-dimensional setting. Quantile regression plays an important role in many applications, including outlier-robust exploratory analysis in gene selection. In addition, the sparsity consideration in quantile regression enables the exploration of the entire conditional distribution of the response variable given the ...
full textLiu Estimates and Influence Analysis in Regression Models with Stochastic Linear Restrictions and AR (1) Errors
In the linear regression models with AR (1) error structure when collinearity exists, stochastic linear restrictions or modifications of biased estimators (including Liu estimators) can be used to reduce the estimated variance of the regression coefficients estimates. In this paper, the combination of the biased Liu estimator and stochastic linear restrictions estimator is considered to overcom...
full textImproved Estimation for Robust Econometric Regression Models
The t distribution has proved to be a useful alternative to the normal distribution in many econometric regression models, especially when robust estimation is desired. In this work, we consider a nonlinear heteroskedastic Student t regression model. We suppose the observations to be independently t distributed, with the location and scale parameters for each observation being related to linear...
full textLeast-squares estimation in linear regression models with vague concepts
The paper is a contribution to parameter estimation in fuzzy regression models with random fuzzy sets. Here models with crisp parameters and fuzzy observations of the variables are investigated. This type of regressionmodelsmay be understood as an extension of the ordinary single equation linear regression models by integrating additionally the physical vagueness of the involved items. So the s...
full textRobust inference in high- dimensional approximately sparse quantile regression models
This work proposes new inference methods for the estimation of a regression coefficientof interest in quantile regression models. We consider high-dimensional models where the number ofregressors potentially exceeds the sample size but a subset of them suffice to construct a reasonableapproximation of the unknown quantile regression function in the model. The proposed methods are<lb...
full textMy Resources
Journal title
volume 22 issue 2
pages 93- 110
publication date 2018-03
By following a journal you will be notified via email when a new issue of this journal is published.
No Keywords
Hosted on Doprax cloud platform doprax.com
copyright © 2015-2023