In multiple regression, different techniques are available to deal with the situation where predictors large in number, and multicollinearity exists among them. Some of these approaches rely on correlation others depend principal components. To cope influential observations (outliers, leverage, or both) data matrix for regression purposes, two proposed this paper. These Robust Correlation Based...

Forecasting with many predictors is of interest, for instance, in macroeconomics and finance. This paper compares two methods for dealing with many predictors, that is, principal component regression (PCR) and principal covariate regression (PCovR). The forecast performance of these methods is compared by simulating data from factor models and from regression models. The simulations show that, ...

Bootstrap methods can be used as an alternative for cross-validation in regression procedures such as principal component regression (PCR). Several bootstrap methods for the estimation of prediction errors and confidence intervals are presented. It is shown that bootstrap error estimates are consistent with cross-validation estimates but exhibit less variability. This makes it easier to select ...

Principal component regression (PCR) is a useful method for regularizing linear regression. Although conceptually simple, straightforward implementations of PCR have high computational costs and so are inappropriate when learning with large scale data. In this paper, we propose efficient algorithms for computing approximate PCR solutions that are, on one hand, high quality approximations to the...