Methods for regression analysis in high-dimensional data

Authors

  • Maanavi, Monireh Semnan University
Abstract:

By evolving science, knowledge and technology, new and precise methods for measuring, collecting and recording information have been innovated, which have resulted in the appearance and development of high-dimensional data. The high-dimensional data set, i.e., a data set in which the number of explanatory variables is much larger than the number of observations, cannot be easily analyzed by traditional and classical methods, same as the ordinary least-squares method, and its interpretability will be very complex. Although, in classical regression analysis, the ordinary least-squares estimation is the best estimation method if the essential assumptions are met, but it is not applicable for high-dimensional data and in this cconditions, we need to apply the modern methods. In this research, it is firstly mentioned to the drawbacks of classical methods in analysis of high-dimensional data and then, it is proceeded to introduce and explain about the modern and common approaches of the regression analysis for high-dimensional data same as principal component analysis and penalized methods. Finally, a simulation study is performed to apply and compare the mentioned methods in high-dimensional data.  

Upgrade to premium to download articles

Sign up to access the full text

Already have an account?login

similar resources

Bayesian models for sparse regression analysis of high dimensional data

This paper considers the task of building efficient regression models for sparse multivariate analysis of high dimensional data sets, in particular it focuses on cases where the numbers q of responses Y = (y k , 1 ≤ k ≤ q) and p of predictors X = (xj , 1 ≤ j ≤ p) to analyse jointly are both large with respect to the sample size n, a challenging bi-directional task. The analysis of such data set...

full text

Robust Ridge Regression for High-Dimensional Data

Ridge regression, being based on the minimization of a quadratic loss function, is sensitive to outliers. Current proposals for robust ridge regression estimators are sensitive to “bad leverage observations”, cannot be employed when the number of predictors p is larger than the number of observations n; and have a low robustness when the ratio p=n is large. In this paper a ridge regression esti...

full text

Statistical Learning Methods for High Dimensional Genomic Data Statistical Learning Methods for High Dimensional Genomic Data Title: Statistical Learning Methods for High Dimensional Genomic Data

Due to their high-dimensionality, -omics technologies require the development of computational methods that are able to work with large number of variables. Each data type is characterized by its method of measurement and by the biological aspect under study. Understanding the data properties allows the design of sophisticated and effective computational models that are able to uncover and expl...

full text

Statistical Analysis Methods for the fMRI Data

Functional magnetic resonance imaging (fMRI) is a safe and non-invasive way to assess brain functions by using signal changes associated with brain activity. The technique has become a ubiquitous tool in basic, clinical and cognitive neuroscience. This method can measure little metabolism changes that occur in active part of the brain. We process the fMRI data to be able to find the parts of br...

full text

Robust high-dimensional semiparametric regression using optimized differencing method applied to the vitamin B2 production data

Background and purpose: By evolving science, knowledge, and technology, we deal with high-dimensional data in which the number of predictors may considerably exceed the sample size. The main problems with high-dimensional data are the estimation of the coefficients and interpretation. For high-dimension problems, classical methods are not reliable because of a large number of predictor variable...

full text

My Resources

Save resource for easier access later

Save to my library Already added to my library

{@ msg_add @}


Journal title

volume 25  issue 1

pages  69- 90

publication date 2021-01

By following a journal you will be notified via email when a new issue of this journal is published.

Keywords

No Keywords

Hosted on Doprax cloud platform doprax.com

copyright © 2015-2023