’Compressed Least Squares Regression revisited’: Appendix
ثبت نشده
چکیده
the best rank-r approximation of X with respect to the Frobenius norm. We write ∆r = X − Tr(X) for the ’residual’. In general, Tr(M) wil be used to denote the best rank-r approximation of a matrix M . Further, PM denotes the orthogonal projection on the subspace spanned by the columns of M , and we write M− for the Moore-Penrose pseudoinverse of a matrix M . The i-th column of M is denoted by M:,i.
منابع مشابه
Compressed Least Squares Regression revisited
We revisit compressed least squares (CLS) regression as originally analyzed in Maillard and Munos (2009) and later on in Kaban (2014) with some refinements. Given a set of high-dimensional inputs, CLS applies a random projection and then performs least squares regression based on the projected inputs of lower dimension. This approach can be beneficial with regard to both computation (yielding a...
متن کاملAn Introduction to Partial Least Squares Regression
Partial least squares is a popular method for soft modelling in industrial applications. This paper introduces the basic concepts and illustrates them with a chemometric example. An appendix describes the experimental PLS procedure of SAS/STAT software.
متن کاملCompressed Least-Squares Regression
We consider the problem of learning, from K data, a regression function in a linear space of high dimensionN using projections onto a random subspace of lower dimension M . From any algorithm minimizing the (possibly penalized) empirical risk, we provide bounds on the excess risk of the estimate computed in the projected subspace (compressed domain) in terms of the excess risk of the estimate b...
متن کاملTime-Series Regression and Generalized Least Squares in R An Appendix to An R Companion to Applied Regression, Second Edition
Generalized least-squares (GLS ) regression extends ordinary least-squares (OLS) estimation of the normal linear model by providing for possibly unequal error variances and for correlations between different errors. A common application of GLS estimation is to time-series regression, in which it is generally implausible to assume that errors are independent. This appendix to Fox and Weisberg (2...
متن کاملThe least squares method for option pricing revisited
It is shown that the the popular least squares method of option pricing converges even under very general assumptions. This substantially increases the freedom of creating different implementations of the method, with varying levels of computational complexity and flexible approach to regression. It is also argued that in many practical applications even modest non-linear extensions of standard...
متن کامل