Multilinear and nonlinear generalizations of partial least squares: an overview of recent advances

نویسندگان

  • Qibin Zhao
  • Liqing Zhang
  • Andrzej Cichocki
چکیده

Partial Least Squares (PLS) is an efficient multivariate statistical regression technique that has proven to be particularly useful for analysis of highly collinear data. To predict response variables Y from independent variables X, PLS attempts to find a set of common orthogonal latent variables by projecting both X and Y onto a new subspace respectively. As an increasing interest in multiway analysis, the extension to multilinear regression model are also developed with the aim to analyzing two multidimensional tensor data. In this article, we overview the PLS related methods including linear, multilinear and nonlinear variants and discuss the strength of the algorithms. Since Canonical Correlation Analysis (CCA) is another similar technique with aim to extract the most correlated latent components between two datasets, we also briefly discuss the extension of CCA to tensor space. Finally, several examples are given to compare these methods with respect to the regression and classification performance.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Tensor Decompositions: A New Concept in Brain Data Analysis?

Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component Analysis (ICA), Nonnegative Matrix and Tensor Factorization (NMF/NTF), Smooth Component Analysis (SmoCA) and Sparse Component Analysis (SCA). Moreover, tensor decompositions hav...

متن کامل

Superlinearly convergent exact penalty projected structured Hessian updating schemes for constrained nonlinear least squares: asymptotic analysis

We present a structured algorithm for solving constrained nonlinear least squares problems, and establish its local two-step Q-superlinear convergence. The approach is based on an adaptive structured scheme due to Mahdavi-Amiri and Bartels of the exact penalty method of Coleman and Conn for nonlinearly constrained optimization problems. The structured adaptation also makes use of the ideas of N...

متن کامل

Least Squares Methods for Models Including Ordinary and Partial Differential Equations

This contribution gives a brief overview on nonlinear constrained least squares methods. The focus is on data fitting problems in which the models include ordinary or partial differential equations.

متن کامل

Generalizations of the total least squares problem

Recent advances in total least squares approaches for solving various errorsin-variables modeling problems are reviewed, with emphasis on the following generalizations: 1. the use of weighted norms as a measure of the data perturbation size, capturing prior knowledge about uncertainty in the data; 2. the addition of constraints on the perturbation to preserve the structure of the data matrix, m...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Wiley Interdisc. Rew.: Data Mining and Knowledge Discovery

دوره 4  شماره 

صفحات  -

تاریخ انتشار 2014