Supervised Locally Linear Embedding
نویسندگان
چکیده
Locally linear embedding (LLE) is a recently proposed method for unsupervised nonlinear dimensionality reduction. It has a number of attractive features: it does not require an iterative algorithm, and just a few parameters need to be set. Two extensions of LLE to supervised feature extraction were independently proposed by the authors of this paper. Here, both methods are unified in a common framework and applied to a number of benchmark data sets. Results show that they perform very well on high-dimensional data which exhibits a manifold structure.
منابع مشابه
Supervised locally linear embedding for classification: an application to gene expression data analysis Supervised locally linear embedding in problemi di classificazione: un’applicazione all’analisi di dati di espressione genica
Some real problems, such as image recognition or the analysis of gene expression data, involve the observation of a very large number of variables on a few units. In such a context conventional classification methods are difficult to employ both from analytical and interpretative points of view. In this paper, a solution based on locally linear embedding (LLE) for supervised classification is p...
متن کاملClassification of handwritten digits using supervised locally linear embedding algorithm and support vector machine
The locally linear embedding (LLE) algorithm is an unsupervised technique recently proposed for nonlinear dimensionality reduction. In this paper, we describe its supervised variant (SLLE). This is a conceptually new method, where class membership information is used to map overlapping high dimensional data into disjoint clusters in the embedded space. In experiments, we combined it with suppor...
متن کاملLocally Linear Embedded Eigenspace Analysis
The existing nonlinear local methods for dimensionality reduction yield impressive results in data embedding and manifold visualization. However, they also open up the problem of how to define a unified projection from new data to the embedded subspace constructed by the training samples. Thinking globally and fitting locally, we present a new linear embedding approach, called Locally Embedded ...
متن کاملSupervised Nonlinear Dimensionality Reduction Based on Evolution Strategy
Most of the classifiers suffer from the curse of dimensionality during classification of high dimensional image and non-image data. In this paper, we introduce a new supervised nonlinear dimensionality reduction (S-NLDR) algorithm called supervised dimensionality reduction based on evolution strategy (SDRES) for both image and nonimage data. The SDRES method uses the power of evolution strategy...
متن کاملLocally linear embedding for classification
Locally linear embedding (LLE) is a recently proposed unsupervised procedure for mapping high-dimensional data nonlinearly to a lower-dimensional space. In this paper, a supervised variation on LLE is proposed. This mapping, when combined with simple classifiers such as the nearest mean classifier, is shown to yield remarkably good classification results in experiments. Furthermore, a number of...
متن کاملGuided Locally Linear Embedding
Nonlinear dimensionality reduction is the problem of retrieving a low-dimensional representation of a manifold that is embedded in a high-dimensional observation space. Locally Linear Embedding (LLE), a prominent dimensionality reduction technique is an unsupervised algorithm; as such, it is not possible to guide it toward modes of variability that may be of particular interest. This paper prop...
متن کامل