Independent Subspaces
نویسنده
چکیده
Several unsupervised learning topics have been extensively studied with wide applications for decades in the literatures of statistics, signal processing, and machine learning. The topics are mutually related and certain connections have been discussed partly, but still in need of a systematical overview. The article provides a unified perspective via a general framework of independent subspaces, with different topics featured by differences in choosing and combining three ingredients. Moreover, an overview is made via three streams of studies. One consists of those on the widely studied principal component analysis (PCA) and factor analysis (FA), featured by the second order independence. The second consists of studies on a higher order independence featured independent component analysis (ICA), binary FA, and nonGaussian FA. The third is called mixture based learning that combines individual jobs to fulfill a complicated task. Extensive literatures make it impossible to provide a complete review. Instead, we aim at sketching a roadmap for each stream with attentions on those topics missing in the existing surveys and textbooks, and limited to the authors’ knowledge.
منابع مشابه
Veroneseans, power subspaces and independence
Results are proved indicating that the Veronese map vd often increases independence of both sets of points and sets of subspaces. For example, any d + 1 Veronesean points of degree d are independent. Similarly, the dth power map on the space of linear forms of a polynomial algebra also often increases independence of both sets of points and sets of subspaces. These ideas produce d+ 1-independen...
متن کاملStyle subspaces for character animation
In this paper, we present a novel method for editing stylistic human motions. We represent styles as differences between stylistic motions and introduced neutral motions, including timing differences and spatial differences. Timing differences are defined as time alignment curves, while spatial differences are found by a machine learning technique: Independent Feature Subspaces Analysis, which ...
متن کاملNon-combinatorial estimation of independent autoregressive sources
Identification of mixed independent subspaces is thought to suffer from combinatorial explosion of two kinds: the minimization of mutual information between the estimated subspaces and the search for the optimal number and dimensions of the subspaces. Here we show that independent auto-regressive process analysis, under certain conditions, can avoid this problem using a two-phase estimation pro...
متن کاملFrameness bound for frame of subspaces
In this paper, we show that in each nite dimensional Hilbert space, a frame of subspaces is an ultra Bessel sequence of subspaces. We also show that every frame of subspaces in a nite dimensional Hilbert space has frameness bound.
متن کاملIndependent Subspaces of Gene Expression Data
Independent subspace anlaysis (ISA) is a linear modelbased method which generalizes independent component analysis (ICA) by incorporating the invariant feature subspace into multidimensional ICA. In this paper we apply ISA to the problem of gene expression data analysis and show the useful behavior of the independent subspaces of gene expression data in the task of gene clustering and gene-gene...
متن کامل