The InfoMin Principle for ICA and Topographic Mappings
نویسندگان
چکیده
It has been well known that edge filters in the visual system can be generated by the InfoMax principle. In this paper, the “InfoMin” principle is proposed, which asserts that the information through some neighboring signals on a two-dimensional mapping must be minimized. It is shown that the standard Comon’s ICA can be derived from the combination of the InfoMax principle for the whole signals and the InfoMin one for each signal under a linear model with sufficiently large noise. It is also shown that the InfoMin principle for the signals within neighboring areas can generate a topographic mapping in the same way as in topographic ICA.
منابع مشابه
An Overcomplete ICA Algorithm by InfoMax and InfoMin
It is known that the number of the edge detectors significantly exceeds that of input signals in the visual system of the brains. This phenomenon has been often regarded as overcomplete independent component analysis (ICA) and some generative models have been proposed. Though the models are effective, they need to assume some ad-hoc prior probabilistic models. Recently, the InfoMin principle wa...
متن کاملTopographic independent component analysis as a model of V1 organization and receptive fields
Independent component analysis (ICA) has been recently used as a model of natural image statistics and V1 simple cell receptive "elds. Here we show how to extend the ICA model to explain V1 topography as well. This is done by relaxing the independence assumption and ordering the basis vectors so that vectors with strong higher-order correlations are near each other. This is a new principle of t...
متن کاملBest Proximity Point Results for Almost Contraction and Application to Nonlinear Differential Equation
Berinde [V. Berinde, Approximating fixed points of weak contractions using the Picard iteration, Nonlinear Anal. Forum {bf 9} (2004), 43-53] introduced almost contraction mappings and proved Banach contraction principle for such mappings. The aim of this paper is to introduce the notion of multivalued almost $Theta$- contraction mappings andto prove some best proximity point results for t...
متن کاملSuzuki-type fixed point theorems for generalized contractive mappings that characterize metric completeness
Inspired by the work of Suzuki in [T. Suzuki, A generalized Banach contraction principle that characterizes metric completeness, Proc. Amer. Math. Soc. 136 (2008), 1861--1869], we prove a fixed point theorem for contractive mappings that generalizes a theorem of Geraghty in [M.A. Geraghty, On contractive mappings, Proc. Amer. Math. Soc., 40 (1973), 604--608]an...
متن کاملTopographic Independent Component Analysis of Gene Expression Time Series Data
Topographic independent component analysis (TICA) is an interesting extension of the conventional ICA, which aims at finding a linear decomposition into approximately independent components with the dependence between two components is approximated by their proximity in the topographic representation. In this paper we apply the topographic ICA to gene expression time series data and compare it ...
متن کامل