Convergence Analysis of Local Algorithms for Blind Decorrelation
نویسندگان
چکیده
In this paper we analyze and extend a class of adaptive networks for second order blind decorrelation of instantaneous signal mix tures Firstly we compare the performance of the decorrelation neural network employing global knowledge of the adaptive co e cients in with a similar structure whose coe cients are adapted via local output connections in Through statistical analyses the convergence behaviors and stability bounds for the algorithms step sizes are studied and derived Secondly we ana lyze the behaviors of locally adaptive multilayer decorrelation net works and quantify their performances for poorly conditioned sig nal mixtures Thirdly we derive a robust locally adaptive network structure based on a posteriori output signals that remains sta ble for any step size value Finally we present an extension of the locally adaptive network for linear phase temporal and spatial whitening of multichannel signals Simulations verify the analy ses and indicate the usefulness of the locally adaptive networks for decorrelating signals in space and time
منابع مشابه
Convolutive Decorrelation Procedures for Blind Source Separation
Convolutive decorrelation algorithms form a class of powerful algorithms for blind source separation. In contrast to ICA, they are based on vanishing second order cross correlation functions between sources. We provide an analyze an unifying approach for convolu-tive decorrelation procedures. The convolutive decor-relation procedures impose the problem of simultaneously diagonalizing a number o...
متن کاملOn Some Extensions of the Natural Gradient Algorithm
Recently several novel gradient descent approaches like natural or relative gradient methods have been proposed to derive rigorously various powerful ICA algorithms. In this paper we propose some extensions of Amari’s Natural Gradient and Atick-Redlich formulas. They allow us to derive rigorously some already known algorithms, like for example, robust ICA algorithm and local algorithm for blind...
متن کاملBlind Signal Deconvolution by Spatio Temporal Decorrelation and Demixing
In this paper we present a simple efficient local unsupervised learning algorithm for on-line adaptive multichannel blind deconvolution and separation of i.i.d. sources. Under mild conditions, there exits a stable inverse system so that the source signals can be exactly recovered from their convolutive mixtures. Based on the existence of the inverse filter, we construct a two-stage neural netwo...
متن کاملDiscussion of Simple Algorithms and Methods to Separate Nonstationary Signals
In the last decade, many researchers have investigated the blind separation of sources and many algorithms have been proposed to solve this problem for the case of an instantaneous mixture (memoryless mixture) [1]. In general, high-order statistics (i.e., fourth order) are used. However, it has been shown that algorithms and criteria can be simpli ed by adding special assumptions [2]. In this p...
متن کاملGlobally Convergent Newton Algorithms for Blind Decorrelation
This paper presents novel Newton algorithms for the blind adaptive decorrelation of real and complex processes. They are globally convergent and exhibit an interesting relationship with the natural gradient algorithm for blind decorrelation and the Goodall learning rule. Indeed, we show that these two later algorithms can be obtained from their Newton decorrelation versions when an exact matrix...
متن کامل