Is the General Form of Renyi's Entropy a Contrast for Source Separation?
نویسندگان
چکیده
Renyi’s entropy-based criterion has been proposed as an objective function for independent component analysis because of its relationship with Shannon’s entropy and its computational advantages in specific cases. These criteria were suggested based on “convincing” experiments. However, there is no theoretical proof that globally maximizing those functions would lead to separate the sources; actually, this was implicitly conjectured. In this paper, the problem is tackled in a theoretical way; it is shown that globally maximizing the Renyi’s entropy-based criterion, in its general form, does not necessarily provide the expected independent signals. The contrast function property of the corresponding criteria simultaneously depend on the value of the Renyi parameter, and on the (unknown) source densities.
منابع مشابه
Blind source separation using Renyi's -marginal entropies
We have recently suggested the minimization of a nonparametric estimator of Renyi’s mutual information as a criterion for blind source separation. Using a two-stage topology, consisting of spatial whitening and a series of Givens rotations, the cost function reduces to the sum of marginal entropies, just like in the Shannon’s entropy case. Since we use a Parzen window density estimator and elim...
متن کاملBLIND SEPARATION OF CONVOLUTIVE MIXTURES USING RENYI’S DIVERGENCE By KENNETH E. HILD II A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY
of Dissertation Presented to the Graduate School of the University of Florida in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy BLIND SEPARATION OF CONVOLUTIVE MIXTURES USING RENYI’S DIVERGENCE By Kenneth E. Hild II December 2003 Chair: Jose C. Principe Major Department: Electrical and Computer Engineering A new information-theoretic (IT) criterion is introduced,...
متن کاملOn the Risk of Using RÉnyi's Entropy for Blind Source Separation
Recently, some researchers have suggested Rényi’s entropy in its general form as a blind source separation (BSS) objective function. This was motivated by two arguments: 1) Shannon’s entropy, which is known to be a suitable criterion for BSS, is a particular case of Rényi’s entropy, and 2) some practical advantages can be obtained by choosing another specific value for the Rényi exponent, yield...
متن کاملModeling the Overalternating Bias with an Asymmetric Entropy Measure
Psychological research has found that human perception of randomness is biased. In particular, people consistently show the overalternating bias: they rate binary sequences of symbols (such as Heads and Tails in coin flipping) with an excess of alternation as more random than prescribed by the normative criteria of Shannon's entropy. Within data mining for medical applications, Marcellin propos...
متن کاملA General Framework for 1-D Histogram-baesd Image Contrast Enhancement
In this paper, a general framework for image contrast enhancement algorithm based on an optimization problem is presented. Through this optimization, the intensities can be better distributed. The algorithm is based on the facts that the histogram of the enhanced image is close to the input image histogram and uniform distribution, simultaneously. Based on this fact, we obtain a closed form opt...
متن کامل