In this paper, following standard arguments, the maximum Renyi entropy problem for the weighted case is analyzed. We verify that under some constrains on weight function, the Student-r and Student-t distributions maximize the weighted Renyi entropy. Furthermore, an extended version of the Hadamard inequality is derived.

In this paper the author analyzes the weighted Renyi entropy in order to derive several inequalities in weighted case. Furthermore, using the proposed notions α-th generalized deviation and (α, p)-th weighted Fisher information, extended versions of the moment-entropy, Fisher information and Cramér-Rao inequalities in terms of generalized Gaussian densities are given. 1 The weighted p-Renyi ent...

in this paper, we extend some famous maximal inequalities and obtain strong laws of largenumbers for arbitrary random variables by use of these inequalities and martingale techniques.

The moment-entropy inequality shows that a continuous random variable with given second moment and maximal Shannon entropy must be Gaussian. Stam’s inequality shows that a continuous random variable with given Fisher information and minimal Shannon entropy must also be Gaussian. The CramérRao inequality is a direct consequence of these two inequalities. In this paper the inequalities above are ...

Let {Yn, n≥ 1} be a sequence of nonmonotonic functions of associated random variables. We derive a Newman and Wright (1981) type of inequality for the maximum of partial sums of the sequence {Yn, n≥ 1} and a Hajek-Renyi-type inequality for nonmonotonic functions of associated random variables under some conditions. As an application, a strong law of large numbers is obtained for nonmonotonic fu...

We show that for a special class of probability distributions that we call contoured distributions, information theoretic invariants and inequalities are equivalent to geometric invariants and inequalities of bodies in Euclidean space associated with the distributions. Using this, we obtain characterizations of contoured distributions with extremal Shannon and Renyi entropy. We also obtain a ne...

assuming of course that the covariance exists. The infinite sequence {Xn, n ≥ 1} is said to be associated if every finite subfamily is associated. The concept of association was introduced by Esary et al. [1]. There are some results on the strong law of large numbers for associated sequences. Rao [4] developed the Hajek-Renyi inequality for associated sequences and proved the following theorem....

Estimating divergences in a consistent way is of great importance in many machine learning tasks. Although this is a fundamental problem in nonparametric statistics, to the best of our knowledge there has been no finite sample exponential inequality convergence bound derived for any divergence estimators. The main contribution of our work is to provide such a bound for an estimator of Rényi-α d...