This paper discusses a possible program for improving the outer (converse) bounds on the finite-blocklength performance of multiple-access codes. The program is based on a certain conjecture involving Rényi entropy of a sum of two independent binary vectors. Some partial results towards showing the conjecture are presented. The problem of bounding the joint Rényi entropy in terms of the margina...

We study the behavior of random geometric graphs in high dimensions. We show that as the dimension grows, the graph becomes similar to an Erdős-Rényi random graph. We pay particular attention to the clique number of such graphs and show that it is very close to that of the corresponding Erdős-Rényi graph when the dimension is larger than log n where n is the number of vertices. The problem is m...

In this paper, we consider the problem of variable-length source coding allowing errors. The exponential moment of the codeword length is analyzed in the non-asymptotic regime and in the asymptotic regime. Our results show that the smooth Rényi entropy characterizes the optimal exponential moment of the codeword length. Index Terms ε source coding, exponential moment, the smooth Rényi entropy, ...

We consider the Rényi entropy function for weakly ψ-mixing systems. The first main result proves existence and regularity properties. The second main result of the paper is to get the decay rate for the large deviation of the return time to cylinder sets. We show it to be exponential with a rate given by the Rényi entropy function. Finally we also obtain bounds for the free energy.

The introduction of the Rényi entropy allowed a generalization of the Shannon entropy and unified its notion with that of other entropies. However, so far there is no generally accepted conditional version of the Rényi entropy corresponding to the one of the Shannon entropy. Different definitions proposed so far in the literature lacked central and natural properties one way or another. In this...

In this work we study the Hausdorff dimension of measures whose weight distribution satisfies a markov non-homogeneous property. In particular, we prove that the Hausdorff dimensions of this kind of measures coincide with their lower Rényi dimensions (entropy). Moreover, we show that the Tricot dimensions (packing dimension) equal upper Rényi dimensions. As an application we get a continuity pr...

We collect results for bond percolation on various lattices from two to fourteen dimensions that, in the limit of large dimension d or number of neighbors z, smoothly approach a randomly diluted Erdős-Rényi graph. We include results on bond-diluted hypersphere packs in up to nine dimensions, which show the mean coordination, excess kurtosis, and skewness evolving smoothly with dimension towards...

Many common probability distributions in statistics like the Gaussian, multinomial, Beta or Gamma distributions can be studied under the unified framework of exponential families. In this paper, we prove that both Rényi and Tsallis divergences of distributions belonging to the same exponential family admit a generic closed form expression. Furthermore, we show that Rényi and Tsallis entropies c...

This paper is twofold. In the first part, we derive an improvement of the Rényi Entropy Power Inequality (EPI) recently obtained by Bobkov and Marsiglietti [10]. The proof largely follows Lieb’s [22] approach of employing Young’s inequality. In the second part, we prove a reverse Rényi EPI, that verifies a conjecture proposed in [4, 23] in two cases. Connections with various p-th mean bodies in...