Shannon entropy of a probability measure P , defined as − ∫ X dP dμ ln dP dμ dμ on a measure space (X,M, μ), is not a natural extension from the discrete case. However, maximum entropy (ME) prescriptions of Shannon entropy functional in the measure-theoretic case are consistent with those for the discrete case. Also it is well known that Kullback-Leibler relative entropy can be extended natural...

We have calculated the Tsallis entropy and Fisher information matrix (entropy) of spatially correlated nonextensive systems, by using an analytic non-Gaussian distribution obtained by the maximum entropy method. The effects of the correlated variability on the Fisher information matrix are shown to be different from those on the Tsallis entropy. The Fisher information is increased (decreased) b...

Convexity is a key concept in information theory, namely via the many implications of Jensen’s inequality, such as the non-negativity of the Kullback-Leibler divergence (KLD). Jensen’s inequality also underlies the concept of Jensen-Shannon divergence (JSD), which is a symmetrized and smoothed version of the KLD. This paper introduces new JSD-type divergences, by extending its two building bloc...

We used magnetohydrodynamic (MHD) simulations of interstellar turbulence to study the probability distribution functions (PDFs) of increments of density, velocity, and magnetic field. We found that the PDFs are well described by a Tsallis distribution, following the same general trends found in solar wind and Electron MHD studies. We found that the PDFs of density are different in subsonic and ...

Shannon entropy [1] is one of fundamental quantities in classical information theory and uniquely determinded by the Shannon-Khinchin axiom or the Faddeev axiom. One-parameter extensions for Shannon entropy have been studied by many researchers. The Rényi entropy [2] and the Tsallis entropy [3] are famous. In the paper [4], the uniqueness theorem for the Tsallis entropy was proved. Also, in our...

Maximum entropy principle does not seem to distinguish between the use of Tsallis and Renyi entropies as either of them may be used to derive similar power-law distributions. In this paper, we address the question whether the Renyi entropy is equally suitable to describe those systems with powerlaw behaviour, where the use of the Tsallis entropy is relevant. We discuss a specific class of dynam...

We show that the non-additivity relation of the Tsallis entropies in nonextensive statistical mechanics has a simple physical interpretation for systems with fluctuating temperature or fluctuating energy dissipation rate. We also show that there is a distinguished dependence of the entropic index q on the spatial scale that makes the Tsallis entropies quasi-additive. Quasi-additivity implies th...

A maximum entropy framework based on Tsallis entropy is proposed to depict long tail behavior of queue lengths in broadband networks. Queue length expression as measured in terms of number of packets involves Hurwitz-zeta function. When the entropy parameter q in Tsallis entropy is less than unity, the distribution of packets yields power law behavior. In the limit q tending to unity, Tsallis e...

We present a first physical application of Tsallis’ generalized entropy to the thermodynamics of self-gravitating systems. The stellar system confined in a spherical cavity of radius re exhibits an instability, so-called gravothermal catastrophe, which has been originally investigated by Antonov (Vest.Leningrad Gros.Univ. 7 (1962) 135) and Lynden-Bell & Wood (Mon.Not.R.Astron.Soc. 138 (1968) 49...