Maximum entropy principles in nonextensive statistical physics are revisited as an application of the Tsallis relative entropy defined for non-negative matrices in the framework of matrix analysis. In addition, some matrix trace inequalities related to the Tsallis relative entropy are studied.

Relations between Shannon entropy and Rényi entropies of integer order are discussed. For any N–point discrete probability distribution for which the Rényi entropies of order two and three are known, we provide an lower and an upper bound for the Shannon entropy. The average of both bounds provide an explicit extrapolation for this quantity. These results imply relations between the von Neumann...

We derive Bose-Einstein statistics and Fermi-Dirac statistics by Principle of Maximum Entropy applied to two families of entropy functions different from the Boltzmann-Gibbs-Shannon entropy. These entropy functions are identified with special cases of modified Naudts’ φ-entropy. In a pioneering work sixty years ago, Jaynes [4] initiated the study of statistical physics by information theory. He...

What is the physical significance of entropy? What is the physical origin of irreversibility? Do entropy and irreversibility exist only for complex and macroscopic systems? For everyday laboratory physics, the mathematical formalism of Statistical Mechanics (canonical and grand-canonical, Boltzmann, Bose-Einstein and Fermi-Dirac distributions) allows a successful description of the thermodynami...

We have proposed the entropy formula of the black hole which is constructed by two intersecting D-branes with no momentum, whose compactification radii are constrained by the surface gravities in ten-dimensions. We interpret the entropy of the black hole as the statistical entropy of the effective string. We further study the behavior of the absorption cross-section of the black hole using our ...

The Bandt-Pompe permutation entropy and the Jensen-Shannon statistical complexity are used to analyze fluctuating time series of three different turbulent plasmas: the magnetohydrodynamic (MHD) turbulence in the plasma wind tunnel of the Swarthmore Spheromak Experiment (SSX), drift-wave turbulence of ion saturation current fluctuations in the edge of the Large Plasma Device (LAPD), and fully de...

I present empirical comparisons between a standard statistical translation model and an equivalent Maximum Entropy model. Results show that the Maximum Entropy model is promising, but highly sensitive to the method of feature selection.

Non-extensive statistical mechanics appears as a powerful way to describe complex systems. Tsallis entropy, the main core of this theory has been remained as an unproven assumption. Many people have tried to derive the Tsallis entropy axiomatically. Here we follow the work of Wang (EPJB, 2002) and use the incomplete information theory to retrieve the Tsallis entropy. We change the incomplete in...

In blackhole physics, the statistical dynamical description of the concept of blackhole entropy is still absence. In this paper, we discuss this problem and sets a number of questions about blackhole entropy whose complete answers are not available at present.

Abstract: Burg’s entropy plays an important role in this age of information euphoria, particularly in understanding the emergent behavior of a complex system such as statistical mechanics. For discrete or continuous variable, maximization of Burg’s Entropy subject to its only natural and mean constraint always provide us a positive density function though the Entropy is always negative. On the ...