The first section gives the measure of uncertainty given by Shannon (1948) and the generalizations thereof by Schvitzenberger (1954), Kullback (1959), Renyi (1961,1965), Kapur (1967, 1968), and Rathie (1970). It gives some postulates characterizing Shannon's entropy, Renyi's entropy of order a and our entropy of order a and type P. It also gives some properties of this most general type of entr...

In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.

in this paper, the ambiguity of nite state irreducible markov chain trajectories is reminded and is obtained for two state markov chain. i give an applicable example of this concept in president election

In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...

In this paper an approximation for entropy rate of an ergodic Markov chain via sample path simulation is calculated. Although there is an explicit form of the entropy rate here, the exact computational method is laborious to apply. It is demonstrated that the estimated entropy rate of Markov chain via sample path not only converges to the correct entropy rate but also does it exponential...

In this paper, we show that in order to obtain the Tsallis entropy rate for stochastic processes, we can use the limit of conditional entropy, as it was done for the case of Shannon and Renyi entropy rates. Using that we can obtain Tsallis entropy rate for stationary Gaussian processes. Finally, we derive the relation between Renyi, Shannon and Tsallis entropy rates for stationary Gaussian proc...

wear is a complicated phenomenon caused by the relative movement of two contacting surfaces compressed together by a normal force. prediction of the wear, in most cases, requires various experiments and microstructural characterization of the contacting surfaces. mathematical models based on physical concepts could provide considerable help in understanding the physical behavior and hence the p...

We study the entropy rate of a hidden Markov process, defined by observing the output of a symmetric channel whose input is a first order Markov process. Although this definition is very simple, obtaining the exact amount of entropy rate in calculation is an open problem. We introduce some probability matrices based on Markov chain's and channel's parameters. Then, we try to obtain an estimate ...

Wear is a complicated phenomenon caused by the relative movement of two contacting surfaces compressed together by a normal force. Prediction of the wear, in most cases, requires various experiments and microstructural characterization of the contacting surfaces. Mathematical models based on physical concepts could provide considerable help in understanding the physical behavior and hence the p...