Entropy rates and finite-state dimension

نویسندگان

  • Chris Bourke
  • John M. Hitchcock
  • N. V. Vinodchandran
چکیده

The effective fractal dimensions at the polynomial-space level and above can all be equivalently defined as the C-entropy rate where C is the class of languages corresponding to the level of effectivization. For example, pspace-dimension is equivalent to the PSPACE-entropy rate. At lower levels of complexity the equivalence proofs break down. In the polynomialtime case, the P-entropy rate is a lower bound on the p-dimension. Equality seems unlikely, but separating the P-entropy rate from p-dimension would require proving P 6= NP. We show that at the finite-state level, the opposite of the polynomial-time case happens: the REG-entropy rate is an upper bound on the finite-state dimension. We also use the finitestate genericity of Ambos-Spies and Busse (2003) to separate finite-state dimension from the REG-entropy rate. However, we point out that a block-entropy rate characterization of finite-state dimension follows from the work of Ziv and Lempel (1978) on finite-state compressibility and the compressibility characterization of finite-state dimension by Dai, Lathrop, Lutz, and Mayordomo (2004). As applications of the REG-entropy rate upper bound and the block-entropy rate characterization, we prove that every regular language has finite-state dimension 0 and that normality is equivalent to finite-state dimension 1.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Calculation of Thermodynamic Properties of the Quasi-one Dimensional Liquid 3He at Finite Temperature

We have used a variational approach to calculate some thermodynamic properties of the quasi-one dimensional liquid 3He such as the energy, entropy, free energy, equation of state and heat capacity at finite temperature. We have employed the Lennard-Jones potential as the inter-atomic interaction. We have seen that the total energy increases by increasing both temperature and density....

متن کامل

Finite-State Dimension and Real Arithmetic

We use entropy rates and Schur concavity to prove that, for every integer k ≥ 2, every nonzero rational number q, and every real number α, the base-k expansions of α, q + α, and qα all have the same finite-state dimension and the same finitestate strong dimension. This extends, and gives a new proof of, Wall’s 1949 theorem stating that the sum or product of a nonzero rational number and a Borel...

متن کامل

Dimension and Relative Frequencies

We show how to calculate the finite-state dimension (equivalently, the finite-state compressibility) of a saturated sets X consisting of all infinite sequences S over a finite alphabet Σm satisfying some given condition P on the asymptotic frequencies with which various symbols from Σm appear in S. When the condition P completely specifies an empirical probability distribution π over Σm, i.e., ...

متن کامل

Comments on the Entropy of nonequilibrium Steady States

We discuss the entropy of nonequilibrium steady states. We analyze the so-called spontaneous production of entropy in certain reversible deterministic nonequilibrium system, and its link with the collapse of such systems towards an attractor that is of lower dimension than the dimension of phase space. This means that in the steady state limit, the Gibbs entropy diverges to negative infinity. W...

متن کامل

Relative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain

 In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Theor. Comput. Sci.

دوره 349  شماره 

صفحات  -

تاریخ انتشار 2005