Entropy of Hidden Markov Processes and Connections to Dynamical Systems BIRS 5-Day Workshop, 07w5103

نویسنده

  • Brian Marcus
چکیده

I will present an overview on the entropy rate of hidden Markov processes (HMP’s), information and coding-theoretic motivation for its study, and some of its connections to dynamical systems, to non-linear filtering, and to statistical physics. Particular attention will be given to: – Alternative representations: via the Blackwell measure, as a Lyapunov exponent, and as a partition function in statistical physics. – Bounds and approximations (stochastic and deterministic), and their complexity-precision tradeoffs. – Asymptotic regimes and analyticity. • M. Boyle (Math, Maryland): Title: Overview of Markovian maps Abstract: A topological Markov shift is the support of a Markov chain (measure); that is, it is the set of infinite sequences all of whose finite subwords have strictly positive probability (measure). A topological Markov shift can support many different Markov chains, including higher-order chains (on which the past and future become independent after conditioning on finitely many steps in the past). Now let f be a sliding block code from a topological Markov shift S onto another topological Markov shift T. We assume S is irreducible (it is the support of an irreducible/ergodic Markov chain). Then there is a dichotomy: either every Markov measure on T lifts (via f) to a Markov measure on S, or every Markov measure on T does not lift to a Markov measure on S. In the former case, the map f is called Markovian. The Markovian condition is a thermodynamic phenomenon and is the first of a range of conditions on the regularity of the map f. I will try to explain this condition, the related conditions, and related work due to myself, Petersen, Quas, Shin, Tuncel, Walters and others. A topological Markov shift is the support of a Markov chain (measure); that is, it is the set of infinite sequences all of whose finite subwords have strictly positive probability (measure). A topological Markov shift can support many different Markov chains, including higher-order chains (on which the past and future become independent after conditioning on finitely many steps in the past). Now let f be a sliding block code from a topological Markov shift S onto another topological Markov shift T. We assume S is irreducible (it is the support of an irreducible/ergodic Markov chain). Then there is a dichotomy: either every Markov measure on T lifts (via f) to a Markov measure on S, or every Markov measure on T does not lift to a Markov measure on S. In the former case, the map f is called Markovian. The Markovian condition is a thermodynamic phenomenon and is the first of a range of conditions on the regularity of the map f. I will try to explain this condition, the related conditions, and related work due to myself, Petersen, Quas, Shin, Tuncel, Walters and others. • E. Verbitsky (Philips-Eindhoven): Title: Thermodynamics of Hidden Processes

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Relative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain

 In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...

متن کامل

Taylor Expansion for the Entropy Rate of Hidden Markov Chains

We study the entropy rate of a hidden Markov process, defined by observing the output of a symmetric channel whose input is a first order Markov process. Although this definition is very simple, obtaining the exact amount of entropy rate in calculation is an open problem. We introduce some probability matrices based on Markov chain's and channel's parameters. Then, we try to obtain an estimate ...

متن کامل

Entropy of Hidden Markov Processes via Cycle Expansion

Hidden Markov Processes (HMP) is one of the basic tools of the modern probabilistic modeling. The characterization of their entropy remains however an open problem. Here the entropy of HMP is calculated via the cycle expansion of the zeta-function, a method adopted from the theory of dynamical systems. For a class of HMP this method produces exact results both for the entropy and the moment-gen...

متن کامل

Statistical Inference and Statistical Mechanics

In this lecture, recent developments on connections between Markov processes and nonequilibrium statistical mechanical systems are discussed. A statistical mechanical analogy is developed for Markov processes and a local entropic measure of their true asymmetry is defined. Introducing partial observations, conditional and joint analogies are developed for Markov processes and their optimal filt...

متن کامل

Generalized Mass Action Law and Thermodynamics of Nonlinear Markov Processes

The nonlinear Markov processes are measure-valued dynamical systems which preserve positivity. They can be represented as the law of large numbers limits of general Markov models of interacting particles. In physics, the kinetic equations allow Lyapunov functionals (entropy, free energy, etc.). This may be considered as a sort of inheritance of the Lyapunov functionals from the microscopic mast...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008