Making Markov chains less lazy

نویسنده

  • Catherine S. Greenhill
چکیده

The mixing time of an ergodic, reversible Markov chain can be bounded in terms of the eigenvalues of the chain: specifically, the second-largest eigenvalue and the smallest eigenvalue. It has become standard to focus only on the secondlargest eigenvalue, by making the Markov chain “lazy”. (A lazy chain does nothing at each step with probability at least 1 2 , and has only nonnegative eigenvalues.) An alternative approach to bounding the smallest eigenvalue was given by Diaconis and Stroock [5, Proposition 2] and Diaconis and Saloff-Coste [4, p.702]. We give examples to show that using this approach it can be quite easy to obtain a bound on the smallest eigenvalue of a combinatorial Markov chain which is several orders of magnitude below the best-known bound on the second-largest eigenvalue.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Characterization of cutoff for reversible Markov chains

A sequence of Markov chains is said to exhibit cutoff if the convergence to stationarity in total variation distance is abrupt. We prove a necessary and sufficient condition for cutoff in reversible lazy chains in terms of concentration of hitting time of certain sets of large stationary measure. (Previous works of Aldous, Oliviera, Sousi and the speaker established a less precise connection be...

متن کامل

A new machine replacement policy based on number of defective items and Markov chains

  A novel optimal single machine replacement policy using a single as well as a two-stage decision making process is proposed based on the quality of items produced. In a stage of this policy, if the number of defective items in a sample of produced items is more than an upper threshold, the machine is replaced. However, the machine is not replaced if the number of defective items is less than ...

متن کامل

Intersection Conductance and Canonical Alternating Paths: Methods for General Finite Markov Chains

We extend the conductance and canonical paths methods to the setting of general finite Markov chains, including non-reversible non-lazy walks. The new path method is used to show that a known bound for mixing time of a lazy walk on a Cayley graph with symmetric generating set also applies to the non-lazy non-symmetric case, often even when there is no holding probability.

متن کامل

Conductance and canonical paths for directed non-lazy walks

We show two Conductance-like theorems for mixing time of finite non-reversible non-lazy Markov Chains, i.e. when the Markov kernel is neither self-adjoint nor positive definite. The first holds for walks with small holding probability, while the second theorem holds even for walks with no holding probability. These are used to derive two canonical path theorems for such non-reversible non-lazy ...

متن کامل

Two conductance theorems, two canonical path theorems, and two walks on directed Cayley graphs

We show two Conductance-like theorems for mixing time of non-reversible non-lazy walks. These bounds involve a measure of expansion which expresses how well ergodic flow is distributed among vertices, which while conceptually similar to Blocking Conductance apply to non-lazy non-reversible Markov chains as well. As an application we derive two canonical path theorems for mixing time of non-reve...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1203.6668  شماره 

صفحات  -

تاریخ انتشار 2012