Zero-Temperature Limit of a Convergent Algorithm to Minimize the Bethe Free Energy
نویسنده
چکیده
After the discovery that fixed points of loopy belief propagation coincide with stationary points of the Bethe free energy, several researchers proposed provably convergent algorithms to directly minimize the Bethe free energy. These algorithms were formulated only for non-zero temperature (thus finding fixed points of the sum-product algorithm) and their possible extension to zero temperature is not obvious. We present the zero-temperature limit of the double-loop algorithm by Heskes, which converges a max-product fixed point. The inner loop of this algorithm is max-sum diffusion. Under certain conditions, the algorithm combines the complementary advantages of the max-product belief propagation and max-sum diffusion (LP relaxation): it yields good approximation of both ground states and max-marginals.
منابع مشابه
Exactness of Belief Propagation in the Zero Temperature Limit for Some Graphical Models with Loops
It is well known that an arbitrary graphical model of statistical inference defined on a tree, i.e. on a graph without loops, is solved exactly and efficiently by an iterative Belief Propagation (BP) algorithm convergent to unique minimum of the so-called Bethe free energy functional. For a general graphical model on a loopy graph the functional may show multiple minima, the iterative BP algori...
متن کاملOn the properties of the Bethe approximation and loopy belief propagation on binary networks
We analyse the local stability of the high-temperature fixed point of the loopy belief propagation (LBP) algorithm and how this relates to the properties of the Bethe free energy which LBP tries to minimize. We focus on the case of binary networks with pairwise interactions. In particular, we state sufficient conditions for convergence of LBP to a unique fixed point and show that these are shar...
متن کاملExactness of Belief Propagation for some Graphical Models with Loops
It is well known that an arbitrary discrete-variable graphical model of statistical inference defined on a tree, i.e. on a graph without loops, is solved exactly and efficiently by algorithms of the Belief Propagation (BP) type. Extending recent results of Kolmogorov & Wainwright ’05 and Bayati, Shah, & Sharma ’06, we discuss here two cases of the opposite extreme, when BP algorithm finds optim...
متن کاملEffects of Some Thermo-Physical Parameters on Free Convective Heat and Mass Transfer over Vertical Stretching Surface at Absolute Zero
Effects of some thermo-physical parameters on free convective heat and mass transfer over a vertical stretching surface at lowest level of heat energy in the presence of suction is investigated. The viscosity of the fluid is assumed to vary as a linear function of temperature and thermal conductivity is assumed constant. A similarity transformation is applied to reduce the governing equations i...
متن کاملDetermination of the Equilibrium Parameters of Gaseous Detonations Using a Genetic Algorithm
The present work is concerned with the development of a new algorithm for determination of the equilibrium composition of gaseous detonations. The elements balance equations, and the second law of thermodynamics (i.e., the minimization of the Gibbs free energy of products), are used to determine the equilibrium composition of the detonation products. To minimize the Gibbs free energy with tradi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1112.5298 شماره
صفحات -
تاریخ انتشار 2011