Maximum Entropy: Clearing up Mysteries

نویسندگان

  • Marian Grendár
  • Marian Grendár
چکیده

There are several mystifications and a couple of mysteries pertinent to MaxEnt. The mystifications, pitfalls and traps are set up mainly by an unfortunate formulation of Jaynes’ die problem, the cause célèbre of MaxEnt. After discussing the mystifications a new formulation of the problem is proposed. Then we turn to the mysteries. An answer to the recurring question ’Just what are we accomplishing when we maximize entropy?’ [8], based on MaxProb rationale of MaxEnt [6], is recalled. A brief view on the other mystery: ’What is the relation between MaxEnt and the Bayesian method?’ [9], in light of the MaxProb rationale of MaxEnt suggests that there is not and cannot be a conflict between MaxEnt and Bayes Theorem.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Clearing up Mysteries { the Original Goal

We show how the character of a scienti c theory depends on one's attitude toward probability. Many circumstances seem mysterious or paradoxical to one who thinks that probabilities are real physical properties existing in Nature. But when we adopt the \Bayesian Inference" viewpoint of Harold Je reys, paradoxes often become simple platitudes and we have a more powerful tool for useful calculatio...

متن کامل

The Multidimensional Maximum Entropy Moment Problem: a Review on Numerical Methods

Recently the author developed a numerical method for the multidimensional momentconstrained maximum entropy problem, which is practically capable of solving maximum entropy problems in the two-dimensional domain with moment constraints of order up to 8, in the threedimensional domain with moment constraints of order up to 6, and in the four-dimensional domain with moment constraints of order up...

متن کامل

Determination of Maximum Bayesian Entropy Probability Distribution

In this paper, we consider the determination methods of maximum entropy multivariate distributions with given prior under the constraints, that the marginal distributions or the marginals and covariance matrix are prescribed. Next, some numerical solutions are considered for the cases of unavailable closed form of solutions. Finally, these methods are illustrated via some numerical examples.

متن کامل

Fundamental Study on Neutron Spectrum Unfolding using Maximum Entropy and Maximum Likelihood Method

We present a novel spectrum unfolding code, Maximum Entropy and Maximum Likelihood Unfolding Code (MEALU), based on the maximum likelihood combined with the maximum entropy method, which can determine a neutron spectrum without requiring an initial guess spectrum. We present the basic theory, limitations and assumptions built into the implementation. The performance is checked through an analys...

متن کامل

Asymptotic Behavior of the Maximum Entropy Routing in Computer Networks

Maximum entropy method has been successfully used for underdetermined systems. Network design problem, with routing and topology subproblems, is an underdetermined system and a good candidate for maximum entropy method application. Wireless ad-hoc networks with rapidly changing topology and link quality, where the speed of recalculation is of crucial importance, have been recently successfully ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Entropy

دوره 3  شماره 

صفحات  -

تاریخ انتشار 2001