A critique of Jaynes' maximum entropy principle
نویسندگان
چکیده
منابع مشابه
Independent Component Analysis Using Jaynes’ Maximum Entropy Principle
ICA deals with finding linear projections in the input space along which the data shows most independence. Therefore, mutual information between the projected outputs, which are usually called the separated outputs due to links with blind source separation (BSS), is considered to be a natural criterion for ICA. Minimization of the mutual information requires primarily the estimation of this qua...
متن کاملQuantum Entanglement and the Maximum Entropy States from the Jaynes Principle
We show that the Jaynes principle is indeed a proper inference scheme when applied to compound systems and will correctly produce the entangled maximum entropy states compatible with appropriate data. This is accomplished by including the dispersion of the entanglement along with its mean value as constraints and an application of the uncertainty principle. We also construct a "thermodynamic-li...
متن کاملJaynes’ Maximum Entropy Principle, Riemannian Metrics and Generalised Least Action Bound
The set of solutions inferred by the generic maximum entropy (MaxEnt) or maximum relative entropy (MaxREnt) principles of Jaynes – considered as a function of the moment constraints or their conjugate Lagrangian multipliers – is endowed with a Riemannian geometric description, based on the second differential tensor of the entropy or its Legendre transform (negative Massieu function). The analy...
متن کاملThe Relevance of Maximum Entropy Production Principle and Maximum Information Entropy Principle in Biology
We start this talk posing the question, is there any physical principle that can serve as a selection principle in biology too? One of the first undertakings in this direction, conducted by Prigogine and Wiame [1] noticed correctly that biological processes are irreversible and as such should be described within irreversible thermodynamics. Since irreversible processes are characterized by entr...
متن کاملSuperstatistical distributions from a maximum entropy principle.
We deal with a generalized statistical description of nonequilibrium complex systems based on least biased distributions given some prior information. A maximum entropy principle is introduced that allows for the determination of the distribution of the fluctuating intensive parameter beta of a superstatistical system, given certain constraints on the complex system under consideration. We appl...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Advances in Applied Mathematics
سال: 1981
ISSN: 0196-8858
DOI: 10.1016/0196-8858(81)90003-8