منابع مشابه
Entropy and Inference, Revisited
We study properties of popular near–uniform (Dirichlet) priors for learning undersampled probability distributions on discrete nonmetric spaces and show that they lead to disastrous results. However, an Occam–style phase space argument expands the priors into their infinite mixture and resolves most of the observed problems. This leads to a surprisingly good estimator of entropies of discrete d...
متن کاملRenyi Entropy Estimation Revisited
We revisit the problem of estimating entropy of discrete distributions from independent samples, studied recently by Acharya, Orlitsky, Suresh and Tyagi (SODA 2015), improving their upper and lower bounds on the necessary sample size n. For estimating Renyi entropy of order α, up to constant accuracy and error probability, we show the following Upper bounds n = O(1) · 2(1− 1 α )Hα for integer α...
متن کاملConfigurational Entropy Revisited
1548 Journal of Chemical Education • Vol. 84 No. 9 September 2007 • www.JCE.DivCHED.org Entropy change is categorized in some prominent general chemistry textbooks as being either positional (configurational) or thermal. Positional entropy focuses on the number of positions in space that can be occupied by the molecules of a system. Then, to the extent that more positions exist after a process ...
متن کاملShannon's entropy revisited
I consider the effect of a finite sample size on the entropy of a sample of independent events. I propose formula for entropy which satisfies Shannon’s axioms, and which reduces to Shannon’s entropy when sample size is infinite. I discuss the physical meaning of the difference between two formulas, including some practical implications, such as maximum achievable channel utilization, and minimu...
متن کاملMatching based on biological categories in Orangutans (Pongo abelii) and a Gorilla (Gorilla gorilla gorilla)
Following a series of experiments in which six orangutans and one gorilla discriminated photographs of different animal species in a two-choice touch screen procedure, Vonk & MacDonald (2002) and Vonk & MacDonald (2004) concluded that orangutans, but not the gorilla, seemed to learn intermediate level category discriminations, such as primates versus non-primates, more rapidly than they learned...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Physics Today
سال: 2000
ISSN: 0031-9228,1945-0699
DOI: 10.1063/1.1325179