A Generalized Theory of Maximum Entropy Prediction by Neurons
نویسندگان
چکیده
The maximum entropy procedure is an axiomatically derived inference technique, producing density functions from moment constraints. In this paper we consider the implications of a hypothesized neuronal prediction based on the maximum entropy principle and investigate the computational and biological consequences of this hypothesis. The ultimate goal of the paper is to translate, as generally as possible, the maximum entropy inference technique into the context of neural computation.
منابع مشابه
Comparison of entropy generation minimization principle and entransy theory in optimal design of thermal systems
In this study, the relationship among the concepts of entropy generation rate, entransy theory, and generalized thermal resistance to the optimal design of thermal systems is discussed. The equations of entropy and entransy rates are compared and their implications for optimization of conductive heat transfer are analyzed. The theoretical analyses show that based on entropy generation minimizat...
متن کاملMaximum Entropy Modeling Toolkit
The Maximum Entropy Modeling Toolkit supports parameter estimation and prediction for statistical language models in the maximum entropy framework. The maximum entropy framework provides a constructive method for obtaining the unique conditional distribution p*(y|x) that satisfies a set of linear constraints and maximizes the conditional entropy H(p|f) with respect to the empirical distribution...
متن کاملPrediction of potential habitats of Astracantha gossypina (Fisch.) Using the maximum entropy model in regional scale
Astracantha gossypina (Fisch.) is one of the most important rangeland plants in the northeastern region of Iran and has a great role in soil conservation and the economy of ranchers. unreasonable uses and management of desire plant species usually led to species loss and the replacement of endemic and specialist species by invasive endemic or exotic species. This study was conducted to determin...
متن کاملBayesian Prediction Intervals under Bivariate Truncated Generalized Cauchy Distribution
Ateya and Madhagi (2011) introduced a multivariate form of truncated generalized Cauchy distribution (TGCD), which introduced by Ateya and Al-Hussaini (2007). The multivariate version of (TGCD) is denoted by (MVTGCD). Among the features of this form are that subvectors and conditional subvectors of random vectors, distributed according to this distribution, have the same form of distribution ...
متن کاملMaximum Entropy Analysis for G/G/1 Queuing System (TECHNICAL NOTE)
This paper provides steady state queue-size distribution for a G/G/1 queue by using principle of maximum entropy. For this purpose we have used average queue length and normalizing condition as constraints to derive queue-size distribution. Our results give good approximation as demonstrated by taking a numerical illustration. In particular case when square coefficient of variation of inter-arr...
متن کامل