Mutual Information as a Bayesian Measure of Independence
نویسنده
چکیده
The problem of hypothesis testing is examined from both the historical and the Bayesian points of view in the case that sampling is from an underlying joint probability distribution and the hypotheses tested for are those of independence and dependence of the underlying distribution. Exact results for the Bayesian method are provided. Asymptotic Bayesian results and historical method quantities are compared, and historical method quantities are interpreted in terms of clearly defined Bayesian quantities. The asymptotic Bayesian test relies upon a statistic that is predominantly mutual information.
منابع مشابه
A Scoring Function for Learning Bayesian Networks based on Mutual Information and Conditional Independence Tests
We propose a new scoring function for learning Bayesian networks from data using score+search algorithms. This is based on the concept of mutual information and exploits some well-known properties of this measure in a novel way. Essentially, a statistical independence test based on the chi-square distribution, associated with the mutual information measure, together with a property of additive ...
متن کاملAdaptive Thresholding in Structure Learning of a Bayesian Network
Thresholding a measure in conditional independence (CI) tests using a fixed value enables learning and removing edges as part of learning a Bayesian network structure. However, the learned structure is sensitive to the threshold that is commonly selected: 1) arbitrarily; 2) irrespective of characteristics of the domain; and 3) fixed for all CI tests. We analyze the impact on mutual information ...
متن کاملAdaptive Thresholding in Structure Learning of a Bayesian Network
Thresholding a measure in conditional independence (CI) tests using a fixed value enables learning and removing edges as part of learning a Bayesian network structure. However, the learned structure is sensitive to the threshold that is commonly selected: 1) arbitrarily; 2) irrespective of characteristics of the domain; and 3) fixed for all CI tests. We analyze the impact on mutual information ...
متن کاملMutual fund performance with learning across funds
The average level and cross-sectional variability of fund alphas are estimated from a large sample of mutual funds. This information is incorporated, along with the usual regression estimate of alpha, in a (roughly) precision-weighted average measure of individual fund performance. Substantial ‘‘learning across funds’’ is documented, with significant effects on investment decisions. In a Bayesi...
متن کاملOn Classification of Bivariate Distributions Based on Mutual Information
Among all measures of independence between random variables, mutual information is the only one that is based on information theory. Mutual information takes into account of all kinds of dependencies between variables, i.e., both the linear and non-linear dependencies. In this paper we have classified some well-known bivariate distributions into two classes of distributions based on their mutua...
متن کامل