Conjugate and conditional conjugate Bayesian analysis of discrete graphical models of marginal independence
نویسندگان
چکیده
A conjugate and conditional conjugate Bayesian analysis is presented for bi-directed discrete graphical models, which are used to describe and estimate marginal associations between categorical variables. To achieve this, each bi-directed graph is re-expressed by a Markov equivalent, over the observed margin, directed acyclic graph (DAG). This DAG equivalent model is obtained using the same vertex set or with the addition of some latent variables when required. It is characterised by a minimal set of marginal and conditional probability parameters. Hence compatible priors based on products of Dirichlet distributions can be applied. For models with DAG representation on the same vertex set, the posterior distribution and the marginal likelihood is analytically available, while for the remaining ones a data augmentation scheme introducing additional latent variables is required. For the latter, the marginal likelihood is estimated using Chib’s estimator. Additional implementation details including identifiability of such models are discussed. Moreover, analytic details concerning the computation of the posterior distributions of the marginal log-linear parameters are provided. The computation is achieved via a simple transformation of the simulated values of the probability parameters of the bi-directed model under study. The marginal log-linear parameterisation provides a straightforward interpretation in terms of log-odds ratios on specificmarginals quantifying the associations between variables involved in the corresponding marginal. The proposed methodology is illustrated using a popular 4-way dataset. © 2013 Elsevier B.V. All rights reserved.
منابع مشابه
Dynamic Matrix-Variate Graphical Models
This paper introduces a novel class of Bayesian models for multivariate time series analysis based on a synthesis of dynamic linear models and graphical models. The synthesis uses sparse graphical modelling ideas to introduce structured, conditional independence relationships in the time-varying, cross-sectional covariance matrices of multiple time series. We define this new class of models and...
متن کاملLearning Conditional Gaussian Networks
This paper considers conditional Gaussian networks. The parameters in the network are learned by using conjugate Bayesian analysis. As conjugate local priors, we apply the Dirichlet distribution for discrete variables and the Gaussian-inverse gamma distribution for continuous variables, given a configuration of the discrete parents. We assume parameter independence and complete data. Further, t...
متن کاملThe Variational Bayesian EM Algorithm for Incomplete Data: with Application to Scoring Graphical Model Structures
We present an efficient procedure for estimating the marginal likelihood of probabilistic models with latent variables or incomplete data. This method constructs and optimises a lower bound on the marginal likelihood using variational calculus, resulting in an iterative algorithm which generalises the EM algorithm by maintaining posterior distributions over both latent variables and parameters....
متن کاملBayesian Structure Learning for Stationary Time Series
While much work has explored probabilistic graphical models for independent data, less attention has been paid to time series. The goal in this setting is to determine conditional independence relations between entire time series, which for stationary series, are encoded by zeros in the inverse spectral density matrix. We take a Bayesian approach to structure learning, placing priors on (i) the...
متن کاملA Brief Introduction to Graphical Models and How to Learn Them from Data
Graphical Models: Core Ideas and Notions A Simple Example: How does it work in principle? Conditional Independence Graphs conditional independence and the graphoid axioms separation in (directed and undirected) graphs decomposition/factorization of distributions Evidence Propagation in Graphical Models Building Graphical Models Learning Graphical Models from Data quantitative (parameter) and qu...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Computational Statistics & Data Analysis
دوره 66 شماره
صفحات -
تاریخ انتشار 2013