Information Measures via Copula Functions
Authors
Abstract:
In applications of differential geometry to problems of parametric inference, the notion of divergence is often used to measure the separation between two parametric densities. Among them, in this paper, we will verify measures such as Kullback-Leibler information, J-divergence, Hellinger distance, -Divergence, … and so on. Properties and results related to distance between probability distributions derived via copula functions. Some inequalities are obtained in view of the dependence and information measures.
similar resources
Statistical Dependence: Copula Functions and Mutual Information Based Measures
Accurately and adequately modelling and analyzing relationships in real random phenomena involving several variables are prominent areas in statistical data analysis. Applications of such models are crucial and lead to severe economic and financial implications in human society. Since the beginning of developments in Statistical methodology as the formal scientific discipline, correlation based...
full textCopula Variational Bayes inference via information geometry
Variational Bayes (VB), also known as independent mean-field approximation, has become a popular method for Bayesian network inference in recent years. Its application is vast, e.g. in neural network, compressed sensing, clustering, etc. to name just a few. In this paper, the independence constraint in VB will be relaxed to a conditional constraint class, called copula in statistics. Since a jo...
full textCopula-based Kernel Dependency Measures
The paper presents a new copula based method for measuring dependence between random variables. Our approach extends the Maximum Mean Discrepancy to the copula of the joint distribution. We prove that this approach has several advantageous properties. Similarly to Shannon mutual information, the proposed dependence measure is invariant to any strictly increasing transformation of the marginal v...
full textNote to Copula Functions
The theory of copulas is known to provide a useful tool for modelling dependence in integrated risk management. In this paper, we describe how may be used copula methodology for the Monte Carlo Analysis whereas the main emphasis is put on Value-at-Risk as a risk measure. In the second part of this paper we show properties more generalised model as measurable space and we show how it is possible...
full textDynamic Bayesian Information Measures
This paper introduces measures of information for Bayesian analysis when the support of data distribution is truncated progressively. The focus is on the lifetime distributions where the support is truncated at the current age t>=0. Notions of uncertainty and information are presented and operationalized by Shannon entropy, Kullback-Leibler information, and mutual information. Dynamic updatings...
full textCopula-based Density Weighting Functions
In this paper, we propose a method how to construct density weighting functions from Copulas. The notion of Copula was introduced by A. Sklar in 1959. A Copula is a dependence function to construct a bivariate distribution function that links joint distributions to their marginals. Other forms of dependence function, based on density weighing functions, have also been developed. The proposed me...
full textMy Resources
Journal title
volume 7 issue 1
pages 47- 60
publication date 2010-09
By following a journal you will be notified via email when a new issue of this journal is published.
Hosted on Doprax cloud platform doprax.com
copyright © 2015-2023