Conditional and Relevant Common Information
نویسندگان
چکیده
Abstract Two variations on Wyner’s common information are proposed: conditional and relevant information. These shown to have operational meanings analogous those of in appropriately defined distributed problems compression, simulation channel synthesis. For information, an additional meaning is identified: a multiple-access with private messages, it the minimal common-message rate that enables communication at maximum sum-rate under weak coordination constraint inputs output. En route, weak-coordination problem over Gray-Wyner network solved no-excess-rate constraint.
منابع مشابه
Directed Information and Conditional Mutual Information
We study directed information in Bayesian networks and related structures. Mutual information is split into directed information and residual information. Some basic equations for directed information and residual information are determined.
متن کاملConditional probability and fuzzy information
The main subject of this paper is the embedding of fuzzy set theory—and related concepts—in a coherent conditional probability scenario. This allows to deal with perception-based information—in the sense of Zadeh—and with a rigorous treatment of the concept of likelihood, dealing also with its role in statistical inference. A coherent conditional probability is looked on as a general non-additi...
متن کاملInformation Flow and Relevant Logics
2 Routley-Meyer Frames Relevant logics are interesting things. One motivating principle for these logics is the requirement that if a conditional of the form ! is to be true, there must be a connection between and . The antecedent must somehow be relevant to the consequent . This is simple to chart prooftheoretically, and for years, this was how relevant logics were studied. (A great deal of th...
متن کاملConditional Information Bottleneck Clustering
We present an extension of the well-known information bottleneck framework, called conditional information bottleneck, which takes negative relevance information into account by maximizing a conditional mutual information score. This general approach can be utilized in a data mining context to extract relevant information that is at the same time novel relative to known properties or structures...
متن کاملZipping out relevant information
represent as sequences of characters. Experimental investigations of physical processes, for instance, typically produce sequences or time series of data. Other systems, such as DNA and protein sequences or human language, are intrinsically represented as strings of characters. Treating information as sequences of characters helps make this information searchable—a necessary first step in navig...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Information and Inference: A Journal of the IMA
سال: 2022
ISSN: ['2049-8772', '2049-8764']
DOI: https://doi.org/10.1093/imaiai/iaab021