Quantifying information flow with beliefs

Quantifying leakage in the presence of unreliable sources of information

Belief and min-entropy leakage are two well-known approaches to quantify information flow in security systems. Both concepts stand as alternatives to the traditional approaches founded on Shannon entropy and mutual information, which were shown to provide inadequate security guarantees. In this paper we unify the two concepts in one model so as to cope with the frequent (potentially inaccurate,...

Quantitative Aspects of Security Seminar Winter Semester 2006-2007 Quantifying Information Flow

Human Frontal-Subcortical Circuit and Asymmetric Belief Updating.

UNLABELLED How humans integrate information to form beliefs about reality is a question that has engaged scientists for centuries, yet the biological system supporting this process is not well understood. One of the most salient attributes of information is valence. Whether a piece of news is good or bad is critical in determining whether it will alter our beliefs. Here, we reveal a frontal-sub...

Data compression to define information content of hydrological time series

When inferring models from hydrological data or calibrating hydrological models, we are interested in the information content of those data to quantify how much can potentially be learned from them. In this work we take a perspective from (algorithmic) information theory, (A)IT, to discuss some underlying issues regarding this question. In the information-theoretical framework, there is a stron...

The Advantage of Cross Entropy over Entropy in Iterative Information Gathering

Gathering the most information by picking the least amount of data is a common task in experimental design or when exploring an unknown environment in reinforcement learning and robotics. A widely used measure for quantifying the information contained in some distribution of interest is its entropy. Greedily minimizing the expected entropy is therefore a standard method for choosing samples in ...