We provide a full behavioral characterization of the standard Shannon model rational inattention. The key axiom is Invariance under Compression, which identifies this as capturing an ideal form attention-constrained choice. introduce tractable generalizations that allow for many known violations from ideal, including asymmetries and complementarities in learning, context effects, low responsive...

We obtain a mathematically simple characterization of all functionals coinciding with the von Neumann reduced entropy on pure states based on the Khinchin-Faddeev axiomatization of Shannon entropy and give a physical interpretation of the axioms in terms of entanglement.

Many viruses evolve rapidly. For example, haemagglutinin (HA) of the H3N2 influenza A virus evolves to escape antibody binding. This evolution of the H3N2 virus means that people who have previously been exposed to an influenza strain may be infected by a newly emerged virus. In this paper, we use Shannon entropy and relative entropy to measure the diversity and selection pressure by an antibod...

The accurate detection and classification of network anomalies based on traffic feature distributions is still a major challenge. Together with volume metrics, traffic feature distributions are the primary source of information of approaches scalable to high-speed and large scale networks. In previous work, we proposed to use the Tsallis entropy based traffic entropy spectrum (TES) to capture c...

Many viruses evolve rapidly. For example, hemagglutinin of the H3N2 influenza A virus evolves to escape antibody binding. This evolution of the H3N2 virus means that people who have previously been exposed to an influenza strain may be infected by a newly emerged virus. In this paper, we use Shannon entropy and relative entropy to measure the diversity and selection pressure by antibody in each...

A new correlation measure, the product of the Shannon entropy power and the Fisher information of the electron density, is introduced by analyzing the Fisher-Shannon information plane of some two-electron systems (He-like ions, Hooke's atoms). The uncertainty and scaling properties of this information product are pointed out. In addition, the Fisher and Shannon measures of a finite many-electro...

We introduce a novel parametric family of symmetric information-theoretic distances based on Jensen’s inequality for a convex functional generator. In particular, this family unifies the celebrated Jeffreys divergence with the Jensen-Shannon divergence when the Shannon entropy generator is chosen. We then design a generic algorithm to compute the unique centroid defined as the minimum average d...