Axiomatic Characterizations of Information Measures
نویسنده
چکیده
Axiomatic characterizations of Shannon entropy, Kullback I-divergence, and some generalized information measures are surveyed. Three directions are treated: (A) Characterization of functions of probability distributions suitable as information measures. (B) Characterization of set functions on the subsets of {1, . . . , N} representable by joint entropies of components of an N -dimensional random vector. (C) Axiomatic characterization of MaxEnt and related inference rules. The paper concludes with a brief discussion of the relevance of the axiomatic approach for information theory.
منابع مشابه
Generalization of the non-additive measures of uncertainty and information and their axiomatic characterizations
The object of this paper is to define generalized non-additive (i) entropy of order a and type /? and (ii) information of order a and type /? and to give their axiomatic characterizations. Further generalizations are indicated towards the end of the paper.
متن کاملAlternative Axiomatic Characterizations of the Grey Shapley Value
The Shapley value, one of the most common solution concepts of cooperative game theory is defined and axiomatically characterized in different game-theoretic models. Certainly, the Shapley value can be used in interesting sharing cost/reward problems in the Operations Research area such as connection, routing, scheduling, production and inventory situations. In this paper, we focus on the Shapl...
متن کاملOn Risk Measures and Decisions in Insurance and Finance∗
In this paper, we argue that there exists a distinction between risk measures and decision principles. Though both can be regarded as functionals assigning a real number to a random variable, we think that there is a hierarchy between the two concepts. Risk measures operate on the first “level”, quantifying the risk in the situation under consideration, while decision principles operate on the ...
متن کاملDecision principles derived from risk measures
In this paper, we argue that a distinction exists between risk measures and decision principles. Though both are functionals assigning a real number to a random variable, we think there is a hierarchy between the two concepts. Risk measures operate on the first “level”, quantifying the risk in the situation under consideration, while decision principles operate on the second “level”, often bein...
متن کاملBoltzmann-gibbs Entropy: Axiomatic Characterization and Application
Wepresent axiomatic characterizations of both Boltzmann andGibbs entropies together with an application.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Entropy
دوره 10 شماره
صفحات -
تاریخ انتشار 2008