Maximum Entropy (maxent) Method in Expert Systems and Intelligent Control: New Possibilities and Limitations

To describe uncertainty of experts’ statements E1, ..., En that form a knowledge base, it is natural to use (subjective) probabilities pi. Correspondingly, it is natural to use probabilities to describe uncertainty of the system’s answer to a given query Q. Since it is impossible to inquire about the expert’s probabilities for all possible (≥ 2) propositional combinations of Ei, a knowledge base is usually incomplete in the sense that there are many probability distributions consistent with this knowledge. If we want to return a single probability, we must select one of these distributions. MaxEnt is a natural selection rule, but for expert systems, computing the MaxEnt distribution often takes an unrealistically long time. In this paper, we propose computationally feasible approximate MaxEnt techniques for expert systems and intelligent control.