This paper is a review of particular approach to the method maximum entropy as general framework for inference. The discussion emphasizes pragmatic elements in derivation. An epistemic notion information defined terms its relation Bayesian beliefs ideally rational agents. updating from prior posterior probability distribution designed through an eliminative induction process. logarithmic relati...

Based on the Markov model and the basic theory of information entropy, this paper puts forward a new method for optimizing the location of observation points in order to obtain more information from limited geological investigation. According to the existing data from observation points data, classification of tunnel geological lithology was performed, and various lithology distribution were de...

Based on the complement behavior of information gain, a new definition of information entropy is proposed along with its justification in rough set theory. Some properties of this definition imply those of Shannon’s entropy. Based on the new information entropy, conditional entropy and mutual information are then introduced and applied to knowledge bases. The new information entropy is proved t...