The Rényi entropy is a generalization of Shannon entropy to a one-parameter family of entropies. Tsallis entropy too is a generalization of Shannon entropy. The measure for Tsallis entropy is non-logarithmic. After the introduction of Shannon entropy , the conditional Shannon entropy was derived and its properties became known. Also, for Tsallis entropy, the conditional entropy was introduced a...

The relationship between the diversity of mixed-species microbial consortia and their electrogenic potential in the anodes of microbial fuel cells was examined using different diversity measures as predictors. Identical microbial fuel cells were sampled at multiple time-points. Biofilm and suspension communities were analysed by denaturing gradient gel electrophoresis to calculate the number an...

Thermodynamic modeling of extensive systems usually implicitly assumes the additivity of entropy. Furthermore, if this modeling is based on the concept of Shannon entropy, additivity of the latter function must also be guaranteed. In this case, the constituents of a thermodynamic system are treated as subsystems of a compound system, and the Shannon entropy of the compound system must be subjec...

This paper demonstrates the performance of two possible CAT selection strategies for cognitive diagnosis. One is based on Shannon entropy and the other is based on Kullback-Leibler information. The performances of these two test construction methods are compared with random item selection. The cognitive diagnosis model used in this study is a simplified version of the Fusion model. Item banks a...

objective(s): iran is considered as one of the high-prevalence areas for β-thalassemia with a rate of about 10% carrier frequency. molecular diagnosis of the disease is performed both by direct sequencing and indirectly by the use of polymorphic markers present in the beta globin gene cluster. however, to date there is no reliable information on the application of the markers in the iranian pop...

Various segmentation algorithms have been proposed for better classification of the highly nonstationary heart sounds. This paper proposes an improved segmentation technique based on Shannon Energy calculation of the phonocardiogram using adaptive windows. The major focus of the research has been on a simple yet comprehensive signal representation as well as on extracting most information from ...

New results are proved on the convergence of the Shannon lower bound to the rate distortion function as the distortion decreases to zero. The key convergence result is proved using a fundamental property of informational divergence. As a corollary, it is shown that the Shannon lower bound is asymptotically tight for norm-based distortions, when the source vector has a finite differential entrop...

The Shannon capacity of a graphG is defined as c(G) = supd≥1(α(G )) 1 d , where α(G) is the independence number of G. The Shannon capacity of the cycle C5 on 5 vertices was determined by Lovász in 1979, but the Shannon capacity of a cycle Cp for general odd p remains one of the most notorious open problems in information theory. By prescribing stabilizers for the independent sets in C p and usi...

Shannon entropy is the most crucial foundation of Information Theory, which has been proven to be effective in many fields such as communications. Rényi entropy and Chernoff information are other two popular measures of information with wide applications. The mutual information is effective to measure the channel information for the fact that it reflects the relation between output variables an...

This essay looks at the historical significance of four APS classic papers that are freely available online: Jolliffe N, Shannon JA, and Smith HW. The excretion of urine in the dog. III. The use of non-metabolized sugars in the measurement of the glomerular filtrate. Am J Physiol 100: 301-312, 1932 (http://ajplegacy.physiology.org/cgi/reprint/100/2/301). Shannon JA. The excretion of inulin by t...