Current definition of high-entropy alloys (HEAs) is commonly based on the configurational entropy. But this depends only chemical composition a HEA and therefore cannot distinguish information content that encoded in various local atomic arrangements measurable by Shannon entropy theory. Here, inspired finding two-dimensional (2D) Sudoku matrices exhibit higher average than 2D random matrix cou...

purpose: this study aimed to measure the information load of words in farsi scientific texts and determine the relationship between some properties of the words and information load of the texts based on shannon entropy. methodology: the study was conducted based on the content analysis of a number of 320 articles that were published in scientific-research iranian journals in 2009. and the arti...

The statistical analysis of data stemming from dynamical systems, including, but not limited to, time series, routinely relies on the estimation information theoretical quantities, most notably Shannon entropy. To this purpose, possibly widespread tool is provided by so-called plug-in estimator, whose properties in terms bias and variance were investigated since first decade after publication S...

1.2 REMARK ON INTERPRETATIONS OF THE SHANNON ENTROPY There are standard ways to interpret the Shannon entropy. For instance, the quantity H(p) can be viewed as a measure of the amount of uncertainty in a random experiment described by the probability mass function p, or as a measure of the amount of information one gains by learning the value of such an experiment. Indeed, it is possible to sta...

The paper examines relationships between the conditional Shannon entropy and the expectation of `α-norm for joint probability distributions. More precisely, we investigate the tight bounds of the expectation of `α-norm with a fixed conditional Shannon entropy, and vice versa. As applications of the results, we derive the tight bounds between the conditional Shannon entropy and several informati...

Quantifiers were introduced to convert recurrence plots into a statistical analysis of dynamical properties. It is shown that the Shannon entropy, if properly computed, increases as the chaotic regime is developed as expected. Recurrence plots and a new estimator for the Shannon entropy are then used to identify asynchronisms in non-invasive mechanical ventilation. It is thus shown that the pha...

Image Segmentation plays an important role in medical field that enable professionals to detect their patient’s problems and help them to get proper diagnosed. In this article, an entropy based approach for image segmentation is discussed to highlight tumor in MRI images. Magnetic Resonance Imaging (MRI) is an imaging, in which pixel values are based on radiation absorption. In the proposed app...