purpose: this study aimed to measure the information load of words in farsi scientific texts and determine the relationship between some properties of the words and information load of the texts based on shannon entropy. methodology: the study was conducted based on the content analysis of a number of 320 articles that were published in scientific-research iranian journals in 2009. and the arti...

The Shannon entropy, one of the cornerstones information theory, is widely used in physics, particularly statistical mechanics. Yet its characterization and connection to physics remain vague, leaving ample room for misconceptions misunderstanding. We will show that entropy can be fully understood as measuring variability elements within a given distribution: it characterizes how much variation...