In this paper, we have proposed a network invulnerability assessment technique based on the entropy of node importance (ENI) determined by the node betweenness combined with node degree, which can measure the network invulnerability dynamically. Simulation results show that the ENI network entropy can accurately change its values as the network nodes removed deliberately or randomly from the ne...

Ultrasound backscattering signals depend on the microstructures of tissues. Some studies have applied Shannon entropy to analyze the uncertainty of raw radiofrequency (RF) data. However, we found that the sensitivity of entropy in detecting various scatterer concentrations is limited; thus, we propose a weighted entropy as a new information entropy-based approach to enhance the performance of s...

in the current study, the generalized maximum entropy (gme) and dynamic positive equilibrium problem (dpep) approach were introduced and used to estimate the set of dynamic supply functions of selected annual crops in mashhad-chenaran plain during the years 2003-2011.in addition, the allen and morishima elasticities of derived demand inputs, and supply elasticity of the crops were determined. t...

This paper extends maximum entropy estimation of discrete probability distributions to the continuous case. This transition leads to a nonparametric estimation of a probability density function, preserving the maximum entropy principle. Furthermore, the derived density estimate provides a minimum mean integrated square error. In a second step it is shown, how boundary conditions can be included...

We present a new class of estimators for approximating the entropy of multi-dimensional probability densities based on a sample of the density. These estimators extend the classic ”m-spacing” estimators of Vasicek and others for estimating entropies of one-dimensional probability densities. Unlike plug-in estimators of entropy, which £rst estimate a probability density and then compute its entr...

Hidden Markov Processes (HMP) is one of the basic tools of the modern probabilistic modeling. The characterization of their entropy remains however an open problem. Here the entropy of HMP is calculated via the cycle expansion of the zeta-function, a method adopted from the theory of dynamical systems. For a class of HMP this method produces exact results both for the entropy and the moment-gen...

The entropy constancy principle describes the tendency for information in language to be conveyed at a constant rate. We explore the possible role of this principle in spoken dialog, using the “summed entropy rate,” that is, the sum of the entropies of the words of both speakers per second of time. Using the Switchboard corpus of casual dialogs and a standard ngram language model to estimate en...

As established by several groups over the last 20 years, amino acid residues in unfolded peptides and proteins do not exhibit the unspecific random distribution as assumed by the classical random coil model. Individual amino acid residues in small peptides were found to exhibit different conformational preferences. Here, we utilize recently obtained conformational distributions of guest amino a...