We compared entropy for texts written in natural languages (English, Spanish) and artificial languages (computer software) based on a simple expression for the entropy as a function of message length and specific word diversity. Code text written in artificial languages showed higher entropy than text of similar length expressed in natural languages. Spanish texts exhibit more symbolic diversit...

In this work, Fault Induced Delayed Voltage Recovery (FIDVR) phenomenon has been characterized as the loss of Entropy in the voltage time series. The relationship between entropy and the voltage recovery rate has been established. It is shown that, the entropy can be an estimate of the recovery rate. Furthermore, the entropy computation has been done entirely from the statistical properties of ...

We prove new inequalities implying exponential decay of relative entropy functionals for a class of Zero–Range processes on the complete graph. We first consider the case of uniformly increasing rates, where we use a discrete version of the Bakry– Emery criterium to prove spectral gap and entropy dissipation estimates, uniformly over the number of particles and the number of vertices. We then s...

In the continuation of [DF], we study reversible reaction-diffusion equations via entropy methods (based on the free energy functional) for a 1D system of four species. We improve the existing theory by getting 1) almost exponential convergence in L1 to the steady state via a precise entropy-entropy dissipation estimate, 2) an explicit global L ∞ bound via interpolation of a polynomially growin...

Word sense distributions are usually skewed. Predicting the extent of the skew can help a word sense disambiguation (WSD) system determine whether to consider evidence from the local context or apply the simple yet effective heuristic of using the first (most frequent) sense. In this paper, we propose a method to estimate the entropy of a sense distribution to boost the precision of a first sen...

In his 1992 paper entitled “A universal statistical test for random bit generators,” Maurer discusses a statistic whose value is closely related to the per-bit-entropy of an ergodic stationary source. Here we derive an entropy estimate from a class of generalized serial tests and discuss its relationship to return-time-based entropy estimators and frequency-based goodness-of-fit tests. Our setu...

A compact graphical device for combining survival and time-varying covariate information is proposed. The proposed graph contains the Kaplan-Meier estimator for right-censored data and a simultaneous display of the behaviour of time-dependent covariate(s) and the lifetime for each subject in the sample. The observed levels of time-dependent covariates are possibly subjected to an initial dimens...

OBJECTIVES To identify factors that influence the extent to which general practitioners use absolute risk (AR) assessment in cardiovascular disease (CVD) risk assessment. DESIGN, SETTING AND PARTICIPANTS Semi-structured interviews with 25 currently practising GPs from eight Divisions of General Practice in New South Wales, Australia, between October 2011 and May 2012. Data were analysed using...

Accurate short-term traffic forecasting is the cornerstone for Intelligent Transportation Systems. In past several decades, many models have been proposed to continuously improve predictive accuracy. A key but unsolved question whether there a theoretical bound accuracy with which can be predicted and that limit directly estimated from data. To answer this question, we use core concepts in info...