In order to deal with the divergence of uncertain variables from a prior one, this paper is devoted to introduce the concept of cross-entropy for uncertain variables and study the minimum cross-entropy principle.

We propose an entropy statistic designed to assess the behavior of slowly varying parameters of real systems. Based on correlation entropy, the method uses symbol dynamics and analysis of increments to achieve sufficient recurrence in a short time series to enable entropy measurements on small data sets. We analyze entropy along a moving window of a time series, the entropy statistic tracking t...

It is often stated in papers tackling the task of selecting a Bayesian network structure from data that there are these two distinct approaches: (i) Apply conditional indepen­ dence tests . when testing for the presence or otherwise of edges; (ii) Search the model space using a scoring metric. Here I argue that for complete data and a given node ordering this division is largely a myth, by show...

There is neither a single clinical, microbiological, histopathological or genetic test, nor combinations of them, to discriminate aggressive periodontitis (AgP) from chronic periodontitis (CP) patients. We aimed to estimate probability density functions of clinical and immunologic datasets derived from periodontitis patients and construct artificial neural networks (ANNs) to correctly classify ...

We present a preliminary study of using the information theoretic concept of cross entropy to measure musical contrast in a symbolic context, with a focus on melody. We measure cross entropy using the Information Dynamics Of Music (IDyOM) framework. Whilst our long term aim is to understand the use of contrast in sonata form, in this paper we take a more general perspective and look at a broad ...