Shannon entropy of a probability measure P , defined as − ∫ X dP dμ ln dP dμ dμ on a measure space (X,M, μ), is not a natural extension from the discrete case. However, maximum entropy (ME) prescriptions of Shannon entropy functional in the measure-theoretic case are consistent with those for the discrete case. Also it is well known that Kullback-Leibler relative entropy can be extended natural...

In this paper, we show that in order to obtain the Tsallis entropy rate for stochastic processes, we can use the limit of conditional entropy, as it was done for the case of Shannon and Renyi entropy rates. Using that we can obtain Tsallis entropy rate for stationary Gaussian processes. Finally, we derive the relation between Renyi, Shannon and Tsallis entropy rates for stationary Gaussian proc...

This review provides a summary of methods originated in (non-equilibrium) statistical mechanics and information theory, which have recently found successful applications to quantitatively studying complexity in various components of the complex Entropy 2013, 15 4845 system Earth. Specifically, we discuss two classes of methods: (i) entropies of different kinds (e.g., on the one hand classical S...

This paper denes and investigates the ergodic proper-ties of the entropy of a countable partition of a fuzzy dynamical sys-tem at different points of the state space. It ultimately introducesthe local fuzzy entropy of a fuzzy dynamical system and proves itto be an isomorphism invariant.

The time evaluation of quantum entropy in a four-level double- type atomic system is theoretically investigated. Quantum entanglement of the atom and its spontaneous emission fields is then discussed via quantum entropy. It is found that the degree of entanglement can be increased by the quantum interference induced by spontaneous emission. The phase dependence of the atom-field entanglement is...

A hybrid censoring scheme is a mixture of type I and type II censoring schemes. When $n$ items are placed on a life test, the experiment terminates under type I or type II hybrid censoring scheme if either a pre-fixed censoring time T or the rth (1<=r<=n&nbsp;is fixed) failure is first or later observed, respectively. In this paper, we investigate the decomposition of entropy in both hybrid cen...

in this paper, a local approach to the concept of hudetz $g$-entropy is presented. the introduced concept is stated in terms of hudetz $g$-entropy. this representation is based on the concept of $g$-ergodic decomposition which is a result of the choquet&apos;s representation theorem for compact convex metrizable subsets of locally convex spaces.

The aim of this paper is to show that the Tsallis-type (q-additive) entropic chain rule allows for a wider class of entropic functionals than previously thought. In particular, we point out that the ensuing entropy solutions (e.g., Tsallis entropy) can be determined uniquely only when one fixes the prescription for handling conditional entropies. By using the concept of Kolmogorov–Nagumo quasi-...

this paper concentrates on a new procedure which experimentally recognises gears and bearings faults of a typical gearbox system using a least square support vector machine (lssvm). two wavelet selection criteria maximum energy to shannon entropy ratio and maximum relative wavelet energy are used and compared to select an appropriate wavelet for feature extraction. the fault diagnosis method co...

this paper concentrates on a new procedure which experimentally recognises gears and bearings faults of a typical gearbox system using a least square support vector machine (lssvm). two wavelet selection criteria maximum energy to shannon entropy ratio and maximum relative wavelet energy are used and compared to select an appropriate wavelet for feature extraction. the fault diagnosis method co...