The worst-case complexity of an implementation of Quicksort depends on the random number generator that is used to select the pivot elements. In this paper we estimate the expected number of comparisons of Quicksort as a function in the entropy of the random source. We give upper and lower bounds and show that the expected number of comparisons increases from n logn to n, if the entropy of the ...

Based on the concept of entropy, a new approach to analyse the quality of features as used in speech recognition is proposed. We regard the relation between the hidden Markov model (HMM) states and the corresponding frame based feature vectors as a coding problem, where the states are sent through a noisy recognition channel and received as feature vectors. Using the relation between Shannon’s ...

The entropy loss due to the formation of one or multiple loops in circular and linear DNA chains is calculated from a scaling approach in the limit of long chain segments. The analytical results allow us to obtain a fast estimate for the entropy loss for a given configuration. Numerical values obtained for some examples suggest that the entropy loss encountered in loop closure in typical geneti...

In the continuation of [DF], we study reversible reaction-diffusion equations via entropy methods (based on the free energy functional) in two situations of degeneracy: Firstly, for a two species system, we show explicit exponential convergence to the unique constant steady state when spatial diffusion of one specie vanishes but the system still obeys the same steady state. Secondly, for a syst...

The goal of this paper is to develop an estimate for the entropy of random long-range correlated symbolic sequences with elements belonging to a finite alphabet. As a plausible model, we use the high-order additive stationary ergodic Markov chain. Supposing that the correlations between random elements of the chain are weak we express the differential entropy of the sequence by means of the sym...

Abstract: Lubricating greases show a structural degradation due to friction stress. The shear process dissipates energy. This results in a breakdown of the thickener structure, heat and entropy generation. Tribo-systems are energy driven systems. The stressed lubricating grease is modeled as a subsystem and presents an open thermodynamic system. Investigations were made to obtain more informati...

In this paper, we present a study on the relationship between entropy and the average power consumption of circuits generated from Boolean functions. Based on a general-delay model, an entropy-based formulation for power estimation is derived from a large set of experimental data. The study shows that the entropy measure provides an e ective power estimate for single-output and fully-correlated...

Transfer entropy is a measure of the magnitude and the direction of information flow between jointly distributed stochastic processes. In recent years, its permutation analogues are considered in the literature to estimate the transfer entropy by counting the number of occurrences of orderings of values, not the values themselves. It has been suggested that the method of permutation is easy to ...

Recent studies suggest that the minimum error entropy (MEE) criterion can outperform the traditional mean square error criterion in supervised machine learning, especially in nonlinear and non-Gaussian situations. In practice, however, one has to estimate the error entropy from the samples since in general the analytical evaluation of error entropy is not possible. By the Parzen windowing appro...