We study the entropy rate of a hidden Markov process, defined by observing the output of a symmetric channel whose input is a first order Markov process. Although this definition is very simple, obtaining the exact amount of entropy rate in calculation is an open problem. We introduce some probability matrices based on Markov chain's and channel's parameters. Then, we try to obtain an estimate ...

 In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...

The notion of entropy was introduced by Clausius in 1850, and some of the main steps towards the consolidation of the concept were taken by Boltzmann and Gibbs. Since then several extensions and reformulations have been developed in various disciplines with motivations and applications in different subjects, such as statistical mechanics, information theory, and dynamical systems. Fujii and Kam...

The combined effects of magnetic field, Navier slip and convective heating on the entropy generation in a flow of a viscous incompressible electrically conducting fluid between two infinite horizontal parallel plates under a constant pressure gradient have been examined. Both the lower and upper plates of the channel are subjected to asymmetric convective heat exchange with the ambient fluid. T...

In this paper an approximation for entropy rate of an ergodic Markov chain via sample path simulation is calculated. Although there is an explicit form of the entropy rate here, the exact computational method is laborious to apply. It is demonstrated that the estimated entropy rate of Markov chain via sample path not only converges to the correct entropy rate but also does it exponential...

We developed a user friendly software tool to identify the potential binding sites of any regulatory protein based on Shannon relative entropy method. Known DtxR binding sites of Corynebacterium diphtheriae (C. diphtheriae) were used to generate a position specific reference profile for DtxR which was used to identify the potential DNA binding sites within the upstream sequences of Corynebacter...

Thermodynamic analysis provides access to the determinants of binding affinity, enthalpy and entropy. In fragment-based drug discovery (FBDD), thermodynamic analysis provides a powerful tool to discriminate fragments based on their potential for successful optimization. The thermodynamic data generated by FBDD studies can in turn be used to better understand the forces that drive biomolecular i...

Titration calorimetry measurements of the binding of phenyl-alpha (alpha PhOGlu), 3-methoxy (3MeOGlu), fluorodeoxy and deoxy derivatives of alpha-D-glucopyranose (Glu) to concanavalin A (conA), pea lectin and lentil lectin were performed at approx. 10 and 25 degrees C in 0.01 M dimethylglutaric acid/NaOH buffer, pH 6.9, containing 0.15 M NaCl and Mn2+ and Ca2+ ions. Apparently the 3-deoxy, 4-de...

In this paper, Kolmogorov-Sinai entropy is studied using mathematical modeling of an observer $ Theta $. The relative entropy of a sub-$ sigma_Theta $-algebra having finite atoms is defined and then   the ergodic properties of relative  semi-dynamical systems are investigated.  Also,  a relative version of Kolmogorov-Sinai theorem  is given. Finally, it is proved  that the relative entropy of a...