We consider two entropy-based interior point methods that solve LP relaxations of MAP estimation in graphical models: (1) an entropy-regularization method and (2) a relative-entropy proximal method. Using the fact that relative-entropy is the Bregman distance induced by entropy, we show that the two approaches are actually equivalent. The purpose of this note is to show one connection between t...

the method of entropy production minimization for finding energy efficient paths of operation of process equipment is first presented using an instructive example with optimal control theory. with refer-ence to the earlier investigations, the researchers present some design rules that relate to the designs’ en-tropy production. minimum entropy production is not obtained in special cases, not ge...

The design of weight is one of the important parts in fuzzy decision making, as it would have a deep effect on the evaluation results. Entropy is one of the weight measure based on objective evaluation. Non--probabilistic-type entropy measures for fuzzy set and interval type-2 fuzzy sets (IT2FS) have been developed and applied to weight measure. Since the entropy for (IT2FS) for decision making...

We study the two party problem of randomly selecting a string among all the strings of length n. We want the protocol to have the property that the output distribution has high entropy, even when one of the two parties is dishonest and deviates from the protocol. We develop protocols that achieve high, close to n, entropy. In the literature the randomness guarantee is usually expressed as being...

the time evaluation of quantum entropy in a four-level double- type atomic system is theoretically investigated. quantum entanglement of the atom and its spontaneous emission fields is then discussed via quantum entropy. it is found that the degree of entanglement can be increased by the quantum interference induced by spontaneous emission. the phase dependence of the atom-field entanglement is...

This paper proposes a maximum-entropy based multi-objective genetic algorithm approach for the design optimization of water distribution networks. The novelty is that in contrast to previous research involving statistical entropy the algorithm can handle multiple operating conditions. We used NSGA II and EPANET 2 and wrote a subroutine that calculates the entropy value for any given water distr...

As can be seen from the title, this article consists of two distinguishable questions: The first, concerns the possibility of defining entropy, and the second, concerns the applicability of the Second Law. In most cases, writers intertwine the two concepts on entropy and the Second Law 1,2 . In fact, most people define the Second Law as “the law of increasing entropy.” 1-2 This is unfortunately...

We show how to determine the maximum and minimum possible values of one measure of entropy for a given value of another measure of entropy. These maximum and minimum values are obtained for two standard forms of probability distribution (or quantum state) independent of the entropy measures, provided the entropy measures satisfy a concavity/convexity relation. These results may be applied to en...

In this paper I will provide an introduction to the theory of cellular automata and review a paper by Michele D’amico, Giovanni Manzini, and Luciano Margara [3], On computing the entropy of cellular automata, in which the authors study the topological entropy of cellular automata. The main problems addressed are proving a closed form for the topological entropy of D-dimensional linear cellular ...

In the past few years, several entropy-based tests have been proposed for testing either single SNP association or gene-gene interaction. These tests are mainly based on Shannon entropy and have higher statistical power when compared to standard χ2 tests. In this paper, we extend some of these tests using a more generalized entropy definition, Rényi entropy, where Shannon entropy is a special c...