In this paper, we propose a new semi-supervised training method for Gaussian Mixture Models. We add a conditional entropy minimizer to the maximum mutual information criteria, which enables to incorporate unlabeled data in a discriminative training fashion. The training method is simple but surprisingly effective. The preconditioned conjugate gradient method provides a reasonable convergence ra...

We consider the problem of zero-delay coding of a deterministic dynamical system over a discrete noiseless channel under three estimation criteria concerned with the low-distortion regime. For these three criteria, formulated stochastically in terms of a probability distribution for the initial state, we characterize the smallest channel capacity above which the estimation objectives can be ach...

Quantifying coherence is an essential endeavor for both quantum mechanical foundations and technologies. We present a bona fide measure of by utilizing the Tsallis relative operator (α,β)-entropy. first prove that proposed fulfills all criteria well defined measure, including strong monotonicity in resource theories coherence. then study ordering (α,β)-entropy coherence, α-entropies Rényi α-ent...

In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...

In this paper, we study the overall performance of two main forms of secret entropy coding – secret Huffman coding and secret arithmetic coding, as solutions to multimedia encryption. We consider a set of criteria, which include not only security but also other aspects of the performance. We draw the conclusion that neither can fulfill all the criteria, but secret arithmetic coding can offer a ...

The purpose of this study is to define the concepts of Tsallis entropy and conditional Tsallis entropy of fuzzy partitions and to obtain some results concerning this kind entropy. We show that the Tsallis entropy of fuzzy partitions has the subadditivity and concavity properties. We study this information measure under the refinement and zero mode subset relations. We check the chain rules for ...

Entropy coding is one of the most important techniques in video codec. Two main criteria to assess an entropy coder are coding efficiency and friendly realization characteristic. In the recent development of the H.264/AVC standard, a sophisticated entropy coder, named Context-based Adaptive Variable Length Coding (CAVLC), has been invented, which supplies higher coding efficiency than other VLC...

In recent two decades, countries focused on minimum extraction of fossil fuels and utilized the renewable energies based on countries' policies and the environmental considerations. Thus, choosing the best renewable energy alternative is a significant role to investment on them. Among the classical decision approaches that have used in the literature, the hesitant fuzzy sets (HFSs) theory is ap...