We derive a dual-primal recursive algorithm based on the Fenchel duality framework, extending Dykstra’s successive projections and Csiszar’s I-projections schemes, to handle Tsallis MaxEnt. The Tsallis entropy Sq(p) is a one-parameter extension of Shannon’s entropyH(p) in the sense that Sq→1(p) = H(p). The solution of the Tsallis MaxEnt falls under a q-deformed Gibbs distribution which is a pow...

Various supervised inference methods can be analyzed as convex duals of the generalized maximum entropy (MaxEnt) framework. Generalized MaxEnt aims to find a distribution that maximizes an entropy function while respecting prior information represented as potential functions in miscellaneous forms of constraints and/or penalties. We extend this framework to semi-supervised learning by incorpora...

A single and self-contained method for determining the crystallite-size distribution and shape from experimental x-ray line profile data is presented. We have shown that the crystallite-size distribution can be determined without assuming a functional form for the size distribution, determining instead the size distribution with the least assumptions by applying the Bayesian/MaxEnt method. The ...

This paper focuses on verb sense disambiguation cast as inferring the VerbNet class to which a verb belongs. To train three different supervised learning models –Maximum Entropy (MaxEnt), Naive Bayes and Decision Tree– we used lexical, co-occurrence and typed-dependency features. For each model, we built three classifiers: one single classifier for all verbs, one single classifier for polysemou...

The paper discusses two policies for recognizing NEs with complex structures by maximum entropy models. One policy is to develop cascaded MaxEnt models at different levels. The other is to design more detailed tags with human knowledge in order to represent complex structures. The experiments on Chinese organization names recognition indicate that layered structures result in more accurate mode...

We consider lower and upper bounds on the difference of differential entropies of a Gaussian random vector and an almost Gaussian random vector after both are “smoothed” by an arbitrarily distributed random vector of finite power. These bounds are important to prove the optimality of corner points in the capacity region of Gaussian interference channels. The upper bound, presented in MaxEnt-201...

The analytical continuation average spectrum method (ASM) and maximum entropy (MaxEnt) method are applied to the dynamic response of a noninteracting resonant level model within the framework of the Kubo formula for electric conductivity. The frequency dependent conductivity is inferred from the imaginary time current-current correlation function for a wide range of temperatures, gate voltages,...

Knowing a biomolecule’s structure is inherently linked to and a prerequisite for any detailed understanding of its function. Significant effort has gone into developing technologies for structural characterization. These technologies do not directly provide 3D structures; instead they typically yield noisy and erroneous distance information between specific entities such as atoms or residues, w...