Toward An Empirical Evaluation of Maximum Entropy for Translation Modeling
نویسنده
چکیده
I present empirical comparisons between a standard statistical translation model and an equivalent Maximum Entropy model. Results show that the Maximum Entropy model is promising, but highly sensitive to the method of feature selection.
منابع مشابه
Modeling of the Maximum Entropy Problem as an Optimal Control Problem and its Application to Pdf Estimation of Electricity Price
In this paper, the continuous optimal control theory is used to model and solve the maximum entropy problem for a continuous random variable. The maximum entropy principle provides a method to obtain least-biased probability density function (Pdf) estimation. In this paper, to find a closed form solution for the maximum entropy problem with any number of moment constraints, the entropy is consi...
متن کاملEvaluating a Maximum Entropy Translation Model
I present empirical comparisons between a standard statistical translation model and an equivalent Maximum Entropy model. Results show that the Maximum Entropy model is promising, but highly sensitive to the method of feature selection.
متن کاملA Maximum Entropy/minimum Divergence Translation Model
I present empirical comparisons between a standard statistical translation model and an equivalent Maximum Entropy/Minimum Divergence (MEMD) model, using several diierent methods for automatic feature selection. Results show that the MEMD model signiicantly outperforms the standard model in test corpus perplexity, even though it has far fewer parameters.
متن کاملAn Optimal Approach to Local and Global Text Coherence Evaluation Combining Entity-based, Graph-based and Entropy-based Approaches
Text coherence evaluation becomes a vital and lovely task in Natural Language Processing subfields, such as text summarization, question answering, text generation and machine translation. Existing methods like entity-based and graph-based models are engaging with nouns and noun phrases change role in sequential sentences within short part of a text. They even have limitations in global coheren...
متن کاملMaximum Entropy Modeling with Clausal Constraints
We present the learning system Maccent which addresses the novel task of stochastic MAximum ENTropy modeling with Clausal Constraints. Maximum Entropy method is a Bayesian method based on the principle that the target stochastic model should be as uniform as possible, subject to known constraints. Maccent incorporates clausal constraints that are based on the evaluation of Prolog clauses in exa...
متن کامل