Towards a Predicate-Argument Evaluation for MT
نویسندگان
چکیده
HMEANT (Lo and Wu, 2011a) is a manual MT evaluation technique that focuses on predicate-argument structure of the sentence. We relate HMEANT to an established linguistic theory, highlighting the possibilities of reusing existing knowledge and resources for interpreting and automating HMEANT. We apply HMEANT to a new language, Czech in particular, by evaluating a set of Englishto-Czech MT systems. HMEANT proves to correlate with manual rankings at the sentence level better than a range of automatic metrics. However, the main contribution of this paper is the identification of several issues of HMEANT annotation and our proposal on how to resolve them.
منابع مشابه
Phrase reordering for statistical machine translation based on predicate-argument structure
In this paper, we describe a novel phrase reordering model based on predicate-argument structure. Our phrase reordering method utilizes a general predicate-argument structure analyzer to reorder source language chunks based on predicate-argument structure. We explicitly model longdistance phrase alignments by reordering arguments and predicates. The reordering approach is applied as a preproces...
متن کاملUsing Grammatical Roles to Improve Statistical Machine Translation
Statistical machine translation systems often struggle to preserve predicateargument structure. We present a new hierarchical machine translation model that explicitly captures the grammatical roles taken on by the words and phrases being translated (e.g., subject, object, and indirect object). Although existing hierarchical and syntax-based grammars can capture how many arguments a predicate t...
متن کاملSemantic Mapping Using Automatic Word Alignment and Semantic Role Labeling
To facilitate the application of semantics in statistical machine translation, we propose a broad-coverage predicate-argument structure mapping technique using automated resources. Our approach utilizes automatic syntactic and semantic parsers to generate Chinese-English predicate-argument structures. The system produced a many-to-many argument mapping for all PropBank argument types by computi...
متن کاملCovering Treebanks With GLARF
This paper introduces GLARF, a framework for predicate argument structure. We report on converting the Penn Treebank II into GLARF by automatic methods that achieved about 90% precision/recall on test sentences from the Penn Treebank. Plans for a corpus of hand-corrected output, extensions of GLARF to Japanese and applications for MT are also discussed.
متن کاملDeriving the Predicate-Argument Structure for a Free Word Order Language
In relatively free word order languages, grammatical functions are intricately related to case marking. Assuming an ordered representation of the predicate-argument structure, this work proposes a Combinatory Categorial Grammar formulation of relating surface case cues to categories and types for correctly placing the arguments in the predicateargument structure. This is achieved by assigning c...
متن کامل