A Linguistic Evaluation of Rule-Based, Phrase-Based, and Neural MT Engines
نویسندگان
چکیده
In this paper, we report an analysis of the strengths and weaknesses of several Machine Translation (MT) engines implementing the three most widely used paradigms. The analysis is based on a manually built test suite that comprises a large range of linguistic phenomena. Two main observations are on the one hand the striking improvement of an commercial online system when turning from a phrase-based to a neural engine and on the other hand that the successful translations of neuralMT systems sometimes bear resemblancewith the translations of a rule-based MT system.
منابع مشابه
Why Catalan-Spanish Neural Machine Translation? Analysis, comparison and combination with standard Rule and Phrase-based technologies
Catalan and Spanish are two related languages given that both derive from Latin. They share similarities in several linguistic levels including morphology, syntax and semantics. This makes them particularly interesting for the MT task. Given the recent appearance and popularity of neural MT, this paper analyzes the performance of this new approach compared to the well-established rule-based and...
متن کاملDeeper Machine Translation and Evaluation for German
This paper describes a hybrid Machine Translation (MT) system built for translating from English to German in the domain of technical documentation. The system is based on three different MT engines (phrase-based SMT, RBMT, neural) that are joined by a selection mechanism that uses deep linguistic features within a machine learning process. It also presents a detailed source-driven manual error...
متن کاملDiagnostic Evaluation of Machine Translation Systems Using Automatically Constructed Linguistic Check-Points
We present a diagnostic evaluation platform which provides multi-factored evaluation based on automatically constructed check-points. A check-point is a linguistically motivated unit (e.g. an ambiguous word, a noun phrase, a verb~obj collocation, a prepositional phrase etc.), which are pre-defined in a linguistic taxonomy. We present a method that automatically extracts check-points from parall...
متن کاملStatistical Phrase-Based Post-Editing
We propose to use a statistical phrasebased machine translation system in a post-editing task: the system takes as input raw machine translation output (from a commercial rule-based MT system), and produces post-edited target-language text. We report on experiments that were performed on data collected in precisely such a setting: pairs of raw MT output and their manually post-edited versions. ...
متن کاملA Fuzzy Rule Based System for Fault Diagnosis, Using Oil Analysis Results
Condition Monitoring, Oil Analysis, Wear Behavior, Fuzzy Rule Based System Maintenance , as a support function, plays an important role in manufacturing companies and operational organizations. In this paper, fuzzy rules used to interpret linguistic variables for determination of priorities. Using this approach, such verbal expressions, which cannot be explicitly analyzed or statistic...
متن کامل