Automatic Extraction of Polish Language Errors from Text Edition History
نویسنده
چکیده
There are no large error corpora for a number of languages, despite the fact that they have multiple applications in natural language processing. The main reason underlying this situation is a high cost of manual corpora creation. In this paper we present the methods of automatic extraction of various kinds of errors such as spelling, typographical, grammatical, syntactic, semantic, and stylistic ones from text edition histories. By applying of these methods to the Wikipedia’s article revision history, we created the large and publicly available corpus of naturally-occurring language errors for Polish, called PlEWi. Finally, we analyse and evaluate the detected error categories in our corpus.
منابع مشابه
Presenting a method for extracting structured domain-dependent information from Farsi Web pages
Extracting structured information about entities from web texts is an important task in web mining, natural language processing, and information extraction. Information extraction is useful in many applications including search engines, question-answering systems, recommender systems, machine translation, etc. An information extraction system aims to identify the entities from the text and extr...
متن کاملAutomatic Detection of Annotation Errors in Polish-Language Corpora
In this article we propose an extension to the variation ngram based method of detecting annotation errors. We also show an approach to nding anomalies in the morphosyntactic annotation layer by using association rule discovery. As no research has previously been done in the eld of morphosyntactic annotation error correction for Polish, we provide novel results based on experiments on the large...
متن کاملA new model for persian multi-part words edition based on statistical machine translation
Multi-part words in English language are hyphenated and hyphen is used to separate different parts. Persian language consists of multi-part words as well. Based on Persian morphology, half-space character is needed to separate parts of multi-part words where in many cases people incorrectly use space character instead of half-space character. This common incorrectly use of space leads to some s...
متن کاملMauroTeX - A Language for Electronic Critical Editions
MauroTeX, an extension of the wellknown LaTeX typesetting system, is a language designed in order to completely describe philological critical editions of ancient mathematical and scientific works. It provides a set of tnacros that the editor can use starting from the early stages of the edition (the transcription and the collation of the different "witnesses" of the edited work), and ending wi...
متن کاملAutomatic correction of grammatical errors in non-native English text
Learning a foreign language requires much practice outside of the classroom. Computerassisted language learning systems can help fill this need, and one desirable capability of such systems is the automatic correction of grammatical errors in texts written by non-native speakers. This dissertation concerns the correction of non-native grammatical errors in English text, and the closely related ...
متن کامل