We present a language complexity analysis of World of Warcraft (WoW) community texts, which we compare to texts from a general corpus of web English. Results from several complexity types are presented, including lexical diversity, density, readability and syntactic complexity. The language of WoW texts is found to be comparable to the general corpus on some complexity measures, yet more specia...

The role of lexical resources is often understated in NLP research. The complexity of Chinese, Japanese and Korean (CJK) poses special challenges to developers of NLP tools, especially in the area of word segmentation (WS), information retrieval (IR), named entity extraction (NER), and machine translation (MT). These difficulties are exacerbated by the lack of comprehensive lexical resources, e...

The role of lexical resources is often understated in NLP research. The complexity of Chinese, Japanese and Korean (CJK) poses special challenges to developers of NLP tools, especially in the area of word segmentation (WS), information retrieval (IR), named entity extraction (NER), and machine translation (MT). These difficulties are exacerbated by the lack of comprehensive lexical resources, e...

1. Intellexer NL parser 1.1) Tokenizer 1.2) Statistical tagger 1.3) Rule-based tagging corrector (RBTC) 1.4) Chunker 1.5) Lexicalized parser 1.6) Paraphraser 1.7) Generation of terms and pairs 2. Indexing and answering 2.1) Indexing 2.2) Resolving anaphora in questions 2.3) Matching Factoid questions 2.4) Matching List questions 2.5) Matching Other questions 2.6) Difference between runs A, B and C

The paper presents and evaluates an efficient algorithm for measuring semantic similarity of texts. Calculating the level of semantic similarity of texts is a very difficult task and the proposed up to now methods suffer from computational complexity. This substantially limits their application area. The proposed algorithm tries to reduce the problem by merging a computationally efficient stati...

1 I n t r o d u c t i o n The two-level model of computational morphology was proposed by Koskenniemi (1983) and has found widespread acceptance due mostly to its general applicability, declarativeness of rules and clear separation of linguistic knowledge and program. The essential difference from generative phonology is that there are no intermediate states between lexical and surface represen...

Text Simplification is the task of reducing the lexical and syntactic complexity of documents in order to improve their readability and understandability. This paper presents a web-based demonstration of a text simplification system that performs state-of-the-art lexical and syntactic simplification of English texts. The core simplification technology used for this demonstration is highly custo...

the present paper aims to examine the role of frequency lexicon in assessing lexical proficiency of persian learners. addressing the frequency distribution pattern of persian words, the research which is conducted in corpus-based method studies the relationship between words and lexical proficiency as well as derives the frequency lexicon from persian corpus. to do so, formal and colloquial per...