Fine-grained essay scoring of a complex writing task for native speakers
نویسندگان
چکیده
Automatic essay scoring is nowadays successfully used even in high-stakes tests, but this is mainly limited to holistic scoring of learner essays. We present a new dataset of essays written by highly proficient German native speakers that is scored using a fine-grained rubric with the goal to provide detailed feedback. Our experiments with two state-of-the-art scoring systems (a neural and a SVM-based one) show a large drop in performance compared to existing datasets. This demonstrates the need for such datasets that allow to guide research on more elaborate essay scoring methods.
منابع مشابه
Automated Essay Scoring for Nonnative English Speakers
The e-rater system 1 , an automated essay scoring system, developed at Educational Testing Service (ETS), is currently being used to score essay responses on the Graduate Management Admissions Test (GMAT). The average agreement between human readers, and between independent human readers and e-rater is approximately 92%. There is much interest in the larger writing community in examining the sy...
متن کاملAutomated Essay Scoring For Nonnative English Speakers
The e-rater system 1 is an operational automated essay scoring system, developed at Educational Testing Service (ETS). The average agreement between human readers, and between independent human readers and e-rater is approximately 92%. There is much interest in the larger writing community in examining the system’s performance on nonnative speaker essays. This paper focuses on results of a stud...
متن کاملA Metadiscourse Analysis over Interactive VS Interactional Resources within English Academic Articles in Arts and Humanities
In this article, researchers set out to discover the metadiscourse markers in research articles written by both native and non-native English speakers. To this end, a total number of twenty research articles published by Iranian and native English speakers in highly reputed journals on Arts and Humanities domains were randomly selected from major databases including Science Direct, Noormagz, an...
متن کاملDocument Similarity Measures to Distinguish Native vs. Non-Native Essay Writers
The ability to distinguish statistically different populations of speakers or writers can be an important asset in many NLP applications. In this paper, we describe a method of using document similarity measures to describe differences in behavior between native and non-native speakers of English in a writing task.
متن کاملScaffolding for English as Foreign Language Writers: Writing a Scholastic Essay
This article describes how a group of Iranian upper-intermediate EFL learners were guided through the practice of writing their first academic essays in English. The method applied the principle of scaffolding to the essay writing process by providing flexible support for the learners during the writ- ing their first essays. Scaffolding included a number of aspects, each of which is explained i...
متن کامل