Applicabilities of Automated Short-answer Scoring to Large-scale English Writing Tests
نویسندگان
چکیده
منابع مشابه
Effective Feature Integration for Automated Short Answer Scoring
A major opportunity for NLP to have a realworld impact is in helping educators score student writing, particularly content-based writing (i.e., the task of automated short answer scoring). A major challenge in this enterprise is that scored responses to a particular question (i.e., labeled data) are valuable for modeling but limited in quantity. Additional information from the scoring guideline...
متن کاملRubric-based Automated Japanese Short-answer Scoring and Support System Applied to QALab-3
We have been developing an automated Japanese shortanswer scoring and support machine for the new National Center written test exams. Our approach is based on the fact that accurately recognizing textual entailment and/or synonymy has been almost impossible. The system generates automated scores on the basis of evaluation criteria or rubrics, and human raters revise them. The system determines ...
متن کاملDeveloping an Analytic Scale for Scoring EFL Descriptive Writing
English language practitioners have long relied on intuition-based scales for rating EFL/ESL writing. As these scales lack an empirical basis, the scores they generate tend to be unreliable, which results in invalid interpretations. Given the significance of the genre of description and the fact that the relevant literature does not introduce any data-based analytic scales for rating EFL descri...
متن کاملInvestigating Active Learning for Short-Answer Scoring
Active learning has been shown to be effective for reducing human labeling effort in supervised learning tasks, and in this work we explore its suitability for automatic short answer assessment on the ASAP corpus. We systematically investigate a wide range of AL settings, varying not only the item selection method but also size and selection of seed set items and batch size. Comparing to a rand...
متن کاملParaphrase Detection for Short Answer Scoring
We describe a system that grades learner answers in reading comprehension tests in the context of foreign language learning. This task, also known as short answer scoring, essentially requires determining whether a semantic entailment relationship holds between an individual learner answer and a target answer; thus semantic information is a necessary part of any automatic short answer scoring s...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Curriculum and Evaluation
سال: 2014
ISSN: 1229-1544
DOI: 10.29221/jce.2014.17.2.71