Automated Scoring of a Summary-Writing Task Designed to Measure Reading Comprehension
نویسندگان
چکیده
We introduce a cognitive framework for measuring reading comprehension that includes the use of novel summary writing tasks. We derive NLP features from the holistic rubric used to score the summaries written by students for such tasks and use them to design a preliminary, automated scoring system. Our results show that the automated approach performs well on summaries written by students for two different passages.
منابع مشابه
Assessing Reading Comprehension of Expository Text across Different Response Formats
This study investigated if different response formats (test methods) measure reading comprehension of expository text differently. The study was conducted with 48 semester 6 TESL students at a university in Selangor, Malaysia. These students received an expository passage having descriptive rhetorical structure followed by three response formats, namely, incomplete outline, graphic organizer, a...
متن کاملThe Effect of Summary Training on Intermediate EFL Learners’ Reading Comprehension in Individual and Collaborative Conditions
Inspired by Vygotsky’s Sociocultural Theory (SCT), the current study intended to investigate the effect of summary training (i.e., oral and written) on intermediate EFL learners’ reading comprehension in different conditions (i.e., individual and collaborative). Data collection tools and procedures encompassed PET test, First Certificate in English (FCE) reading pre-test, and post-test. First, ...
متن کاملTask-Induced Involvement in L2 Vocabulary Learning: A Case for Listening Comprehension
The study aimed at investigating whether the retention of vocabulary acquired incidentally is dependent upon the amount of task-induced involvement. Immediate and delayed retention of twenty unfamiliar words was examined in three learning tasks( listening comprehension + group discussion, listening comprehension + dictionary checking + summary writing in L1, and listening comprehension + dictio...
متن کاملUsing Analytic Scoring Rubrics in the Automatic Assessment of College-Level Summary Writing Tasks in L2
Assessing summaries is a demanding, yet useful task which provides valuable information on language competence, especially for second language learners. We consider automated scoring of college-level summary writing task in English as a second language (EL2). We adopt the Reading-forUnderstanding (RU) cognitive framework, extended with the Reading-to-Write (RW) element, and use analytic scoring...
متن کاملWriting Quality, Knowledge, and Comprehension Correlates of Human and Automated Essay Scoring
Automated essay scoring tools are often criticized on the basis of construct validity. Specifically, it has been argued that computational scoring algorithms may be unaligned to higher-level indicators of quality writing, such as writers’ demonstrated knowledge and understanding of the essay topics. In this paper, we consider how and whether the scoring algorithms within an intelligent writing ...
متن کامل