Most of the previous work on cloze prediction focused on grammar testing such as preposition generation. In this paper we explore a different problem on knowledge testing by designing a system to automatically generate blanks for cloze test. We present a cross-document Information Extraction (IE) driven approach, and compare its performance on two different tasks with and without background doc...

Linguists have suggested that one mechanism for the creative extension of meaning in language involves mapping, or constructing correspondences between conceptual domains. For example, the sentence, "The clever boys used a cardboard box as a boat," sets up a novel mapping between the concepts cardboard box and boat, while "His main method of transportation is a boat," relies on a more conventio...

The aim of the study was to verify the accuracy of the formula for assessing the difficulty of texts written in Polish (Pisarek 1969). The study involved 1,309 persons aged between 15 and 84. 15 texts were used, each approximately 300 words long, representing different subjects and varied difficulty level. Text comprehension was checked with multiple choice tests, the cloze procedure and open-e...

The multiple choice cloze (MCC) question format is commonly used to assess students' comprehension. It is an especially useful format for ITS because it is fully automatable and can be used on any text. Unfortunately, very little is known about the factors that influence MCC question difficulty and student performance on such questions. In order to better understand student performance on MCC q...

We report an experiment to evaluate DQGen’s performance in generating three types of distractors for diagnostic multiple-choice cloze (fill-in-theblank) questions to assess children’s reading comprehension processes. Ungrammatical distractors test syntax, nonsensical distractors test semantics, and locally plausible distractors test inter-sentential processing. 27 knowledgeable humans rated can...

s Scott Crossley Crowdsourcing text complexity models The current study builds on work by De Clercq et al. (2014) and Crossley et al. (2017) by using crowdsourcing techniques to collect human ratings of text comprehension, processing, and familiarity across a large corpus comprising a diverse variety of topic domains (science, technology, and history). Pairwise comparisons among the ratings wer...

the present study was an attempt to investigate varieties of cloze test and c-test as measures of reading comprehension ability. it aimed at comparing the performances of subjects on different cloze and c-test forms constructed from the same passage. to this end, five versions of cloze test and two versions of c-test were developed by applying different deletion techniques and deletion rates, a...

When performing online language comprehension, comprehenders probabilistically anticipate upcoming words. Psycholinguistic studies thus often depend on accurately estimating stimulus predictability, either to control it or to study it, and this estimation is conventionally accomplished via the cloze task. But we do not know how effectively — or even, strictly speaking, whether — cloze probabili...