Manning [1] presents an extended critique of a paper by Zaenen, Karttunen and Crouch [2] (henceforth ZKC), which was a commentary on the PASCAL Recognizing Textual Entailment (RTE) challenge [3]. The ZKC paper was entitled “Local textual inference: can it be defined or circumscribed?” and argued that the PASCAL data should have been better defined and circumscribed so as to distinguish between ...

In this paper, we present a system for automatically answering opendomain, multiple choice reading comprehension questions about short English narrative texts. The system is based on state-of-the-art text similarity measures, textual entailment metrics and coreference resolution and does not make use of any additional domain specific background knowledge. Each answer option is scored with a com...

This paper reports the Recognizing Textual Entailment (RTE) system that our ‘IKOMA team’ developed at TAC 2010. We implemented a new method that identifies entailment sentences using local-novelty detection. This method determines whether a Hypothesis (H) is local-novel. ‘H is local-novel’ means that H is the new information first appeared in TH , and TH denotes the text (T) that entails H. If ...

The Answer Validation Exercise at the Cross Language Evaluation Forum is aimed at developing systems able to decide whether the answer of a Question Answering system is correct or not. We present here the exercise description, the changes in the evaluation methodology with respect to the first edition, and the results of this second edition (AVE 2007). The changes in the evaluation methodology ...

This paper reports on the performance of a new system for recognizing textual entailment. We present a brief overview of the CERES system and summarize its semantic alignment method for determining entailment. Then, we describe the experiments that were performed, both official and subsequently, against the RTE4 test dataset. We also report on comparison runs against the previous RTE3 developme...

In the 2009 Recognizing Textual Entailment challenge a Search Pilot task has been introduced, aimed at finding all the sentences in a corpus which entail a set of given hypotheses. The preparation of the data set for this task has provided an opportunity to better understand some phenomena concerning textual entailment recognition in a natural setting. This paper focuses on some problematic iss...

this study was motivated by three factors, which also contribute to its significance for today’s academic writing. first, research articles are the significant means of communication between the writers all over the world. second, persuasion and organization are crucial notions in academic writing where the authors have to consider the academic audiences and their needs.  third, some writers ar...

This paper describes the participation of DAEDALUS at ImageCLEF 2011 Medical Retrieval task. We have focused on multimodal (or mixed) experiments that combine textual and visual retrieval. The main objective of our research has been to evaluate the effect on the medical retrieval process of the existence of an extended corpus that is annotated with the image type, associated to both the image i...

In the work here presented, we apply textual and sequential methods to assess the outcomes of an unconstrained multiparty dialogue. In the context of chat transcripts from a collaborative learning scenario, we demonstrate that while low-level textual features can indeed predict student success, models derived from sequential discourse act labels are also predictive, both on their own and as a s...