QA Better Than IR ?
نویسندگان
چکیده
A Question Answering (QA) system allows the user to ask questions in natural language and to obtain one or several answers. If compared with a classical IR engine like Google, what kind of key benefits QA bring to users and how to measure their distinctive performances. This is what we shall attempt here to determine, specially in providing a comparative weak and strong points table of each system, along with showing how QA systems, in particular our Qristal QA system, requires up two to six time less “user effort”.
منابع مشابه
Human Question Answering Performance using an Interactive Information Retrieval System
Every day, people widely use information retrieval (IR) systems to find documents that answer their questions. Compared to these IR systems, question answering (QA) systems aim to speed the rate at which users find answers by retrieving answers rather than documents. To better understand how IR systems compare to QA systems, we measured the performance of humans using an interactive IR system t...
متن کاملIs Question Answering Better than Information Retrieval? Towards a Task-Based Evaluation Framework for Question Series
This paper introduces a novel evaluation framework for question series and employs it to explore the effectiveness of QA and IR systems at addressing users’ information needs. The framework is based on the notion of recall curves, which characterize the amount of relevant information contained within a fixed-length text segment. Although it is widely assumed that QA technology provides more eff...
متن کاملPassage Selection To Improve Question Answering
Open-Domain Question Answering systems (QA) performs the task of detecting text fragments in a collection of documents that contain the response to user’s queries. These systems use high complexity tools that reduce its applicability to the treatment of small amounts of text. Consequently, when working on large document collections, QA systems apply Information Retrieval (IR) techniques to redu...
متن کاملUniversity of Hagen at GeoCLEF 2008: Combining IR and QA for Geographic Information Retrieval
This paper describes the participation of GIRSA at GeoCLEF 2008, the geographic information retrieval task at CLEF. GIRSA is a modified and improved variant of the system which participated at GeoCLEF 2007. It combines results retrieved with methods from information retrieval (IR) on geographically annotated data and question answering (QA) employing query decomposition. For the monolingual Ger...
متن کاملEvaluating Passage Retrieval Approaches for Question Answering
Automatic open domain question answering (QA) has been the focus of much recent research, stimulated by the introduction of a QA track in TREC in 1999. Many QA systems have been developed and most follow the same broad pattern of operation: first an information retrieval (IR) system, often passage-based, is used to find passages from a large document collection which are likely to contain answe...
متن کامل