IREX: IR & IE Evaluation Project in Japanese
نویسندگان
چکیده
We will report on the IREX (Information Retrieval and Extraction Exercise) project. It is an evaluation-based project for Information Retrieval and Information Extraction in Japanese. The project started in May 1998 and concluded in September 1999 with the IREX workshop held in Tokyo with more than 150 attendance (IREX Commettee, 1999). There is a homepage of the project at (IREX, Homepage) and anyone can download almost all the data and the tools produced by the project for free.
منابع مشابه
NTCIR Advisor Report
NTCIR is one of the rst projects to construct, using a TREC-like contest operation, a practical Japanese IR test collection. This report discusses design and the administration issues, such as the size and genre of the collection, the description of topics, tasks, the pre-test, and the collaboration with the IREX project.
متن کاملJapanese Named Entity Extraction Evaluation - Analysis of Results
We will report on one of the two tasks in the IREX (Information Retrieval and Extraction Exercise) project, an evaluation-based project for Information Retrieval and Information Extraction in Japanese (Sekine and Isahara, 2000) (IREX Committee, 1999). The project started in 1998 and concluded in September 1999 with many participants and collaborators (45 groups in total from Japan and the US). ...
متن کاملThe NTCIR Workshop : the First Evaluation Workshop on Japanese Text Retrieval and Cross-Lingual Information Retrieval
This paper introduces the outline of the first NTCIR Workshop, which is the first evaluation workshop designed to enhance research in Japanese text retrieval and cross-lingual information retrieval. The test collection used in the Workshop consists of more than 330,000 documents with more than half are EnglishJapanese paired. Twenty-three groups from four countries have conducted IR tasks and s...
متن کاملA Proposal for the Development of a Study to Determine the Effectiveness of a Creativity-Centered Unit of Study in the Advancement of Spatial Abilities of American and Japanese Female Engineering Students
The purpose of this project is the deivlopirieiit, evaluation, aid iriipleriieritatioii of a crwiti\itycentered i ir i i t of study in the ndvariceriieiit of sp t ia l abilities of Aiiiericari arid Japmese Feiiiale eiigirieeriiig studeiits. This project is eiivisioiied as ( I pcirtnership betweeri the author aiid colleagiies iii universities iii Japaii. The betiefits will iiicliide iriteriintio...
متن کاملA Novelty-based Evaluation Method for Information Retrieval
In information retrieval research, precision and recall have long been used to evaluate IR systems. However, given that a number of retrieval systems resembling one another are already available to the public, it is valuable to retrieve novel relevant documents, i.e., documents that cannot be retrieved by those existing systems. In view of this problem, we propose an evaluation method that favo...
متن کامل