Abstract With the swift growth of information over past few years, taking full benefit is increasingly essential. Question Answering System one promising methods to access this much information. The lacks humans’ common sense and reasoning power cannot identify unanswerable questions irrelevant questions. These are answered by making unreliable incorrect guesses. In paper, we address limitation...

A Pilot Question Answering Task has been activated in the Cross-Language Evaluation Forum 2004 with a twofold objective. In the first place, the evaluation of Question Answering systems when they have to answer conjunctive lists, disjunctive lists and questions with temporal restrictions. In the second place, the evaluation of systems’ capability to give an accurate self-scoring about the confi...

This paper presents the sequential evaluation of the question answering system SQuaLIA. This system is based on the same sequential process as most statistical question answering systems, involving 4 main steps from question analysis to answer extraction.The evaluation is based on a corpus made from 20 questions taken in the set of an evaluation campaign and which were well answered by SQuaLIA....

Machine Translation Evaluation Metrics (MTEMs) are the central core of Machine Translation (MT) engines as they are developed based on frequent evaluation. Although MTEMs are widespread today, their validity and quality for many languages is still under question. The aim of this research study was to examine the validity and assess the quality of MTEMs from Lexical Similarity set on machine tra...

E-learning system which allows students’ confidence level evaluation with their voice when they answer to the question during achievement tests is proposed. Through experiments of comparison of students’ confidence level between the conventional (without evaluation) and the proposed (with evaluation), 17-57% of improvement is confirmed for the proposed e-learning system. Keywordslearnng system;...

We present a question answering system with a hybrid design, combining techniques from knowledge representation, information retrieval, and natural language processing. This combination enables domain independence and robustness in the face of text variability, both in the question and in the raw text documents used as knowledge sources. We describe the specific design of our current prototype,...

There has been increasing attention paid to the question of how to evaluate the creativity of computational creativity systems. A number of different evaluation methods, strategies and approaches have been proposed recently, causing a shift in focus: which methodology should be used to evaluate creative systems? What are the pros and cons of using each method? In short: how can we evaluate the ...

introduction. evaluation is one of the characteristic issues of education process and help us to assess deficiency and powerty of education programs and solve the problems of education. methods. in this study a proper questionnaire was distributed and answered by instructors. then information was analyzed by spss software. results. in this study 72.5% of instructors used formative evaluation an...

We present an evaluation methodology and a system for ranking questions within the context of a multimodal tutorial dialogue. Such a framework has applications for automatic question selection and generation in intelligent tutoring systems. To create this ranking system we manually author candidate questions for specific points in a dialogue and have raters assign scores to these questions. To ...