Today human performance on search tasks and information retrieval evaluation metrics are loosely coupled. Instead, information retrieval evaluation should be a direct prediction of human performance rather than a related measurement of ranked list quality. We propose a TREC track or other group effort that will collect a large amount of human usage data on search tasks and then measure particip...

background: one of the pollutant components that can be observed in many industrial wastewaters is formaldehyde. the biological treatment of the wastewater contaminated by formaldehyde is very difficult due to its antibacterial property. however the removal of formaldehyde using adsorption process is feasible but it may be expensive. the main purpose of this study is to examine the adsorption o...

The paper presents the results of the first large-scale human evaluation of automatic grammatical error correction (GEC) systems. Twelve participating systems and the unchanged input of the CoNLL-2014 shared task have been reassessed in a WMT-inspired human evaluation procedure. Methods introduced for the Workshop of Machine Translation evaluation campaigns have been adapted to GEC and extended...

This paper deals with a mobile robot with structured intelligence. The robot interacts with a dynamic environment. The evaluation criteria or functions are the strategy for the behavior acquisition. Generally, it is difficult for human operators to describe internal models of the robot because the organization of the robot is quite different from that of a human. In the optimization, the evalua...

The evaluation of how (human) individuals perceive robots is a central issue to better understand human–robot interaction (HRI). On this topic, promising proposals have emerged. However, present tools are not able assess sufficient part the composite psychological dimensions involved in HRI. Indeed, percentage variance explained often under recommended threshold for construct be valid. In artic...

Automatic evaluation metrics are fast and cost-effective measurements of the quality of a Machine Translation (MT) system. However, as humans are the end-user of MT output, human judgement is the benchmark to assess the usefulness of automatic evaluation metrics. While most studies report the correlation between human evaluation and automatic evaluation at corpus level, our study examines their...

In this paper, we propose an automatic evaluating system of human skin surface condition based on subjective evaluation provided by cosmeticians. In the proposed system, image features extracted on skin image and subjective evaluation by cosmeticians are flexibly connected by using a back-propagation neural network, so that it can automatically estimate human skin surface condition on based on ...