Recent studies suggest that machine learning can be applied to develop good automatic evaluation metrics for machine translated sentences. This paper further analyzes aspects of learning that impact performance. We argue that previously proposed approaches of training a HumanLikeness classifier is not as well correlated with human judgments of translation quality, but that regression-based lear...

We introduce a manually-created, multireference dataset for abstractive sentence and short paragraph compression. First, we examine the impact of singleand multi-sentence level editing operations on human compression quality as found in this corpus. We observe that substitution and rephrasing operations are more meaning preserving than other operations, and that compressing in context improves ...

Automatic evaluation metrics are fast and cost-effective measurements of the quality of a Machine Translation (MT) system. However, as humans are the end-user of MT output, human judgement is the benchmark to assess the usefulness of automatic evaluation metrics. While most studies report the correlation between human evaluation and automatic evaluation at corpus level, our study examines their...

Traditional machine translation evaluation metrics such as BLEU and WER have been widely used, but these metrics have poor correlations with human judgements because they badly represent word similarity and impose strict identity matching. In this paper, we propose some modifications to the traditional measures based on word embeddings for these two metrics. The evaluation results show that our...

The quality of the learning objects metadata records stored in a repository is important its operation and interoperability. While several studies have tried to define and measure quality for metadata, a scalable and effective way to assess this quality is not currently available. This work converts the fuzzy quality definitions found in those studies into implementable measures (metrics). Seve...

the aim of this study was to analyze the impact of organizational learning and marketing metrics on the marketing performance in the elon plast company of kermanshah province. it is a functional purpose study with descriptive – survey method. the statistical population includes 100 employees of elon plast company in kermanshah province. a sample of 80 people was chosen using cochran formula. da...

Landscape metrics are used in landscape ecology to quantify landscape characteristics related to structure, function and change by quantifying the structure and distributional pattern of landscape elements such as plants, animals and other physical landscape features. To date, there has been little published research on landscape metrics that include social perceptions of landscape. In this pap...

Dukhanin and colleagues’ taxonomy of metrics for patient engagement at the organizational and system levels has great potential for supporting more careful and useful evaluations of this ever-growing phenomenon. This commentary highlights the central importance to the taxonomy of metrics assessing the extent of meaningful participation in decision-making by patients, consumers and community mem...