We present a first attempt at predicting the quality of translations produced by human, professional translators. We examine datasets annotated for quality at sentenceand word-level for four language pairs and provide experiments with prediction models for these datasets. We compare the performance of such models against that of models built from machine translations, highlighting a number of c...

Professionals involved in cross-cultural assessment have acknowledged the methodological challenges which they must face when translating and adapting questionnaires developed for a specific linguistic and cultural group. International medical studies have demonstrated that a simple translation of a questionnaire does not ensure data accuracy (Guillemin et al., 1993). Guidelines for adapting te...

Automatic metrics are widely used in machine translation as a substitute for human assessment. With the introduction of any new metric comes the question of just how well that metric mimics human assessment of translation quality. This is often measured by correlation with human judgment. Significance tests are generally not used to establish whether improvements over existing methods such as B...

Word is usually adopted as the smallest unit in most tasks of Chinese language processing. However, for automatic evaluation of the quality of Chinese translation output when translating from other languages, either a word-level approach or a character-level approach is possible. So far, there has been no detailed study to compare the correlations of these two approaches with human assessment. ...

Automatic metrics are widely used in machine translation as a substitute for human assessment. With the introduction of any new metric comes the question of just how well that metric mimics human assessment of translation quality. This is often measured by correlation with human judgment. Significance tests are generally not used to establish whether improvements over existing methods such as B...

Re-speaking is a mechanism for obtaining high quality subtitles for use in live broadcast and other public events. Because it relies on humans performing the actual re-speaking, the task of estimating the quality of the results is non-trivial. Most organisations rely on humans to perform the actual quality assessment, but purely automatic methods have been developed for other similar problems, ...

This paper examines the use of information technology in the electric and gas utilities of Ukraine, Armenia, and Georgia. Data was gathered through the performance of Year 2000 risk assessments, small business visits, document research, and academic visits between 1999 and 2001. Data was analyzed by comparing IT usage in Ukraine, Armenia, and Georgia to that in the United States. Overall IT usa...

he aim of educational assessment is promoting the quality of educationand efficiency in the educational system (1). in every educational system,keeping quality requires awareness of the strengths and weaknesses andmeasurement of the objectives (2).the internal assessment is carried out as an introduction to performexternal assessment in order to do budgeting and ranking of universities.therefor...