Raters’ reliability in clone benchmarks construction
نویسندگان
چکیده
منابع مشابه
Estimating the Intra-Rater Reliability of Essay Raters
The intra-rater reliability in rating essays is usually indexed by the inter-rater correlation. We suggest an alternative method for estimating intra-rater reliability, in the framework of classical test theory, by using the dis-attenuation formula for inter-test correlations. The validity of the method is demonstrated by extensive simulations, and by applying it to an empirical dataset. It is ...
متن کاملInterrater reliability of algometry in measuring pressure pain thresholds in healthy humans, using multiple raters.
OBJECTIVE To evaluate interrater reliability using 5 newly trained observers in the assessment of pressure pain threshold (PPT) using a fixed-angle algometer. METHODS The study design comprised 2 phases. Phase 1: 5 undergraduate physical therapists were trained in algometry at a predefined angle, at a rate of 5 Newtons (N)/s, to the first dorsal interosseous muscle. Each observer then underwe...
متن کاملNursing-sensitive benchmarks for hospitals to gauge high-reliability performance.
Benchmarking expedites the quest for best practices and is crucial to hospitals' effective, reliable, and superior performance. Comparative performance data are used by accrediting and regulatory bodies to evaluate performance and by consumers in making decisions on where to seek healthcare. Nursing-sensitive quality measures affirmed by the National Quality Forum are now used in public reporti...
متن کاملConstruction of Benchmarks for Comparison of Grid Resource Planning Algorithms
The present contribution will focus on the systematic construction of benchmarks used for the evaluation of resource planning systems. Two characteristics for assessing the complexity of the benchmarks were developed. These benchmarks were used to evaluate the resource management system GORBA and the optimization strategies for resource planning applied in this system. At first, major aspects o...
متن کاملVariance Estimation of Nominal-scale Inter-rater Reliability with Random Selection of Raters
Most inter-rater reliability studies using nominal scales suggest the existence of two populations of inference: the population of subjects (collection of objects or persons to be rated) and that of raters. Consequently, the sampling variance of the inter-rater reliability coefficient can be seen as a result of the combined effect of the sampling of subjects and raters. However, all inter-rater...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Empirical Software Engineering
سال: 2016
ISSN: 1382-3256,1573-7616
DOI: 10.1007/s10664-015-9419-z