The Kappa coefficient is widely used in assessing categorical agreement between two raters or two methods. It can also be extended to more than two raters (methods). When using Kappa, the shortcomings of this coefficient should be not neglected. Bias and prevalence effects lead to paradoxes of Kappa. These problems can be avoided by using some other indexes together, but the solutions of the Ka...

http://ptjournal.apta.org/content/69/11/970 be found online at: The online version of this article, along with updated information and services, can Collections Statistics in the following collection(s): This article, along with others on similar topics, appears e-Letters "Responses" in the online version of this article. "Submit a response" in the right-hand menu under or click on here To sub...

It is very common to examine reliability of triage scales using (weighted) kappa statistics. The point is that weighted kappa has grossly underestimated disagreements by one category and put more emphasis on extreme category disagreements; therefore, low prevalence of critically-ill and non-urgent patients has excluded the effect of extreme categories disagreement from calculated kappa coeffici...

Assessing agreement is often of interest in clinical studies to evaluate the similarity of measurements produced by different raters or methods on the same subjects. We present a modified weighted kappa coefficient to measure agreement between bivariate discrete survival times. The proposed kappa coefficient accommodates censoring by redistributing the mass of censored observations within the g...

11 The agreement between two raters judging items on a categorical scale 12 is traditionally measured by Cohen’s kappa coefficient. We introduce a new 13 coefficient for quantifying the degree of agreement between an isolated rater 14 and a group of raters on a nominal or ordinal scale. The coefficient, which 15 is defined on a population-based model, requires a specific definition of the 16 co...

BACKGROUND Establishing the validity of classification schemes is a crucial preparatory step that should precede multicenter studies. There are no studies investigating the reproducibility of arthroscopic classification of meniscal pathology among multiple surgeons at different institutions. HYPOTHESIS Arthroscopic classification of meniscal pathology is reliable and reproducible and suitable...

This paper presents an evaluation of the multi-source satellite datasets such as Sentinel-2, Landsat-8, and Moderate Resolution Imaging Spectroradiometer (MODIS) with different spatial and temporal resolutions for nationwide vegetation mapping. The random forests based machine learning and cross-validation approach was applied for evaluating the performance of different datasets. Cross-validati...