We present a generalized estimating equations approach for estimating the concordance correlation coefficient and the kappa coefficient from sample survey data. The estimates and their accompanying standard error need to correctly account for the sampling design. Weighted measures of the concordance correlation coefficient and the kappa coefficient, along with the variance of these measures acc...

This paper studies correction for chance for coefficients that are linear functions of the proportion of observed agreement. The fixed points of the correction for chance function are characterized. An equivalence relation on the set of linear functions is defined and it is shown that each linear function is mapped to the unique fixed point in its equivalence class. keywords: Chance-corrected c...

OBJECTIVE To determine intra and interobserver agreement of the grading system for femoral cementation in hip arthroplasty proposed by Barrack. METHODS Immediate anteroposterior and lateral postoperative radiographs of 55 primary total hip arthroplasties were assessed by two observers familiar with the use of this grading system. The assessments were performed on two separate occasions by eac...

In recent years, the Kappa coefficient of agreement has become the de facto standard to evaluate intercoder agreement in the discourse and dialogue processing community. Together with the adoption of this standard, researchers have adopted one specific scale to evaluate Kappa values, the one proposed in (Krippendorff, 1980). In this position paper, I highlight some issues that should be taken i...

Cohen’s kappa coefficient has become a standard method for measuring the degree of agreement between two raters. Confidence intervals for kappa and weighted kappa based on its asymptotic variance are available in the SAS system through the FREQ procedure. However, this variance can become unreliable as sample size decreases or as kappa approaches unity. This paper presents a SAS macro for calcu...

Many empirical studies are confronted with severe misclassification error. While interest is in the realizations of a variable Y (e.g. disease yes/no), only a related variable Y ∗ (e.g. the outcome of a diagnostic test) can be observed. Even in the case of simple prevalence estimation, naive estimation, neglecting the fundamental difference between Y and Y ∗, may be considerably biased ([1], [2...

BACKGROUND Tissue microarrays (TMAs) are an attractive alternative to analysis of whole sections (WS). For breast carcinomas, the recent recommendations for cut-offs (i.e. Ki67, H-score) have necessitated the re-evaluation of TMAs. MATERIALS AND METHODS TMA results of immunohistochemistry (IHC) and Fluorescence in situ hybridization (FISH) testing for Estrogen receptors (ER), Progesterone rec...