BACKGROUND When assessing the concordance between two methods of measurement of ordinal categorical data, summary measures such as Cohen's (1960) kappa or Bangdiwala's (1985) B-statistic are used. However, a picture conveys more information than a single summary measure. METHODS We describe how to construct and interpret Bangdiwala's (1985) agreement chart and illustrate its use in visually a...

This study was done to evaluate the validity and reliability of women's reproductive history questionnaire which will be used in Azar Cohort study; a cohort that is conducted by Tabriz University of Medical Science in Shabestar county for identifying risk factors of no communicable diseases. Content and face validity were evaluated by ten experts in the field and quantified as content validity ...

BACKGROUND AND PURPOSE The modified Rankin Scale (mRS) is a popular primary stroke outcome measure, but its usefulness is limited by suboptimal reliability (inter-rater agreement). METHODS We developed and tested the reliability of a simplified mRS questionnaire (smRSq) in 50 patients after stroke seen in outpatient clinics. Randomly chosen paired raters administered the smRSq within 20 minut...

AIMS To determine the interobserver and the intraobserver reliability of a published classification scheme for corneal topography in normal subjects using the absolute scale. METHOD A prospective observational study was done in which 195 TMS-1 corneal topography maps in the absolute scale were independently classified twice by three classifiers--a cornea fellow, an ophthalmic technician, and ...

BACKGROUND To assess the intra- and inter-rater agreement of chart abstractors from multiple sites involved in the evaluation of an Asthma Care Program (ACP). METHODS For intra-rater agreement, 110 charts randomly selected from 1,433 patients enrolled in the ACP across eight Ontario communities were re-abstracted by 10 abstractors. For inter-rater agreement, data abstractors reviewed a set of...

The purpose of this study was to determine the level of interobserver and test-retest reliability of the Milani-Comparetti Motor Development Screening Test. Sixty healthy children, aged 1 through 16 months, were videotaped during administration of the Milani-Comparetti test. Four pediatric physical therapists independently viewed each videotape and scored the responses. Interobserver reliabilit...

In order to develop forest management strategies in tropical forest in Malaysia, surveying the forest resources and monitoring the forest area affected by logging activities is essential. There are tremendous effort has been done in classification of land cover related to forest resource management in this country as it is a priority in all aspects of forest mapping using remote sensing and rel...

OBJECTIVES To examine the use of the multi-rater Kappa measure of agreement (Nonparametric Statistics for the Behavioural Sciences, McGraw Hill, New York, 1988) in team based, mixed method, qualitative nursing research. DESIGN The article presents an illustrative description of the application of the qualitative coding procedure and associated multi-rater Kappa measurement at four time points...

SAS/STAT® procedure FREQ is the place to start when you need to compute measures of rater or test agreement on the classic kappa scale (Cohen 1960), namely, the ratio of the actual improvement over chance to the maximum possible improvement over chance. But when you see the frustrating message "WARNING: AGREE statistics are computed only for tables where the number of rows equals the number of ...