In recent years, the Kappa coefficient of agreement has become the de facto standard to evaluate intercoder agreement in the discourse and dialogue processing community. Together with the adoption of this standard, researchers have adopted one specific scale to evaluate Kappa values, the one proposed in (Krippendorff, 1980). In this position paper, I highlight some issues that should be taken i...

PURPOSE To assess the performance of a refined Web-based tool for documenting retinal hemorrhage characteristics in suspected abusive head trauma. METHODS Using a comprehensive tabular secure platform, with access to digital images in color, black and white, and 4-zone system schematic overlay, four pediatric ophthalmologists performed pilot testing with 80 images for tool refinement. In a se...

background: los angeles classification is widely adopted as a means of unifying endoscopic observation for gerd. we assessed the inter- and intra-observer variability of la classification. materials and methods: two-hundred fifty-four still images of the lower esophagus taken by an expert endoscopist (rm) were randomly selected and presented to 9 gastroenterologists (2 females, 6 experts, 3 tra...

We assessed the inter- and intraobserver variation in classification systems for fractures of the distal humerus. Three orthopaedic trauma consultants, three trauma registrars and three consultant musculoskeletal radiologists independently classified 33 sets of radiographs of such fractures on two occasions, each using three separate systems. For interobserver variation, the Riseborough and Rad...

The objective of this study was to determine the inter-observers level of agreement in interpreting cervical vertebral maturation (CVM) stages. This cross-sectional study was carried out at the Department of Orthodontics, Khyber College of Dentistry. The patient’s lateral cephalograms present in the Department were used. Sixty randomly selected cephalograms were digitized by using Nikon camera ...

A study was performed to investigate interlaboratory test agreement between a research and a commercial veterinary diagnostic laboratory on blood and urine samples, and to investigate test agreement between blood, urine, and kidney samples (research laboratory) for leptospirosis diagnosis. Samples were sourced from 399 sheep and 146 beef cattle from a local abattoir. Interlaboratory agreement f...