Objective: To evaluate the correlation between the reflux symptom index (RSI) and the reflux finding score (RFS) in the patients with voice-related problems and to investigate the reliability of RFS. Methods: Fifty-four patients presenting with the complaint of voice abnormality were included in the study. Patients were asked to complete an RSI score sheet, and they were examined by rigid laryn...

Written responses can provide a wealth of data in understanding student reasoning on a topic. Yet they are timeand laborintensive to score, requiring many instructors to forego them except as limited parts of summative assessments at the end of a unit or course. Recent developments in Machine Learning (ML) have produced computational methods of scoring written responses for the presence or abse...

Many research designs require the assessment of inter-rater reliability (IRR) to demonstrate consistency among observational ratings provided by multiple coders. However, many studies use incorrect statistical procedures, fail to fully report the information necessary to interpret their results, or do not address how IRR affects the power of their subsequent analyses for hypothesis testing. Thi...

The aim of the present work was to examine validity of the graphological method to assess personality traits. The results of two studies are described. In Study 1, the Big Five Questionnaire was administered to a sample of 101 university students who provided a sample of a handwritten text. Two graphologists were asked to detect the same dimensions and facets measured by the Big Five Questionna...

This paper describes a corpus annotation project to study issues in the manual annotation of opinions, emotions, sentiments, speculations, evaluations and other private states in language. The resulting corpus annotation scheme is described, as well as examples of its use. In addition, the manual annotation process and the results of an inter-annotator agreement study on a 10,000-sentence corpu...

GOAL To assess the reliability of a reference standard for an information extraction task. SETTING Twenty-four physician raters from two sites and two specialties judged whether clinical conditions were present based on reading chest radiograph reports. METHODS Variance components, generalizability (reliability) coefficients, and the number of expert raters needed to generate a reliable ref...

BACKGROUND Hand held Doppler examination is a frequently used non-invasive vascular assessment utilised by podiatrists. Despite this, the reliability of hand-held Doppler has not been thoroughly investigated. Given the importance of Doppler in completing a vascular assessment of the lower limb, it is essential to determine the reliability of the interpretation of this testing method in practici...

BACKGROUND Reproducibility measurements of the range of motion are an important prerequisite for the interpretation of study results. The aim of the study is to assess the intra-rater and inter-rater reproducibility of the measurement of active Range of Motion (ROM) in patients with neck pain using the Cybex Electronic Digital Inclinometer-320 (EDI-320). METHODS In an outpatient clinic in a p...

[Purpose] Measurement of posture is important for those with a clinical diagnosis as well as researchers aiming to understand the impact of faulty postures on the development of musculoskeletal disorders. A reliable, cost-effective and low tech posture measure may be beneficial for research and clinical applications. The purpose of this study was to determine rater reliability and construct val...

OBJECTIVE Chronic pain from rheumatic and musculoskeletal conditions is associated with cortical changes and altered tactile acuity. Tactile acuity is considered a clinical signature of primary somatosensory representation. The two-point discrimination (TPD) threshold is increasingly used both clinically and in research. Remarkably, the reliability and precision of the measure at commonly used ...