Few, if any, studies have investigated the effect of professional experience as a rater variable and type of assessment as a task variable on raters’ criteria in the assessment of speech acts. This study aimed to explore the impact of nonnative teachers’ professional experience on the use of criteria in monologic and dialogic assessment of 12 role-plays of 3 apology speech acts. To this end, 60...

Abstract Due to subjectivity in oral assessment, much concentration has been put on obtaining a satisfactory measure of consistency among raters. However, the process for more might not result valid decisions. One matter that is at core both reliability and validity assessment rater training. Recently, multifaceted Rasch measurement (MFRM) adopted address problem bias inconsistency scoring; how...

A growing literature documents the relationship between tongue strength and oral phase swallowing function. Objective measures of strength have been recommended as more valid and reliable than subjective measures for the assessment of tongue function, yet subjective measures remain the more commonly used clinical method for assessing tongue strength. This study assessed the relationships among ...

OBJECTIVES To develop comprehensive and reliable radiation-free methods to quantify femoral and acetabular morphology using MRI. METHODS 32 hips (16 subjects, 6 with intra-articular hip disorder (IAHD); 10 controls) were included. A 1.5T magnetic resonance system was used to obtain 3D fat suppressed gradient echo images at the pelvis and distal femora. After acquisition, pelvic images were po...

BACKGROUND AND PURPOSE For MR perfusion-diffusion (PWI-DWI) mismatch to become routine in thrombolysis patient selection, rapid and reliable assessment tools are required. We examined interrater variability in PWI/DWI volume measurements and developed a rapid assessment tool based on the Alberta Stroke Program Early CT Scores (ASPECTS) system. METHODS DWI and PWI were performed in 35 patients...

CONTEXT Landing kinematics have been identified as a risk factor for knee injury. Detecting atypical kinematics in clinical settings is important for identifying individuals at risk for these injuries. OBJECTIVE To determine the reliability of a handheld tablet and application (app) for measuring lower-extremity kinematics during drop vertical-jump landings. DESIGN Measurement reliability. ...

BACKGROUND The Cochrane risk of bias (RoB) tool has been widely embraced by the systematic review community, but several studies have reported that its reliability is low. We aim to investigate whether training of raters, including objective and standardized instructions on how to assess risk of bias, can improve the reliability of this tool. We describe the methods that will be used in this in...

Creativity research crucially relies on creativity evaluations by external raters, but it is not clear what properties characterize good raters. In the present study, we investigated whether rater personality and are related to discernment (i.e., ability distinguish creative from uncreative responses) when evaluating others’ responses. To this end, 166 novice raters evaluated a pre-selected set...