BACKGROUND To enhance the non-technical skills (NTS) assessment literature by developing a reliable and valid peer and self-assessment tool for NTS in a simulated ward setting to include emotional reactions: the Temporal Rating of Emergency Non-Technical skills (TRENT) Index. The paper aims to document (1) the psychometric properties of the TRENT index (e.g., reliability, idiosyncrasy biases) a...

This paper discusses the extension of a system developed for automatic discovery of treebank annotation inconsistencies over an entire corpus to the particular case of evaluation of inter-annotator agreement. This system makes for a more informative IAA evaluation than other systems because it pinpoints the inconsistencies and groups them by their structural types. We evaluate the system on two...

In medical records review studies, information on the interrater reliability (IRR) of the data is seldom reported. This study assesses the IRR of data collected for a complex medical records review study. Elements selected for determining IRR included "demographic" data that require copying explicit information (e.g., gender, birth date), "free-text" data that require identifying and copying (e...

BACKGROUND The quality of behaviour support plans (BSPs) can be an important influence on the quality of the support provided to people with disability who show challenging behaviours. The Behavior Support Plan Quality Evaluation Guide II (BSP-QE II) is one tool that may be useful in assessing the quality of behaviour support plans. It has previously been used to assess BSPs to support children...

The triple jump examination (TJE) attempts to assess a higher level of learning with demand for analysis, critical thinking, and resolution of problems presented by written scenarios based on patient care situations. The purpose of this study was to examine the internal consistency, scale reliability, and interrater reliability of the TJE used at the Ostrow School of Dentistry, University of So...

BACKGROUND Google Street View provides a valuable and efficient alternative to observe the physical environment compared to on-site fieldwork. However, studies on the use, reliability and validity of Google Street View in a cycling-to-school context are lacking. We aimed to study the intra-, inter-rater reliability and criterion validity of EGA-Cycling (Environmental Google Street View Based Au...

The NTID Writing Test was developed to assess the writing ability of postsecondary deaf students entering the National Technical Institute for the Deaf and to determine their appropriate placement into developmental writing courses. While previous research (Albertini et al., 1986; Albertini et al., 1996; Bochner, Albertini, Samar, & Metz, 1992) has shown the test to be reliable between multiple...

The purposes of this investigation of patients with stroke were to 1) determine and compare shoulder lateral rotation range of motion (SLRROM) measured at the threshold of pain on the paretic and nonparetic sides; 2) establish the intrarater and interrater reliability of the measurements; and 3) determine the relationship between SLRROM measurements and the independent variables of age, sex, an...

Practical assessment instruments are commonly used in the workplace and educational environments to assess a person's level of digital literacy and end-user computer skill. However, it is often difficult to find statistical evidence of the actual validity of instruments being used. To ensure that the correct factors are being assessed for a particular purpose it is necessary to undertake some t...

OBJECTIVE To determine the intrarater and interrater reliability of cirtometry (measurements of the circumference of the chest and abdomen taken during respiratory movements) as well as its correlation with pulmonary volumes measured by respiratory inductive plethysmography. METHODS A total of 40 healthy individuals were evaluated. The mean age was 28 years. The measurements were taken in the...