In a large-scale study of how people find topical shifts in written text, 27 annotators were asked to mark topically continuous segments in 20 chapters of a novel. We analyze the resulting corpus for inter-annotator agreement and examine disagreement patterns. The results suggest that, while the overall agreement is relatively low, the annotators show high agreement on a subset of topical break...

This article argues that the general practice of describing interrater reliability as a single, unified concept is at best imprecise, and at worst potentially misleading. Rather than representing a single concept, different statistical methods for computing interrater reliability can be more accurately classified into one of three categories based upon the underlying goals of analysis. The thre...

In this chapter, we will introduce the basic concepts that constitute what is known as ReliabilityCentered Maintenance. Initially, however, we will briefly discuss how PM has evolved in the industrial world, and most importantly, we will look at how one of the basic tenets of reliability engineering—the “bathtub curve”—can and should influence the formulation of PM tasks. Next, we will look at ...

[Purpose] This study examined the reliability of a clinical ability evaluation table developed in a previous study with the aim of clarifying the abilities necessary for therapists to independently implement their duties. [Subjects and Methods] Forty-eight physical therapists with less than 2 years of clinical experience were targeted for evaluation, 48 main supervisors, and 48 sub-supervisors,...