Evaluating frame-of-reference rater training effectiveness using performance schema accuracy.
نویسندگان
چکیده
Frame-of-reference training has been shown to be an effective intervention for improving the accuracy of performance ratings (e.g., Woehr & Huffcutt, 1994). Despite evidence in support of the effectiveness of frame-of-reference training, few studies have empirically addressed the ultimate goal of such training, which is to teach raters to share a common conceptualization of performance (Athey & McIntyre, 1987; Woehr, 1994). The present study tested the hypothesis that, following training, frame-of-reference-trained raters would possess schemas of performance that are more similar to a referent schema, as compared with control-trained raters. Schema accuracy was also hypothesized to be positively related to rating accuracy. Results supported these hypotheses. Implications for frame-of-reference training research and practice are discussed.
منابع مشابه
Impact of Frame-of-Reference and Behavioral Observation Training on Alternative Training Effectiveness Criteria in a Canadian Military Sample
We examined the utility of frame-of-reference (FOR) training and behavioral observation training (BOT) for enhancing rating accuracy in a field study involving Canadian military personnel. Participants were randomly assigned to either (a) FOR training, (b) FOR training + BOT, or (c) control training. Participants were assessed on a variety of training program evaluation criteria, including rati...
متن کاملEffects of a rater training on rating accuracy in a physical examination skills assessment
BACKGROUND The accuracy and reproducibility of medical skills assessment is generally low. Rater training has little or no effect. Our knowledge in this field, however, relies on studies involving video ratings of overall clinical performances. We hypothesised that a rater training focussing on the frame of reference could improve accuracy in grading the curricular assessment of a highly standa...
متن کاملA Study of Raters’ Behavior in Scoring L2 Speaking Performance: Using Rater Discussion as a Training Tool
The studies conducted so far on the effectiveness of resolution methods including the discussion method in resolving discrepancies in rating have yielded mixed results. What is left unnoticed in the literature is the potential of discussion to be used as a training tool rather than a resolution method. The present study addresses this research gap by exploring the data coming from rating behavi...
متن کاملRaters’ Perception and Expertise in Evaluating Second Language Compositions
The consideration of rater training is very important in construct validation of a writing test because it is through training that raters are adapted to the use of students’ writing ability instead of their own criteria for assessing compositions (Charney, 1984). However, although training has been discussed in the literature of writing assessment, there is little research regarding raters’ pe...
متن کاملComparison between effectiveness of dialectical behavioral therapy and emotional schema therapy on pain severity and performance limitation in people who suffering of tension headache
Background: The aim of the present study was to compare the effectiveness of dialectical behavioral therapy and emotional schema therapy on pain severity and performance limitation in people who suffering of tension headache. Methods: The present study was a quasi- experimental design that conducted in the form of pretest-posttest-2mounths follow up. In this study, 68 patients with c...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- The Journal of applied psychology
دوره 94 5 شماره
صفحات -
تاریخ انتشار 2009