Assessing Raters: What Factors Predict Discernment in Novice Creativity Raters?

Creativity research crucially relies on creativity evaluations by external raters, but it is not clear what properties characterize good raters. In the present study, we investigated whether rater personality and are related to discernment (i.e., ability distinguish creative from uncreative responses) when evaluating others’ responses. To this end, 166 novice raters evaluated a pre-selected set of responses alternate uses task for creativity. We further assessed rater’s explored role factors such as rating motivation time. found that in terms potential achievement independently predicted discernment. At level personality, openness experience was higher discernment, any other Big-Five or dark triad traits. Rater also increased with time, motivation, leniency tendency appreciate responses). Finally, seized large sample estimate extent inter-rater reliability depends number how dependable ratings across scale. Together, these findings highlight relevant at person, task, method predicting individual which should be considered ensure ratings.