Can you crowdsource expertise? Comparing expert and crowd‐based scoring keys for three situational judgment tests

How "situational" is judgment in situational judgment tests?

Whereas situational judgment tests (SJTs) have traditionally been conceptualized as low-fidelity simulations with an emphasis on contextualized situation descriptions and context-dependent knowledge, a recent perspective views SJTs as measures of more general domain (context-independent) knowledge. In the current research, we contrasted these 2 perspectives in 3 studies by removing the situatio...

Expertise, Judgment, Underwriters and Expert Systems

Expertise m what is it? Expertise is the ability of one human within an organization to outperform a similarly educated and informed peer group in discrete, repetitive tasks involving decision-making and risk assessment. Expertise is best measured by the degree to which an individual’s performance provides proprietary advantage to his organization. Bright people with exceptional ways of accompl...

Situational Judgment Tests: A Review of Practice and Constructs Assessed

In this article, we seek to summarize current practice concerning situational judgment tests in personnel selection. We begin by describing the manner in which situational judgment tests are developed and examining the diverse ways in which situational items are presented and scored. We then offer speculation concerning constructs assessed by situational judgment tests as well as discuss the le...

An Evaluation of the Construct Validity of Situational Judgment Tests

Situational judgment tests: a review of recent research

Purpose – The purpose of this paper is to give an empirically-based review of the strengths and weaknesses of situational judgment tests (SJTs). Design/methodology/approach – The features, history, and development of SJTs are discussed. Next, a computerized search (from 1990-2007) is conducted to retrieve empirical studies related to SJTs. The effectiveness of SJTs is discussed in terms of reli...