Asking applicants what they <i>would do</i> versus what they <i>did do</i> : A meta‐analytic comparison of situational and past behaviour employment interview questions

verifiedmedium profile · Journal of Occupational and Organizational Psychology · 2002

Taylor, Paul J.; Small, Bruce

10.1348/096317902320369712 · CrossRef: verified

How this was studied

paradigm: positivistpurpose: explanatory causaldesign: meta analytic synthesisidentification: nonetime: cross sectionaldata: quantitative survey

A meta-analytic synthesis — it pools many primary studies rather than running a single design, so there is no single-study diagram.

analysis: meta analysis · validity (validity): internal addressed · external unclear · construct addressed · statistical addressed · classifier confidence 0.85

What this article reports

The findings we extracted from this work, normalized into Principia’s relationship form (X → Y). Each feeds the synthesized models below.

situational interviewstask performance

r = 0.45 · k=30 · grade A · unverified

Models this article informs

The meta-analytic priors this article contributes evidence to — its place in the broader synthesis.

In the authors’ words

The article’s own abstract.

Criterion‐related validities and inter‐rater reliabilities for structured employment interview studies using situational questions (e.g. “Assume that you were faced with the following situation … what would you do?”) were compared meta‐analytically with studies using past behaviour questions (e.g. “Can you think of a time when … what did you do?”). Validities and reliabilities were further analysed in terms of whether descriptively‐anchored rating scales were used to judge interviewees' answers, and validities for each question type were also assessed across three levels of job complexity. While both question formats yielded high validity estimates, studies using past behaviour questions, when used with discriptively anchored answer rating scales, yielded a substantially higher mean validity estimate than studies using the situational question format with descriptively‐anchored answer rating scales (.63 versus .47). Question type (situational versus past behaviour) was found to moderate interview validity, after controlling for whether studies used answer rating scales. No support was found for the hypothesis that situational questions are less valid for predicting job performance in high‐complexity jobs. Sample‐weighted mean inter‐rater reliabilities were similar for both situational and past behaviour questions, provided that descriptively‐anchored rating scales were used (.79 and .77, respectively), although they were slightly lower (.73) for past behaviour question studies lacking such rating scales.

What the literature says about it

Attributed, open-access quotes from other works that cite this article, plus the citation-graph verdict tally. Corroborations and disputes, in one place — the honest-broker view.

0 supporting1 disputing

No open-access quotations have been captured yet.

Ancillary research

Neighbouring works in the citation graph around this article.

Assembled from Principia’s registry — bibliographic record, extracted effect sizes, the models they inform, and open-access citing literature.

Asking applicants what they <i>would do</i> versus what they <i>did do</i> : A meta‐analytic comparison of situational and past behaviour employment interview questions · Principia