Effects of Situational Judgment Test Format on Reliability and Validity. Issue 2 (3rd April 2018)

• Record Type: Journal Article
• Authors: Martin-Raugh, Michelle P.; Anguiano-Carrsaco, Cristina; Jackson, Teresa; Brenneman, Meghan W.; Carney, Lauren; Barnwell, Patrick; Kochert, Jonathan
• Is Part Of: International journal of testing. Volume 18:Issue 2(2018)
• Page Start: 135
• Page End: 154
• Publication Date: 2018-04-03
• Subjects: situational judgment tests (SJTs) -- reliability -- validity -- cross-cultural competence; Psychological tests -- Periodicals; Educational tests and measurements -- Periodicals; 150.28705
• DOI: 10.1080/15305058.2018.1428981
• Languages: English
• ISSNs: 1530-5058

Abstract

Abstract : Single-response situational judgment tests (SRSJTs) differ from multiple-response SJTs (MRSJTS) in that they present test takers with edited critical incidents and simply ask test takers to read over the action described and evaluate it according to its effectiveness. Research comparing the reliability and validity of SRSJTs and MRSJTs is thus far extremely limited. The study reported here directly compares forms of a SRSJT and MRSJT and explores the reliability, convergent validity, and predictive validity of each format. Results from this investigation present preliminary evidence to suggest SRSJTs may produce internal consistency reliability, convergent validity, and predictive validity estimates that are comparable to those achieved with many traditional MRSJTs. We conclude by discussing practical implications for personnel selection and assessment, and future research in psychological science more broadly.