An applied examination of the computerized adaptive rating scale for assessing performance. (June 2017)

• Record Type: Journal Article
• Authors: Darr, Wendy; Borman, Walter C.; St‐Pierre, Line; Kubisiak, Christean; Grossman, Matthew
• Is Part Of: International journal of selection and assessment. Volume 25:Number 2(2017:Jun.)
• Page Start: 149
• Page End: 153
• Publication Date: 2017-06
• Subjects: Employee selection -- Periodicals; Personality and occupation -- Periodicals; Employment interviewing -- Periodicals; Prediction of occupational success -- Periodicals; Employees -- Rating of -- Periodicals; 658.3112
• DOI: 10.1111/ijsa.12167
• Languages: English
• ISSNs: 0965-075X

Abstract

Abstract: In the present research, we developed and conducted a field test of the computerized adaptive rating scale (CARS) for assessing military officer performance. Participants completed the CARS and a behaviorally anchored rating scale (BARS) which were both designed to assess five leadership competencies (action orientation/initiative, communication, developing self and others, behavioral flexibility, and teamwork). We obtained data from 116 supervisors and 207 peers who provided ratings on 126 officer ratees. Although interrater reliability estimates were lower for CARS ratings on some competencies, there was a 20–25% improvement in standard error of measurement, the measurement precision in CARS ratings compared to the BARS. Results support findings from a previous lab study.