A Special Case of Brennan's Index for Tests That Aim to Select a Limited Number of Students: A Monte Carlo Simulation Study. Issue 4 (8th September 2022)

• Record Type: Journal Article
• Authors: Arikan, Serkan; Aybek, Eren Can
• Is Part Of: Educational measurement. Volume 41:Issue 4(2022)
• Page Start: 35
• Page End: 49
• Publication Date: 2022-09-08
• Subjects: classical test theory -- high‐stake tests -- item discrimination indices -- item response theory -- Monte Carlo simulation; Educational tests and measurements -- Periodicals; Educational tests and measurements -- United States -- Periodicals; 371.262
• DOI: 10.1111/emip.12528
• Languages: English
• ISSNs: 0731-1745

Abstract

Abstract: Many scholars compared various item discrimination indices in real or simulated data. Item discrimination indices, such as item‐total correlation, item‐rest correlation, and IRT item discrimination parameter, provide information about individual differences among all participants. However, there are tests that aim to select a very limited number of students, examinees, or candidates for allocated schools and job positions. Thus, there is a need to evaluate the performances of CTT and IRT item discrimination indices when the test purpose is to select a limited number of students. The purpose of the current Monte Carlo study is to evaluate item discrimination indices in the case of selecting a limited number of high‐achieving students. The results showed that a special case of Brennan's index, B 10–90, provided more accurate information for this specific test purpose. Additionally, the effects of various factors, such as test length, ability distributions of examinees, and item difficulty variance on item discrimination indices were investigated. The performance of each item discrimination index is discussed in detail.