Exploring Alternative Test Form Linking Designs With Modified Equating Sample Size and Anchor Test Length. Issue 1 (June 2013)

• Record Type: Journal Article
• Authors: Wang, Lin; Qian, Jiahe; Lee, Yi‐Hsuan
• Is Part Of: ETS research report series. Issue 1(2013:Jun.)
• Page Start: i
• Page End: 17
• Publication Date: 2013-06
• Subjects: anchor test length -- equating sample size -- equating to a calibrated item pool design -- complete grouped jackknifing; Universities and colleges -- Entrance examinations; Universities and colleges -- Graduate work -- Examinations; Universities and colleges -- United States -- Entrance examinations; Universities and colleges -- United States -- Graduate work -- Examinations; Graduate Record Examination; Educational tests and measurements; Social sciences; Education -- Research; Education -- Research; Educational tests and measurements; Graduate Record Examination; Social sciences; Universities and colleges -- Entrance examinations; Universities and colleges -- Graduate work -- Examinations; United States; 378
• DOI: 10.1002/j.2333-8504.2013.tb02309.x
• Languages: English
• ISSNs: 2330-8516

Abstract

Abstract: The purpose of this study was to evaluate the combined effects of reduced equating sample size and shortened anchor test length on item response theory (IRT)‐based linking and equating results. Data from two independent operational forms of a large‐scale testing program were used to establish the baseline results for evaluating the results from two alternative designs. Under the two alternative designs, two simulated conditions were created from the original data. Under one condition, we reduced the equating sample size (from about 2, 000 to about 1, 000) per anchor item and shortened the anchor test length (by half) per equating sample. Under the other condition, we reduced the sample size (from about 2, 000 to about 1, 000) per anchor item only. A complete grouped jackknife replication method was used to estimate the standard errors of the linking and equating procedures from 100 jackknife replicate samples; the complete procedures included IRT calibrations, item parameter scaling, and IRT true score equating. The findings from a comparison of the results from the two simulated conditions and the baseline results showed that neither alternative design had any practical impact on the linking and equating results for either test form.