A Bias-Corrected RMSD Item Fit Statistic: An Evaluation and Comparison to Alternatives. (June 2020)
- Record Type:
- Journal Article
- Title:
- A Bias-Corrected RMSD Item Fit Statistic: An Evaluation and Comparison to Alternatives. (June 2020)
- Main Title:
- A Bias-Corrected RMSD Item Fit Statistic: An Evaluation and Comparison to Alternatives
- Authors:
- Köhler, Carmen
Robitzsch, Alexander
Hartig, Johannes - Abstract:
- Testing whether items fit the assumptions of an item response theory model is an important step in evaluating a test. In the literature, numerous item fit statistics exist, many of which show severe limitations. The current study investigates the root mean squared deviation (RMSD) item fit statistic, which is used for evaluating item fit in various large-scale assessment studies. The three research questions of this study are (1) whether the empirical RMSD is an unbiased estimator of the population RMSD; (2) if this is not the case, whether this bias can be corrected; and (3) whether the test statistic provides an adequate significance test to detect misfitting items. Using simulation studies, it was found that the empirical RMSD is not an unbiased estimator of the population RMSD, and nonparametric bootstrapping falls short of entirely eliminating this bias. Using parametric bootstrapping, however, the RMSD can be used as a test statistic that outperforms the other approaches—infit and outfit, S − X 2 —with respect to both Type I error rate and power. The empirical application showed that parametric bootstrapping of the RMSD results in rather conservative item fit decisions, which suggests more lenient cut-off criteria.
- Is Part Of:
- Journal of educational and behavioral statistics. Volume 45:Number 3(2020)
- Journal:
- Journal of educational and behavioral statistics
- Issue:
- Volume 45:Number 3(2020)
- Issue Display:
- Volume 45, Issue 3 (2020)
- Year:
- 2020
- Volume:
- 45
- Issue:
- 3
- Issue Sort Value:
- 2020-0045-0003-0000
- Page Start:
- 251
- Page End:
- 273
- Publication Date:
- 2020-06
- Subjects:
- item fit -- item response theory -- educational measurement -- bootstrap
Educational statistics -- Periodicals
Social sciences -- Statistical methods -- Periodicals
370.2 - Journal URLs:
- http://jeb.sagepub.com/ ↗
http://www.jstor.org/journals/10769986.html ↗
http://www.sagepublications.com/ ↗ - DOI:
- 10.3102/1076998619890566 ↗
- Languages:
- English
- ISSNs:
- 1076-9986
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 13090.xml