Embedded Standard Setting: Aligning Standard‐Setting Methodology with Contemporary Assessment Design Principles. Issue 1 (26th February 2020)
- Record Type:
- Journal Article
- Title:
- Embedded Standard Setting: Aligning Standard‐Setting Methodology with Contemporary Assessment Design Principles. Issue 1 (26th February 2020)
- Main Title:
- Embedded Standard Setting: Aligning Standard‐Setting Methodology with Contemporary Assessment Design Principles
- Authors:
- Lewis, Daniel
Cook, Robert - Abstract:
- Abstract: In this paper we assert that the practice of principled assessment design renders traditional standard‐setting methodology redundant at best and contradictory at worst. We describe the rationale for, and methodological details of, Embedded Standard Setting (ESS; previously, Engineered Cut Scores. Lewis, 2016), an approach to establish performance standards that augments and is embedded within existing principled assessment design practices. Under ESS, achievement level descriptor writing and the targeting of items to specified achievement levels are viewed as the fundamental standard‐setting activities and cut scores are estimated by optimizing the relationship between the item targets and the empirically based grouping of items. If the relationship between item targets and empirical data are sufficiently strong, then the traditional standard‐setting workshop is either unnecessary or altered in nature and significantly reduced in scope. We provide empirical evidence supporting the efficacy of ESS and describe how ESS is embedded throughout the assessment lifecycle.
- Is Part Of:
- Educational measurement. Volume 39:Issue 1(2020)
- Journal:
- Educational measurement
- Issue:
- Volume 39:Issue 1(2020)
- Issue Display:
- Volume 39, Issue 1 (2020)
- Year:
- 2020
- Volume:
- 39
- Issue:
- 1
- Issue Sort Value:
- 2020-0039-0001-0000
- Page Start:
- 8
- Page End:
- 21
- Publication Date:
- 2020-02-26
- Subjects:
- evidence‐centered design -- embedded standard setting -- item alignment -- principled assessment design -- standard setting
Educational tests and measurements -- Periodicals
Educational tests and measurements -- United States -- Periodicals
371.262 - Journal URLs:
- http://firstsearch.oclc.org ↗
http://www.blackwell-synergy.com/servlet/useragent?func=showIssues&code=emip ↗
http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1745-3992 ↗
http://onlinelibrary.wiley.com/ ↗
http://www.blackwellpublishing.com/journal.asp?ref=0731-1745&site=1 ↗ - DOI:
- 10.1111/emip.12318 ↗
- Languages:
- English
- ISSNs:
- 0731-1745
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 3661.446000
British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 13183.xml