Variance Estimation With Complex Data and Finite Population Correction—A Paradigm for Comparing Jackknife and Formula‐Based Methods for Variance Estimation. Issue 1 (21st May 2020)

• Record Type: Journal Article
• Authors: Qian, Jiahe
• Is Part Of: ETS research report series. Issue 1(2020)
• Page Start: 1
• Page End: 16
• Publication Date: 2020-05-21
• Subjects: Finite population sampling -- two‐stage PPS sampling -- Horvitz–Thompson estimator -- jackknife approach -- delta method -- joint inclusion probability -- Hájek approximation; Universities and colleges -- Entrance examinations; Universities and colleges -- Graduate work -- Examinations; Universities and colleges -- United States -- Entrance examinations; Universities and colleges -- United States -- Graduate work -- Examinations; Graduate Record Examination; Educational tests and measurements; Social sciences; Education -- Research; Education -- Research; Educational tests and measurements; Graduate Record Examination; Social sciences; Universities and colleges -- Entrance examinations; Universities and colleges -- Graduate work -- Examinations; United States; 378
• DOI: 10.1002/ets2.12294
• Languages: English
• ISSNs: 2330-8516

Abstract

Abstract : The finite population correction (FPC) factor is often used to adjust variance estimators for survey data sampled from a finite population without replacement. As a replicated resampling approach, the jackknife approach is usually implemented without the FPC factor incorporated in its variance estimates. A paradigm is proposed to compare the jackknifed variance estimates with those yielded by the delta method because the delta method has the effect of the FPC factor implicitly integrated. The goal is to examine whether the grouped jackknife approach properly estimates the variance of complex samples without incorporating the FPC effect, in particular for data sampled from a finite population with a high sampling rate. The investigation focuses on the data drawn by two‐stage sampling with probability proportional to size of schools and with simple random sampling of students. Moreover, the Hájek approximation of the joint probabilities is used in the delta method for a Horvitz–Thompson (H–T) estimator. Samples of the National Assessment of Educational Progress (NAEP) state science assessments are used in the analysis. Abstract : Report Number: ETS RR‐20‐11