High-confidence nonparametric fixed-width uncertainty intervals and applications to projected high-dimensional data and common mean estimation. Issue 1 (19th January 2021)

• Record Type: Journal Article
• Authors: Steland, Ansgar; Chang, Yuan-Tsung
• Is Part Of: Sequential analysis. Volume 40:Issue 1(2021)
• Page Start: 97
• Page End: 124
• Publication Date: 2021-01-19
• Subjects: Big data -- data science -- high-dimensional data -- jackknife -- sequential analysis -- sequential sampling; 62L15 -- 60G40 -- 62F12 -- 62F15; Sequential analysis -- Periodicals; 519.54
• DOI: 10.1080/07474946.2021.1847966
• Languages: English
• ISSNs: 0747-4946

Abstract

Abstract: Nonparametric two-stage procedures to construct fixed-width confidence intervals are studied to quantify uncertainty. It is shown that the validity of the random central limit theorem (RCLT) accompanied by a consistent and asymptotically unbiased estimator of the asymptotic variance already guarantees consistency and first-order as well as second-order efficiency of the two-stage procedures. This holds under the common asymptotics where the length of the confidence interval tends toward 0 as well as under the novel proposed high-confidence asymptotics where the confidence level tends toward 1. The approach is motivated by and applicable to data analysis from distributed big data with nonnegligible costs of data queries. The following problems are discussed: Fixed-width intervals for the mean, for a projection when observing high-dimensional data, and for the common mean when using nonlinear common mean estimators under order constraints. The procedures are investigated by simulations and illustrated by a real data analysis.