Good–Turing frequency estimation in a finite population. Issue 2 (12th November 2014)

• Record Type: Journal Article
• Authors: Hwang, Wen‐Han; Lin, Chih‐Wei; Shen, Tsung‐Jen
• Is Part Of: Biometrical journal. Volume 57:Issue 2(2015:Mar.)
• Page Start: 321
• Page End: 339
• Publication Date: 2014-11-12
• Subjects: Biometry -- Periodicals; Medical statistics -- Periodicals; 570.15195
• DOI: 10.1002/bimj.201300168
• Languages: English
• ISSNs: 0323-3847

Abstract

<abstract abstract-type="main"> <title> <x xml:space="preserve">Abstract</x> </title> <p>Good–Turing frequency estimation (Good, <xref ref-type="link" rid="bimj1550-bib-0016">1953</xref>) is a simple, effective method for predicting detection probabilities of objects of both observed and unobserved classes based on observed frequencies of classes in a sample. The method has been used widely in several disciplines, such as information retrieval, computational linguistics, text recognition, and ecological diversity estimation. Nevertheless, existing studies assume sampling with replacement or sampling from an infinite population, which might be inappropriate for many practical applications. In light of this limitation, this article presents a modification of the Good–Turing estimation method to account for finite population sampling. We provide three practical extensions of the modified method, and we examine performance of the modified method and its extensions in simulation experiments.</p> </abstract>