A nonparametric two‐sample test using a general φ‐divergence‐based mutual information. (29th December 2020)

• Record Type: Journal Article
• Authors: Guha, Apratim; Biswas, Atanu; Ghosh, Abhik
• Is Part Of: Statistica Neerlandica. Volume 75:Number 2(2021)
• Page Start: 180
• Page End: 202
• Publication Date: 2020-12-29
• Subjects: φ‐divergence -- information leakage -- kernel density estimation -- nonparametric test -- power divergence -- test of independence; Statistics -- Periodicals; 519.5; 314.92
• DOI: 10.1111/stan.12232
• Languages: English
• ISSNs: 0039-0402

Abstract

Abstract : Nonparametric two‐sample problems are extremely important for applications in different applied disciplines. We define a general MI based on the φ divergences and use its estimate to propose a new general class of nonparametric two sample tests for continuous distributions. We derive the asymptotic distribution of the estimates of φ ‐divergence‐based MI ( φ DMI) under the assumption of independence in the hybrid setup of one binary and one continuous random variables. Additionally, for finite sample cases, we describe an algorithm for obtaining the bootstrap‐based critical value of our proposed two‐sample test based on the estimated φ DMI. We demonstrate through extensive simulations that the proposed class of tests work exceptionally well in many situations and can detect differences where other two‐sample tests fail. Finally, we analyze an application of our proposed tests to assess a solution to information leakage in e‐passport data.