A mutual information criterion with applications to canonical correlation analysis and graphical models. Issue 1 (7th September 2021)

• Record Type: Journal Article
• Authors: DelSole, Timothy; Tippett, Michael K.
• Is Part Of: Stat. Volume 10:Issue 1(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-09-07
• Subjects: Akaike's information criterion -- CCA -- model selection -- mutual information; Statistics -- Periodicals; 519.2
• DOI: 10.1002/sta4.385
• Languages: English
• ISSNs: 2049-1573

Abstract

Abstract : This paper derives a criterion for deciding conditional independence that is consistent with small‐sample corrections of Akaike's information criterion but is easier to apply to such problems as selecting variables in canonical correlation analysis and selecting graphical models. The criterion reduces to mutual information when the assumed distribution equals the true distribution; hence, it is called mutual information criterion (MIC). Although small‐sample Kullback–Leibler criteria for these selection problems have been proposed previously, some of which are not widely known, MIC is strikingly more direct to derive and apply.