A partial EM algorithm for model‐based clustering with highly diverse missing data patterns. Issue 1 (18th March 2022)

• Record Type: Journal Article
• Authors: Browne, Ryan P.; McNicholas, Paul D.; Findlay, Christopher J.
• Is Part Of: Stat. Volume 11:Issue 1(2022)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2022-03-18
• Subjects: balanced‐incomplete‐block -- missing data -- mixture models -- partial EM -- sensometrics; Statistics -- Periodicals; 519.2
• DOI: 10.1002/sta4.437
• Languages: English
• ISSNs: 2049-1573

Abstract

Abstract : The expectation‐maximization (EM) algorithm for incomplete data with highly diverse missing data patterns can be computationally expensive. A partial expectation‐maximization (PEM) algorithm is developed to ease this computational burden. This PEM algorithm circumvents the need for a traditional E‐step by performing a partial E‐step that reduces the Kullback‐Leibler divergence between the conditional distribution of the missing data and the distribution of the missing data given the observed data. The PEM and EM algorithms are compared in terms of computation time and convergence on simulated data. The PEM algorithm is illustrated using a latent Gaussian mixture model to cluster a white bread sensory analysis dataset.