Active learning of continuous-time Bayesian networks through interventions*This article is an updated version of: Linzner D and Koeppl H 2021 Active learning of continuous-time Bayesian networks through interventions Proc. 38th Int. Conf. on Machine Learning vol 139 ed M Meila and T Zhang pp 6692–701. (29th December 2021)

• Record Type: Journal Article
• Authors: Linzner, Dominik; Koeppl, Heinz
• Is Part Of: Journal of statistical mechanics. (2021:Dec.)
• Publication Date: 2021-12-29
• Subjects: machine learning -- network reconstruction -- optimization under uncertainty -- statistical inference; Statistical mechanics -- Periodicals; Mechanics -- Statistical methods -- Periodicals; 530.1305
• DOI: 10.1088/1742-5468/ac3908
• Languages: English
• ISSNs: 1742-5468

Abstract

Abstract: We consider the problem of learning structures and parameters of continuous-time Bayesian networks (CTBNs) from time-course data under minimal experimental resources. In practice, the cost of generating experimental data poses a bottleneck, especially in the natural and social sciences. A popular approach to overcome this is Bayesian optimal experimental design (BOED). However, BOED becomes infeasible in high-dimensional settings, as it involves integration over all possible experimental outcomes. We propose a novel criterion for experimental design based on a variational approximation of the expected information gain. We show that for CTBNs, a semi-analytical expression for this criterion can be calculated for structure and parameter learning. By doing so, we can replace sampling over experimental outcomes by solving the CTBNs master-equation, for which scalable approximations exist. This alleviates the computational burden of integrating over possible experimental outcomes in high-dimensions. We employ this framework in order to recommend interventional sequences. In this context, we extend the CTBN model to conditional CTBNs in order to incorporate interventions. We demonstrate the performance of our criterion on synthetic and real-world data.