Offline sequential learning via simulation. (2nd November 2022)

• Record Type: Journal Article
• Authors: Liu, Haitao; Xiao, Hui; Li, Haobin; Lee, Loo Hay; Chew, Ek Peng
• Is Part Of: IISE transactions. Volume 54:Number 11(2022)
• Page Start: 1019
• Page End: 1032
• Publication Date: 2022-11-02
• Subjects: Offline sequential learning -- binary outcomes -- logistic model -- scenario-based feasibility determination; Industrial engineering -- Periodicals; Systems engineering -- Periodicals; Industrial engineering; Systems engineering; Electronic journals; Periodicals; 670.285
• DOI: 10.1080/24725854.2021.1968079
• Languages: English
• ISSNs: 2472-5854

Abstract

Abstract: Simulation has been widely used for static system designs, but it is rarely used in making online decisions, due to the time delay of executing simulation. We consider a system with stochastic binary outcomes that can be predicted via a logistic model depending on scenarios and decisions. The goal is to identify all feasible decisions conditioning on any online scenario. We propose to learn offline the relationship among scenarios, decisions, and binary outcomes. An Information Gradient (IG) policy is developed to sequentially allocate offline simulation budget. We show that the maximum likelihood estimator produced via the IG policy is consistent and asymptotically normal. Numerical results on synthetic data and a case study demonstrate the superior performance of the IG policy than benchmark policies. Moreover, we find that the IG policy tends to sample the location near boundaries of the design space, due to its higher Fisher information, and that the time complexity of the IG policy is linear to the number of design points and simulation budget.