Data-driven stochastic robust optimization: General computational framework and algorithm leveraging machine learning for optimization under uncertainty in the big data era. (4th March 2018)

• Record Type: Journal Article
• Authors: Ning, Chao; You, Fengqi
• Is Part Of: Computers & chemical engineering. Volume 111(2018)
• Page Start: 115
• Page End: 133
• Publication Date: 2018-03-04
• Subjects: Big data -- Optimization under uncertainty -- Bayesian model -- Machine learning -- Process design and operations; Chemical engineering -- Data processing -- Periodicals; 660.0285
• DOI: 10.1016/j.compchemeng.2017.12.015
• Languages: English
• ISSNs: 0098-1354

Abstract

Highlights: Machine learning based uncertainty model is developed. A data-driven optimization under uncertainty framework is proposed. Labeled multi-class uncertainty data is leveraged for decision making. The resulting problem is solved with a decomposition-based algorithm. Applications to process network design and planning. Abstract: A novel data-driven stochastic robust optimization (DDSRO) framework is proposed for optimization under uncertainty leveraging labeled multi-class uncertainty data. Uncertainty data in large datasets are often collected from various conditions, which are encoded by class labels. Machine learning methods including Dirichlet process mixture model and maximum likelihood estimation are employed for uncertainty modeling. A DDSRO framework is further proposed based on the data-driven uncertainty model through a bi-level optimization structure. The outer optimization problem follows a two-stage stochastic programming approach to optimize the expected objective across different data classes; adaptive robust optimization is nested as the inner problem to ensure the robustness of the solution while maintaining computational tractability. A decomposition-based algorithm is further developed to solve the resulting multi-level optimization problem efficiently. Case studies on process network design and planning are presented to demonstrate the applicability of the proposed framework and algorithm.