Using stochastic dual dynamic programming in problems with multiple near‐optimal solutions. Issue 5 (27th May 2016)

• Record Type: Journal Article
• Authors: Rougé, Charles; Tilmant, Amaury
• Is Part Of: Water resources research. Volume 52:Issue 5(2016:May)
• Page Start: 4151
• Page End: 4163
• Publication Date: 2016-05-27
• Subjects: stochastic dual dynamic programming -- year‐periodic reoptimization -- limited data availability -- multiple near‐optimal solutions -- Zambezi River Basin -- chaos; Hydrology -- Periodicals; 333.91
• DOI: 10.1002/2016WR018608
• Languages: English
• ISSNs: 0043-1397

Abstract

Abstract: Stochastic dual dynamic programming (SDDP) is one of the few algorithmic solutions available to optimize large‐scale water resources systems while explicitly considering uncertainty. This paper explores the consequences of, and proposes a solution to, the existence of multiple near‐optimal solutions (MNOS) when using SDDP for mid or long‐term river basin management. These issues arise when the optimization problem cannot be properly parametrized due to poorly defined and/or unavailable data sets. This work shows that when MNOS exists, (1) SDDP explores more than one solution trajectory in the same run, suggesting different decisions in distinct simulation years even for the same point in the state‐space, and (2) SDDP is shown to be very sensitive to even minimal variations of the problem setting, e.g., initial conditions—we call this "algorithmic chaos." Results that exhibit such sensitivity are difficult to interpret. This work proposes a reoptimization method, which simulates system decisions by periodically applying cuts from one given year from the SDDP run. Simulation results obtained through this reoptimization approach are steady state solutions, meaning that their probability distributions are stable from year to year. Key Points: SDDP results can be hard to interpret in the presence of multiple near‐optimal solutions A year‐periodic reoptimization method is proposed to solve this issue Limited data availability favors the presence of multiple near‐optimal solutions