Assessing Adaptive Irrigation Impacts on Water Scarcity in Nonstationary Environments—A Multi‐Agent Reinforcement Learning Approach. Issue 9 (20th September 2021)

• Record Type: Journal Article
• Authors: Hung, Fengwei; Yang, Y. C. Ethan
• Is Part Of: Water resources research. Volume 57:Issue 9(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-09-20
• Subjects: coupled human‐nature systems -- agriculture water demands -- machine learning -- water resources -- Colorado River Basin; Hydrology -- Periodicals; 333.91
• DOI: 10.1029/2020WR029262
• Languages: English
• ISSNs: 0043-1397

Abstract

Abstract: One major challenge in water resource management is to balance the uncertain and nonstationary water demands and supplies caused by the changing anthropogenic and hydroclimate conditions. To address this issue, we developed a reinforcement learning agent‐based modeling (RL‐ABM) framework where agents (agriculture water users) are able to learn and adjust water demands based on their interactions with the water systems. The intelligent agents are created by a reinforcement learning algorithm adapted from the Q‐learning algorithm. We illustrated this framework in a case study where the RL‐ABM is two‐way coupled with the Colorado River Simulation System (CRSS), a long‐term planning model used for the administration of the Colorado River Basin, for assessing agriculture water uses impacts on water scarcity. Seventy‐eight intelligent agents are simulated, which can be grouped into three categories based on their parameter values: the "aggressive" (swift actions; low regrets), the "forward‐looking conservative" (mild actions; high regrets; fast learning), and the "myopic conservative" (mild actions; median regrets; slow learning). The ABM‐CRSS results showed that the major reservoirs in the Upper Colorado Basin might experience more frequent water shortages due to the increasing water uses compared to the original CRSS results. If the drought continues, the case study also demonstrates that agents can learn and adjust their demands. Key Points: We create a modeling framework that allows agriculture water users to learn and adapt to institutional and climatic changes This framework enables assessments of the irrigation water consumption impacts on regional water resources management The proposed reinforcement learning algorithm is generalizable for coupled human‐nature systems