Decentralised demand response market model based on reinforcement learning. Issue 5 (15th September 2020)

• Record Type: Journal Article
• Authors: Shafie‐Khah, Miadreza; Talari, Saber; Wang, Fei; Catalão, João P.S.
• Is Part Of: IET smart grid. Volume 3:Issue 5(2020)
• Page Start: 713
• Page End: 721
• Publication Date: 2020-09-15
• Subjects: pricing -- demand side management -- power markets -- learning (artificial intelligence); aggregation‐based model -- decentralised model -- decentralised demand response market model -- bi‐directional communications -- reinforcement learning -- Q‐learning -- local DR market clearing price -- local markets -- decentralised DR market model -- electricity cost -- system operator; Smart power grids -- Periodicals; Computer science -- Periodicals; Energy industries -- Periodicals; Broadcasting -- Periodicals; 333.79110285
• DOI: 10.1049/iet-stg.2019.0129
• Languages: English
• ISSNs: 2515-2947

Abstract

Abstract : A new decentralised demand response (DR) model relying on bi‐directional communications is developed in this study. In this model, each user is considered as an agent that submits its bids according to the consumption urgency and a set of parameters defined by a reinforcement learning algorithm called Q‐learning. The bids are sent to a local DR market, which is responsible for communicating all bids to the wholesale market and the system operator (SO), reporting to the customers after determining the local DR market clearing price. From local markets' viewpoint, the goal is to maximise social welfare. Four DR levels are considered to evaluate the effect of different DR portions in the cost of the electricity purchase. The outcomes are compared with the ones achieved from a centralised approach (aggregation‐based model) as well as an uncontrolled method. Numerical studies prove that the proposed decentralised model remarkably drops the electricity cost compare to the uncontrolled method, being nearly as optimal as a centralised approach.