A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning. (October 2022)

• Record Type: Journal Article
• Authors: Jiang, Yingying; Mao, Yuxuan; Wu, Gaoxiang; Cai, Zhenhua; Hao, Yixue
• Is Part Of: Computers & electrical engineering. Volume 103(2022)
• Publication Date: 2022-10
• Subjects: MEC -- Task offloading -- Resource allocation -- MADRL; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2022.108278
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: With the emergence of mobile edge computing (MEC), the edge cloud with certain computing power is deployed closer to the mobile device, which can well solve the computing and delay requirements of the mobile device. In 5G ultra-dense heterogeneous networks, where the macro base station (MBS) and multiple dense small base stations (SBS) are deployed in the region, the offloading decision faces multiple choices. In order to solve the problem of computing offloading and resource allocation in 5G ultra-dense heterogeneous networks, we propose a collaborative optimization strategy based on multi-agent deep reinforcement learning (MADRL). At each time, the mobile device only needs to make the optimal offloading decision according to its own historical offloading decision, the allocated bandwidth and computing resources at the past time, as well as the service response delay and energy consumption at the past time, without knowing other user information and dynamic network environment information. Simulation results show that the proposed collaborative optimization strategy is better than the other three baseline schemes in terms of service response delay and energy consumption performance. Graphical abstract: Highlights: A joint optimization strategy of task offloading and resource allocation for 5G ultra-dense networks is proposed. The offloading decision of mobile devices is made based on MAPPO. The heterogeneous edge clouds realize the allocation of bandwidth and computing resources based on convex optimization.