A practical heterogeneous network optimisation algorithm based on reinforcement learning. (6th June 2011)

• Record Type: Journal Article
• Authors: Feng, Zhiyong; Tan, Li; Li, Wei; Gulliver, T. Aaron; , Litao Liang
• Is Part Of: International journal of communication networks and distributed systems. Volume 6:Number 4(2011)
• Page Start: 357
• Page End: 372
• Publication Date: 2011-06-06
• Subjects: reconfigurable systems -- Q-learning -- reinforcement learning -- multi-agent systems -- agent-based systems -- self-optimisation -- universal mobile telecommunications -- UMTS -- wireless LANs -- local area networks -- WLAN -- network optimisation -- system blocking rate -- network revenue; Computer networks -- Periodicals; Telecommunication systems -- Periodicals; Electronic data processing -- Distributed processing -- Periodicals; 004.6
• Languages: English
• ISSNs: 1754-3916

Abstract

Owing to the increasing and diversifying service requirements of wireless communications, wireless networks must coexist with heterogeneous radio systems. To realise the interconnection between different networks, it is important for the radio access network elements, such as the cellular network base stations (BSs) and the wireless local area network (WLAN) access points (APs) to be reconfigurable based on the real-time network environment. In this paper, we propose an efficient distributed reconfiguration algorithm for heterogeneous networks: the dynamic network self-optimisation algorithm (DNSA). This algorithm is based on the Q-learning algorithm and the self-optimisation of each network entity acting as independent agents. In the proposed algorithm, multiple agents perform the optimisation cooperatively to reduce the system blocking rate and improve network revenue. The dynamic network self-optimisation problem is transformed into a multiple-agent reinforcement learning problem which has much lower complexity and better performance.