Reinforcement learning‐based negotiation for spectrum micro‐trading framework. Issue 6 (1st November 2018)

• Record Type: Journal Article
• Authors: Paul, Ayan; Mukherjee, Devodyuti; Maitra, Madhubanti
• Is Part Of: IET networks. Volume 7:Issue 6(2018)
• Page Start: 435
• Page End: 444
• Publication Date: 2018-11-01
• Subjects: learning (artificial intelligence) -- wireless channels -- radio spectrum management -- Bayes methods -- telecommunication computing; multiissue bilateral negotiation problem -- Bayesian learning‐based negotiation method -- channel configuration -- static negotiation technique -- spectrum microtrading framework -- wireless markets -- spectrum trading framework -- wireless service provider -- WSP -- base station -- reinforcement learning‐based negotiation process -- BS -- BLBN method -- RLBN method; Computer network architectures -- Periodicals; Computer network protocols -- Periodicals; Information networks -- Periodicals; Telecommunication systems -- Periodicals; 004.605
• DOI: 10.1049/iet-net.2018.5052
• Languages: English
• ISSNs: 2047-4954

Abstract

Abstract : Spectrum trading has been permitted in most of the major wireless markets to facilitate better utilisation of spectrum. The authors have considered a spectrum trading framework in which a wireless service provider (WSP) leases its available channel(s) to another WSP for use at the designated base station (BS) of the latter for short duration. In their model, the agents of WSPs carry out the negotiation on the specifications of the channel usage such as transmission power, antenna height, spectrum band of the channel and price of the channel. In this work, they have modelled the negotiation as a multi‐issue bilateral negotiation problem. Initially, they have solved the problem with the help of the Bayesian learning‐based negotiation (BLBN) method. Furthermore, they have devised the novel reinforcement learning‐based technique namely, reinforcement learning‐based negotiation (RLBN) considering the adaptability of the BS to the new channel configuration. Surplus utility and convergence time of the negotiation process are considered as performance indices for the above techniques. The simulation results show that the RLBN outperforms BLBN and static negotiation technique as far as the objective of surplus utility is concerned.