Aligning individual and collective welfare in complex socio-technical systems by combining metaheuristics and reinforcement learning. (March 2019)

• Record Type: Journal Article
• Authors: Bazzan, Ana L.C.
• Is Part Of: Engineering applications of artificial intelligence. Volume 79(2019)
• Page Start: 23
• Page End: 33
• Publication Date: 2019-03
• Subjects: Complex systems -- Socio-technical systems -- Multiagent systems -- Multiagent reinforcement learning -- Metaheuristics -- Load balance -- Route choice -- Selfish routing; Engineering -- Data processing -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Ingénierie -- Informatique -- Périodiques; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; Artificial intelligence; Engineering -- Data processing; Expert systems (Computer science); Periodicals; 620.00285
• DOI: 10.1016/j.engappai.2018.12.003
• Languages: English
• ISSNs: 0952-1976

Abstract

Abstract: In complex socio-technical systems it is not easy to find a balance between the welfare state (i.e., a state where the overall performance of a system is optimal) and a situation in which individual components act selfishly to optimize their own utilities. This is even harder when individuals compete for scarce resources. In order to deal with this, some forms of biasing the optimization process have been proposed. However, mostly, such approaches only work for cooperative scenarios. When resources are scarce, the components of the system compete for them, thus approaches designed for cooperative systems are not necessarily appropriate. In the present paper an approach is proposed, which is based on a synergy between: (i) a global optimization process in which the system authority employs metaheuristics, and (ii) reinforcement learning processes that run at each component or agent. Both the agents and the system authority exchange solutions that are incorporated by the other party. The contributions of the proposed approach are twofold: a general scheme for such synergy is given and its benefits are shown in scenarios related to selfish routing, a typical load balance problem in a complex socio-technical system. Highlights: A synergy between metaheuristics and reinforcement learning is proposed. Useful when aligning the social (system) and individuals optima. An application to selfish routing (various traffic networks) is shown as illustration of the general approach. Travel time in road networks reduced by biasing individuals' (agents') decision-making.