An open-source software framework for reinforcement learning-based control of tracked robots in simulated indoor environments. (3rd June 2022)

• Record Type: Journal Article
• Authors: Mitriakov, A.; Papadakis, P.; Garlatti, S.
• Is Part Of: Advanced robotics. Volume 36:Number 11(2022)
• Page Start: 519
• Page End: 532
• Publication Date: 2022-06-03
• Subjects: Reinforcement learning -- robot control -- incremental learning -- domain randomization -- staircase negotiation; Robotics -- Periodicals; Robotics -- Japan -- Periodicals; Robotics; Japan; Periodicals; 629.89205
• DOI: 10.1080/01691864.2022.2076570
• Languages: English
• ISSNs: 0169-1864

Abstract

Abstract : A simulation framework based on the open-source robotic software Gazebo and the Robot Operating System is presented for articulated tracked robots, designed for reinforcement-learning-based (RL) control skill acquisition. In particular, it is destined to serve as a research tool in the development and evaluation of methods in the domain of mobility learning for articulated tracked robots, in 3D indoor environments. Its architecture allows to interchange between different RL libraries and algorithm implementations, while learning can be customized to endow specific properties within a control skill. To demonstrate its utility, we focus on the most demanding case of staircase ascent and descent using depth image data, while respecting safety via reward function shaping and incremental, domain randomization-based, end-to-end learning. GRAPHICAL ABSTRACT: UF0001