A Deep Q-Network for robotic odor/gas source localization: Modeling, measurement and comparative study. (October 2021)

• Record Type: Journal Article
• Authors: Chen, Xinxing; Fu, Chenglong; Huang, Jian
• Is Part Of: Measurement. Volume 183(2021)
• Publication Date: 2021-10
• Subjects: Olfactory robot -- Odor source localization -- Deep Q-Network -- Obstacle avoidance -- Action policy; Weights and measures -- Periodicals; Measurement -- Periodicals; Measurement; Weights and measures; Periodicals; 530.8
• DOI: 10.1016/j.measurement.2021.109725
• Languages: English
• ISSNs: 0263-2241

Abstract

Highlights: An odor hits distribution model was proposed. A Deep Q-Network robotic odor/gas source localization method was proposed. The proposed method helps locate odor/gas sources in various indoor environments. Abstract: Robotic odor/gas source localization is a widely studied field, but most of the existing works are about rule-based algorithms. In this paper, the Deep Q-Network algorithm is applied to solve the odor source localization problem. An odor hits distribution model is proposed to model the odor concentration distribution in indoor environments, taking the dispersion by airflow, the odor molecular random walk, and the obstacles into account. The Deep Q-Network takes the stacked historic measurement data as the input and outputs the expected cumulative future reward of actions of the robots. The network is trained through 35, 000 repeated episodes of random odor source localization tasks. The Deep Q-Network method is evaluated under four different environment settings in a simplified simulator and compared with two widely used odor source localization algorithms. The evaluation results demonstrate the advantages of the proposed algorithm. The algorithm is also validated in more complex indoor environments.