Continuous shared control in prosthetic hand grasp tasks by Deep Deterministic Policy Gradient with Hindsight Experience Replay. (24th August 2020)

• Record Type: Journal Article
• Authors: Gao, Zhaolong; Tang, Rongyu; Chen, Luyao; Huang, Qiang; He, Jiping
• Is Part Of: International journal of advanced robotic systems. Volume 17:Number 4(2020:Jul./Aug.)
• Publication Date: 2020-08-24
• Subjects: Shared control -- reinforcement learning -- adaptive dynamic programming prosthetic hand -- telerobotics; Robotics -- Periodicals; Robotics; Periodicals; 629.892
• DOI: 10.1177/1729881420936851
• Languages: English
• ISSNs: 1729-8806

Abstract

Grasp using a prosthetic hand in real life can be a difficult task. The amputee users are often capable of planning the reaching trajectory and hand grasp location selection, however, failed in precise finger movements, such as adapting the fingers to the surface of the object without excessive force. It is much efficient to leave that part to the machine autonomy. In order to combine the intention and planning ability of users with robotic control, the shared control is introduced in which users' inputs and robot control methods are combined to achieve a goal. The shared control problem can be formulated as a Partially Observable Markov Decision Process. To find the optimal control policy, we adopt an adaptive dynamic programming and reinforcement learning-based control algorithm-Deep Deterministic Policy Gradient combined with Hindsight Experience Replay. We proposed the algorithm with a prediction layer using the reparameterization technique. The system was tested in a modified simulation environment for the ability to follow the user's intention and keep the contact force in boundary for safety.