An effective swimming stroke recognition system utilizing deep learning based on inertial measurement units. (3rd April 2023)

• Record Type: Journal Article
• Authors: Chen, Longwen; Hu, Dean
• Is Part Of: Advanced robotics. Volume 37:Number 7(2023)
• Page Start: 467
• Page End: 479
• Publication Date: 2023-04-03
• Subjects: Swimming stroke recognition -- inertial measurement unit -- deep convolutional neural network -- bidirectional long short-term memory; Robotics -- Periodicals; Robotics -- Japan -- Periodicals; Robotics; Japan; Periodicals; 629.89205
• DOI: 10.1080/01691864.2022.2160274
• Languages: English
• ISSNs: 0169-1864

Abstract

Abstract : Machine learning (ML) and deep learning (DL) techniques have been applied to activity recognition in sports such as swimming with the help of inertial measurement units (IMU). In this study, we propose a DL-based swimming stroke recognition (SSR) system that can be used for swimming power-assisted exoskeletons by applying IMUs. The data of four swimming strokes are collected by 10 IMUs placed on the back, lumbar, upper limbs and lower limbs of swimmers. A Deep Convolutional Neural and Bidirectional Long Short-Term Memory network (DCNN-BiLSTM) is proposed for SSR and achieves a balanced accuracy of 96.27%. Then, the SSR system is optimized by selecting the quantity and layout of IMUs on the basis of an acceptable SSR accuracy with DCNN-BiLSTM in order to reduce the influence of IMUs on swimming. The optimized SSR system still has a balanced SSR accuracy of 93.44% while only applying two IMUs. Finally, two extra swimmers are invited to validate the optimized SSR system and receive a balanced accuracy of 92.67% and 92.94%. Although the results of this study, we can conclude that the proposed DCNN-BiLSTM can effectively recognize four target swimming strokes from different swimmers, which means that our system can be applied to exoskeletons. GRAPHICAL ABSTRACT: UF0001