Multi-Cue Gate-Shift Networks for Mouse Behavior Recognition. Issue 1 (31st December 2022)

• Record Type: Journal Article
• Authors: Shen, Longfeng; Jian, Yulei; Chen, Debao; Ge, Fangzheng; Gao, Xiangjun; Liu, Huaiyu; Meng, Qianqian; Zhang, Yingjie; Xu, Chengzhen
• Is Part Of: Applied artificial intelligence. Volume 36:Issue 1(2022)
• Publication Date: 2022-12-31
• Subjects: Artificial intelligence -- Periodicals; 006.3
• DOI: 10.1080/08839514.2022.2151680
• Languages: English
• ISSNs: 0883-9514

Abstract

ABSTRACT: Automatic identification of mouse behavior plays an important role in the study of disease or treatment, especially regarding the short-term action of mice. Existing three-dimensional (3D) convolutional neural networks (CNNs) and two-dimensional (2D) CNNs have different limitations when addressing the task of mouse behavior recognition. For instance, 3D CNNs require a large calculation cost, while 2D CNNs cannot capture motion information. To solve these problems, a low-computational and efficient multi-cue gate-shift network (MGSN) was developed. First, to capture motion information, a multi-cue feature switching module (MFSM) was designed to utilize RGB and motion information. Second, an adaptive feature fusion module (AFFM) was designed to adaptively fuse the features. Third, we used a 2D network to reduce the amount of computation. Finally, we performed an extensive evaluation of the proposed module to study its effectiveness in mouse behavior recognition, achieving state-of-the-art accuracy results using the Jiang database, and comparable results using the Jhuang database. An absolute improvement of +5.41% over the benchmark gate-shift module was achieved using the Jiang database.