Shape and Pose Estimation for Closely Interacting Persons Using Multi‐view Images. (24th October 2018)

• Record Type: Journal Article
• Authors: Li, Kun; Jiao, Nianhong; Liu, Yebin; Wang, Yangang; Yang, Jingyu
• Is Part Of: Computer graphics forum. Volume 37:Number 7(2018)
• Page Start: 361
• Page End: 371
• Publication Date: 2018-10-24
• Subjects: Categories and Subject Descriptors (according to ACM CCS): I.4.8 [Computer Graphics]: Scene Analysis—Shape, Motion; Computer graphics -- Periodicals; 006.605
• DOI: 10.1111/cgf.13574
• Languages: English
• ISSNs: 0167-7055

Abstract

Abstract: Multi‐person pose and shape estimation is very challenging, especially when the persons have close interactions. Existing methods only work well when people are well spaced out in the captured images. However, close interaction among people is very common in real life, which is more challenge due to complex articulation, frequent occlusion and inherent ambiguities. We present a fully‐automatic markerless motion capture method to simultaneously estimate 3D poses and shapes of closely interacting people from multi‐view sequences. We first predict the 2D joints for each person in an image, and then design a spatio‐temporal tracker for multi‐person pose tracking based on multi‐view videos. Finally, we estimate 3D poses and shapes of all the persons with multi‐view constraints using a skinned multi‐person linear model (SMPL). Experimental results demonstrate that our method achieves fast but accurate pose and shape estimation results for multi‐person close interaction cases. Compared with existing methods, our method does not need pre‐segmentation for each person and manual intervention, which greatly reduces the complexity of the system including time complexity and system processing complexity.