Personness estimation for real-time human detection on mobile devices. (15th April 2017)

• Record Type: Journal Article
• Authors: Kim, Kyuwon; Oh, Changjae; Sohn, Kwanghoon
• Is Part Of: Expert systems with applications. Volume 72(2017)
• Page Start: 130
• Page End: 138
• Publication Date: 2017-04-15
• Subjects: Human detection -- Detection proposals -- Normed gradients -- Color attributes -- Deformable part-based model; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2016.12.017
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: A fast and accurate detection proposal method for the person category is proposed. Detection proposals are used by the part-based human detector in a improved way. High effectiveness of the proposed method is demonstrated on a real mobile device. Abstract: One aim of detection proposal methods is to reduce the computational overhead of object detection. However, most of the existing methods have significant computational overhead for real-time detection on mobile devices. A fast and accurate proposal method of human detection called personness estimation is proposed, which facilitates real-time human detection on mobile devices and can be effectively integrated into part-based detection, achieving high detection performance at a low computational cost. Our work is based on two observations: (i) normed gradients, which are designed for generic objectness estimation, effectively generate high-quality detection proposals for the person category; (ii) fusing the normed gradients with color attributes improves the performance of proposal generation for human detection. Thus, the candidate windows generated by the personness estimation will very likely contain human subjects. The human detection is then guided by the candidate windows, offering high detection performance even when the detection task terminates prior to completion. This interruptible detection scheme, called anytime detection, enables real-time human detection on mobile devices. Furthermore, we introduce a new evaluation methodology called time-recall curves to practically evaluate our approach. The applicability of our proposed method is demonstrated in extensive experiments on a publicly available dataset and a real mobile device, facilitating acquisition and enhancement of portrait photographs (e.g. selfie) on widespread mobile platforms.