Extracting human emotions at different places based on facial expressions and spatial clustering analysis. Issue 3 (18th June 2019)

• Record Type: Journal Article
• Authors: Kang, Yuhao; Jia, Qingyuan; Gao, Song; Zeng, Xiaohuan; Wang, Yueyao; Angsuesser, Stephan; Liu, Yu; Ye, Xinyue; Fei, Teng
• Is Part Of: Transactions in GIS. Volume 23:Issue 3(2019)
• Page Start: 450
• Page End: 480
• Publication Date: 2019-06-18
• Subjects: Geographic information systems -- Periodicals; 910.285
• DOI: 10.1111/tgis.12552
• Languages: English
• ISSNs: 1361-1682

Abstract

Abstract: The emergence of big data enables us to evaluate the various human emotions at places from a statistical perspective by applying affective computing. In this study a novel framework for extracting human emotions from large‐scale georeferenced photos at different places is proposed. After the construction of places based on spatial clustering of user‐generated footprints collected from social media websites, online cognitive services are utilized to extract human emotions from facial expressions using state‐of‐the‐art computer vision techniques. Two happiness metrics are defined for measuring the human emotions at different places. To validate the feasibility of the framework, we take 80 tourist attractions around the world as an example and a happiness ranking list of places is generated based on human emotions calculated over 2 million faces detected from greater than 6 million photos. Different kinds of geographical contexts are taken into consideration to find out the relationship between human emotions and environmental factors. Results show that much of the emotional variation at different places can be explained by a few factors such as openness. The research offers insights into integrating human emotions to enrich the understanding of sense of place in geography and in place‐based GIS.