CrowdPulse: A framework for real-time semantic analysis of social streams. (December 2015)

• Record Type: Journal Article
• Authors: Musto, Cataldo; Semeraro, Giovanni; Lops, Pasquale; Gemmis, Marco de
• Is Part Of: Information systems. Volume 54(2015)
• Page Start: 127
• Page End: 146
• Publication Date: 2015-12
• Subjects: Smart cities -- Social networks -- Text analytics -- Sentiment analysis -- Semantics; Database management -- Periodicals; Electronic data processing -- Periodicals; Bases de données -- Gestion -- Périodiques; Informatique -- Périodiques; Database management; Electronic data processing; Periodicals; 005.7
• DOI: 10.1016/j.is.2015.06.007
• Languages: English
• ISSNs: 0306-4379

Abstract

Abstract: The recent huge availability of data coming from mobile phones, social networks and urban sensors leads research scientists to new opportunities and challenges. For example, mining micro-blogs content to unveil latent information about people sentiment and opinions is drawing more and more attention, since it can improve the understanding of complex phenomena and paves the way to the development of new innovative and intelligent services. In this paper we present CrowdPulse, a domain-agnostic framework for text analytics of social streams. The framework extracts textual data from social networks and implements algorithms for semantic processing, sentiment analysis and classification of gathered data. The framework has been deployed in two real-world scenarios in order to identify the most at-risk areas of the Italian territory according to the content posted on social networks and to monitor the recovering state of the social capital of L׳Aquila׳s city after the dreadful earthquake of April 2009 1, respectively. In both scenarios, the framework showed its effectiveness and confirmed the insight that the combination of technologies specifically designed for Big Data processing with state-of-the-art methodologies for semantic analysis of textual content can provide very interesting findings and permits the analysis of such phenomena in a totally new way. Abstract : Highlights: We propose a domain-agnostic modular framework for real-time processing of social streams of human-generated data. We introduce a pipeline based on state-of-the-art methodologies for semantic processing and sentiment analysis of textual content. We show the application of our framework in two real-world use case scenarios. We evaluate the effectiveness of the framework with two experiments based on realworld data.