Applying spark based machine learning model on streaming big data for health status prediction. (January 2018)

• Record Type: Journal Article
• Authors: Nair, Lekha R.; Shetty, Sujala D.; Shetty, Siddhanth D.
• Is Part Of: Computers & electrical engineering. Volume 65(2018)
• Page Start: 393
• Page End: 399
• Publication Date: 2018-01
• Subjects: Big data machine learning -- Streaming data processing -- Tweet processing -- Apache spark -- Health informatics; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2017.03.009
• Languages: English
• ISSNs: 0045-7906

Abstract

Highlights: Real-time health status prediction system and the user communicate via Twitter. Tweet streams are processed and health attributes extracted using Apache Spark. Machine learning model applied on streaming data to predict health status. Predicted health status is sent back as a direct message to the user. Successfully deployed and tested the system in Amazon Elastic Compute Cloud. Abstract: Machine learning is one of the driving forces of science and commerce, but the proliferation of Big Data demands paradigm shifts from traditional methods in the application of machine learning techniques on this voluminous data having varying velocity. With the availability of large health care datasets and progressions in machine learning techniques, computers are now well equipped in diagnosing many health issues. This work aims at developing a real time remote health status prediction system built around open source Big Data processing engine, the Apache Spark, deployed in the cloud which focus on applying machine learning model on streaming Big Data. In this scalable system, the user tweets his health attributes and the application receives the same in real time, extracts the attributes and applies machine learning model to predict user's health status which is then directly messaged to him/her instantly for taking appropriate action. Graphical abstract: