Big Data Visualization Collaborative Filtering Algorithm Based on RHadoop. (4th October 2015)

• Record Type: Journal Article
• Authors: Cai, Lijun; Guan, Xiangqing; Chi, Peng; Chen, Lei; Luo, Jianting
• Is Part Of: International journal of distributed sensor networks. Volume 11:Number 10(2015)
• Publication Date: 2015-10-04
• Subjects: Sensor networks -- Periodicals; Intelligent agents (Computer software) -- Periodicals; Multisensor data fusion -- Periodicals; 681.2
• DOI: 10.1155/2015/271253
• Languages: English
• ISSNs: 1550-1329

Abstract

With the rapid growth of various data, it is becoming increasingly important to extract useful information from big data. While the analysis tools of big data visualization is very rare, in this paper, we propose a new big data visualization algorithm analysis integrated model. The model integrates the processing of big data and the visualization of data as a whole. It is a good analysis tool of timely big data visualization. We use hadoop_1.X as the data storage and use R as the compiler environment in the model. If you are skilled in R, it is easy to design kinds of paralleling algorithms, and analyze and process the kinds of big data. Secondly we design and implement a paralleled collaborative filtering algorithm with the model. Finally we analyze the various performance indicators with kinds of experiments. The indicators show that the model has good scalability and easy operability, and contains all the advantages of Map Reduce. In conclusion, the big data visualization algorithm analysis integrated model has high performance to process and visualize the big data.