Programming models and systems for Big Data analysis. Issue 6 (2nd November 2019)

• Record Type: Journal Article
• Authors: Belcastro, Loris; Marozzo, Fabrizio; Talia, Domenico
• Is Part Of: International journal of parallel, emergent and distributed systems. Volume 34:Issue 6(2019)
• Page Start: 632
• Page End: 652
• Publication Date: 2019-11-02
• Subjects: Parallel programming models -- programming systems -- Big Data analysis -- cloud computing -- programming frameworks -- MapReduce -- directed acyclic graph -- message passing -- bulk synchronous parallel -- workflow -- SQL-like; Parallel computers -- Periodicals; Electronic data processing -- Distributed processing -- Periodicals; Computer algorithms -- Periodicals; 004.35
• DOI: 10.1080/17445760.2017.1422501
• Languages: English
• ISSNs: 1744-5760

Abstract

ABSTRACT: Big Data analysis refers to advanced and efficient data mining and machine learning techniques applied to large amount of data. Research work and results in the area of Big Data analysis are continuously rising, and more and more new and efficient architectures, programming models, systems, and data mining algorithms are proposed. Taking into account the most popular programming models for Big Data analysis (MapReduce, Directed Acyclic Graph, Message Passing, Bulk Synchronous Parallel, Workflow and SQL-like), we analysed the features of the main systems implementing them. Such systems are compared using four classification criteria (i.e. level of abstraction, type of parallelism, infrastructure scale and classes of applications) for helping developers and users to identify and select the best solution according to their skills, hardware availability, productivity and application needs. GRAPHICAL ABSTRACT: This figure is a word cloud highlighting the most popular words related to Big Data analysis.