Investigations on optimizing performance of the distributed computing in heterogeneous environment using machine learning technique for large scale data set. (2023)

• Record Type: Journal Article
• Authors: Pandey, Rajeev; Silakari, Sanjay
• Is Part Of: Materials today. Volume 80:Part 3(2023)
• Page Start: 2976
• Page End: 2982
• Publication Date: 2023
• Subjects: Machine learning -- Heterogeneous -- Data mining -- Big data -- Optimization -- Distributed computing; Materials science -- Congresses -- Periodicals; 620.1
• DOI: 10.1016/j.matpr.2021.07.089
• Languages: English
• ISSNs: 2214-7853

Abstract

Abstract: Enforcing admired machine learning approaches to huge data enhanced novel issues for researchers. Conventional libraries could not suitably fulfil the requirement of complex model with wide variety of data and system parameters. Therefore new methodologies are required performing the computation on more than one machine over distributed environment. Some distributed frameworks on huge data such as MapReduce and TensorFlow have been deployed to solve various machine learning problems in heterogeneous distributed environment. The objective of this paper is providing a wide variety of useful information about platforms, approaches, problems, datasets, and optimization approaches in distributed systems. So researchers have been used the beneficial information to develop new approaches for efficient machine learning. This paper also covers the various formats of data like structured, semi structured and unstructured big data. A brief review of previous works is also represented in text and tabular format to provide motivation to the researchers for developing new paradigm of distributed computing environment.