Big Data technologies to process spatial and attribute data when designing and operating mine-engineering systems. (3rd July 2019)

• Record Type: Journal Article
• Authors: Stepanov, Yuri A.; Stepanov, Alexander V.
• Is Part Of: International journal of image and data fusion. Volume 10:Number 3(2019)
• Page Start: 217
• Page End: 231
• Publication Date: 2019-07-03
• Subjects: BigData tools -- database -- database management system (DBMS) -- data search -- unstructured data; Image processing -- Periodicals; Multisensor data fusion -- Periodicals; Multisensor data fusion; Periodicals; 621.36705
• DOI: 10.1080/19479832.2019.1625448
• Languages: English
• ISSNs: 1947-9832

Abstract

ABSTRACT: A myriad of spatial and attribute data are in use when designing and operating mine-engineering systems. These data are hosted on various servers of a company and are diverse in structure of data and units of measurement and have different subject areas related to each other in a complex way. There is no conformity between conventional systems for managing and storing data and tools for analysing incoming data. Big Data paradigm that implies methods for processing distributed data is utilised in 'big data' processing. A MapReduce method involves two procedures: map procedure that applies a proper function to each element of the list and reduce procedure, integrating the map procedure results. Such conventional database management system methods as integration and indexation, graph search and other methods are used to cluster big data. These methods should be used within MapReduce . Employing standard equipment and means to control a distributed Hadoop and Apache Hadoop Distributed File System (HDFS) file system, data storages in petabytes can be implemented. To make a more in-depth analysis, Data Mining methods are utilised along with network analysis, predictive analytics, etc. The articlecovers various methods applied to collect and analyse 'big data' to do a feasibility study and design mine and engineering systems.