A distributed big data analytics model for people re-identification based dimensionality reduction. (20th November 2021)

• Record Type: Journal Article
• Authors: Ez-Zahout, Abderrahmane
• Is Part Of: International journal of high performance systems architecture. Volume 10:Number 2(2021)
• Page Start: 57
• Page End: 63
• Publication Date: 2021-11-20
• Subjects: SparkMlLib -- re-identification -- ROI -- regions of interest -- features similarity -- Kmeans -- Minkowski distance -- CMC -- cumulative match curve -- CDF -- cumulative distribution function -- PCA -- principal component analysis; Computer architecture -- Periodicals; Computer systems -- Periodicals; High performance computing -- Periodicals; 004.205
• Languages: English
• ISSNs: 1751-6528

Abstract

Big data analytics is a vast domain includes intelligent processing systems. Intelligent video surveillance generates a huge volume of data; and unstructured data requires fast processing speed. In big data analytics, most of the data involved in the processing comes from closed-circuit television (CCTV) are unstructured. Therefore, a very big volume of data requires an efficient and advanced processing. Those systems operate on four phases, detection, tracking, profile analysis and re-identification. In this work, re-identification is based real time dimensionality reduction with SparkMlLib library to speed up the feature's extraction. Practically, Minkowski distance and Kmeans algorithms are used for this issue. Therefore, to improve the effectiveness of our model, principal component analysis (PCA), cumulative match curve (CMC) and cumulative distribution function (CDF) have been used. These functions measure the re-identification errors and provide more re-identification in real time context.