A machine learning-based approach for picture acquisition timeslot prediction using defective pixels. (December 2021)

• Record Type: Journal Article
• Authors: Ahmed, Farah Nafees; Khelifi, Fouad; Lawgaly, Ashref; Bouridane, Ahmed
• Is Part Of: Forensic science international. Volume 39(2021)
• Publication Date: 2021-12
• Subjects: Defective pixel detection -- Pixel classification -- Picture acquisition timeslot -- Temporal image forensics -- Defective pixel location -- Machine learning -- Digital evidence
• DOI: 10.1016/j.fsidi.2021.301311
• Languages: English
• ISSNs: 2666-2817

Abstract

Abstract: Estimating the acquisition time of digital photographs is a challenging task in temporal image forensics, but the application is highly demanded for establishing temporal order among individual pieces of evidence and deduce the causal relationship of events in a court case. The forensic investigator needs to identify the timeline of events and look for some patterns to gain a clear overview of activities associated with a crime. This paper aims to explore the presence of defective pixels over time for estimating the acquisition date of digital pictures. We propose a technique to predict the acquisition timeslots of digital pictures using a set of candidate defective pixels in non-overlapping image blocks. First, potential candidate defective pixels are determined through related pixel neighbourhood and two proposed features, called the local variation features to best fit in a machine learning model. The machine learning approach is used to model the temporal behaviour of camera sensor defects in each block using the scores obtained from individually trained pixel defect locations and fused in a majority voting method. Interestingly, timeslot estimation using individual blocks has been shown to be more accurate when virtual sub-classes corresponding to halved timeslots are first considered prior to the reconstruction step. Finally, the last stage of the system consists of the combination of block scores in a second majority voting operation to further enhance performance. Assessed on the NTIF image dataset, the proposed system has been shown to reach very promising results with an estimated accuracy between 88% and 93% and clear superiority over a related state-of-the-art system. Highlights: Acquisition time estimation of digital pictures is a challenging task in temporal image forensics. Forensic investigators need a correct timeline of suspect images to answer the questions during an investigation. Using defective pixel locations, the acquisition timeslots of digital pictures can be predicted. Temporal behavior of defective pixels can be analyzed through machine learning technique.