Twinned Residual Auto-Encoder (TRAE)—A new DL architecture for denoising super-resolution and task-aware feature learning from COVID-19 CT images. (1st September 2023)

• Record Type: Journal Article
• Authors: Baccarelli, Enzo; Scarpiniti, Michele; Momenzadeh, Alireza
• Is Part Of: Expert systems with applications. Volume 225(2023)
• Publication Date: 2023-09-01
• Subjects: Twinned Residual Auto-Encoder (TRAE) -- Single-Image Super-Resolution (SISR) -- Task-awareness -- Transfer learning -- Feature-aided SISR -- Noise reduction; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2023.120104
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: The detection of the COronaVIrus Disease 2019 (COVID-19) from Computed Tomography (CT) scans has become a very important task in modern medical diagnosis. Unfortunately, typical resolutions of state-of-the-art CT scans are still not adequate for reliable and accurate automatic detection of COVID-19 disease. Motivated by this consideration, in this paper, we propose a novel architecture that jointly affords the Single-Image Super-Resolution (SISR) and the reliable classification problems from Low Resolution (LR) and noisy CT scans. Specifically, the proposed architecture is based on a couple of Twinned Residual Auto-Encoders (TRAE), which exploits the feature vectors and the SR images recovered by a Master AE for performing transfer learning and then improves the training of a "twinned" Follower AE. In addition, we also develop a Task-Aware (TA) version of the basic TRAE architecture, namely the TA-TRAE, which further utilizes the set of feature vectors generated by the Follower AE for the joint training of an additional auxiliary classifier, so to perform automated medical diagnosis on the basis of the available LR input images without human support. Experimental results and comparisons with a number of state-of-the-art CNN/GAN/CycleGAN benchmark SISR architectures, performed by considering × 2, × 4, and × 8 super-resolution (i.e., upscaling) factors, support the effectiveness of the proposed TRAE/TA-TRAE architectures. In particular, the detection accuracy attained by the proposed architectures outperforms the corresponding ones of the implemented CNN, GAN and CycleGAN baselines up to 9.0%, 6.5%, and 6.0% at upscaling factors as high as × 8 . Highlights: High-performance automatic COVID-19 disease detection. Twinned Residual Auto-Encoders for CT scans classification and super-resolution. Task-aware architecture for joint CT scans classification and super-resolution.