A Non-Blind Deconvolution Semi Pipelined Approach to Understand Text in Blurry Natural Images for Edge Intelligence. Issue 6 (November 2021)

• Record Type: Journal Article
• Authors: Ansari, Ghulam Jillani; Shah, Jamal Hussain; Khan, Muhammad Attique; Sharif, Muhammad; Tariq, Usman; Akram, Tallha
• Is Part Of: Information processing & management. Volume 58:Issue 6(2021)
• Publication Date: 2021-11
• Subjects: Synthetic blur -- Non-blind deconvolution -- Edge Intelligence -- 2D Radix-4 DIT; Information storage and retrieval systems -- Periodicals; Information science -- Periodicals; Systèmes d'information -- Périodiques; Sciences de l'information -- Périodiques; Information science; Information storage and retrieval systems; Periodicals; 658.4038
• DOI: 10.1016/j.ipm.2021.102675
• Languages: English
• ISSNs: 0306-4573

Abstract

Highlights: The text images are synthetically blurred as per degradation model described above to generate blurry dataset. To recover a clear text image from blurry dataset, a non-blind deconvolution approach is adapted. Text localization and edge-based connected component text extraction is proposed. Separate foreground from background followed by proposed CL-CNN for deep feature extraction. Classification of recovered images into text class and non-text class from unseen data. Abstract: Text understanding from natural scene images has progressively gained much interest in computer vision due to the frequent emergence of handheld or wearable devices. Sometimes, these devices capture low-quality images. As a result, the image can be disrupted with unpredictable blur caused by text movement and camera shake. Further, the problem is integrated with edge intelligence, an emerging paradigm that drives the computing services, applications, and tasks from mainstream cloud to network edge. The purpose is to minimize the bandwidth cost and latency and improves privacy. Hence, this research introduces a novel semi pipelined technique to address such challenging issue for edge intelligence. The fundamental contributions of this work are as given: (i) after text image enhancement, the natural text images are blurred to create a synthetic dataset; (ii) we introduced image-based 2D Radix-4 DIT FFT and the inverse to deblur the blurred images; (iii) after that, text understanding process is applied on the recovered images. Firstly, the text localization and segmentation are taken out using a novel open contour and 4-connected edge-based region approach. Secondly, the recovered images are classified into text and non-text classes adopting multimodal feature representation. Thirdly, Character Labeling Convolution Neural Network (CL-CNN) model is introduced for character labeling by extracting deep features to work fine on discriminative and ambiguous text. Finally, the experiments validated that the proposed framework achieved promising results on ICDAR 2003, SVT, and IIIT5K compared with standard techniques substantially and from blur images efficiently and flexibly.