Deep learning can generate traditional retinal fundus photographs using ultra-widefield images via generative adversarial networks. (December 2020)

• Record Type: Journal Article
• Authors: Yoo, Tae Keun; Ryu, Ik Hee; Kim, Jin Kuk; Lee, In Sik; Kim, Jung Sub; Kim, Hong Kyu; Choi, Joon Yul
• Is Part Of: Computer methods and programs in biomedicine. Volume 197(2020)
• Publication Date: 2020-12
• Subjects: Fundus photography -- Ultra-widefield -- Deep learning -- Generative adversarial networks -- CycleGAN; Medicine -- Computer programs -- Periodicals; Biology -- Computer programs -- Periodicals; Computers -- Periodicals; Medicine -- Periodicals; Médecine -- Logiciels -- Périodiques; Biologie -- Logiciels -- Périodiques; Biology -- Computer programs; Medicine -- Computer programs; Periodicals; Electronic journals; 610.28
• DOI: 10.1016/j.cmpb.2020.105761
• Languages: English
• ISSNs: 0169-2607

Abstract

Highlights: A deep learning-based domain transfer from ultra-widefield to traditional retinal fundus photography. The CycleGAN successfully translated ultra-widefield into traditional fundus photography. It might be useful for researchers in integrating two different domain databases. This is likely to save scan time by avoiding additional examinations for an accurate diagnosis. Abstract: Background and objective: Retinal imaging has two major modalities, traditional fundus photography (TFP) and ultra-widefield fundus photography (UWFP). This study demonstrates the feasibility of a state-of-the-art deep learning-based domain transfer from UWFP to TFP. Methods: A cycle-consistent generative adversarial network (CycleGAN) was used to automatically translate the UWFP to the TFP domain. The model was based on an unpaired dataset including anonymized 451 UWFP and 745 TFP images. To apply CycleGAN to an independent dataset, we randomly divided the data into training (90%) and test (10%) datasets. After automated image registration and masking dark frames, the generator and discriminator networks were trained. Additional twelve publicly available paired TFP and UWFP images were used to calculate the intensity histograms and structural similarity (SSIM) indices. Results: We observed that all UWFP images were successfully translated into TFP-style images by CycleGAN, and the main structural information of the retina and optic nerve was retained. The model did not generate fake features in the output images. Average histograms demonstrated that the intensity distribution of the generated output images provided a good match to the ground truth images, with an average SSIM level of 0.802. Conclusions: Our approach enables automated synthesis of TFP images directly from UWFP without a manual pre-conditioning process. The generated TFP images might be useful for clinicians in investigating posterior pole and for researchers in integrating TFP and UWFP databases. This is also likely to save scan time and will be more cost-effective for patients by avoiding additional examinations for an accurate diagnosis. Graphical abstract: Image, graphical abstract