Pitfalls in training and validation of deep learning systems. (June 2021)

• Record Type: Journal Article
• Authors: Eelbode, Tom; Sinonquel, Pieter; Maes, Frederik; Bisschops, Raf
• Is Part Of: Best practice & research. Volume 52/53(2021)
• Publication Date: 2021-06
• Subjects: Deep learning -- Supervised machine learning -- Reproducibility of results -- Benchmarking; Gastroenterology -- Periodicals; Gastrointestinal system -- Diseases -- Periodicals; Gastrointestinal Diseases; Gastroenterology; Klinische geneeskunde; Gastro-enterologie; Gastroenterology; Gastrointestinal system -- Diseases; Periodicals; 616.33005
• DOI: 10.1016/j.bpg.2020.101712
• Languages: English
• ISSNs: 1521-6918

Abstract

Abstract: The number of publications in endoscopic journals that present deep learning applications has risen tremendously over the past years. Deep learning has shown great promise for automated detection, diagnosis and quality improvement in endoscopy. However, the interdisciplinary nature of these works has undoubtedly made it more difficult to estimate their value and applicability. In this review, the pitfalls and common misconducts when training and validating deep learning systems are discussed and some practical guidelines are proposed that should be taken into account when acquiring data and handling it to ensure an unbiased system that will generalize for application in routine clinical practice. Finally, some considerations are presented to ensure correct validation and comparison of AI systems.