1D convolutional neural networks and applications: A survey. (April 2021)

• Record Type: Journal Article
• Authors: Kiranyaz, Serkan; Avci, Onur; Abdeljaber, Osama; Ince, Turker; Gabbouj, Moncef; Inman, Daniel J.
• Is Part Of: Mechanical systems and signal processing. Volume 151(2021)
• Publication Date: 2021-04
• Subjects: Artificial Neural Networks -- Machine learning -- Deep learning -- Convolutional neural networks -- Structural health monitoring -- Condition monitoring -- Arrhythmia detection and identification -- Fault detection -- Structural damage detection; Structural dynamics -- Periodicals; Vibration -- Periodicals; Constructions -- Dynamique -- Périodiques; Vibration -- Périodiques; Structural dynamics; Vibration; Periodicals; 621
• DOI: 10.1016/j.ymssp.2020.107398
• Languages: English
• ISSNs: 0888-3270

Abstract

Highlights: This paper presents a comprehensive review of the general architecture of 1D CNNs. Their major engineering applications, principals, and recent progress on 1D CNNs are reviewed. The state-of-the-art performance and unique properties of 1D CNNs are highlighted. Detailed computational complexity analysis of compact and adaptive 1D CNNs are reported. The benchmark datasets and the principal 1D CNN software are also publicly shared. Abstract: During the last decade, Convolutional Neural Networks (CNNs) have become the de facto standard for various Computer Vision and Machine Learning operations. CNNs are feed-forward Artificial Neural Networks (ANNs) with alternating convolutional and subsampling layers. Deep 2D CNNs with many hidden layers and millions of parameters have the ability to learn complex objects and patterns providing that they can be trained on a massive size visual database with ground-truth labels. With a proper training, this unique ability makes them the primary tool for various engineering applications for 2D signals such as images and video frames. Yet, this may not be a viable option in numerous applications over 1D signals especially when the training data is scarce or application specific. To address this issue, 1D CNNs have recently been proposed and immediately achieved the state-of-the-art performance levels in several applications such as personalized biomedical data classification and early diagnosis, structural health monitoring, anomaly detection and identification in power electronics and electrical motor fault detection. Another major advantage is that a real-time and low-cost hardware implementation is feasible due to the simple and compact configuration of 1D CNNs that perform only 1D convolutions (scalar multiplications and additions). This paper presents a comprehensive review of the general architecture and principals of 1D CNNs along with their major engineering applications, especially focused on the recent progress in this field. Their state-of-the-art performance is highlighted concluding with their unique properties. The benchmark datasets and the principal 1D CNN software used in those applications are also publicly shared in a dedicated website. While there has not been a paper on the review of 1D CNNs and its applications in the literature, this paper fulfills this gap.