Convolutional feature extraction for process monitoring using ultrasonic sensors. (December 2021)

• Record Type: Journal Article
• Authors: Bowler, Alexander; Pound, Michael; Watson, Nicholas
• Is Part Of: Computers & chemical engineering. Volume 155(2021)
• Publication Date: 2021-12
• Subjects: Convolutional neural networks -- Ultrasonic sensors -- Transfer learning -- Process monitoring -- Industrial digital technologies, multi-task learning; Chemical engineering -- Data processing -- Periodicals; 660.0285
• DOI: 10.1016/j.compchemeng.2021.107508
• Languages: English
• ISSNs: 0098-1354

Abstract

Highlights: Optimal feature extraction from ultrasonic waveform essential for machine learning. Convolutional neural networks pre-trained on auxiliary task. Principal component analysis applied to CNN extracted features. CNN feature extraction produced more informative features. CNN method best for 65% of process monitoring tasks evaluated. Abstract: Ultrasonic sensors are a low-cost and in-line technique and can be combined with machine learning for industrial process monitoring. However, training accurate machine learning models for process monitoring using sensor data is dependant on the feature selection methodology. This paper compares a convolutional feature extraction method to a traditional, coarse feature engineering approach. The convolutional method uses filter weights pre-trained on an auxiliary task to classify ultrasonic waveform dataset membership using previously obtained sensor data. The filter weights are used to extract features from the ultrasonic waveform. Principal component analysis is then applied to produce five principal components to be input into long short-term memory neural networks. The two approaches are compared on fermentation, mixing and cleaning datasets monitored using ultrasonic sensors. Overall, the convolutional feature method produced more informative waveform features than the coarse feature engineering approach, achieving higher model accuracy for datasets requiring substantial waveform information and for 65% of tasks overall. Multi-task learning also improved feature trajectory learning but led to reduced model accuracy for data points far from the classification decision boundaries. This can be overcome by further optimisation of neural network hyperparameters, though at increased model development time. Once trained, the convolutional feature extraction approach is a fast and convenient way of producing high quality features from ultrasonic waveforms using convolutional neural networks with little training data. Graphical abstract: Image, graphical abstract