Design choice and machine learning model performances. (24th May 2022)

• Record Type: Journal Article
• Authors: Arboretti, Rosa; Ceccato, Riccardo; Pegoraro, Luca; Salmaso, Luigi
• Is Part Of: Quality and reliability engineering international. Volume 38:Number 7(2022)
• Page Start: 3357
• Page End: 3378
• Publication Date: 2022-05-24
• Subjects: artificial neural networks -- gaussian process -- physical experiments -- predictive analytics -- simulation study; Reliability (Engineering) -- Periodicals; Quality control -- Periodicals; High technology -- Periodicals; 620.00452
• DOI: 10.1002/qre.3123
• Languages: English
• ISSNs: 0748-8017

Abstract

Abstract: An increasing number of publications present the joint application of design of experiments (DOE) and machine learning (ML) as a methodology to collect and analyze data on a specific industrial phenomenon. However, the literature shows that the choice of the design for data collection and model for data analysis is often not driven by statistical or algorithmic advantages, thus there is a lack of studies which provide guidelines on what designs and ML models to jointly use for data collection and analysis. This article discusses the choice of design in relation to the ML model performances. A study is conducted that considers 12 experimental designs, seven families of predictive models, seven test functions that emulate physical processes, and eight noise settings, both homoscedastic and heteroscedastic. The results of the research can have an immediate impact on the work of practitioners, providing guidelines for practical applications of DOE and ML.