Geometric Stability Classification: Datasets, Metamodels, and Adversarial Attacks. (February 2021)

• Record Type: Journal Article
• Authors: Lejeune, Emma
• Is Part Of: Computer aided design. Volume 131(2021)
• Publication Date: 2021-02
• Subjects: Machine learning -- Buckling -- Open data; Computer-aided design -- Periodicals; Engineering design -- Data processing -- Periodicals; Computer graphics -- Periodicals; Conception technique -- Informatique -- Périodiques; Infographie -- Périodiques; Computer graphics; Engineering design -- Data processing; Periodicals; Electronic journals; 620.00420285
• DOI: 10.1016/j.cad.2020.102948
• Languages: English
• ISSNs: 0010-4485

Abstract

Abstract: Many recent advances in machine learning have been motivated by classification problems. For example, classification methods are used to differentiate between "spam" and "non-spam" emails, identify hand written digits, and recognize the content of photos. For each application, a different model and model architecture will often perform best. Therefore, machine learning research has been enabled by readily available benchmark datasets. In particular, benchmark datasets have been used by researchers to demonstrate that novel methods can achieve high accuracy, and to demonstrate common vulnerabilities of classification methods to adversarial attacks. In the recent mechanics literature, there has been substantial interest in machine learning driven metamodels. Metamodels, or models of models, are appealing because once trained, they typically require orders of magnitude less compute time than full fidelity simulations. However, a better understanding of which machine learning methods and model architectures will perform best on mechanical data has been limited. Here we introduce an open source dataset "BIC" (Buckling Instability Classification) where a heterogeneous column is subject to a fixed level of applied displacement and is classified as either "Stable" or "Unstable." In addition to introducing this benchmark dataset, we show baseline metamodel performance, and show two different types of adversarial attack. We anticipate that the open source BIC dataset will enable the future development of improved methods for classification problems in mechanics. Graphical abstract: Highlights: Despite recent advances, methods for constructing metamodels remain ad hoc Therefore, we created an open source dataset for mechanics classification problems The dataset is available here: https://open.bu.edu/handle/2144/40085 . Of the metamodels explored, Gaussian process classification performed best Despite good performance, the metamodel was vulnerable to adversarial attacks