Guaranteed approximation error estimation of neural networks and model modification. (July 2022)

• Record Type: Journal Article
• Authors: Yang, Yejiang; Wang, Tao; Woolard, Jefferson P.; Xiang, Weiming
• Is Part Of: Neural networks. Volume 151(2022)
• Page Start: 61
• Page End: 69
• Publication Date: 2022-07
• Subjects: Feedforward neural network -- Approximation error estimation -- Lipschitz constant -- Reachability -- Neural network compression; Neural computers -- Periodicals; Neural networks (Computer science) -- Periodicals; Neural networks (Neurobiology) -- Periodicals; Nervous System -- Periodicals; Ordinateurs neuronaux -- Périodiques; Réseaux neuronaux (Informatique) -- Périodiques; Réseaux neuronaux (Neurobiologie) -- Périodiques; Neural computers; Neural networks (Computer science); Neural networks (Neurobiology); Periodicals; 006.32
• DOI: 10.1016/j.neunet.2022.03.023
• Languages: English
• ISSNs: 0893-6080

Abstract

Abstract: Approximation error is a key measure in the process of model validation and verification for neural networks. In this paper, the problems of guaranteed error estimation of neural networks and applications to assured system modeling and assured neural network compression are addressed. First, a concept called guaranteed error estimation of feedforward neural networks is proposed, which intends to provide the worst-case approximation error of a trained neural network with respect to a compact input set essentially containing an infinite number of values. Given different prior information about the original system, two approaches including Lipschitz constant analysis and set-valued reachability analysis methods are developed to efficiently compute upper-bounds of approximation errors. Based on the guaranteed approximation error estimation framework, an optimization for obtaining parameter values from data set is proposed. A robotic arm and neural network compression examples are presented to illustrate the effectiveness of our approach.