Stochastic Search Algorithms for Identification, Optimization, and Training of Artificial Neural Networks. (5th March 2015)

• Record Type: Journal Article
• Authors: Nikolic, Kostantin P.
• Other Names: Kisi Ozgur Academic Editor.
• Is Part Of: Advances in artificial neural systems. (2015)
• Publication Date: 2015-03-05
• Subjects: Neural networks (Computer science) -- Periodicals; Neural networks (Computer science); Periodicals; Electronic journals; 006.32
• DOI: 10.1155/2015/931379
• Languages: English
• ISSNs: 1687-7594

Abstract

Abstract : This paper presents certain stochastic search algorithms (SSA) suitable for effective identification, optimization, and training of artificial neural networks (ANN). The modified algorithm of nonlinear stochastic search (MN-SDS) has been introduced by the author. Its basic objectives are to improve convergence property of the source defined nonlinear stochastic search (N-SDS) method as per Professor Rastrigin. Having in mind vast range of possible algorithms and procedures a so-called method of stochastic direct search (SDS) has been practiced (in the literature is called stochastic local search-SLS). The MN-SDS convergence property is rather advancing over N-SDS; namely it has even better convergence over range of gradient procedures of optimization. The SDS, that is, SLS, has not been practiced enough in the process of identification, optimization, and training of ANN. Their efficiency in some cases of pure nonlinear systems makes them suitable for optimization and training of ANN. The presented examples illustrate only partially operatively end efficiency of SDS, that is, MN-SDS. For comparative method backpropagation error (BPE) method was used.