RANDOM NEURAL NETWORK LEARNING HEURISTICS. Issue 4 (22nd May 2017)

• Record Type: Journal Article
• Authors: Javed, Abbas; Larijani, Hadi; Ahmadinia, Ali; Emmanuel, Rohinton
• Is Part Of: Probability in the engineering and informational sciences. Volume 31:Issue 4(2017)
• Page Start: 436
• Page End: 456
• Publication Date: 2017-05-22
• Subjects: artificial bee colony, -- learning algorithms, -- particle swarm optimization, -- random neural networks, -- sequential quadratic programming; Probabilities -- Periodicals; Engineering -- Statistical methods -- Periodicals; Information science -- Statistical methods -- Periodicals; 519.202462
• DOI: 10.1017/S0269964817000201
• Languages: English
• ISSNs: 0269-9648

Abstract

Abstract : The random neural network (RNN) is a probabilitsic queueing theory-based model for artificial neural networks, and it requires the use of optimization algorithms for training. Commonly used gradient descent learning algorithms may reside in local minima, evolutionary algorithms can be also used to avoid local minima. Other techniques such as artificial bee colony (ABC), particle swarm optimization (PSO), and differential evolution algorithms also perform well in finding the global minimum but they converge slowly. The sequential quadratic programming (SQP) optimization algorithm can find the optimum neural network weights, but can also get stuck in local minima. We propose to overcome the shortcomings of these various approaches by using hybridized ABC/PSO and SQP. The resulting algorithm is shown to compare favorably with other known techniques for training the RNN. The results show that hybrid ABC learning with SQP outperforms other training algorithms in terms of mean-squared error and normalized root-mean-squared error.