An empirical evaluation of constructive neural network algorithms in classification tasks. (26th April 2007)

• Record Type: Journal Article
• Authors: Nicoletti, Maria do Carmo; Bertini Jr., Joao R.
• Is Part Of: International journal of innovative computing and applications. Volume 1:Number 1(2007)
• Page Start: 2
• Page End: 13
• Publication Date: 2007-04-26
• Subjects: ANNs -- constructive neural networks -- CoNN algorithms -- network architectures -- learning -- classification -- training; Evolutionary computation -- Periodicals; Neural networks (Computer science) -- Periodicals; Genetic programming (Computer science) -- Periodicals; Biologically-inspired computing -- Periodicals; Swarm intelligence -- Periodicals; Quantum computers -- Periodicals; 006.3
• Languages: English
• ISSNs: 1751-648X

Abstract

Unlike conventional Neural Network (NN) algorithms that require the definition of the NN architecture before learning starts, Constructive Neural Network (CoNN) algorithms enable the network architecture to be constructed along with the learning process. This paper presents and discusses the results of an empirical evaluation of seven two-class CoNN algorithms, namely Tower, Pyramid, Tiling, Upstart, Shift, Perceptron Cascade (PC) and Partial Target Inversion (PTI) in 12 knowledge domains. The way each particular algorithm approaches the growing of the network determines their differences. This paper also presents and analyses empirical results of five multiclass CoNN algorithms in five knowledge domains, namely MTower, MPyramid, MTiling, MUpstart and MPerceptron Cascade, which can be considered extensions of their two-class counterparts. Results obtained with the Pocket with the Ratchet Modification (PRM) algorithm, with its multiclass version, the PRMWTA algorithm and with the back propagation algorithm, are presented for comparison.