Building feedforward neural networks with random weights for large scale datasets. (15th September 2018)

• Record Type: Journal Article
• Authors: Ye, Hailiang; Cao, Feilong; Wang, Dianhui; Li, Hong
• Is Part Of: Expert systems with applications. Volume 106(2018)
• Page Start: 233
• Page End: 243
• Publication Date: 2018-09-15
• Subjects: Large scale data -- Neural networks -- Learning -- Approximate Newton-type method; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2018.04.007
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: Give an overall iterative method for NNRW to deal with large scale datasets. An efficient ANE-NNRW algorithm is developed. ANE-NNRW's convergence is analyzed and proved theoretically. Some efficient comparisons experiments are studied. Abstract: With the explosive growth in size of datasets, it becomes more significant to develop effective learning schemes for neural networks to deal with large scale data modelling. This paper proposes an iterative approximate Newton-type learning algorithm to build neural networks with random weights (NNRWs) for problem solving, where the whole training samples are divided into some small subsets under certain assumptions, and each subset is employed to construct a local learner model for integrating a unified classifier. The convergence of the output weights of the unified learner model is given. Experimental results on UCI datasets with comparisons demonstrate that the proposed algorithm is promising for large scale datasets.