Demystifying echo state network with deterministic simple topologies. (26th July 2019)

• Record Type: Journal Article
• Authors: Elsarraj, Duaa; Qisi, Maha Al; Rodan, Ali; Obeid, Nadim; Sharieh, Ahmad; Faris, Hossam
• Is Part Of: International journal of computational science and engineering. Volume 19:Number 3(2019)
• Page Start: 407
• Page End: 417
• Publication Date: 2019-07-26
• Subjects: echo state network -- ESN -- reservoir computing -- reservoir structure topology -- memory capacity -- ESN algorithm -- complexity; Computer science -- Mathematics -- Periodicals; Computer simulation -- Mathematical aspects -- Periodicals; Computational intelligence -- Periodicals; 004.015105
• Languages: English
• ISSNs: 1742-7185

Abstract

Echo state networks (ESN) are a special type of recurrent neural networks (RNN) with distinct performance in the field of reservoir computing (RC). The state space of the ESN is initially randomised and the reservoir weights are fixed with training done only on the state readout. Beside the advantages of ESN, there remains some opacity in the dynamic properties of the reservoir due to the presence of randomisation. Our aim in this paper is to demystify the model of ESN in a complete deterministic structure with the use of different proposed reservoir structures (topologies) and compare their performance with the random ESN on different benchmark datasets. All applied topologies maintain the simplicity of random ESN computation complexity. Most of the topologies showed comparable or even better performance.