Deep learning on Sleptsov nets. Issue 6 (2nd November 2021)

• Record Type: Journal Article
• Authors: Shmeleva, Tatiana R.; Owsiński, Jan W.; Lawan, Abdulmalik Ahmad
• Is Part Of: International journal of parallel, emergent and distributed systems. Volume 36:Issue 6(2021)
• Page Start: 535
• Page End: 548
• Publication Date: 2021-11-02
• Subjects: Neural network -- Sleptsov net -- deep learning -- mass parallel computations -- sigmoid -- gradient descend; Parallel computers -- Periodicals; Electronic data processing -- Distributed processing -- Periodicals; Computer algorithms -- Periodicals; 004.35
• DOI: 10.1080/17445760.2021.1945055
• Languages: English
• ISSNs: 1744-5760

Abstract

Abstract : Sleptsov nets are applied as a uniform language to specify models of unconventional computations and artificial intelligence systems. A technique for specification of neural networks, including multidimensional and multilayer networks of deep learning approach, using Sleptsov nets, is shown; the ways of specifying basic activation functions by Sleptsov net are discussed, the threshold and sigmoid functions implemented. A methodology of training neural networks is presented with the loss function minimisation, based on a run of a pair of interacting Sleptsov nets, the first net implementing the neural network based on data flow approach, while the second net solves the optimisation task by adjusting the weights of the first net by the gradient descend method. The optimising net uses the earlier developed technology of programming in Sleptsov nets with reverse control flow and the subnet call technique. Real numbers and arrays are represented as markings of a single place of a Sleptsov net. Hyperperformance is achieved because of the possibility of implementing mass parallel computations.