CRBA: A Competitive Rate-Based Algorithm Based on Competitive Spiking Neural Networks

• Main Authors: Paolo G. Cachi, Sebastián Ventura, Krzysztof J. Cios
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2021-04-01
• Series: Frontiers in Computational Neuroscience
• Subjects: rate-based algorithm; competitive spiking neural networks; competitive learning; unsupervised image classification; MNIST
• Online Access: https://www.frontiersin.org/articles/10.3389/fncom.2021.627567/full

In this paper we present a Competitive Rate-Based Algorithm (CRBA) that approximates operation of a Competitive Spiking Neural Network (CSNN). CRBA is based on modeling of the competition between neurons during a sample presentation, which can be reduced to ranking of the neurons based on a dot product operation and the use of a discrete Expectation Maximization algorithm; the latter is equivalent to the spike time-dependent plasticity rule. CRBA's performance is compared with that of CSNN on the MNIST and Fashion-MNIST datasets. The results show that CRBA performs on par with CSNN, while using three orders of magnitude less computational time. Importantly, we show that the weights and firing thresholds learned by CRBA can be used to initialize CSNN's parameters that results in its much more efficient operation.