GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity

Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. H...

Full description

Bibliographic Details
Main Authors: Dongcheng Zhao, Yi Zeng, Tielin Zhang, Mengting Shi, Feifei Zhao
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-11-01
Series:Frontiers in Computational Neuroscience
Subjects:
SNN
Online Access:https://www.frontiersin.org/articles/10.3389/fncom.2020.576841/full
id doaj-94ea0b9033304e478c06f8c1db2520d4
record_format Article
spelling doaj-94ea0b9033304e478c06f8c1db2520d42020-11-25T04:03:31ZengFrontiers Media S.A.Frontiers in Computational Neuroscience1662-51882020-11-011410.3389/fncom.2020.576841576841GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP PlasticityDongcheng Zhao0Dongcheng Zhao1Yi Zeng2Yi Zeng3Yi Zeng4Yi Zeng5Tielin Zhang6Mengting Shi7Mengting Shi8Feifei Zhao9Research Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaSchool of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, ChinaResearch Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaSchool of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, ChinaCenter for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Beijing, ChinaNational Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaResearch Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaResearch Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaSchool of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, ChinaResearch Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaSpiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. Here we give an alternative method to train SNNs by biologically-plausible structural and functional inspirations from the brain. Firstly, inspired by the significant top-down structural connections, a global random feedback alignment is designed to help the SNN propagate the error target from the output layer directly to the previous few layers. Then inspired by the local plasticity of the biological system in which the synapses are more tuned by the neighborhood neurons, a differential STDP is used to optimize local plasticity. Extensive experimental results on the benchmark MNIST (98.62%) and Fashion MNIST (89.05%) have shown that the proposed algorithm performs favorably against several state-of-the-art SNNs trained with backpropagation.https://www.frontiersin.org/articles/10.3389/fncom.2020.576841/fullSNNplasticitybrainlocal STDPglobal feedback alignment
collection DOAJ
language English
format Article
sources DOAJ
author Dongcheng Zhao
Dongcheng Zhao
Yi Zeng
Yi Zeng
Yi Zeng
Yi Zeng
Tielin Zhang
Mengting Shi
Mengting Shi
Feifei Zhao
spellingShingle Dongcheng Zhao
Dongcheng Zhao
Yi Zeng
Yi Zeng
Yi Zeng
Yi Zeng
Tielin Zhang
Mengting Shi
Mengting Shi
Feifei Zhao
GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
Frontiers in Computational Neuroscience
SNN
plasticity
brain
local STDP
global feedback alignment
author_facet Dongcheng Zhao
Dongcheng Zhao
Yi Zeng
Yi Zeng
Yi Zeng
Yi Zeng
Tielin Zhang
Mengting Shi
Mengting Shi
Feifei Zhao
author_sort Dongcheng Zhao
title GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title_short GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title_full GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title_fullStr GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title_full_unstemmed GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title_sort glsnn: a multi-layer spiking neural network based on global feedback alignment and local stdp plasticity
publisher Frontiers Media S.A.
series Frontiers in Computational Neuroscience
issn 1662-5188
publishDate 2020-11-01
description Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. Here we give an alternative method to train SNNs by biologically-plausible structural and functional inspirations from the brain. Firstly, inspired by the significant top-down structural connections, a global random feedback alignment is designed to help the SNN propagate the error target from the output layer directly to the previous few layers. Then inspired by the local plasticity of the biological system in which the synapses are more tuned by the neighborhood neurons, a differential STDP is used to optimize local plasticity. Extensive experimental results on the benchmark MNIST (98.62%) and Fashion MNIST (89.05%) have shown that the proposed algorithm performs favorably against several state-of-the-art SNNs trained with backpropagation.
topic SNN
plasticity
brain
local STDP
global feedback alignment
url https://www.frontiersin.org/articles/10.3389/fncom.2020.576841/full
work_keys_str_mv AT dongchengzhao glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT dongchengzhao glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT yizeng glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT yizeng glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT yizeng glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT yizeng glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT tielinzhang glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT mengtingshi glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT mengtingshi glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT feifeizhao glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
_version_ 1724439864285331456