GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. H...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2020-11-01
|
Series: | Frontiers in Computational Neuroscience |
Subjects: | |
Online Access: | https://www.frontiersin.org/articles/10.3389/fncom.2020.576841/full |
id |
doaj-94ea0b9033304e478c06f8c1db2520d4 |
---|---|
record_format |
Article |
spelling |
doaj-94ea0b9033304e478c06f8c1db2520d42020-11-25T04:03:31ZengFrontiers Media S.A.Frontiers in Computational Neuroscience1662-51882020-11-011410.3389/fncom.2020.576841576841GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP PlasticityDongcheng Zhao0Dongcheng Zhao1Yi Zeng2Yi Zeng3Yi Zeng4Yi Zeng5Tielin Zhang6Mengting Shi7Mengting Shi8Feifei Zhao9Research Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaSchool of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, ChinaResearch Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaSchool of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, ChinaCenter for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Beijing, ChinaNational Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaResearch Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaResearch Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaSchool of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, ChinaResearch Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaSpiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. Here we give an alternative method to train SNNs by biologically-plausible structural and functional inspirations from the brain. Firstly, inspired by the significant top-down structural connections, a global random feedback alignment is designed to help the SNN propagate the error target from the output layer directly to the previous few layers. Then inspired by the local plasticity of the biological system in which the synapses are more tuned by the neighborhood neurons, a differential STDP is used to optimize local plasticity. Extensive experimental results on the benchmark MNIST (98.62%) and Fashion MNIST (89.05%) have shown that the proposed algorithm performs favorably against several state-of-the-art SNNs trained with backpropagation.https://www.frontiersin.org/articles/10.3389/fncom.2020.576841/fullSNNplasticitybrainlocal STDPglobal feedback alignment |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Dongcheng Zhao Dongcheng Zhao Yi Zeng Yi Zeng Yi Zeng Yi Zeng Tielin Zhang Mengting Shi Mengting Shi Feifei Zhao |
spellingShingle |
Dongcheng Zhao Dongcheng Zhao Yi Zeng Yi Zeng Yi Zeng Yi Zeng Tielin Zhang Mengting Shi Mengting Shi Feifei Zhao GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity Frontiers in Computational Neuroscience SNN plasticity brain local STDP global feedback alignment |
author_facet |
Dongcheng Zhao Dongcheng Zhao Yi Zeng Yi Zeng Yi Zeng Yi Zeng Tielin Zhang Mengting Shi Mengting Shi Feifei Zhao |
author_sort |
Dongcheng Zhao |
title |
GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title_short |
GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title_full |
GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title_fullStr |
GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title_full_unstemmed |
GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title_sort |
glsnn: a multi-layer spiking neural network based on global feedback alignment and local stdp plasticity |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Computational Neuroscience |
issn |
1662-5188 |
publishDate |
2020-11-01 |
description |
Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. Here we give an alternative method to train SNNs by biologically-plausible structural and functional inspirations from the brain. Firstly, inspired by the significant top-down structural connections, a global random feedback alignment is designed to help the SNN propagate the error target from the output layer directly to the previous few layers. Then inspired by the local plasticity of the biological system in which the synapses are more tuned by the neighborhood neurons, a differential STDP is used to optimize local plasticity. Extensive experimental results on the benchmark MNIST (98.62%) and Fashion MNIST (89.05%) have shown that the proposed algorithm performs favorably against several state-of-the-art SNNs trained with backpropagation. |
topic |
SNN plasticity brain local STDP global feedback alignment |
url |
https://www.frontiersin.org/articles/10.3389/fncom.2020.576841/full |
work_keys_str_mv |
AT dongchengzhao glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT dongchengzhao glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT yizeng glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT yizeng glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT yizeng glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT yizeng glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT tielinzhang glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT mengtingshi glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT mengtingshi glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT feifeizhao glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity |
_version_ |
1724439864285331456 |