Computing with spikes, architecture, properties and implementation of emerging paradigms

In this thesis we study at a concrete practical level how computation with action potentials (spikes) can be performed. We address the problem of pro- gramming a dynamical system modeled as a neural network and considering both, hardware and software implementations. For this, we use a discrete- tim...

Full description

Bibliographic Details
Main Author: Rostro-Gonzalez, Horacio
Language:ENG
Published: Université Nice Sophia Antipolis 2011
Subjects:
Online Access:http://tel.archives-ouvertes.fr/tel-00850264
http://tel.archives-ouvertes.fr/docs/00/85/02/64/PDF/rostro-11.pdf
id ndltd-CCSD-oai-tel.archives-ouvertes.fr-tel-00850264
record_format oai_dc
spelling ndltd-CCSD-oai-tel.archives-ouvertes.fr-tel-008502642013-10-02T03:02:17Z http://tel.archives-ouvertes.fr/tel-00850264 http://tel.archives-ouvertes.fr/docs/00/85/02/64/PDF/rostro-11.pdf Computing with spikes, architecture, properties and implementation of emerging paradigms Rostro-Gonzalez, Horacio [INFO:INFO_OH] Computer Science/Other spikes In this thesis we study at a concrete practical level how computation with action potentials (spikes) can be performed. We address the problem of pro- gramming a dynamical system modeled as a neural network and considering both, hardware and software implementations. For this, we use a discrete- time spiking neuron model, which has been introduced in Soula et al. (2006), and called BMS in the sequel, whose dynamics is rather rich (see section 1.2.4). On one hand, we propose an efficient method to properly estimate the parameters (delayed synaptic weights) of a neural network from the observa- tion of its spiking dynamics. The idea is to avoid the underlying NP-complete problem (when both weights and inter-neural transmission delays are con- sidered in the parameters estimation). So far, our method defines a Linear Programming (LP) system to perform the parameters estimation. Another aspect considered in this part of the work is the fact that we include a reser- voir computing mechanism (hidden network), which permits us, as we show, to increase the computational power and to add robustness in the system. Furthermore these ideas are applied to implement input-output transforma- tions, with a method learning the implicit parameters of the corresponding transfer function. On the other hand we have worked on the development of numerical implementations permitting us to validate our algorithms. We also made contributions to code methods for spike trains statistics analysis and simu- lations of spiking neural networks. Thus, we co-develop a C++ library, called EnaS, which is distributed under the CeCILL-C free license. This library is also compatible with other simulators and could be used as a plugin. Finally we consider the emergent field of bio-inspired hardware im- plementations, where FPGA (Field Programmable Gate Array) and GPU (Graphic Processing Unit) technologies are studied. In this sense, we evalu- ate the hardware implementations of the proposed neuron models (gIF-type neuron models) under periodic and chaotic activity regimes. The FPGA- based implementation has been achieved using a precision analysis and its performance compared with that based on GPU. 2011-01-24 ENG PhD thesis Université Nice Sophia Antipolis
collection NDLTD
language ENG
sources NDLTD
topic [INFO:INFO_OH] Computer Science/Other
spikes
spellingShingle [INFO:INFO_OH] Computer Science/Other
spikes
Rostro-Gonzalez, Horacio
Computing with spikes, architecture, properties and implementation of emerging paradigms
description In this thesis we study at a concrete practical level how computation with action potentials (spikes) can be performed. We address the problem of pro- gramming a dynamical system modeled as a neural network and considering both, hardware and software implementations. For this, we use a discrete- time spiking neuron model, which has been introduced in Soula et al. (2006), and called BMS in the sequel, whose dynamics is rather rich (see section 1.2.4). On one hand, we propose an efficient method to properly estimate the parameters (delayed synaptic weights) of a neural network from the observa- tion of its spiking dynamics. The idea is to avoid the underlying NP-complete problem (when both weights and inter-neural transmission delays are con- sidered in the parameters estimation). So far, our method defines a Linear Programming (LP) system to perform the parameters estimation. Another aspect considered in this part of the work is the fact that we include a reser- voir computing mechanism (hidden network), which permits us, as we show, to increase the computational power and to add robustness in the system. Furthermore these ideas are applied to implement input-output transforma- tions, with a method learning the implicit parameters of the corresponding transfer function. On the other hand we have worked on the development of numerical implementations permitting us to validate our algorithms. We also made contributions to code methods for spike trains statistics analysis and simu- lations of spiking neural networks. Thus, we co-develop a C++ library, called EnaS, which is distributed under the CeCILL-C free license. This library is also compatible with other simulators and could be used as a plugin. Finally we consider the emergent field of bio-inspired hardware im- plementations, where FPGA (Field Programmable Gate Array) and GPU (Graphic Processing Unit) technologies are studied. In this sense, we evalu- ate the hardware implementations of the proposed neuron models (gIF-type neuron models) under periodic and chaotic activity regimes. The FPGA- based implementation has been achieved using a precision analysis and its performance compared with that based on GPU.
author Rostro-Gonzalez, Horacio
author_facet Rostro-Gonzalez, Horacio
author_sort Rostro-Gonzalez, Horacio
title Computing with spikes, architecture, properties and implementation of emerging paradigms
title_short Computing with spikes, architecture, properties and implementation of emerging paradigms
title_full Computing with spikes, architecture, properties and implementation of emerging paradigms
title_fullStr Computing with spikes, architecture, properties and implementation of emerging paradigms
title_full_unstemmed Computing with spikes, architecture, properties and implementation of emerging paradigms
title_sort computing with spikes, architecture, properties and implementation of emerging paradigms
publisher Université Nice Sophia Antipolis
publishDate 2011
url http://tel.archives-ouvertes.fr/tel-00850264
http://tel.archives-ouvertes.fr/docs/00/85/02/64/PDF/rostro-11.pdf
work_keys_str_mv AT rostrogonzalezhoracio computingwithspikesarchitecturepropertiesandimplementationofemergingparadigms
_version_ 1716597835267309568