Réseaux de neurones et acquisition de l'information parcimonieuse

• Main Author: KAMARY ALIABADI, Behrooz
• Language: ENG
• Published: 2013
• Subjects: [MATH:MATH_IT] Mathematics/Information Theory; [MATH:MATH_IT] Mathématiques/Théorie de l'information et codage; [INFO:INFO_IT] Computer Science/Information Theory; [INFO:INFO_IT] Informatique/Théorie de l'information; Neural Networks; Neural Coding; Distributed Coding; Compressed Sensing; Parsimony
• Online Access: http://tel.archives-ouvertes.fr/tel-00962603; http://tel.archives-ouvertes.fr/docs/00/96/26/03/PDF/2013telb0278_Kamary_Aliabadi_Behrooz.pdf

This thesis studies a neural network inspired by human neocortex. An extension of the recurrent and binary network proposed by Gripon and Berrou is given to store sparse messages. In this new version of the neural network, information is borne by graphical codewords (cliques) that use a fraction of the network available resources. These codewords can have different sizes that carry variable length information. We have examined this concept and computed the capacity limits on erasure correction as a function of error rate. These limits are compared with simulation results that are obtained from different experiment setups. We have finally studied the network under the formalism of information theory and established a connection between compressed sensing and the proposed network.