Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System.

The visual cortex analyzes motion information along hierarchically arranged visual areas that interact through bidirectional interconnections. This work suggests a bio-inspired visual model focusing on the interactions of the cortical areas in which a new mechanism of feedforward and feedback proces...

Full description

Bibliographic Details
Main Authors: Luma Issa Abdul-Kreem, Heiko Neumann
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2015-01-01
Series:PLoS ONE
Online Access:http://europepmc.org/articles/PMC4640561?pdf=render
id doaj-197572987bd54bfaae8c099b4c855157
record_format Article
spelling doaj-197572987bd54bfaae8c099b4c8551572020-11-25T01:24:02ZengPublic Library of Science (PLoS)PLoS ONE1932-62032015-01-011011e014248810.1371/journal.pone.0142488Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System.Luma Issa Abdul-KreemHeiko NeumannThe visual cortex analyzes motion information along hierarchically arranged visual areas that interact through bidirectional interconnections. This work suggests a bio-inspired visual model focusing on the interactions of the cortical areas in which a new mechanism of feedforward and feedback processing are introduced. The model uses a neuromorphic vision sensor (silicon retina) that simulates the spike-generation functionality of the biological retina. Our model takes into account two main model visual areas, namely V1 and MT, with different feature selectivities. The initial motion is estimated in model area V1 using spatiotemporal filters to locally detect the direction of motion. Here, we adapt the filtering scheme originally suggested by Adelson and Bergen to make it consistent with the spike representation of the DVS. The responses of area V1 are weighted and pooled by area MT cells which are selective to different velocities, i.e. direction and speed. Such feature selectivity is here derived from compositions of activities in the spatio-temporal domain and integrating over larger space-time regions (receptive fields). In order to account for the bidirectional coupling of cortical areas we match properties of the feature selectivity in both areas for feedback processing. For such linkage we integrate the responses over different speeds along a particular preferred direction. Normalization of activities is carried out over the spatial as well as the feature domains to balance the activities of individual neurons in model areas V1 and MT. Our model was tested using different stimuli that moved in different directions. The results reveal that the error margin between the estimated motion and synthetic ground truth is decreased in area MT comparing with the initial estimation of area V1. In addition, the modulated V1 cell activations shows an enhancement of the initial motion estimation that is steered by feedback signals from MT cells.http://europepmc.org/articles/PMC4640561?pdf=render
collection DOAJ
language English
format Article
sources DOAJ
author Luma Issa Abdul-Kreem
Heiko Neumann
spellingShingle Luma Issa Abdul-Kreem
Heiko Neumann
Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System.
PLoS ONE
author_facet Luma Issa Abdul-Kreem
Heiko Neumann
author_sort Luma Issa Abdul-Kreem
title Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System.
title_short Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System.
title_full Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System.
title_fullStr Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System.
title_full_unstemmed Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System.
title_sort neural mechanisms of cortical motion computation based on a neuromorphic sensory system.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2015-01-01
description The visual cortex analyzes motion information along hierarchically arranged visual areas that interact through bidirectional interconnections. This work suggests a bio-inspired visual model focusing on the interactions of the cortical areas in which a new mechanism of feedforward and feedback processing are introduced. The model uses a neuromorphic vision sensor (silicon retina) that simulates the spike-generation functionality of the biological retina. Our model takes into account two main model visual areas, namely V1 and MT, with different feature selectivities. The initial motion is estimated in model area V1 using spatiotemporal filters to locally detect the direction of motion. Here, we adapt the filtering scheme originally suggested by Adelson and Bergen to make it consistent with the spike representation of the DVS. The responses of area V1 are weighted and pooled by area MT cells which are selective to different velocities, i.e. direction and speed. Such feature selectivity is here derived from compositions of activities in the spatio-temporal domain and integrating over larger space-time regions (receptive fields). In order to account for the bidirectional coupling of cortical areas we match properties of the feature selectivity in both areas for feedback processing. For such linkage we integrate the responses over different speeds along a particular preferred direction. Normalization of activities is carried out over the spatial as well as the feature domains to balance the activities of individual neurons in model areas V1 and MT. Our model was tested using different stimuli that moved in different directions. The results reveal that the error margin between the estimated motion and synthetic ground truth is decreased in area MT comparing with the initial estimation of area V1. In addition, the modulated V1 cell activations shows an enhancement of the initial motion estimation that is steered by feedback signals from MT cells.
url http://europepmc.org/articles/PMC4640561?pdf=render
work_keys_str_mv AT lumaissaabdulkreem neuralmechanismsofcorticalmotioncomputationbasedonaneuromorphicsensorysystem
AT heikoneumann neuralmechanismsofcorticalmotioncomputationbasedonaneuromorphicsensorysystem
_version_ 1725119340090490880