Decoding visual colour from scalp electroencephalography measurements

Recent advances have made it possible to decode various aspects of visually presented stimuli from patterns of scalp EEG measurements. As of recently, such multivariate methods have been commonly used to decode visual-spatial features such as location, orientation, or spatial frequency. In the curre...

Full description

Bibliographic Details
Main Authors: Jasper E. Hajonides, Anna C. Nobre, Freek van Ede, Mark G. Stokes
Format: Article
Language:English
Published: Elsevier 2021-08-01
Series:NeuroImage
Subjects:
EEG
Online Access:http://www.sciencedirect.com/science/article/pii/S1053811921003074
id doaj-402b510e4ac14f14b53ea9b645f4fb7d
record_format Article
spelling doaj-402b510e4ac14f14b53ea9b645f4fb7d2021-07-03T04:43:53ZengElsevierNeuroImage1095-95722021-08-01237118030Decoding visual colour from scalp electroencephalography measurementsJasper E. Hajonides0Anna C. Nobre1Freek van Ede2Mark G. Stokes3Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, United Kingdom; Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom; Corresponding author.Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, United Kingdom; Department of Experimental Psychology, University of Oxford, Oxford, United KingdomOxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, United Kingdom; Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, NetherlandsDepartment of Experimental Psychology, University of Oxford, Oxford, United KingdomRecent advances have made it possible to decode various aspects of visually presented stimuli from patterns of scalp EEG measurements. As of recently, such multivariate methods have been commonly used to decode visual-spatial features such as location, orientation, or spatial frequency. In the current study, we show that it is also possible to track visual colour processing by using Linear Discriminant Analysis on patterns of EEG activity. Building on other recent demonstrations, we show that colour decoding: (1) reflects sensory qualities (as opposed to, for example, verbal labelling) with a prominent contribution from posterior electrodes contralateral to the stimulus, (2) conforms to a parametric coding space, (3) is possible in multi-item displays, and (4) is comparable in magnitude to the decoding of visual stimulus orientation. Through subsampling our data, we also provide an estimate of the approximate number of trials and participants required for robust decoding. Finally, we show that while colour decoding can be sensitive to subtle differences in luminance, our colour decoding results are primarily driven by measured colour differences between stimuli. Colour decoding opens a relevant new dimension in which to track visual processing using scalp EEG measurements, while bypassing potential confounds associated with decoding approaches that focus on spatial features.http://www.sciencedirect.com/science/article/pii/S1053811921003074ColorEEGDecodingSupervised learningFeaturesVision
collection DOAJ
language English
format Article
sources DOAJ
author Jasper E. Hajonides
Anna C. Nobre
Freek van Ede
Mark G. Stokes
spellingShingle Jasper E. Hajonides
Anna C. Nobre
Freek van Ede
Mark G. Stokes
Decoding visual colour from scalp electroencephalography measurements
NeuroImage
Color
EEG
Decoding
Supervised learning
Features
Vision
author_facet Jasper E. Hajonides
Anna C. Nobre
Freek van Ede
Mark G. Stokes
author_sort Jasper E. Hajonides
title Decoding visual colour from scalp electroencephalography measurements
title_short Decoding visual colour from scalp electroencephalography measurements
title_full Decoding visual colour from scalp electroencephalography measurements
title_fullStr Decoding visual colour from scalp electroencephalography measurements
title_full_unstemmed Decoding visual colour from scalp electroencephalography measurements
title_sort decoding visual colour from scalp electroencephalography measurements
publisher Elsevier
series NeuroImage
issn 1095-9572
publishDate 2021-08-01
description Recent advances have made it possible to decode various aspects of visually presented stimuli from patterns of scalp EEG measurements. As of recently, such multivariate methods have been commonly used to decode visual-spatial features such as location, orientation, or spatial frequency. In the current study, we show that it is also possible to track visual colour processing by using Linear Discriminant Analysis on patterns of EEG activity. Building on other recent demonstrations, we show that colour decoding: (1) reflects sensory qualities (as opposed to, for example, verbal labelling) with a prominent contribution from posterior electrodes contralateral to the stimulus, (2) conforms to a parametric coding space, (3) is possible in multi-item displays, and (4) is comparable in magnitude to the decoding of visual stimulus orientation. Through subsampling our data, we also provide an estimate of the approximate number of trials and participants required for robust decoding. Finally, we show that while colour decoding can be sensitive to subtle differences in luminance, our colour decoding results are primarily driven by measured colour differences between stimuli. Colour decoding opens a relevant new dimension in which to track visual processing using scalp EEG measurements, while bypassing potential confounds associated with decoding approaches that focus on spatial features.
topic Color
EEG
Decoding
Supervised learning
Features
Vision
url http://www.sciencedirect.com/science/article/pii/S1053811921003074
work_keys_str_mv AT jasperehajonides decodingvisualcolourfromscalpelectroencephalographymeasurements
AT annacnobre decodingvisualcolourfromscalpelectroencephalographymeasurements
AT freekvanede decodingvisualcolourfromscalpelectroencephalographymeasurements
AT markgstokes decodingvisualcolourfromscalpelectroencephalographymeasurements
_version_ 1721321266793676800