Overfitting the Literature to One Set of Stimuli and Data

A large number of papers in Computational Cognitive Neuroscience are developing and testing novel analysis methods using one specific neuroimaging dataset and problematic experimental stimuli. Publication bias and confirmatory exploration will result in overfitting to the limited available data. We...

Full description

Bibliographic Details
Main Authors: Grootswagers, T. (Author), Robinson, A.K (Author)
Format: Article
Language:English
Published: Frontiers Media S.A. 2021
Subjects:
EEG
MEG
Online Access:View Fulltext in Publisher
Description
Summary:A large number of papers in Computational Cognitive Neuroscience are developing and testing novel analysis methods using one specific neuroimaging dataset and problematic experimental stimuli. Publication bias and confirmatory exploration will result in overfitting to the limited available data. We highlight the problems with this specific dataset and argue for the need to collect more good quality open neuroimaging data using a variety of experimental stimuli, in order to test the generalisability of current published results, and allow for more robust results in future work. © Copyright © 2021 Grootswagers and Robinson.
ISBN:16625161 (ISSN)
DOI:10.3389/fnhum.2021.682661