Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach

Cognitive flexibility helps us to navigate through our ever-changing environment and has often been examined by reversal learning paradigms. Performance in reversal learning can be modeled using computational modeling which allows for the specification of biologically plausible models to infer psych...

Full description

Bibliographic Details
Main Authors: Eileen Oberwelland Weiss, Jana A. Kruppa, Gereon R. Fink, Beate Herpertz-Dahlmann, Kerstin Konrad, Martin Schulte-Rüther
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-01-01
Series:Frontiers in Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fnins.2020.536596/full
id doaj-33543470e8364e809aa3da455031b546
record_format Article
collection DOAJ
language English
format Article
sources DOAJ
author Eileen Oberwelland Weiss
Eileen Oberwelland Weiss
Eileen Oberwelland Weiss
Eileen Oberwelland Weiss
Jana A. Kruppa
Jana A. Kruppa
Jana A. Kruppa
Jana A. Kruppa
Gereon R. Fink
Gereon R. Fink
Beate Herpertz-Dahlmann
Kerstin Konrad
Kerstin Konrad
Kerstin Konrad
Martin Schulte-Rüther
Martin Schulte-Rüther
Martin Schulte-Rüther
Martin Schulte-Rüther
Martin Schulte-Rüther
spellingShingle Eileen Oberwelland Weiss
Eileen Oberwelland Weiss
Eileen Oberwelland Weiss
Eileen Oberwelland Weiss
Jana A. Kruppa
Jana A. Kruppa
Jana A. Kruppa
Jana A. Kruppa
Gereon R. Fink
Gereon R. Fink
Beate Herpertz-Dahlmann
Kerstin Konrad
Kerstin Konrad
Kerstin Konrad
Martin Schulte-Rüther
Martin Schulte-Rüther
Martin Schulte-Rüther
Martin Schulte-Rüther
Martin Schulte-Rüther
Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach
Frontiers in Neuroscience
cognitive flexibility
executive functioning
development
reinforcement learning
feedback processing
author_facet Eileen Oberwelland Weiss
Eileen Oberwelland Weiss
Eileen Oberwelland Weiss
Eileen Oberwelland Weiss
Jana A. Kruppa
Jana A. Kruppa
Jana A. Kruppa
Jana A. Kruppa
Gereon R. Fink
Gereon R. Fink
Beate Herpertz-Dahlmann
Kerstin Konrad
Kerstin Konrad
Kerstin Konrad
Martin Schulte-Rüther
Martin Schulte-Rüther
Martin Schulte-Rüther
Martin Schulte-Rüther
Martin Schulte-Rüther
author_sort Eileen Oberwelland Weiss
title Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach
title_short Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach
title_full Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach
title_fullStr Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach
title_full_unstemmed Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach
title_sort developmental differences in probabilistic reversal learning: a computational modeling approach
publisher Frontiers Media S.A.
series Frontiers in Neuroscience
issn 1662-453X
publishDate 2021-01-01
description Cognitive flexibility helps us to navigate through our ever-changing environment and has often been examined by reversal learning paradigms. Performance in reversal learning can be modeled using computational modeling which allows for the specification of biologically plausible models to infer psychological mechanisms. Although such models are increasingly used in cognitive neuroscience, developmental approaches are still scarce. Additionally, though most reversal learning paradigms have a comparable design regarding timing and feedback contingencies, the type of feedback differs substantially between studies. The present study used hierarchical Gaussian filter modeling to investigate cognitive flexibility in reversal learning in children and adolescents and the effect of various feedback types. The results demonstrate that children make more overall errors and regressive errors (when a previously learned response rule is chosen instead of the new correct response after the initial shift to the new correct target), but less perseverative errors (when a previously learned response set continues to be used despite a reversal) adolescents. Analyses of the extracted model parameters of the winning model revealed that children seem to use new and conflicting information less readily than adolescents to update their stimulus-reward associations. Furthermore, more subclinical rigidity in everyday life (parent-ratings) is related to less explorative choice behavior during the probabilistic reversal learning task. Taken together, this study provides first-time data on the development of the underlying processes of cognitive flexibility using computational modeling.
topic cognitive flexibility
executive functioning
development
reinforcement learning
feedback processing
url https://www.frontiersin.org/articles/10.3389/fnins.2020.536596/full
work_keys_str_mv AT eileenoberwellandweiss developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT eileenoberwellandweiss developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT eileenoberwellandweiss developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT eileenoberwellandweiss developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT janaakruppa developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT janaakruppa developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT janaakruppa developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT janaakruppa developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT gereonrfink developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT gereonrfink developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT beateherpertzdahlmann developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT kerstinkonrad developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT kerstinkonrad developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT kerstinkonrad developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT martinschulteruther developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT martinschulteruther developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT martinschulteruther developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT martinschulteruther developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
AT martinschulteruther developmentaldifferencesinprobabilisticreversallearningacomputationalmodelingapproach
_version_ 1724333675696357376
spelling doaj-33543470e8364e809aa3da455031b5462021-01-18T05:37:21ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2021-01-011410.3389/fnins.2020.536596536596Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling ApproachEileen Oberwelland Weiss0Eileen Oberwelland Weiss1Eileen Oberwelland Weiss2Eileen Oberwelland Weiss3Jana A. Kruppa4Jana A. Kruppa5Jana A. Kruppa6Jana A. Kruppa7Gereon R. Fink8Gereon R. Fink9Beate Herpertz-Dahlmann10Kerstin Konrad11Kerstin Konrad12Kerstin Konrad13Martin Schulte-Rüther14Martin Schulte-Rüther15Martin Schulte-Rüther16Martin Schulte-Rüther17Martin Schulte-Rüther18Translational Brain Research in Psychiatry and Neurology, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital Aachen, Aachen, GermanyCognitive Neuroscience, Institute of Neuroscience and Medicine (INM-3), Jülich Research Centre, Jülich, GermanyInstitute of Neuroscience and Medicine (INM-11), Jülich Research Centre, Jülich, GermanyChild Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital Aachen, Aachen, GermanyTranslational Brain Research in Psychiatry and Neurology, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital Aachen, Aachen, GermanyCognitive Neuroscience, Institute of Neuroscience and Medicine (INM-3), Jülich Research Centre, Jülich, GermanyInstitute of Neuroscience and Medicine (INM-11), Jülich Research Centre, Jülich, GermanyChild Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital Aachen, Aachen, GermanyCognitive Neuroscience, Institute of Neuroscience and Medicine (INM-3), Jülich Research Centre, Jülich, GermanyDepartment of Neurology, University Hospital Cologne, Cologne, GermanyDepartment of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital Aachen, Aachen, GermanyCognitive Neuroscience, Institute of Neuroscience and Medicine (INM-3), Jülich Research Centre, Jülich, GermanyInstitute of Neuroscience and Medicine (INM-11), Jülich Research Centre, Jülich, GermanyChild Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital Aachen, Aachen, GermanyTranslational Brain Research in Psychiatry and Neurology, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital Aachen, Aachen, GermanyCognitive Neuroscience, Institute of Neuroscience and Medicine (INM-3), Jülich Research Centre, Jülich, GermanyInstitute of Neuroscience and Medicine (INM-11), Jülich Research Centre, Jülich, GermanyChild Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital Aachen, Aachen, GermanyDepartment of Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, GermanyCognitive flexibility helps us to navigate through our ever-changing environment and has often been examined by reversal learning paradigms. Performance in reversal learning can be modeled using computational modeling which allows for the specification of biologically plausible models to infer psychological mechanisms. Although such models are increasingly used in cognitive neuroscience, developmental approaches are still scarce. Additionally, though most reversal learning paradigms have a comparable design regarding timing and feedback contingencies, the type of feedback differs substantially between studies. The present study used hierarchical Gaussian filter modeling to investigate cognitive flexibility in reversal learning in children and adolescents and the effect of various feedback types. The results demonstrate that children make more overall errors and regressive errors (when a previously learned response rule is chosen instead of the new correct response after the initial shift to the new correct target), but less perseverative errors (when a previously learned response set continues to be used despite a reversal) adolescents. Analyses of the extracted model parameters of the winning model revealed that children seem to use new and conflicting information less readily than adolescents to update their stimulus-reward associations. Furthermore, more subclinical rigidity in everyday life (parent-ratings) is related to less explorative choice behavior during the probabilistic reversal learning task. Taken together, this study provides first-time data on the development of the underlying processes of cognitive flexibility using computational modeling.https://www.frontiersin.org/articles/10.3389/fnins.2020.536596/fullcognitive flexibilityexecutive functioningdevelopmentreinforcement learningfeedback processing