Stress enhances model-free reinforcement learning only after negative outcome.

Previous studies found that stress shifts behavioral control by promoting habits while decreasing goal-directed behaviors during reward-based decision-making. It is, however, unclear how stress disrupts the relative contribution of the two systems controlling reward-seeking behavior, i.e. model-free...

Full description

Bibliographic Details
Main Authors: Heyeon Park, Daeyeol Lee, Jeanyung Chey
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2017-01-01
Series:PLoS ONE
Online Access:http://europepmc.org/articles/PMC5516979?pdf=render
id doaj-fb90628b7a8b45f99da4b144054bf84a
record_format Article
spelling doaj-fb90628b7a8b45f99da4b144054bf84a2020-11-25T01:45:44ZengPublic Library of Science (PLoS)PLoS ONE1932-62032017-01-01127e018058810.1371/journal.pone.0180588Stress enhances model-free reinforcement learning only after negative outcome.Heyeon ParkDaeyeol LeeJeanyung CheyPrevious studies found that stress shifts behavioral control by promoting habits while decreasing goal-directed behaviors during reward-based decision-making. It is, however, unclear how stress disrupts the relative contribution of the two systems controlling reward-seeking behavior, i.e. model-free (or habit) and model-based (or goal-directed). Here, we investigated whether stress biases the contribution of model-free and model-based reinforcement learning processes differently depending on the valence of outcome, and whether stress alters the learning rate, i.e., how quickly information from the new environment is incorporated into choices. Participants were randomly assigned to either a stress or a control condition, and performed a two-stage Markov decision-making task in which the reward probabilities underwent periodic reversals without notice. We found that stress increased the contribution of model-free reinforcement learning only after negative outcome. Furthermore, stress decreased the learning rate. The results suggest that stress diminishes one's ability to make adaptive choices in multiple aspects of reinforcement learning. This finding has implications for understanding how stress facilitates maladaptive habits, such as addictive behavior, and other dysfunctional behaviors associated with stress in clinical and educational contexts.http://europepmc.org/articles/PMC5516979?pdf=render
collection DOAJ
language English
format Article
sources DOAJ
author Heyeon Park
Daeyeol Lee
Jeanyung Chey
spellingShingle Heyeon Park
Daeyeol Lee
Jeanyung Chey
Stress enhances model-free reinforcement learning only after negative outcome.
PLoS ONE
author_facet Heyeon Park
Daeyeol Lee
Jeanyung Chey
author_sort Heyeon Park
title Stress enhances model-free reinforcement learning only after negative outcome.
title_short Stress enhances model-free reinforcement learning only after negative outcome.
title_full Stress enhances model-free reinforcement learning only after negative outcome.
title_fullStr Stress enhances model-free reinforcement learning only after negative outcome.
title_full_unstemmed Stress enhances model-free reinforcement learning only after negative outcome.
title_sort stress enhances model-free reinforcement learning only after negative outcome.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2017-01-01
description Previous studies found that stress shifts behavioral control by promoting habits while decreasing goal-directed behaviors during reward-based decision-making. It is, however, unclear how stress disrupts the relative contribution of the two systems controlling reward-seeking behavior, i.e. model-free (or habit) and model-based (or goal-directed). Here, we investigated whether stress biases the contribution of model-free and model-based reinforcement learning processes differently depending on the valence of outcome, and whether stress alters the learning rate, i.e., how quickly information from the new environment is incorporated into choices. Participants were randomly assigned to either a stress or a control condition, and performed a two-stage Markov decision-making task in which the reward probabilities underwent periodic reversals without notice. We found that stress increased the contribution of model-free reinforcement learning only after negative outcome. Furthermore, stress decreased the learning rate. The results suggest that stress diminishes one's ability to make adaptive choices in multiple aspects of reinforcement learning. This finding has implications for understanding how stress facilitates maladaptive habits, such as addictive behavior, and other dysfunctional behaviors associated with stress in clinical and educational contexts.
url http://europepmc.org/articles/PMC5516979?pdf=render
work_keys_str_mv AT heyeonpark stressenhancesmodelfreereinforcementlearningonlyafternegativeoutcome
AT daeyeollee stressenhancesmodelfreereinforcementlearningonlyafternegativeoutcome
AT jeanyungchey stressenhancesmodelfreereinforcementlearningonlyafternegativeoutcome
_version_ 1725023073407598592