Stress enhances model-free reinforcement learning only after negative outcome.
Previous studies found that stress shifts behavioral control by promoting habits while decreasing goal-directed behaviors during reward-based decision-making. It is, however, unclear how stress disrupts the relative contribution of the two systems controlling reward-seeking behavior, i.e. model-free...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2017-01-01
|
Series: | PLoS ONE |
Online Access: | http://europepmc.org/articles/PMC5516979?pdf=render |
id |
doaj-fb90628b7a8b45f99da4b144054bf84a |
---|---|
record_format |
Article |
spelling |
doaj-fb90628b7a8b45f99da4b144054bf84a2020-11-25T01:45:44ZengPublic Library of Science (PLoS)PLoS ONE1932-62032017-01-01127e018058810.1371/journal.pone.0180588Stress enhances model-free reinforcement learning only after negative outcome.Heyeon ParkDaeyeol LeeJeanyung CheyPrevious studies found that stress shifts behavioral control by promoting habits while decreasing goal-directed behaviors during reward-based decision-making. It is, however, unclear how stress disrupts the relative contribution of the two systems controlling reward-seeking behavior, i.e. model-free (or habit) and model-based (or goal-directed). Here, we investigated whether stress biases the contribution of model-free and model-based reinforcement learning processes differently depending on the valence of outcome, and whether stress alters the learning rate, i.e., how quickly information from the new environment is incorporated into choices. Participants were randomly assigned to either a stress or a control condition, and performed a two-stage Markov decision-making task in which the reward probabilities underwent periodic reversals without notice. We found that stress increased the contribution of model-free reinforcement learning only after negative outcome. Furthermore, stress decreased the learning rate. The results suggest that stress diminishes one's ability to make adaptive choices in multiple aspects of reinforcement learning. This finding has implications for understanding how stress facilitates maladaptive habits, such as addictive behavior, and other dysfunctional behaviors associated with stress in clinical and educational contexts.http://europepmc.org/articles/PMC5516979?pdf=render |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Heyeon Park Daeyeol Lee Jeanyung Chey |
spellingShingle |
Heyeon Park Daeyeol Lee Jeanyung Chey Stress enhances model-free reinforcement learning only after negative outcome. PLoS ONE |
author_facet |
Heyeon Park Daeyeol Lee Jeanyung Chey |
author_sort |
Heyeon Park |
title |
Stress enhances model-free reinforcement learning only after negative outcome. |
title_short |
Stress enhances model-free reinforcement learning only after negative outcome. |
title_full |
Stress enhances model-free reinforcement learning only after negative outcome. |
title_fullStr |
Stress enhances model-free reinforcement learning only after negative outcome. |
title_full_unstemmed |
Stress enhances model-free reinforcement learning only after negative outcome. |
title_sort |
stress enhances model-free reinforcement learning only after negative outcome. |
publisher |
Public Library of Science (PLoS) |
series |
PLoS ONE |
issn |
1932-6203 |
publishDate |
2017-01-01 |
description |
Previous studies found that stress shifts behavioral control by promoting habits while decreasing goal-directed behaviors during reward-based decision-making. It is, however, unclear how stress disrupts the relative contribution of the two systems controlling reward-seeking behavior, i.e. model-free (or habit) and model-based (or goal-directed). Here, we investigated whether stress biases the contribution of model-free and model-based reinforcement learning processes differently depending on the valence of outcome, and whether stress alters the learning rate, i.e., how quickly information from the new environment is incorporated into choices. Participants were randomly assigned to either a stress or a control condition, and performed a two-stage Markov decision-making task in which the reward probabilities underwent periodic reversals without notice. We found that stress increased the contribution of model-free reinforcement learning only after negative outcome. Furthermore, stress decreased the learning rate. The results suggest that stress diminishes one's ability to make adaptive choices in multiple aspects of reinforcement learning. This finding has implications for understanding how stress facilitates maladaptive habits, such as addictive behavior, and other dysfunctional behaviors associated with stress in clinical and educational contexts. |
url |
http://europepmc.org/articles/PMC5516979?pdf=render |
work_keys_str_mv |
AT heyeonpark stressenhancesmodelfreereinforcementlearningonlyafternegativeoutcome AT daeyeollee stressenhancesmodelfreereinforcementlearningonlyafternegativeoutcome AT jeanyungchey stressenhancesmodelfreereinforcementlearningonlyafternegativeoutcome |
_version_ |
1725023073407598592 |