Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment

In order to investigate roles of dopamine receptor subtypes in reward-based learning, we examined choice behavior of dopamine D1 and D2 receptor-knockout (D1R-KO and D2R-KO, respectively) mice in an instrumental learning task with progressively increasing reversal frequency and a dynamic two-armed b...

Full description

Bibliographic Details
Main Authors: Shinae eKwak, Namjung eHuh, Ji-Seon eSeo, Jung-Eun eLee, Pyung-Lim eHan, Min W Jung
Format: Article
Language:English
Published: Frontiers Media S.A. 2014-10-01
Series:Frontiers in Behavioral Neuroscience
Subjects:
Online Access:http://journal.frontiersin.org/Journal/10.3389/fnbeh.2014.00368/full
id doaj-6324771d3c054e94ac5ae77e38c3bb5c
record_format Article
spelling doaj-6324771d3c054e94ac5ae77e38c3bb5c2020-11-25T00:30:06ZengFrontiers Media S.A.Frontiers in Behavioral Neuroscience1662-51532014-10-01810.3389/fnbeh.2014.00368116721Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environmentShinae eKwak0Namjung eHuh1Ji-Seon eSeo2Jung-Eun eLee3Pyung-Lim eHan4Min W Jung5Ajou University School of MedicineInstitute for Basic ScienceEwha Womans UniversityEwha Womans UniversityEwha Womans UniversityKorea Advanced Institute for Science and TechnologyIn order to investigate roles of dopamine receptor subtypes in reward-based learning, we examined choice behavior of dopamine D1 and D2 receptor-knockout (D1R-KO and D2R-KO, respectively) mice in an instrumental learning task with progressively increasing reversal frequency and a dynamic two-armed bandit task. Performance of D2R-KO mice was progressively impaired in the former as the frequency of reversal increased and profoundly impaired in the latter even with prolonged training, whereas D1R-KO mice showed relatively minor performance deficits. Choice behavior in the dynamic two-armed bandit task was well explained by a hybrid model including win-stay-lose-switch and reinforcement learning terms. A model-based analysis revealed increased win-stay, but impaired value updating and decreased value-dependent action selection in D2R-KO mice, which were detrimental to maximizing rewards in the dynamic two-armed bandit task. These results suggest an important role of dopamine D2 receptors in learning from past choice outcomes for rapid adjustment of choice behavior in a dynamic and uncertain environment.http://journal.frontiersin.org/Journal/10.3389/fnbeh.2014.00368/fullMousereinforcement learningD1 receptordynamic foraging taskD2 receptorreversal
collection DOAJ
language English
format Article
sources DOAJ
author Shinae eKwak
Namjung eHuh
Ji-Seon eSeo
Jung-Eun eLee
Pyung-Lim eHan
Min W Jung
spellingShingle Shinae eKwak
Namjung eHuh
Ji-Seon eSeo
Jung-Eun eLee
Pyung-Lim eHan
Min W Jung
Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment
Frontiers in Behavioral Neuroscience
Mouse
reinforcement learning
D1 receptor
dynamic foraging task
D2 receptor
reversal
author_facet Shinae eKwak
Namjung eHuh
Ji-Seon eSeo
Jung-Eun eLee
Pyung-Lim eHan
Min W Jung
author_sort Shinae eKwak
title Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment
title_short Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment
title_full Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment
title_fullStr Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment
title_full_unstemmed Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment
title_sort role of dopamine d2 receptors in optimizing choice strategy in a dynamic and uncertain environment
publisher Frontiers Media S.A.
series Frontiers in Behavioral Neuroscience
issn 1662-5153
publishDate 2014-10-01
description In order to investigate roles of dopamine receptor subtypes in reward-based learning, we examined choice behavior of dopamine D1 and D2 receptor-knockout (D1R-KO and D2R-KO, respectively) mice in an instrumental learning task with progressively increasing reversal frequency and a dynamic two-armed bandit task. Performance of D2R-KO mice was progressively impaired in the former as the frequency of reversal increased and profoundly impaired in the latter even with prolonged training, whereas D1R-KO mice showed relatively minor performance deficits. Choice behavior in the dynamic two-armed bandit task was well explained by a hybrid model including win-stay-lose-switch and reinforcement learning terms. A model-based analysis revealed increased win-stay, but impaired value updating and decreased value-dependent action selection in D2R-KO mice, which were detrimental to maximizing rewards in the dynamic two-armed bandit task. These results suggest an important role of dopamine D2 receptors in learning from past choice outcomes for rapid adjustment of choice behavior in a dynamic and uncertain environment.
topic Mouse
reinforcement learning
D1 receptor
dynamic foraging task
D2 receptor
reversal
url http://journal.frontiersin.org/Journal/10.3389/fnbeh.2014.00368/full
work_keys_str_mv AT shinaeekwak roleofdopamined2receptorsinoptimizingchoicestrategyinadynamicanduncertainenvironment
AT namjungehuh roleofdopamined2receptorsinoptimizingchoicestrategyinadynamicanduncertainenvironment
AT jiseoneseo roleofdopamined2receptorsinoptimizingchoicestrategyinadynamicanduncertainenvironment
AT jungeunelee roleofdopamined2receptorsinoptimizingchoicestrategyinadynamicanduncertainenvironment
AT pyunglimehan roleofdopamined2receptorsinoptimizingchoicestrategyinadynamicanduncertainenvironment
AT minwjung roleofdopamined2receptorsinoptimizingchoicestrategyinadynamicanduncertainenvironment
_version_ 1725327960524718080