Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases

Individual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. W...

Full description

Bibliographic Details
Main Authors: Christine M Constantinople, Alex T Piet, Peter Bibawi, Athena Akrami, Charles Kopec, Carlos D Brody
Format: Article
Language:English
Published: eLife Sciences Publications Ltd 2019-11-01
Series:eLife
Subjects:
Online Access:https://elifesciences.org/articles/49744
id doaj-642f31ed144d4547bf09819349976c93
record_format Article
spelling doaj-642f31ed144d4547bf09819349976c932021-05-05T18:04:31ZengeLife Sciences Publications LtdeLife2050-084X2019-11-01810.7554/eLife.49744Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biasesChristine M Constantinople0https://orcid.org/0000-0003-4435-4460Alex T Piet1https://orcid.org/0000-0002-6529-1414Peter Bibawi2Athena Akrami3Charles Kopec4Carlos D Brody5https://orcid.org/0000-0002-4201-561XPrinceton Neuroscience Institute, Princeton University, Princeton, United StatesPrinceton Neuroscience Institute, Princeton University, Princeton, United StatesPrinceton Neuroscience Institute, Princeton University, Princeton, United StatesPrinceton Neuroscience Institute, Princeton University, Princeton, United States; Department of Molecular Biology, Princeton University, Princeton, United States; Howard Hughes Medical Institute, Princeton University, Princeton, United StatesPrinceton Neuroscience Institute, Princeton University, Princeton, United States; Department of Molecular Biology, Princeton University, Princeton, United StatesPrinceton Neuroscience Institute, Princeton University, Princeton, United States; Department of Molecular Biology, Princeton University, Princeton, United States; Howard Hughes Medical Institute, Princeton University, Princeton, United StatesIndividual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. We trained rats to choose between cued guaranteed and probabilistic rewards in a task in which outcomes on each trial were independent. Behavioral variability often reflected sequential effects, including increased willingness to take risks following risky wins, and spatial ‘win-stay/lose-shift’ biases. Recordings from lateral orbitofrontal cortex (lOFC) revealed encoding of reward history and receipt, and optogenetic inhibition of lOFC eliminated rats’ increased preference for risk following risky wins, but spared other sequential effects. Our data show that different sequential biases are neurally dissociable, and the lOFC’s role in adaptive behavior promotes learning of more abstract biases (here, biases for the risky option), but not spatial ones.https://elifesciences.org/articles/49744decision-makingorbitofrontal cortexsequential biaslearningreinforcement learning
collection DOAJ
language English
format Article
sources DOAJ
author Christine M Constantinople
Alex T Piet
Peter Bibawi
Athena Akrami
Charles Kopec
Carlos D Brody
spellingShingle Christine M Constantinople
Alex T Piet
Peter Bibawi
Athena Akrami
Charles Kopec
Carlos D Brody
Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases
eLife
decision-making
orbitofrontal cortex
sequential bias
learning
reinforcement learning
author_facet Christine M Constantinople
Alex T Piet
Peter Bibawi
Athena Akrami
Charles Kopec
Carlos D Brody
author_sort Christine M Constantinople
title Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases
title_short Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases
title_full Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases
title_fullStr Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases
title_full_unstemmed Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases
title_sort lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases
publisher eLife Sciences Publications Ltd
series eLife
issn 2050-084X
publishDate 2019-11-01
description Individual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. We trained rats to choose between cued guaranteed and probabilistic rewards in a task in which outcomes on each trial were independent. Behavioral variability often reflected sequential effects, including increased willingness to take risks following risky wins, and spatial ‘win-stay/lose-shift’ biases. Recordings from lateral orbitofrontal cortex (lOFC) revealed encoding of reward history and receipt, and optogenetic inhibition of lOFC eliminated rats’ increased preference for risk following risky wins, but spared other sequential effects. Our data show that different sequential biases are neurally dissociable, and the lOFC’s role in adaptive behavior promotes learning of more abstract biases (here, biases for the risky option), but not spatial ones.
topic decision-making
orbitofrontal cortex
sequential bias
learning
reinforcement learning
url https://elifesciences.org/articles/49744
work_keys_str_mv AT christinemconstantinople lateralorbitofrontalcortexpromotestrialbytriallearningofriskybutnotspatialbiases
AT alextpiet lateralorbitofrontalcortexpromotestrialbytriallearningofriskybutnotspatialbiases
AT peterbibawi lateralorbitofrontalcortexpromotestrialbytriallearningofriskybutnotspatialbiases
AT athenaakrami lateralorbitofrontalcortexpromotestrialbytriallearningofriskybutnotspatialbiases
AT charleskopec lateralorbitofrontalcortexpromotestrialbytriallearningofriskybutnotspatialbiases
AT carlosdbrody lateralorbitofrontalcortexpromotestrialbytriallearningofriskybutnotspatialbiases
_version_ 1721458740144635904