A neural computational model of incentive salience.
Incentive salience is a motivational property with 'magnet-like' qualities. When attributed to reward-predicting stimuli (cues), incentive salience triggers a pulse of 'wanting' and an individual is pulled toward the cues and reward. A key computational question is how incentive...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2009-07-01
|
Series: | PLoS Computational Biology |
Online Access: | http://europepmc.org/articles/PMC2703828?pdf=render |
id |
doaj-97b9008f08a943d38b71cea8624d6868 |
---|---|
record_format |
Article |
spelling |
doaj-97b9008f08a943d38b71cea8624d68682020-11-25T01:53:28ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582009-07-0157e100043710.1371/journal.pcbi.1000437A neural computational model of incentive salience.Jun ZhangKent C BerridgeAmy J TindellKyle S SmithJ Wayne AldridgeIncentive salience is a motivational property with 'magnet-like' qualities. When attributed to reward-predicting stimuli (cues), incentive salience triggers a pulse of 'wanting' and an individual is pulled toward the cues and reward. A key computational question is how incentive salience is generated during a cue re-encounter, which combines both learning and the state of limbic brain mechanisms. Learning processes, such as temporal-difference models, provide one way for stimuli to acquire cached predictive values of rewards. However, empirical data show that subsequent incentive values are also modulated on the fly by dynamic fluctuation in physiological states, altering cached values in ways requiring additional motivation mechanisms. Dynamic modulation of incentive salience for a Pavlovian conditioned stimulus (CS or cue) occurs during certain states, without necessarily requiring (re)learning about the cue. In some cases, dynamic modulation of cue value occurs during states that are quite novel, never having been experienced before, and even prior to experience of the associated unconditioned reward in the new state. Such cases can include novel drug-induced mesolimbic activation and addictive incentive-sensitization, as well as natural appetite states such as salt appetite. Dynamic enhancement specifically raises the incentive salience of an appropriate CS, without necessarily changing that of other CSs. Here we suggest a new computational model that modulates incentive salience by integrating changing physiological states with prior learning. We support the model with behavioral and neurobiological data from empirical tests that demonstrate dynamic elevations in cue-triggered motivation (involving natural salt appetite, and drug-induced intoxication and sensitization). Our data call for a dynamic model of incentive salience, such as presented here. Computational models can adequately capture fluctuations in cue-triggered 'wanting' only by incorporating modulation of previously learned values by natural appetite and addiction-related states.http://europepmc.org/articles/PMC2703828?pdf=render |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Jun Zhang Kent C Berridge Amy J Tindell Kyle S Smith J Wayne Aldridge |
spellingShingle |
Jun Zhang Kent C Berridge Amy J Tindell Kyle S Smith J Wayne Aldridge A neural computational model of incentive salience. PLoS Computational Biology |
author_facet |
Jun Zhang Kent C Berridge Amy J Tindell Kyle S Smith J Wayne Aldridge |
author_sort |
Jun Zhang |
title |
A neural computational model of incentive salience. |
title_short |
A neural computational model of incentive salience. |
title_full |
A neural computational model of incentive salience. |
title_fullStr |
A neural computational model of incentive salience. |
title_full_unstemmed |
A neural computational model of incentive salience. |
title_sort |
neural computational model of incentive salience. |
publisher |
Public Library of Science (PLoS) |
series |
PLoS Computational Biology |
issn |
1553-734X 1553-7358 |
publishDate |
2009-07-01 |
description |
Incentive salience is a motivational property with 'magnet-like' qualities. When attributed to reward-predicting stimuli (cues), incentive salience triggers a pulse of 'wanting' and an individual is pulled toward the cues and reward. A key computational question is how incentive salience is generated during a cue re-encounter, which combines both learning and the state of limbic brain mechanisms. Learning processes, such as temporal-difference models, provide one way for stimuli to acquire cached predictive values of rewards. However, empirical data show that subsequent incentive values are also modulated on the fly by dynamic fluctuation in physiological states, altering cached values in ways requiring additional motivation mechanisms. Dynamic modulation of incentive salience for a Pavlovian conditioned stimulus (CS or cue) occurs during certain states, without necessarily requiring (re)learning about the cue. In some cases, dynamic modulation of cue value occurs during states that are quite novel, never having been experienced before, and even prior to experience of the associated unconditioned reward in the new state. Such cases can include novel drug-induced mesolimbic activation and addictive incentive-sensitization, as well as natural appetite states such as salt appetite. Dynamic enhancement specifically raises the incentive salience of an appropriate CS, without necessarily changing that of other CSs. Here we suggest a new computational model that modulates incentive salience by integrating changing physiological states with prior learning. We support the model with behavioral and neurobiological data from empirical tests that demonstrate dynamic elevations in cue-triggered motivation (involving natural salt appetite, and drug-induced intoxication and sensitization). Our data call for a dynamic model of incentive salience, such as presented here. Computational models can adequately capture fluctuations in cue-triggered 'wanting' only by incorporating modulation of previously learned values by natural appetite and addiction-related states. |
url |
http://europepmc.org/articles/PMC2703828?pdf=render |
work_keys_str_mv |
AT junzhang aneuralcomputationalmodelofincentivesalience AT kentcberridge aneuralcomputationalmodelofincentivesalience AT amyjtindell aneuralcomputationalmodelofincentivesalience AT kylessmith aneuralcomputationalmodelofincentivesalience AT jwaynealdridge aneuralcomputationalmodelofincentivesalience AT junzhang neuralcomputationalmodelofincentivesalience AT kentcberridge neuralcomputationalmodelofincentivesalience AT amyjtindell neuralcomputationalmodelofincentivesalience AT kylessmith neuralcomputationalmodelofincentivesalience AT jwaynealdridge neuralcomputationalmodelofincentivesalience |
_version_ |
1724990842995736576 |