DASH
Repository logo
Communities & Collections
Browse DASH
DASH Stories
Statistics
  1. Home
  2. Faculty of Arts and Sciences
  3. FAS Theses and Dissertations
  4. Relationship of striatal dopamine to reward history and action during probabilistic decision making

Relationship of striatal dopamine to reward history and action during probabilistic decision making

Open/View files
Celia_Beron_Dissertation.pdf (10.04 MB)
Date
May 2, 2023
Author(s)
Beron, Celia Claire
The Harvard community has made this article openly available. Please share how this access benefits you.
Citation
Beron, Celia Claire. 2023. Relationship of striatal dopamine to reward history and action during probabilistic decision making. Doctoral dissertation, Harvard University Graduate School of Arts and Sciences.
Abstract
Adaptive behavior requires animals to flexibly switch between actions to obtain reward. It is unknown how the brain mediates transitions when the relative value between actions is unclear. To study these processes, we examined decision-making strategies employed by mice in a probabilistic two-armed bandit task (2ABT). We found that switching behavior in this task is modulated by previous action and outcome history, producing two distinct behavioral regimes. In one, given certain trial histories, mice nearly deterministically repeat their previous actions. In contrast, following other experiences, mice appear to choose actions randomly. We were able to capture the trial history dependence of switching behavior through several mathematically equivalent models, namely a recursively formulated logistic regression, an action-value reinforcement learning algorithm, and sticky Bayesian inference. Each model required a combined representation of action-outcome history, a perseverative bias, and a stochastic action policy. Using externally observable variables alone, it was necessary that our behavior models capture the probabilistic nature of switching to recapitulate the structure of mouse trial-to-trial decision making. However, we examined whether accessing neural activity would reveal internally determined signatures of switching embedded in the action selection circuitry. We collected fiber photometry recordings of dopamine release into ventrolateral striatum (VLS) in a head-fixed 2ABT in which mice lick both to express decisions and evaluate outcomes. We have previously shown that lick direction and lick action outcome (i.e., the presence or absence of water) are dependent on and encoded in neural activity in VLS. We found evidence that dopamine activity in VLS is modulated by the same set of features necessary to model the behavioral strategy, producing responses to reward outcome consistent with reward prediction error (RPE) theory from reinforcement learning. Other components of VLS dopamine activity produce patterns that are distinct from RPE-encoding and are perhaps better aligned with features such as motivation or salience. Finally, we fail to connect modulation of VLS dopamine activity with future switching behavior through simple linear discrimination, despite the prior evidence that its encoding profile contains features behaviorally predictive of switching, suggesting an anatomical separation between evaluation and action selection.
Terms of Use
This article is made available under the terms and conditions applicable to Other Posted Material (LAA), as set forth at Terms of Service
URI
https://nrs.harvard.edu/URN-3:HUL.INSTREPOS:37375555
Subjects

Basal ganglia

Decision making

Dopamine

Flexible behavior

Reinforcement learnin...

Stochasticity

Neurosciences

Collection
FAS Theses and Dissertations
Metrics
Repository logo
  • CONTACT US
  • OSRDS
  • ABOUT DASH
  • DEPOSITING TO DASH
  • TERMS OF USE
  • REQUEST A WAIVER
  • TAKE DOWN POLICY
  • NAME CHANGE POLICY
  • HARVARD OA POLICIES
  • DASH SUBMITTER AGREEMENT
  • Accessibility
  • Privacy
Creative Commons License BY
Creative Commons Attribution 4.0 International License

Except where otherwise noted, this work is subject to a Creative Commons Attribution 4.0 International License,
which allows anyone to share and adapt our material as long as proper attribution is given.
For details and exceptions, see the Harvard Library Copyright Policy
©2024 Presidents and Fellows of Harvard College.