Author:
Chen Cathy S.,Ebitz R. Becket,Bindas Sylvia R.,Redish A. David,Hayden Benjamin Y.,Grissom Nicola M.
Abstract
AbstractA frequent assumption in value-based decision-making tasks is that agents make decisions based on the feature dimension that reward probabilities vary on. However, in complex, multidimensional environments, stimuli can vary on multiple dimensions at once, meaning that the feature deserving the most credit for outcomes is not always obvious. As a result, individuals may vary in the strategies used to sample stimuli across dimensions, and these strategies may have an unrecognized influence on decision-making. Sex is a proxy for multiple genetic and endocrine influences that can influence decision-making strategies, including how environments are sampled. In this study, we examined the strategies adopted by female and male mice as they learned the value of stimuli that varied in both image and location in a visually-cued two-armed bandit, allowing two possible dimensions to learn about. Female mice acquired the correct image-value associations more quickly than male mice, and they used a fundamentally different strategy to do so. Female mice constrained their decision-space early in learning by preferentially sampling one location over which images varied. Conversely, male strategies were inconsistent, changing frequently and strongly influenced by the immediate experience of stochastic rewards. Individual strategies were related to sex-gated changes in neuronal activation in early learning. Together, we find that in mice, sex is linked with divergent strategies for sampling and learning about the world, revealing substantial unrecognized variability in the approaches implemented during value-based decision-making.
Publisher
Cold Spring Harbor Laboratory
Reference73 articles.
1. Exploration Disrupts Choice-Predictive Signals and Alters Dynamics in Prefrontal Cortex;Neuron,2018
2. Motivational neural circuits underlying reinforcement learning
3. Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target
4. Neurons in Posterior Cingulate Cortex Signal Exploratory Decisions in a Dynamic Multioption Choice Task
5. Bartolo, R. , Saunders, R.C. , Mitz, A. , and Averbeck, B.B. (2019). Dimensionality, information and learning in prefrontal cortex. bioRxiv, 823377. Available at: https://www.biorxiv.org/content/10.1101/823377v1.full [Accessed February 25, 2020].
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献