工作记忆、强化学习与努力在价值决策中的交互:新范式及精神分裂症的选择性缺陷
研究开发新实验范式分离工作记忆与强化学习对学习的贡献,在健康年轻人中验证两者存在交互且高工作记忆负荷下强化学习增强,并发现精神分裂症患者存在工作记忆贡献的选择性缺陷而强化学习价值学习保留。
要点
- 新范式可分离工作记忆与强化学习对学习的贡献并检测二者交互。
- 健康年轻人中高工作记忆负荷下强化学习增强,且低负荷下偏好更强。
- 精神分裂症患者工作记忆贡献选择性受损,强化学习价值学习保留。
核心结论
- 计算建模可分离工作记忆与强化学习对学习的贡献并揭示二者交互。
- 精神分裂症患者存在工作记忆贡献的选择性缺陷而强化学习价值学习保留。
研究设计与样本
- 实验1和2在健康年轻成人中验证新范式(n=29和n=52)。
- 实验3比较服药精神分裂症患者(n=49)与对照(n=32)的学习缺陷。
主要发现
- 实验1和2通过负荷与延迟调制选择及奖励历史分别确立工作记忆与强化学习贡献。
- 实验1和2显示工作记忆与强化学习存在交互,高工作记忆负荷下强化学习增强。
- 控制强化历史后观察到心理努力成本:参与者偏好低工作记忆负荷下遇到的刺激。
- 实验3显示精神分裂症患者工作记忆贡献选择性缺陷且强化学习价值学习保留。
临床怎么用
- 可用该范式结合计算建模评估精神分裂症患者工作记忆与强化学习的分离贡献。
局限性
- 实验3患者为服药个体,结果可能受药物影响。
- 样本为特定实验条件,外推需谨慎。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: When studying learning, researchers directly observe only the participants' choices, which are often assumed to arise from a unitary learning process. However, a number of separable systems, such as working memory (WM) and reinforcement learning (RL), contribute simultaneously to human learning. Identifying each system's contributions is essential for mapping the neural substrates contributing in parallel to behavior; computational modeling can help to design tasks that allow such a separable identification of processes and infer their contributions in individuals. METHODS: We present a new experimental protocol that separately identifies the contributions of RL and WM to learning, is sensitive to parametric variations in both, and allows us to investigate whether the processes interact. In experiments 1 and 2, we tested this protocol with healthy young adults (n = 29 and n = 52, respectively). In experiment 3, we used it to investigate learning deficits in medicated individuals with schizophrenia (n = 49 patients, n = 32 control subjects). RESULTS: Experiments 1 and 2 established WM and RL contributions to learning, as evidenced by parametric modulations of choice by load and delay and reward history, respectively. They also showed interactions between WM and RL, where RL was enhanced under high WM load. Moreover, we observed a cost of mental effort when controlling for reinforcement history: participants preferred stimuli they encountered under low WM load. Experiment 3 revealed selective deficits in WM contributions and preserved RL value learning in individuals with schizophrenia compared with control subjects. CONCLUSIONS: Computational approaches allow us to disentangle contributions of multiple systems to learning and, consequently, to further our understanding of psychiatric diseases.
引用
- Collins AGE, Albrecht MA, Waltz JA, et al. Interactions Among Working Memory, Reinforcement Learning, and Effort in Value-Based Choice: A New Paradigm and Selective Deficits in Schizophrenia. Biol Psychiatry. 2017. PMID: 28651789. doi:10.1016/j.biopsych.2017.05.017
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。