由痛苦而非获益驱动:精神病学中厌恶相关决策的计算方法
本文综述了厌恶相关决策(ARDM)的计算模型在精神病学中的应用,重点讨论基于状态依赖强化学习模型中的巴甫洛夫偏差参数和工具性更新差异学习率,以及主动推理中的超精确先验信念在焦虑和成瘾相关功能障碍性回避行为中的作用,并指出模型面临个体差异稳定性证据有限、任务信度较低和障碍异质性等挑战。
要点
- ARDM计算模型主要用状态依赖强化学习中的偏差参数量化巴甫洛夫关联,用差异学习率量化工具性更新。
- 巴甫洛夫偏差或主动推理中的超精确先验信念可能促成焦虑和成瘾中的功能障碍性回避行为。
- ARDM的神经基础涉及腹内侧前额叶皮层、腹侧纹状体、岛叶皮层和小脑。
核心结论
- ARDM计算模型有望为焦虑障碍和成瘾的发展提供定量解释,但需解决个体差异稳定性证据有限、任务信度较低和障碍异质性等挑战。
研究设计与样本
- 本文为综述,检索范围未在摘要中报告。
主要发现
- ARDM计算模型主要实现为状态依赖强化学习模型,含偏差参数量化巴甫洛夫关联、差异学习率量化工具性更新。
- 工具性更新依赖情境、涉及复杂成本计算并考虑反事实结果。
- 个体差异如何影响焦虑相关状况或成瘾相关功能障碍的模型尚知之甚少。
- 巴甫洛夫偏差或超精确先验信念在功能障碍性回避行为中起重要作用。
- ARDM神经实现涉及腹内侧前额叶皮层、腹侧纹状体、岛叶皮层和小脑。
关键数值与推荐
- 巴甫洛夫偏差参数用于量化强化学习中的巴甫洛夫关联。
- 差异学习率用于量化工具性更新。
- 超精确先验信念在主动推理框架中与功能障碍性回避行为相关。
临床怎么用
- 计算模型可为焦虑障碍和成瘾的回避行为提供定量解释框架。
- 需开发稳健、可靠、基于模型的实验探针以推进临床转化。
- 需招募更大样本量并采用单案例实验设计以建立更好的实用和解释性生物模型。
局限性
- 个体差异稳定性证据有限。
- 任务信度相对较低。
- 障碍异质性影响模型适用性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
Although it is well known that "losses loom larger than gains," computational approaches to aversion-related decision making (ARDM) for psychiatric disorders is an underdeveloped area. Computational models of ARDM have been implemented primarily as state-dependent reinforcement learning models with bias parameters to quantify Pavlovian associations, and differential learning rates to quantify instrumental updating have been shown to depend on context, involve complex cost calculations, and include the consideration of counterfactual outcomes. Little is known about how individual differences influence these models relevant to anxiety-related conditions or addiction-related dysfunction. It is argued that model parameters reflecting 1) Pavlovian biases in the context of reinforcement learning or 2) hyperprecise prior beliefs in the context of active inference play an important role in the emergence of dysfunctional avoidance behaviors. The neural implementation of ARDM includes brain areas that are important for valuation (ventromedial prefrontal cortex) and positive reinforcement-related prediction errors (ventral striatum), but also aversive processing (insular cortex and cerebellum). Computational models of ARDM will help to establish a quantitative explanatory account of the development of anxiety disorders and addiction, but such models also face several challenges, including limited evidence for stability of individual differences, relatively low reliability of tasks, and disorder heterogeneity. Thus, it will be necessary to develop robust, reliable, and model-based experimental probes; recruit larger sample sizes; and use single case experimental designs for better pragmatic and explanatory biological models of psychiatric disorders.
引用
- Paulus MP. Driven by Pain, Not Gain: Computational Approaches to Aversion-Related Decision Making in Psychiatry. Biol Psychiatry. 2019. PMID: 31653478. doi:10.1016/j.biopsych.2019.08.025
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。