文献速递流行病学与生物统计医学人工智能与信息学

基于逐步调整树强化学习评估嵌套动态治疗方案:用于检测与治疗观察性数据

Step-adjusted tree-based reinforcement learning for evaluating nested dynamic treatment regimes using test-and-treat observational data.
PubMed 文献 · Stat Med · 2021-09-07

针对嵌套检测与治疗策略中治疗决策嵌入检测决策的特点,现有统计方法无法处理,本研究开发了逐步调整树强化学习新方法。该方法在每个决策步骤结合增广逆概率加权的稳健半参数估计与树强化学习进行反事实优化,模拟研究显示稳健性能,并应用于约翰霍普金斯大学前列腺癌主动监测数据集评估活检必要性及识别最优检测与治疗方案。

要点

  • 新方法可处理治疗决策嵌套于检测决策的动态治疗方案评估。
  • 结合增广逆概率加权与树强化学习实现反事实优化。
  • 应用于前列腺癌主动监测数据识别最优检测与治疗策略。

核心结论

  • 提出的逐步调整树强化学习方法能在嵌套多阶段动态决策框架下利用观察性数据评估动态治疗方案。

研究设计与样本

  • 开发统计学习方法逐步调整树强化学习,并在模拟研究及约翰霍普金斯大学前列腺癌主动监测数据集上应用。

主要发现

  • 模拟研究表明所提方法在不同场景下具有稳健性能。
  • 在前列腺癌数据中评估了活检必要性并识别了最优检测与治疗方案。

临床怎么用

  • 可用于利用观察性数据评估嵌套检测与治疗策略,如前列腺癌中先检测后治疗的决策序列。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

Dynamic treatment regimes (DTRs) include a sequence of treatment decision rules, in which treatment is adapted over time in response to the changes in an individual's disease progression and health care history. In medical practice, nested test-and-treat strategies are common to improve cost-effectiveness. For example, for patients at risk of prostate cancer, only patients who have high prostate-specific antigen (PSA) need a biopsy, which is costly and invasive, to confirm the diagnosis and help determine the treatment if needed. A decision about treatment happens after the biopsy, and is thus nested within the decision of whether to do the test. However, current existing statistical methods are not able to accommodate such a naturally embedded property of the treatment decision within the test decision. Therefore, we developed a new statistical learning method, step-adjusted tree-based reinforcement learning, to evaluate DTRs within such a nested multistage dynamic decision framework using observational data. At each step within each stage, we combined the robust semiparametric estimation via augmented inverse probability weighting with a tree-based reinforcement learning method to deal with the counterfactual optimization. The simulation studies demonstrated robust performance of the proposed methods under different scenarios. We further applied our method to evaluate the necessity of prostate biopsy and identify the optimal test-and-treat regimes for prostate cancer patients using data from the Johns Hopkins University prostate cancer active surveillance dataset.

来源:Stat Med,查看原文。版权归原作者所有。

引用

  1. Tang M, Wang L, Gorin MA, et al. Step-adjusted tree-based reinforcement learning for evaluating nested dynamic treatment regimes using test-and-treat observational data. Stat Med. 2021. PMID: 34490942. doi:10.1002/sim.9177

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。