临床试验中可确认的应答者类别的学习与验证
该研究提出可确认应答者类别(CRC)学习框架:在随机一半数据(训练集)中学习预测条件平均处理效应(CATE)提示临床获益的亚群,并在另一半(测试集)中通过假设检验验证。模拟显示,当全部患者获益时仅两种学习器能稳定识别多数人群为CRC;其中基于交叉验证的学习器在部分患者获益时表现最佳,且对协变量维度和人群特征稳健。
要点
- CRC学习旨在训练集中识别CATE提示获益的亚群,并在测试集中验证。
- 全部患者获益时,仅两种学习器能稳定识别多数人群为CRC。
- 基于交叉验证的学习器在部分患者获益时确认率高且稳健。
核心结论
- 基于交叉验证的CRC学习器在全部或部分患者获益场景下均表现稳健,是模型选择标准进一步开发的可能方向。
- 交替使用原始数据集两半作为训练集和测试集可提升所有方法的性能。
研究设计与样本
- 模拟研究:在全部患者获益或仅部分患者获益的数据集中评估多种CRC学习器。
- CRC学习在随机一半数据(训练集)中学习亚群,在另一半(测试集)中通过假设检验验证。
主要发现
- 全部患者获益时,仅两种学习器能一致识别多数人群为CRC。
- 其中一种学习器在部分患者获益时确认率相对较高,且对协变量维度和人群特征稳健。
- 所有方法通过交替使用两半数据作为训练集和测试集均可改善性能。
关键数值与推荐
- 性能指标包括测试集中的确认率,以及CRC与真实CATE>0组的分类准确率。
临床怎么用
- 可考虑采用基于交叉验证的CRC学习器在临床试验中识别可能获益的亚群,以提高后续研究成功率。
局限性
- 结论基于模拟数据集,尚未在真实临床试验中验证。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
Clinical trials require substantial effort and time to complete, and regulatory agencies may require two successful efficacy trials before approving a new drug. One way to improve the chance of follow-up success is to identify a subpopulation among whom treatment effects are estimated to be beneficial, and enrolling future studies from this subpopulation. In this article we study confirmable responder class (CRC) learning, where the objective is to learn in a random half of the dataset (training set) a subpopulation among whom the predicted conditional ATE (CATE) suggests clinically meaningful benefit, with maximum power of being confirmed via hypothesis test in the other half (test set). We studied a set of CRC learners across simulated datasets in which either all patients benefited, or only some did. Performance metrics included the rate of confirmation in the test set, and the classification accuracy of the CRC compared with the group with true CATE>0. In trials where all patients benefitted, only two learners were able to consistently identify most of the population as the CRC. One of these also performed especially well when only some patients benefitted, having relatively high confirmation rates, and showing robustness to the dimension of the covariate vector and population characteristics. This learner is based on cross-validation, and is a possible avenue for further development of model selection criteria for CRC learning. We also show that the performance of all methods can be improved by using both halves of the original dataset as training and test sets in turn.
引用
- Talisa VB, Chang CH. Learning and confirming a class of treatment responders in clinical trials. Stat Med. 2021. PMID: 34121214. doi:10.1002/sim.9100
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。