文献速递流行病学与生物统计临床试验与 GCP

Upstrap法用于无效性监测:基于历史数据非参数预测未来结局

Upstrapping to determine futility: predicting future outcomes nonparametrically from past data.
PubMed 文献 · Trials · 2024-05-09

该研究提出一种基于重抽样的Upstrap无效性监测方法,通过从期中数据反复有放回抽样模拟数千个完整试验,计算每个模拟试验的p值并与预设决策阈值比较。模拟研究显示,在零假设下Upstrap比备择假设下更易发现无效性;与O'Brien-Fleming成组序贯法相比,I类错误率差异最多1.7%,零假设下预期样本量降低2-22%,备择假设下把握度变化在降低15.7%至升高0.2%之间,预期样本量降低0-15%。

要点

  • Upstrap是一种非参数期中无效性监测方法,通过有放回重抽样模拟完整试验。
  • 模拟研究显示Upstrap在零假设下比备择假设下更易发现无效性证据。
  • 与O'Brien-Fleming法相比,I类错误率差异最多1.7%,零假设下预期样本量降低2-22%。

核心结论

  • 在这项概念验证性模拟研究中,评估了Upstrap作为基于重抽样的临床试验无效性监测方法的潜力。
  • 预期样本量、把握度和I类错误率控制之间的权衡表明,Upstrap可通过校准以不同激进程度实施无效性监测,并可识别其与所考虑的alpha消耗法和条件把握度无效性监测方法之间的性能相似性。

研究设计与样本

  • 方法学模拟研究:Upstrap基于病例重抽样bootstrap,从期中数据反复有放回抽样模拟数千个完整入组试验,计算每个Upstrap试验的p值,并将满足p值标准的Upstrap试验比例与预设决策阈值比较。
  • 模拟研究考虑不同样本量及多种Upstrap校准策略,首先比较不同阈值组合下的试验拒绝率以验证Upstrap方法,然后将Upstrap方法应用于模拟临床试验数据,直接与传统的alpha消耗法和条件把握度无效性监测方法比较性能。

主要发现

  • 方法验证表明,在多种模拟设置下,Upstrap在零假设情景中比备择假设情景中更可能发现无效性证据。
  • 提出的三种Upstrap校准方法根据所用停止规则不同而各有优势。
  • 与O'Brien-Fleming成组序贯方法相比,Upstrap方法的I类错误率差异最多为1.7%,零假设情景下预期样本量降低2-22%。
  • 备择假设情景下,Upstrap方法与O'Brien-Fleming方法相比把握度变化在降低15.7%至升高0.2%之间,预期样本量降低0-15%。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Clinical trials often involve some form of interim monitoring to determine futility before planned trial completion. While many options for interim monitoring exist (e.g., alpha-spending, conditional power), nonparametric based interim monitoring methods are also needed to account for more complex trial designs and analyses. The upstrap is one recently proposed nonparametric method that may be applied for interim monitoring. METHODS: Upstrapping is motivated by the case resampling bootstrap and involves repeatedly sampling with replacement from the interim data to simulate thousands of fully enrolled trials. The p-value is calculated for each upstrapped trial and the proportion of upstrapped trials for which the p-value criteria are met is compared with a pre-specified decision threshold. To evaluate the potential utility for upstrapping as a form of interim futility monitoring, we conducted a simulation study considering different sample sizes with several different proposed calibration strategies for the upstrap. We first compared trial rejection rates across a selection of threshold combinations to validate the upstrapping method. Then, we applied upstrapping methods to simulated clinical trial data, directly comparing their performance with more traditional alpha-spending and conditional power interim monitoring methods for futility. RESULTS: The method validation demonstrated that upstrapping is much more likely to find evidence of futility in the null scenario than the alternative across a variety of simulations settings. Our three proposed approaches for calibration of the upstrap had different strengths depending on the stopping rules used. Compared to O'Brien-Fleming group sequential methods, upstrapped approaches had type I error rates that differed by at most 1.7% and expected sample size was 2-22% lower in the null scenario, while in the alternative scenario power fluctuated between 15.7% lower and 0.2% higher and expected sample size was 0-15% lower. CONCLUSIONS: In this proof-of-concept simulation study, we evaluated the potential for upstrapping as a resampling-based method for futility monitoring in clinical trials. The trade-offs in expected sample size, power, and type I error rate control indicate that the upstrap can be calibrated to implement futility monitoring with varying degrees of aggressiveness and that performance similarities can be identified relative to considered alpha-spending and conditional power futility monitoring methods.

来源:Trials,查看原文。版权归原作者所有。

引用

  1. Wild JL, Ginde AA, Lindsell CJ, et al. Upstrapping to determine futility: predicting future outcomes nonparametrically from past data. Trials. 2024. PMID: 38725072. doi:10.1186/s13063-024-08136-3

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。