用非随机数据库分析模拟随机临床试验:32项临床试验的结果
本研究用3个美国保险索赔数据库模拟30项已完成和2项正在进行的药物随机临床试验的设计参数,采用倾向评分匹配的新使用者队列研究,比较数据库模拟与原始随机试验结果的一致性;总体Pearson相关系数为0.82(95%CI 0.64-0.91),在16项设计可更紧密模拟的试验中一致性更高(Pearson r=0.93;95%CI 0.79-0.97)。
要点
- 总体Pearson相关系数为0.82(95%CI 0.64-0.91),75%达到统计学显著性一致。
- 16项设计可紧密模拟的试验一致性更高:Pearson r=0.93(95%CI 0.79-0.97)。
- 16项关键设计要素难以模拟的试验一致性较弱:Pearson r=0.53(95%CI 0.00-0.83)。
核心结论
- 当设计和测量能够被紧密模拟时,真实世界证据研究可以得出与随机临床试验相似的结论,但这可能难以实现。
- 结果一致性因一致性度量指标而异,模拟差异、偶然和残余混杂可导致结果分歧且难以区分。
研究设计与样本
- 使用3个美国保险索赔数据库(Optum Clinformatics、MarketScan和Medicare)进行倾向评分匹配的新使用者队列研究。
- 模拟30项已完成和2项正在进行的药物随机临床试验的设计参数(人群、干预、对照、结局、时间)。
- 每个数据库研究的纳入排除标准预先设定以模拟对应随机试验,所有32项方案在分析前注册于ClinicalTrials.gov。
- 模拟于2017年至2022年进行。
主要发现
- 总体观察一致性为Pearson相关系数0.82(95%CI 0.64-0.91),75%达到统计学显著性一致,66%估计值一致,75%标准化差异一致。
- 在16项设计可更紧密模拟的随机试验中,一致性更高:Pearson r=0.93(95%CI 0.79-0.97),94%达到统计学显著性一致,88%估计值一致,88%标准化差异一致。
- 在16项某些定义研究问题的设计要素(PICOT)无法用保险索赔数据紧密模拟的随机试验中,一致性较弱:Pearson r=0.53(95%CI 0.00-0.83),56%达到统计学显著性一致,50%估计值一致,69%标准化差异一致。
局限性
- 模拟差异、偶然和残余混杂可导致结果分歧且难以区分。
- 设计要素(PICOT)无法用保险索赔数据紧密模拟时,结果一致性较弱。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
IMPORTANCE: Nonrandomized studies using insurance claims databases can be analyzed to produce real-world evidence on the effectiveness of medical products. Given the lack of baseline randomization and measurement issues, concerns exist about whether such studies produce unbiased treatment effect estimates. OBJECTIVE: To emulate the design of 30 completed and 2 ongoing randomized clinical trials (RCTs) of medications with database studies using observational analogues of the RCT design parameters (population, intervention, comparator, outcome, time [PICOT]) and to quantify agreement in RCT-database study pairs. DESIGN, SETTING, AND PARTICIPANTS: New-user cohort studies with propensity score matching using 3 US claims databases (Optum Clinformatics, MarketScan, and Medicare). Inclusion-exclusion criteria for each database study were prespecified to emulate the corresponding RCT. RCTs were explicitly selected based on feasibility, including power, key confounders, and end points more likely to be emulated with real-world data. All 32 protocols were registered on ClinicalTrials.gov before conducting analyses. Emulations were conducted from 2017 through 2022. EXPOSURES: Therapies for multiple clinical conditions were included. MAIN OUTCOMES AND MEASURES: Database study emulations focused on the primary outcome of the corresponding RCT. Findings of database studies were compared with RCTs using predefined metrics, including Pearson correlation coefficients and binary metrics based on statistical significance agreement, estimate agreement, and standardized difference. RESULTS: In these highly selected RCTs, the overall observed agreement between the RCT and the database emulation results was a Pearson correlation of 0.82 (95% CI, 0.64-0.91), with 75% meeting statistical significance, 66% estimate agreement, and 75% standardized difference agreement. In a post hoc analysis limited to 16 RCTs with closer emulation of trial design and measurements, concordance was higher (Pearson r, 0.93; 95% CI, 0.79-0.97; 94% meeting statistical significance, 88% estimate agreement, 88% standardized difference agreement). Weaker concordance occurred among 16 RCTs for which close emulation of certain design elements that define the research question (PICOT) with data from insurance claims was not possible (Pearson r, 0.53; 95% CI, 0.00-0.83; 56% meeting statistical significance, 50% estimate agreement, 69% standardized difference agreement). CONCLUSIONS AND RELEVANCE: Real-world evidence studies can reach similar conclusions as RCTs when design and measurements can be closely emulated, but this may be difficult to achieve. Concordance in results varied depending on the agreement metric. Emulation differences, chance, and residual confounding can contribute to divergence in results and are difficult to disentangle.
引用
- Wang SV, Schneeweiss S, Franklin JM, et al. Emulation of Randomized Clinical Trials With Nonrandomized Database Analyses: Results of 32 Clinical Trials. JAMA. 2023. PMID: 37097356. doi:10.1001/jama.2023.4221
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。