文献速递流行病学与生物统计医学教育与科研方法

已发表随机试验中预设统计分析方法的公开性与依从性均较低

Public availability and adherence to prespecified statistical analysis approaches was low in published randomized trials.
PubMed 文献 · J Clin Epidemiol · 2020-07-28

该研究评估了2018年发表的100项随机试验中主要结局预设统计分析方法是否公开可得,并比较可得的预设分析与最终发表分析之间是否存在无法解释的差异。结果显示仅12%的试验公开了预设分析方法,其中92%存在至少一处无法解释的差异,且仅少数试验报告统计师设盲情况。

要点

  • 仅12%的试验公开了主要结局的预设统计分析方法。
  • 12项有预设分析的试验中11项存在无法解释的差异。
  • 仅4%的试验说明统计师在SAP签署前设盲。

核心结论

  • 多数已发表随机试验的信息不足以判断结果是否可能受到p-hacking影响。
  • 在信息可得的试验中,预设分析与最终分析方法之间常存在无法解释的差异。

研究设计与样本

  • 研究纳入2018年发表并被PubMed收录的100项随机试验。
  • 评估每项试验主要结局预设统计分析方法是否公开可得,并与发表内容比较识别无法解释的差异。

主要发现

  • 100项试验中仅12项(12%)公开了主要结局的预设统计分析方法。
  • 仅2项试验的预设分析文件日期早于受试者招募开始。
  • 12项有预设分析的试验中11项(92%)存在至少一处无法解释的差异。
  • 仅4项试验(4%)说明统计师在SAP签署前设盲。
  • 仅10项试验(10%)说明统计师在数据库锁定前设盲。

临床怎么用

  • 阅读随机试验报告时应核查预设统计分析方法的公开情况与日期。
  • 关注预设分析与最终分析之间是否存在无法解释的差异。
  • 关注统计师设盲时点的报告情况以辅助判断分析独立性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND AND OBJECTIVE: Prespecification of statistical methods in clinical trial protocols and statistical analysis plans can help to deter bias from p-hacking but is only effective if the prespecified approach is made available. STUDY DESIGN AND SETTING: For 100 randomized trials published in 2018 and indexed in PubMed, we evaluated how often a prespecified statistical analysis approach for the trial's primary outcome was publicly available. For each trial with an available prespecified analysis, we compared this with the trial publication to identify whether there were unexplained discrepancies. RESULTS: Only 12 of 100 trials (12%) had a publicly available prespecified analysis approach for their primary outcome; this document was dated before recruitment began for only two trials. Of the 12 trials with an available prespecified analysis approach, 11 (92%) had one or more unexplained discrepancies. Only 4 of 100 trials (4%) stated that the statistician was blinded until the SAP was signed off, and only 10 of 100 (10%) stated the statistician was blinded until the database was locked. CONCLUSION: For most published trials, there is insufficient information available to determine whether the results may be subject to p-hacking. Where information was available, there were often unexplained discrepancies between the prespecified and final analysis methods.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Kahan BC, Ahmad T, Forbes G, et al. Public availability and adherence to prespecified statistical analysis approaches was low in published randomized trials. J Clin Epidemiol. 2020. PMID: 32730852. doi:10.1016/j.jclinepi.2020.07.015

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。