文献速递流行病学与生物统计

试验结果的脆弱性不止涉及统计学显著性

The fragility of trial results involves more than statistical significance alone.
PubMed 文献 · J Clin Epidemiol · 2020-04-13

该研究指出既往将试验结果的脆弱性仅定义为改变统计学显著性所需的结果变化次数存在局限,提出应同时纳入临床重要性和定量稳定性。作者通过示例说明,影响统计学显著性所需的小幅数据变化实际可能难以发生;仅凭统计学显著性无法反映治疗效应大小。结论认为脆弱性概念应包含临床重要性、定量稳定性与统计学显著性三方面。

要点

  • 仅用统计学显著性评估试验脆弱性视角有限且可能误导。
  • 脆弱性评估应同时纳入临床重要性与定量稳定性。
  • 仅当结果统计学显著且定量稳定时才应宣布为稳定。

核心结论

  • 脆弱性概念应包含试验发现的临床重要性、定量稳定性以及统计学显著性。
  • 仅当结果统计学显著且定量稳定时才应宣布为稳定,否则应宣布为不稳定或脆弱。

研究设计与样本

  • 本文为方法学论述,提出增强框架以评估试验结果的脆弱性。

主要发现

  • 示例显示,影响统计学显著性所需的小幅数据变化实际可能难以发生。
  • 统计学显著性不提供治疗效应大小的信息。

关键数值与推荐

  • 增强框架纳入试验结果的临床重要性与定量稳定性。
  • 结果稳定需同时满足统计学显著与定量稳定,临床重要性可重要或不重要。

临床怎么用

  • 解读试验结果时应同时考虑统计学显著性、临床重要性与定量稳定性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: The fragility of clinical trial findings has been previously defined as the number of changes in outcomes that are required to change their statistical significance. We show that reliance on statistical significance alone provides only a limited and potentially misleading perspective, and an enhanced approach is developed. METHODS: Clinical importance of trial results and their quantitative stability are incorporated into an enhanced framework to assess fragility. RESULTS: Examples show that the small data changes required to affect statistical significance may actually be unlikely to occur. Recognizing this limitation, and because statistical significance conveys no information about the treatment effect size, our approach additionally takes into account the clinical importance of the results and their quantitative stability. The interpretation of studies with various combinations of these features is described. CONCLUSION: The concept of fragility should include clinical importance of trial findings and their quantitative stability, as well as statistical significance. Study results should be declared as stable only if they are statistically significant and quantitatively stable, but they can be either clinically important or unimportant; otherwise, the findings should be declared as unstable, or fragile.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Walter SD, Thabane L, Briel M, et al. The fragility of trial results involves more than statistical significance alone. J Clin Epidemiol. 2020. PMID: 32298777. doi:10.1016/j.jclinepi.2020.02.011

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。