文献速递流行病学与生物统计医学教育与科研方法

超越统计学显著性:Cochrane综述中对统计学非显著结果的细致解读罕见——一项元流行病学研究

Beyond statistical significance: nuanced interpretations of statistically nonsignificant results were rare in Cochrane reviews - a metaepidemiological study.
PubMed 文献 · J Clin Epidemiol · 2023-06-12

该元流行病学研究筛查了2017至2022年发表的2337篇Cochrane综述,检出139例作者将统计学非显著效应量表述为有意义的差异。作者常用限定词表达不确定性(66.9%),有时(26.6%)对某一干预的更大获益或危害做出绝对断言而未承认统计学不确定性。曲线下面积分析提示部分作者可能夸大非显著差异的重要性,而另一些作者可能忽视非显著效应估计中有意义的差异。

要点

  • 在2337篇Cochrane综述中检出139例作者将统计学非显著结果强调为有意义的差异。
  • 66.9%的案例使用限定词表达不确定性,26.6%的案例做出绝对断言而未承认统计学不确定性。
  • 曲线下面积分析提示部分作者可能夸大非显著差异的重要性,另一些可能忽视有意义的差异。

核心结论

  • Cochrane综述中对统计学非显著结果的细致解读罕见,作者在解读统计学非显著效应估计时需要更细致的方法。

研究设计与样本

  • 元流行病学研究,筛查2017至2022年发表的Cochrane综述中作者将统计学非显著效应估计表述为有意义差异的案例。
  • 对解读进行定性分类,并通过计算置信区间超过无效值或最小重要差异部分(指示某一干预效应更大)的曲线下面积进行定量评估。

主要发现

  • 在2337篇综述中检出139例作者将非显著结果强调为有意义的差异。
  • 作者常用限定词表达不确定性(66.9%)。
  • 有时(26.6%)对某一干预的更大获益或危害做出绝对断言而未承认统计学不确定性。
  • 曲线下面积分析提示部分作者可能夸大非显著差异的重要性,而另一些作者可能忽视非显著效应估计中有意义的差异。

关键数值与推荐

  • 在2337篇综述中检出139例作者将非显著结果强调为有意义的差异。
  • 作者常用限定词表达不确定性(66.9%)。
  • 有时(26.6%)对某一干预的更大获益或危害做出绝对断言而未承认统计学不确定性。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: To assess the language used by systematic review authors to emphasize that statistically nonsignificant results show meaningful differences. To determine whether the magnitude of these treatment effects was distinct from nonsignificant results that authors interpreted as not different. STUDY DESIGN AND SETTING: We screened Cochrane reviews published between 2017 and 2022 for statistically nonsignificant effect estimates that authors presented as meaningful differences. We classified interpretations qualitatively and assessed them quantitatively by calculating the areas under the curve of the portions of confidence intervals exceeding the null or a minimal important difference, indicating one intervention's greater effect. RESULTS: In 2,337 reviews, we detected 139 cases where authors emphasized meaningful differences in nonsignificant results. Authors commonly used qualifying words to express uncertainty (66.9%). Sometimes (26.6%), they made absolute claims about one intervention's greater benefit or harm without acknowledging statistical uncertainty. The areas under the curve analyses indicated that some authors may overstate the importance of nonsignificant differences, whereas others may overlook meaningful differences in nonsignificant effect estimates. CONCLUSION: Nuanced interpretations of statistically nonsignificant results were rare in Cochrane reviews. Our study highlights the need for a more nuanced approach by systematic review authors when interpreting statistically nonsignificant effect estimates.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Gartlehner G, Persad E, Ledinger D, et al. Beyond statistical significance: nuanced interpretations of statistically nonsignificant results were rare in Cochrane reviews - a metaepidemiological study. J Clin Epidemiol. 2023. PMID: 37315819. doi:10.1016/j.jclinepi.2023.06.007

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。