文献速递重症综合管理与镇静镇痛

麻醉与重症医学随机试验中统计学显著结论的脆弱性与可靠性:系统评价

The Fragility and Reliability of Conclusions of Anesthesia and Critical Care Randomized Trials With Statistically Significant Findings: A Systematic Review.
PubMed 文献 · Crit Care Med · 2019-01-01
一句话结论麻醉与重症随机试验中统计学显著结果常较脆弱,中位脆弱指数仅为3,且42%的阴性试验存在高度曲解(spin)。

该系统评价检索MEDLINE 2007年1月1日至2017年2月22日,纳入166项1:1平行对照、至少有一项二分类结局达统计学显著(p<0.05)的麻醉或重症干预随机对照试验。中位样本量207例(IQR 109-497),中位脆弱指数为3(IQR 1-7),即只需在某一治疗组增加3个事件即可使显著性消失。42%(n=30)的阴性试验存在高度曲解,21%(n=20)的阳性试验给出了临床实践推荐。在高影响因子期刊发表与较低曲解水平和较少推荐相关(两者p<0.001)。作者认为常规计算脆弱指数可能有助于更好理解试验并提升报告质量。

要点

  • 166项麻醉与重症随机试验中,中位脆弱指数仅3(IQR 1-7),即某一治疗组仅需增加3个事件即可使统计学显著结果消失。
  • 中位样本量为207例(IQR 109-497),提示多数试验样本量有限。
  • 42%(n=30)的阴性随机对照试验存在高度曲解(spin),即结论表述偏离实际结果。
  • 21%(n=20)的阳性随机对照试验给出了临床实践推荐。
  • 在高影响因子期刊发表与较低曲解水平和较少推荐相关(p<0.001)。

适用人群与场景

  • 纳入标准:将患者1:1随机分配至两个平行臂、并报告至少一项统计学显著(p<0.05)二分类结局(主要或次要)的随机对照试验。
  • 研究领域为重症医学或麻醉干预的随机对照试验,检索MEDLINE 2007年1月1日至2017年2月22日。

诊断标准与关键阈值

  • 脆弱指数(Fragility Index):使统计学显著结果消失所需在某一治疗组增加的事件数;本研究中位值为3(IQR 1-7)。
  • 统计学显著性定义为p<0.05。

研究设计与关键结果

  • 系统评价共纳入166项符合条件的随机对照试验,中位样本量207例(IQR 109-497)。
  • 中位脆弱指数为3(IQR 1-7),意味着在某一治疗组增加3个事件即可使统计学显著性消失。
  • 42%(n=30)的阴性随机对照试验存在高度曲解(spin)。
  • 21%(n=20)的阳性随机对照试验提供了临床实践推荐。
  • 在高影响因子期刊发表与较低曲解水平和较少推荐相关(两者p<0.001)。

证据类型、等级与局限

  • 证据类型:系统评价,检索MEDLINE 2007年1月1日至2017年2月22日。
  • 由两名评价者独立评估合格性并提取数据。
  • 局限:原文未报告局限性。

对床旁实践的改变

  • 作者认为,在医学文献中常规计算脆弱指数可能有助于更好地理解试验,并因此提升报告质量。
  • 原文未据此给出针对急诊或ICU具体临床操作的建议。

提炼说明

  • 本条依据论文摘要整理;摘要未涉及「处置流程与药物剂量」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开

OBJECTIVES: The Fragility Index, which represents the number of patients responsible for a statistically significant finding, has been suggested as an aid for interpreting the robustness of results from clinical trials. A small Fragility Index indicates that the statistical significance of a trial depends on only a few events. Our objectives were to calculate the Fragility Index of statistically significant results from randomized controlled trials of anesthesia and critical care interventions and to determine the frequency of distorted presentation of results or "spin".

DATA SOURCES: We systematically searched MEDLINE from January 01, 2007, to February 22, 2017, to identify randomized controlled trials exploring the effect of critical care medicine or anesthesia interventions.

STUDY SELECTION: Studies were included if they randomized patients 1:1 into two parallel arms and reported at least one statistically significant (p < 0.05) binary outcome (primary or secondary).

DATA EXTRACTION: Two reviewers independently assessed eligibility and extracted data. The Fragility Index was determined for the chosen outcome. We assessed the level of spin in negative trials and the presence of recommendations for clinical practice in positive trials.

DATA SYNTHESIS: We identified 166 eligible randomized controlled trials with a median sample size of 207 patients (interquartile range, 109-497). The median Fragility Index was 3 (interquartile range, 1-7), which means that adding three events to one of the trials treatment arms eliminated its statistical significance. High spin was identified in 42% (n = 30) of negative randomized controlled trials, whereas 21% (n = 20) of positive randomized controlled trials provided recommendations. Lower levels of spin and recommendations were associated with publication in journals with high impact factors (p < 0.001 for both).

CONCLUSIONS: Statistically significant results in anesthesia and critical care randomized controlled trials are often fragile, and study conclusions are frequently affected by spin. Routine calculation of the Fragility Index in medical literature may allow for better understanding of trials and therefore enhance the quality of reporting.

来源:Crit Care Med,查看原文。版权归原作者所有。

参考来源

  1. Grolleau F, Collins GS, Smarandache A, et al. The Fragility and Reliability of Conclusions of Anesthesia and Critical Care Randomized Trials With Statistically Significant Findings: A Systematic Review. Crit Care Med. 2019. PMID: 30394920. doi:10.1097/CCM.0000000000003527

供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。