运动外科随机试验中统计学显著发现的脆弱性:一项系统性调查
该研究检索2005年1月1日至2015年10月30日Medline、EMBASE和PubMed中运动医学与关节镜外科的平行组随机对照试验,计算统计学显著二分类结局的脆弱指数。共纳入48项随机对照试验,脆弱指数中位数为2(IQR 1-2.8),即治疗组改变2例患者的事件状态即可使结果变为统计学不显著(P≥.05)。结论认为多数运动医学与关节镜外科随机对照试验的统计学显著结果不稳健。
要点
- 共纳入48项运动医学与关节镜外科平行组随机对照试验。
- 脆弱指数中位数为2(IQR 1-2.8),即治疗组改变2例事件状态即可使显著结果变为不显著。
- 作者结论认为多数统计学显著随机对照试验结果不稳健。
核心结论
- 多数运动医学与关节镜外科的统计学显著随机对照试验不稳健,因为仅改变1个治疗组中少数患者的事件状态即可逆转统计学显著性。
- 未来工作需要确定常规报告脆弱指数是否增强临床医生识别应谨慎看待的试验结果的能力。
研究设计与样本
- 检索Medline、EMBASE和PubMed中2005年1月1日至2015年10月30日发表的运动医学与关节镜外科相关随机对照试验。
- 由两名评审员独立评估标题和摘要的研究资格、进行数据提取并评估偏倚风险。
- 对平行组随机对照试验的所有统计学显著二分类结局使用Fisher精确检验计算脆弱指数。
- 采用双变量相关分析评估脆弱指数与试验特征之间的关联。
- 共纳入48项随机对照试验。
主要发现
- 中位样本量为64(四分位距[IQR] 48.5-89.5)。
- 中位结局事件总数为19(IQR 10-27)。
- 脆弱指数中位数为2(IQR 1-2.8),即治疗组改变2例患者的事件状态即可使结果变为统计学不显著(P≥.05)。
局限性
- 未来工作需要确定常规报告脆弱指数是否增强临床医生识别应谨慎看待的试验结果的能力。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: High-quality, evidence-based orthopaedic care relies on the generation and translation of robust research evidence. The Fragility Index is a novel method for evaluating the robustness of statistically significant findings from randomized controlled trials (RCTs). It is defined as the minimum number of patients in 1 arm of a trial that would have to change status from a nonevent to an event to alter the results of the trial from statistically significant to nonsignificant. PURPOSE: To calculate the Fragility Index of statistically significant results from clinical trials in sports medicine and arthroscopic surgery to characterize the robustness of the RCTs in these fields. METHODS: A search was conducted in Medline, EMBASE, and PubMed for RCTs related to sports medicine and arthroscopic surgery from January 1, 2005, to October 30, 2015. Two reviewers independently assessed titles and abstracts for study eligibility, performed data extraction, and assessed risk of bias. The Fragility Index was calculated using the Fisher exact test for all statistically significant dichotomous outcomes from parallel-group RCTs. Bivariate correlation was performed to evaluate associations between the Fragility Index and trial characteristics. RESULTS: A total of 48 RCTs were included. The median sample size was 64 (interquartile range [IQR], 48.5-89.5), and the median total number of outcome events was 19 (IQR, 10-27). The median Fragility Index was 2 (IQR, 1-2.8), meaning that changing 2 patients from a nonevent to an event in the treatment arm changed the result to a statistically nonsignificant result, or P ≥ .05. CONCLUSION: Most statistically significant RCTs in sports medicine and arthroscopic surgery are not robust because their statistical significance can be reversed by changing the outcome status on only a few patients in 1 treatment group. Future work is required to determine whether routine reporting of the Fragility Index enhances clinicians' ability to detect trial results that should be viewed cautiously.
引用
- Khan M, Evaniew N, Gichuru M, et al. The Fragility of Statistically Significant Findings From Randomized Trials in Sports Surgery: A Systematic Survey. Am J Sports Med. 2016. PMID: 27895038. doi:10.1177/0363546516674469
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。