血管外科随机对照试验中无显著结果研究的语言扭曲分析
该研究检索MEDLINE、EMBASE和Cochrane对照试验注册库,纳入比较颈动脉内膜切除术与颈动脉支架置入术治疗颈动脉狭窄、以及腹主动脉瘤腔内修复与开放修复的无显著统计学意义主要结局的III期随机对照试验,使用经验证工具评估语言扭曲的特征与严重程度。共纳入31篇文献,发现语言扭曲常见于讨论部分,最常用策略是将无显著统计学意义的主要结果解读为治疗等效或排除不良治疗效应。期刊影响因子升高与标题或摘要结论中出现语言扭曲的可能性降低相关(β比值比0.96,95%CI 0.94-0.98,P<.01),资助来源无显著关联(β比值比1.33,95%CI 0.30-5.92,P=.71)。
要点
- 在无显著统计学意义主要结局的血管外科III期随机对照试验中,语言扭曲常见于讨论部分。
- 最常用的语言扭曲策略是将无显著统计学意义的主要结果解读为治疗等效或排除不良治疗效应。
- 期刊影响因子升高与标题或摘要结论中出现语言扭曲的可能性降低相关(β比值比0.96,95%CI 0.94-0.98,P<.01)。
核心结论
- 很大比例的无显著统计学意义随机对照试验包含与其结果不一致的解读,作者和读者应独立评价研究结果并限制语言扭曲在研究解读中的使用。
研究设计与样本
- 研究于2020年6月检索MEDLINE、EMBASE和Cochrane对照试验注册库,纳入比较颈动脉内膜切除术与颈动脉支架置入术治疗颈动脉狭窄、以及腹主动脉瘤腔内修复与开放修复的无显著统计学意义主要结局的III期随机对照试验。
- 共纳入31篇文献进行分析,其中腹主动脉瘤文章18篇,颈动脉狭窄文章13篇。
主要发现
- 腹主动脉瘤文章中,9篇摘要(9/18)和13篇正文(13/18)存在语言扭曲;颈动脉狭窄文章中,7篇摘要(7/13)和10篇正文(10/13)存在语言扭曲。
- 腹主动脉瘤和颈动脉狭窄文章的语言扭曲均最常见于讨论部分,最常用策略是将无显著统计学意义的主要结果解读为治疗等效或排除不良治疗效应。
- 期刊影响因子升高与标题或摘要结论中出现语言扭曲的可能性降低相关(β比值比0.96,95%CI 0.94-0.98,P<.01)。
- 资助来源与语言扭曲无显著关联(β比值比1.33,95%CI 0.30-5.92,P=.71)。
关键数值与推荐
- 使用经验证工具评估语言扭曲的特征与严重程度。
- 主要分析指标为语言扭曲分级与资助来源(商业vs非商业)及期刊影响因子的关联。
临床怎么用
- 作者认为这些发现应促使作者和读者独立评价研究结果,并限制语言扭曲在研究解读中的使用。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: Spin is the manipulation of language that distorts the interpretation of objective findings. The purpose of this study is to describe the characteristics of spin found in statistically nonsignificant randomized controlled trials (RCT) comparing carotid endarterectomy with carotid artery stenting for carotid artery stenosis (CS), and endovascular repair with open repair (OR) for abdominal aortic aneurysms (AAA). METHODS: A search of MEDLINE, EMBASE, and the Cochrane Controlled Register of Trials was performed in June 2020 for studies published describing AAA or CS. All phase III RCTs with nonsignificant primary outcomes comparing open repair with endovascular repair or carotid endarterectomy to carotid artery stenting were included. Studies were appraised for the characteristics and severity of spin using a validated tool. Binary logistic regression was performed to assess the association of spin grade to (1) funding source (commercial vs noncommercial) and (2) the publishing journal's impact factor. RESULTS: Thirty-one of 355 articles captured were included for analysis. Spin was identified in 9 abstracts (9/18) and 13 main texts (13/18) of AAA articles and 7 abstracts (7/13) and 10 main texts (10/13) of CS articles. For both AAA and CS articles, spin was most commonly found in the discussion section, with the most commonly used strategy being the interpretation of statistically nonsignificant primary results to show treatment equivalence or rule out adverse treatment effects. Increasing journal impact factor was associated with a statistically significant lower likelihood of spin in the study title or abstract conclusion (β odds ratio, 0.96; 95% confidence interval, 0.94-0.98; P < .01); no significant association could be found with funding source (β odds ratio, 1.33; 95% confidence interval, 0.30-5.92; P = .71). CONCLUSIONS: A large proportion of statistically nonsignificant RCTs contain interpretations that are inconsistent with their results. These findings should prompt authors and readers to appraise study findings independently and to limit the use of spin in study interpretations.
引用
- Nguyen J, Li A, Tam DY, et al. Analysis of spin in vascular surgery randomized controlled trials with nonsignificant outcomes. J Vasc Surg. 2021. PMID: 34923067. doi:10.1016/j.jvs.2021.09.051
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。