纳入会议摘要很少改变系统评价结论:基于COVID-19治疗活体网络Meta分析的案例研究
该回顾性方法学研究评估了截至2024年5月19日纳入COVID-19活体系统评价与网络Meta分析的全部105篇会议摘要,其中53%(56/105)有全文发表,仅7%达到高报告标准。纳入会议摘要在14%的时间点使Meta分析成为可能,使用零阈值时不改变结论,但使用最小重要差异时改变55.6%的效应估计和16%的不精确性评级。作者建议逐案评估会议摘要的纳入并促进更好的报告实践。
要点
- 105篇会议摘要中仅7%达到高报告标准,53%(56/105)有全文发表。
- 纳入会议摘要在14%的时间点使Meta分析成为可能。
- 使用最小重要差异时,纳入会议摘要改变55.6%的效应估计和16%的不精确性评级。
核心结论
- 会议摘要在数据有限或新兴时可填补证据空白,使用零阈值时很少改变结论,但使用最小重要差异时影响更大,评价者应逐案评估其纳入并促进更好的报告实践。
研究设计与样本
- 对截至2024年5月19日纳入COVID-19活体系统评价与网络Meta分析的所有会议摘要进行回顾性方法学研究,共纳入105篇会议摘要。
- 使用CONSORT-A评估报告质量,并与全文发表进行一致性比较;在预设时间点比较纳入与不纳入会议摘要的Meta分析对死亡率和住院时长的效应及GRADE域的变化。
主要发现
- 105篇会议摘要中53%(56/105)与全文发表关联,仅7%达到高报告标准。
- 关键方法学条目与全文发表的平均一致性为67.6%,常因两来源均缺失细节。
- 会议摘要在14%的时间点使原本无法进行的Meta分析成为可能。
- 使用零阈值时纳入会议摘要不改变结论,但使用最小重要差异时改变55.6%的效应估计和16%的不精确性评级。
- 少数情况下会议摘要还影响偏倚风险和不一致性评估。
临床怎么用
- 作者建议评价者逐案评估会议摘要的纳入,并促进更好的报告实践以增强其对系统评价的贡献。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND OBJECTIVES: Including conference abstracts (CAs) in systematic reviews (SRs) helps reduce publication bias but raises concerns about reporting quality and reliability. While discrepancies with full publications are known, excluding CAs may overlook relevant early evidence. To evaluate the reporting quality of CAs, their consistency with full-text publications, and the impact of including them on effect estimates and the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) framework in a living systematic review and network meta-analysis (SRNMA) of COVID-19 drug treatments. STUDY DESIGN AND SETTING: We conducted a retrospective methodological study of all CAs included in the COVID-19 SRNMA until May 19, 2024. We assessed trial characteristics, reporting quality using Consolidated Standards of Reporting Trials (CONSORT)-A, and consistency with full-text publications. We also compared meta-analyses with and without CAs at predefined time points for mortality and hospital length of stay, evaluating changes in effect and GRADE domains. RESULTS: We included 105 CAs; 53% (56/105) were linked to a full publication. Only 7% met high reporting standards. Average consistency with full-text publications across key methodological items was 67.6%, often due to missing details in both sources. CAs enabled meta-analyses that would not have been possible at 14% of time points. Their inclusion did not affect conclusions when using the null threshold but changed the effect estimate in 55.6% and imprecision ratings in 16% of cases when using minimally important differences (MIDs). In a few instances, CAs also influenced risk of bias and inconsistency assessments. CONCLUSION: CAs can fill evidence gaps when data are limited or emerging. Although they rarely change conclusions based on the null threshold, their inclusion has a greater impact when using MID. Reviewers should assess their inclusion case by case and promote better reporting practices to enhance their contribution to SRs.
引用
- Oliveros MJ, Ibrahim S, Bravo-Soto G, et al. Including conference abstracts rarely changed systematic review conclusions: a case study from a living network meta-analysis of COVID-19 treatments. J Clin Epidemiol. 2025. PMID: 40834932. doi:10.1016/j.jclinepi.2025.111931
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。