文献速递医学教育与科研方法

两周系统评价(2weekSR)方法被另一团队成功盲法重复:一项案例研究

The 2-week systematic review (2weekSR) method was successfully blind-replicated by another team: a case study.
PubMed 文献 · J Clin Epidemiol · 2023-10-23

本研究评估由另一团队使用保真度方法重复一项借助自动化工具完成的两周系统评价(2weekSR)的可行性。重复团队由三名评价员组成,完成系统评价共耗时63人时(11个工作日/15个日历日),方法学保真度评分为0.95,结局保真度评分为0.63,重复研究得出了与原始研究相同的结论。

要点

  • 重复团队由三名评价员组成,借助自动化工具在63人时(11个工作日/15个日历日)内完成系统评价。
  • 方法学保真度评分为0.95,8项任务中3项仅部分重复;结局保真度评分为0.63,7项任务中6项仅部分重复,1项未重复。
  • 重复研究得出了与原始研究相同的结论。

核心结论

  • 一项2weekSR研究由三名评价员组成的小团队在自动化工具支持下成功重复,重复研究得出了与原始研究相同的结论。
  • 在报告系统评价时纳入额外信息应能提高其可重复性。

研究设计与样本

  • 基于已发表的索引2weekSR研究信息,制定符合系统评价和荟萃分析优先报告条目(PRISMA)的系统评价方案。
  • 重复团队由三名评价员组成,其中两名评价员在重复期间封锁了时间。
  • 比较完成各项任务的总时间及荟萃分析结果与索引2weekSR研究,并计算评价方法和结局的审查过程保真度评分(FS),识别完成重复的障碍。

主要发现

  • 重复研究在63人时(11个工作日/15个日历日)内完成。
  • 方法学保真度评分为0.95,8项任务中3项仅部分重复。
  • 结局保真度评分为0.63,7项任务中6项仅部分重复,1项任务未重复。
  • 未重复主要归因于索引2weekSR研究中缺失的信息,而标准报告指南不要求这些信息。
  • 重复研究得出了与原始研究相同的结论。

局限性

  • 未重复主要归因于索引2weekSR研究中缺失的信息,而标准报告指南不要求这些信息。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: To assess the replicability of a 2-week systematic review (index 2weekSR) created with the assistance of automation tools using the fidelity method. METHODS: A Preferred Reporting Items for Systematic reviews and Meta-Analyses compliant SR protocol was developed based on the published information of the index 2weekSR study. The replication team consisted of three reviewers. Two reviewers blocked off time during the replication. The total time to complete tasks and the meta-analysis results were compared with the index 2weekSR study. Review process fidelity scores (FSs) were calculated for review methods and outcomes. Barriers to completing the replication were identified. RESULTS: The review was completed over 63 person-hours (11 workdays/15 calendar days). A FS of 0.95 was achieved for the methods, with 3 (of 8) tasks only partially replicated, and an FS of 0.63 for the outcomes, with 6 (of 7) only partially replicated and one task was not replicated. Nonreplication was mainly caused by missing information in the index 2weekSR study that was not required in standard reporting guidelines. The replication arrived at the same conclusions as the original study. CONCLUSION: A 2weekSR study was replicated by a small team of three reviewers supported by automation tools. Including additional information when reporting SRs should improve their replicability.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Tufanaru C, Surian D, Scott AM, et al. The 2-week systematic review (2weekSR) method was successfully blind-replicated by another team: a case study. J Clin Epidemiol. 2023. PMID: 37879542. doi:10.1016/j.jclinepi.2023.10.013

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。