系统综述中的去重:存在免费且准确的自动化方法
该研究以人工检索为参考标准,评估多种自动化去重工具在系统综述 Eligibility 流程中识别重复记录的准确性。检索覆盖七个电子数据库至2021年5月31日。Rayyan、Mendeley和SRA的灵敏度较高,EndNote X9和Zotero灵敏度一般;Rayyan的PPV较差。结论认为Rayyan、Mendeley和SRA足够准确可用于系统综述去重步骤。
要点
- Rayyan、Mendeley和SRA灵敏度较高(分别为0.98、0.93和0.90),EndNote X9和Zotero灵敏度一般(0.73和0.74)。
- Mendeley和SRA的PPV较好(0.93和0.99),EndNote X9和Zotero一般(0.61和0.62),Rayyan较差(0.41)。
- 选择最合适的工具取决于界面特征、识别并排除重复记录的算法以及流程的透明度。
核心结论
- Rayyan、Mendeley和SRA被证明足够准确,可用于系统综述的去重步骤。
研究设计与样本
- 在七个电子数据库中执行预定的检索策略,检索截止至2021年5月31日。
- 以人工检索为参考标准,评估一组自动化去重工具的灵敏度、特异度、阴性预测值和阳性预测值(PPV)。
主要发现
- 特异度范围为0.96至1.00。
- Rayyan灵敏度为0.98(95%CI=0.94-1.00),Mendeley为0.93(95%CI=0.88-0.97),SRA为0.90(95%CI=0.84-0.95)。
- EndNote X9灵敏度为0.73(95%CI=0.65-0.80),Zotero为0.74(95%CI=0.66-0.81)。
- 阴性预测值范围为0.99至1.00。
- Mendeley的PPV为0.93(95%CI=0.88-0.97),SRA为0.99(95%CI=0.96-1.00);EndNote X9为0.61(95%CI=0.54-0.69),Zotero为0.62(95%CI=0.54-0.69),Rayyan为0.41(95%CI=0.36-0.47)。
临床怎么用
- 选择最合适的工具取决于其界面特征、识别并排除重复记录的算法以及流程的透明度。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: Here, we examined the accuracy measures of a set of automated deduplication tools to identify duplicate in the eligibility process of systematic reviews. STUDY DESIGN AND SETTING: A planned search strategy was carried out on seven electronic databases until May 31, 2021. Using manual search as the reference standard, we assessed sensibility, specificity, negative predictive value, and positive predictive value (PPV). RESULTS: Specificity ranged from 0.96 to 1.00. Rayyan, Mendeley, and Systematic Review Accelerator (SRA) presented high sensibility (0.98 [95% CI = 0.94-1.00]; 0.93 [95% CI = 0.88-0.97] and 0.90 [95% CI = 0.84-0.95], respectively), whereas EndNote X9 and Zotero had only fair sensitivity (0.73 [95% CI = 0.65-0.80] and 0.74 [95% CI = 0.66-0.81], respectively). Negative predictive value ranged from 0.99 to 1.00. Mendeley and SRA had good PPV (0.93 [95% CI = 0.88-0.97] and 0.99 [95% CI = 0.96-1.00], respectively). PPV was fair for EndNote X9 (0.61 [95% CI = 0.54-0.69]) and Zotero (0.62 [95% CI = 0.54-0.69]) and poor for Rayyan (0.41 [95% CI = 0.36-0.47]). CONCLUSION: Choosing the most suitable tool depends on its interface's characteristics, the algorithm to identify and exclude duplicates, and the transparency of the process. Therefore, Rayyan, Mendeley, and SRA proved to be accurate enough for the systematic reviews' deduplication step.
引用
- Guimarães NS, Ferreira AJF, Ribeiro Silva RC, et al. Deduplicating records in systematic reviews: there are free, accurate automated ways to do so. J Clin Epidemiol. 2022. PMID: 36241035. doi:10.1016/j.jclinepi.2022.10.009
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。