文本挖掘工具辅助与常规方法开发证据合成检索策略的前瞻性比较
该描述性比较分析纳入七项系统综述,由两名馆员分别用常规实践或文本挖掘工具制定MEDLINE检索策略。常规检索敏感度更高且需读文献数更低,但文本挖掘检索耗时更少;复杂主题中文本挖掘检索敏感度较低却检出常规检索未发现的合格文献。
要点
- 常规检索敏感度92%,文本挖掘检索84.9%,置信区间重叠。
- 常规检索平均耗时12小时,文本挖掘检索平均5小时。
- 复杂系统综述中文本挖掘检索可检出常规检索遗漏的合格文献。
核心结论
- 总体文本挖掘检索敏感度低于常规检索但置信区间重叠。
- 简单系统综述主题中文本挖掘检索更快且敏感度略低。
- 复杂系统综述主题中文本挖掘检索更快、敏感度较低但可检出常规检索未发现的合格文献。
研究设计与样本
- 描述性比较分析纳入七项系统综述,分为简单或复杂两类。
- 两名馆员为每项综述分别用常规实践或文本挖掘工具制定MEDLINE检索策略。
- 计算每项检索的敏感度、需读文献数和制定检索策略所花时间。
主要发现
- 常规检索敏感度92%(95%CI 85-99),文本挖掘检索84.9%(95%CI 74.4-95.4)。
- 常规检索需读文献数83(SD 34),文本挖掘检索90(SD 68)。
- 常规检索馆员平均耗时12小时(SD 8),文本挖掘检索馆员平均5小时(SD 2)。
临床怎么用
- 简单系统综述主题可考虑文本挖掘工具以缩短检索策略制定时间。
- 复杂系统综述主题使用文本挖掘工具需注意敏感度下降并补充检索。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: We compared the process of developing searches with and without using text-mining tools (TMTs) for evidence synthesis products. STUDY DESIGN: This descriptive comparative analysis included seven systematic reviews, classified as simple or complex. Two librarians created MEDLINE strategies for each review, using either usual practice (UP) or TMTs. For each search we calculated sensitivity, number-needed-to-read (NNR) and time spent developing the search strategy. RESULTS: We found UP searches were more sensitive (UP 92% (95% CI, 85-99); TMT 84.9% (95% CI, 74.4-95.4)), with lower NNR (UP 83 (SD 34); TMT 90 (SD 68)). UP librarians spent an average of 12 h (SD 8) developing search strategies, compared to TMT librarians' 5 hours (SD 2). CONCLUSION: Across all reviews, TMT searches were less sensitive than UP searches, but confidence intervals overlapped. For simple SR topics, TMT searches were faster and slightly less sensitive than UP. For complex SR topics, TMT searches were faster and less sensitive than UP searches but identified unique eligible citations not found by the UP searches.
引用
- Paynter RA, Featherstone R, Stoeger E, et al. A prospective comparison of evidence synthesis search strategies developed with and without text-mining tools. J Clin Epidemiol. 2021. PMID: 33753230. doi:10.1016/j.jclinepi.2021.03.013
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。