一种可交互筛选PubMed引文的新工具在生物医学文献半自动识别中显示出应用前景
为减轻系统评价文献识别负担,开发了结合查询构建与引文筛选步骤的Pythia系统,利用自然语言问题与机器学习算法对全部PubMed引文按相关性排序并返回前100条供人工筛选,标记引文迭代用于优化检索与重排。在七项系统评价中,Pythia识别相关引文的敏感度为0.09至0.58,每篇相关摘要所需阅读摘要数在四项评价中低于人工筛选、两项高于人工、一项结果混合。作者结论为因敏感度低,Pythia尚不准备广泛使用。
要点
- Pythia将查询构建与引文筛选合并,按相关性排序返回前100条PubMed引文供人工筛选。
- 七项系统评价中Pythia识别相关引文的敏感度为0.09至0.58。
- 每篇相关摘要所需阅读摘要数在四项评价低于人工筛选、两项高于人工、一项结果混合。
核心结论
- 因敏感度低,Pythia尚不准备广泛使用。
- 未来研究应探索在查询构建中编码领域知识,以更好地丰富检索所用问题。
研究设计与样本
- 开发了结合查询构建与引文筛选步骤的文献识别系统Pythia。
- Pythia纳入一组自然语言问题与机器学习算法,对全部PubMed引文按相关性排序,返回前100条最高排名引文供人工筛选。
- 标记引文被Pythia迭代利用以优化检索并重新排序引文。
- 在七项系统评价中评估Pythia识别相关引文的能力。
主要发现
- 七项系统评价中,Pythia识别相关引文的敏感度为0.09至0.58。
- 每篇相关摘要所需阅读摘要数在四项评价中低于人工筛选项目,两项高于人工筛选项目,一项结果混合。
- 总体敏感度较高的评价在早期批次中检索到更多相关引文,但检索一般不受研究设计、研究规模及特定关键问题等其他方面影响。
临床怎么用
- 原文未据此给出临床推荐。
局限性
- 因敏感度低,Pythia尚不准备广泛使用。
- 未来研究应探索在查询构建中编码领域知识,以更好地丰富检索所用问题。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND OBJECTIVES: Systematic reviews form the basis of evidence-based medicine, but are expensive and time-consuming to produce. To address this burden, we have developed a literature identification system (Pythia) that combines the query formulation and citation screening steps. METHODS: Pythia incorporates a set of natural-language questions with machine-learning algorithms to rank all PubMed citations based on relevance, returning the 100 top-ranked citations for human screening. The tagged citations are iteratively exploited by Pythia to refine the search and re-rank the citations. RESULTS: Across seven systematic reviews, the ability of Pythia to identify the relevant citations (sensitivity) ranged from 0.09 to 0.58. The number of abstracts reviewed per relevant abstract number needed to read (NNR) was lower than in the manually screened project in four reviews, higher in two, and had mixed results in one. The reviews that had greater overall sensitivity retrieved more relevant citations in early batches, but retrieval was generally unaffected by other aspects, such as study design, study size, and specific key question. CONCLUSION: Due to its low sensitivity, Pythia is not ready for widespread use. Future research should explore ways to encode domain knowledge in query formulation to better enrich the questions used in the search.
引用
- Adam GP, Pappas D, Papageorgiou H, et al. A novel tool that allows interactive screening of PubMed citations showed promise for the semi-automation of identification of Biomedical Literature. J Clin Epidemiol. 2022. PMID: 35738306. doi:10.1016/j.jclinepi.2022.06.007
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。