文献速递医学人工智能与信息学流行病学与生物统计

机器学习扩展PubMed检索至ClinicalTrials.gov辅助系统评价

Extending PubMed searches to ClinicalTrials.gov through a machine learning approach for systematic reviews.
PubMed 文献 · J Clin Epidemiol · 2018-07-05

本研究旨在利用文本挖掘与机器学习技术,将PubMed文献检索自动扩展至ClinicalTrials.gov数据库。结果显示除一篇外所有系统评价灵敏度达100%,特异度97.2%至99.9%,ROC曲线下面积93.4%至99.9%,表明该工具可在不损失灵敏度的情况下减少工作量。

要点

  • 该机器学习工具可将PubMed检索自动扩展至ClinicalTrials.gov,辅助系统评价识别相关研究。
  • 工具区分主题相关与不相关文章的能力以ROC曲线下面积衡量为93.4%至99.9%。

核心结论

  • 所提出的机器学习工具有潜力帮助研究人员在系统评价过程中识别相关研究,减少工作量,且不损失灵敏度,仅以小幅特异度下降为代价。

主要发现

  • 除一篇系统评价灵敏度为87.5%外,其余所有系统评价灵敏度均为100%。
  • 特异度范围为97.2%至99.9%。
  • 工具区分主题相关与不相关文章的能力以ROC曲线下面积衡量为93.4%至99.9%。

关键数值与推荐

  • 灵敏度:除一篇系统评价为87.5%外,其余均为100%。
  • 特异度范围:97.2%至99.9%。
  • ROC曲线下面积范围:93.4%至99.9%。

临床怎么用

  • 系统评价研究者可利用该工具将PubMed检索自动扩展至ClinicalTrials.gov,以减少识别相关研究的工作量,同时保持高灵敏度。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: Despite their essential role in collecting and organizing published medical literature, indexed search engines are unable to cover all relevant knowledge. Hence, current literature recommends the inclusion of clinical trial registries in systematic reviews (SRs). This study aims to provide an automated approach to extend a search on PubMed to the ClinicalTrials.gov database, relying on text mining and machine learning techniques. STUDY DESIGN AND SETTING: The procedure starts from a literature search on PubMed. Next, it considers the training of a classifier that can identify documents with a comparable word characterization in the ClinicalTrials.gov clinical trial repository. Fourteen SRs, covering a broad range of health conditions, are used as case studies for external validation. A cross-validated support-vector machine (SVM) model was used as the classifier. RESULTS: The sensitivity was 100% in all SRs except one (87.5%), and the specificity ranged from 97.2% to 99.9%. The ability of the instrument to distinguish on-topic from off-topic articles ranged from an area under the receiver operator characteristic curve of 93.4% to 99.9%. CONCLUSION: The proposed machine learning instrument has the potential to help researchers identify relevant studies in the SR process by reducing workload, without losing sensitivity and at a small price in terms of specificity.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Lanera C, Minto C, Sharma A, et al. Extending PubMed searches to ClinicalTrials.gov through a machine learning approach for systematic reviews. J Clin Epidemiol. 2018. PMID: 29981872. doi:10.1016/j.jclinepi.2018.06.015

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。