文献速递医学人工智能与信息学流行病学与生物统计

人工智能在COVID-19证据合成中未被充分利用但具影响力:一项方法学研究

Artificial intelligence in COVID-19 evidence syntheses was underutilized, but impactful: a methodological study.
PubMed 文献 · J Clin Epidemiol · 2022-05-02

该研究评估人工智能(AI)工具在COVID-19证据合成中的应用。在3999篇COVID-19综述中,仅28篇(0.7%,95%CI 0.47-1.03%)使用了AI。与匹配对照相比,AI综述发表于更高影响因子期刊,筛选效率更高,但引用数、完成时间和AMSTAR-2评分无显著差异。

要点

  • COVID-19综述中仅0.7%(28/3999)使用了AI工具。
  • AI综述的期刊影响因子中位数8.9 vs 对照3.5(P<0.001)。
  • AI综述每作者筛选摘要数302.2 vs 140.3(P=0.009),每纳入研究筛选摘要数189.0 vs 365.8(P<0.001)。

核心结论

  • AI在COVID-19系统综述中未被充分利用;与无AI的综述相比,其使用与更高效的文献筛选和更高的发表影响力相关。

研究设计与样本

  • 方法学研究:前瞻性注册综述方案后,自动化下载COVID-19 Living Overview of Evidence数据库中所有开放获取的COVID-19系统综述,索引AI相关关键词并定位使用AI工具的综述;与发表时间匹配的无AI对照综述比较期刊JCR影响因子、每月引用数、筛选工作量、完成时间和AMSTAR-2方法学评估(最高13分)。

主要发现

  • 共纳入3999篇COVID-19综述,其中28篇(0.7%,95%CI 0.47-1.03%)使用了AI。
  • AI综述发表于影响因子更高的期刊(中位数8.9 vs 对照3.5,P<0.001)。
  • AI综述每作者筛选摘要数更多(302.2 vs 140.3,P=0.009),每纳入研究筛选摘要数更少(189.0 vs 365.8,P<0.001),每作者检查全文数更少(5.3 vs 14.0,P=0.005)。
  • 引用数(0.5 vs 0.6,P=0.600)、每纳入研究检查全文数(3.8 vs 3.4,P=0.481)、完成时间(74.0 vs 123.0,P=0.205)和AMSTAR-2评分(7.5 vs 6.3,P=0.119)均无显著差异。

关键数值与推荐

  • AI综述定义:使用AI工具进行证据合成的COVID-19系统综述。
  • AMSTAR-2方法学评估最高13分;AI综述中位数7.5 vs 对照6.3(P=0.119)。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: A rapidly developing scenario like a pandemic requires the prompt production of high-quality systematic reviews, which can be automated using artificial intelligence (AI) techniques. We evaluated the application of AI tools in COVID-19 evidence syntheses. STUDY DESIGN: After prospective registration of the review protocol, we automated the download of all open-access COVID-19 systematic reviews in the COVID-19 Living Overview of Evidence database, indexed them for AI-related keywords, and located those that used AI tools. We compared their journals' JCR Impact Factor, citations per month, screening workloads, completion times (from pre-registration to preprint or submission to a journal) and AMSTAR-2 methodology assessments (maximum score 13 points) with a set of publication date matched control reviews without AI. RESULTS: Of the 3,999 COVID-19 reviews, 28 (0.7%, 95% CI 0.47-1.03%) made use of AI. On average, compared to controls (n = 64), AI reviews were published in journals with higher Impact Factors (median 8.9 vs. 3.5, P < 0.001), and screened more abstracts per author (302.2 vs. 140.3, P = 0.009) and per included study (189.0 vs. 365.8, P < 0.001) while inspecting less full texts per author (5.3 vs. 14.0, P = 0.005). No differences were found in citation counts (0.5 vs. 0.6, P = 0.600), inspected full texts per included study (3.8 vs. 3.4, P = 0.481), completion times (74.0 vs. 123.0, P = 0.205) or AMSTAR-2 (7.5 vs. 6.3, P = 0.119). CONCLUSION: AI was an underutilized tool in COVID-19 systematic reviews. Its usage, compared to reviews without AI, was associated with more efficient screening of literature and higher publication impact. There is scope for the application of AI in automating systematic reviews.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Tercero-Hidalgo JR, Khan KS, Bueno-Cavanillas A, et al. Artificial intelligence in COVID-19 evidence syntheses was underutilized, but impactful: a methodological study. J Clin Epidemiol. 2022. PMID: 35513213. doi:10.1016/j.jclinepi.2022.04.027

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。