文献速递医学人工智能与信息学流行病学与生物统计

人工智能在乳腺癌筛查图像分析中的应用:测试准确性的系统综述

Use of artificial intelligence for image analysis in breast cancer screening programmes: systematic review of test accuracy.
PubMed 文献 · BMJ · 2021-09-01

该系统综述评估AI在乳腺X线筛查中检测乳腺癌的准确性,检索2010年至2021年文献,纳入12项研究共131 822名筛查女性。未发现前瞻性筛查实践研究,现有证据方法学质量差,多数AI系统准确性低于单个放射科医生,不足以替代双读。

要点

  • 现有证据无法判断AI在乳腺癌筛查中的准确性,缺乏前瞻性研究。
  • AI分诊可筛除部分低风险女性,但也会漏检部分癌症。

核心结论

  • 当前AI证据尚不足以判断其在乳腺癌筛查项目中的准确性,也不明确AI在临床路径中的最佳受益环节。
  • AI系统特异性不足,不足以替代筛查项目中的放射科医生双读。
  • 小研究中的 promising 结果未在大研究中重复,需前瞻性研究评估AI在临床实践中的效果。

研究设计与样本

  • 系统综述,检索Medline、Embase、Web of Science和Cochrane系统综述数据库,时间2010年1月1日至2021年5月17日。
  • 纳入报告AI算法单独或联合放射科医生在筛查实践或测试集中检测数字乳腺X线癌症准确性的研究。
  • 共纳入12项研究,总计131 822名筛查女性;未发现前瞻性筛查实践中的AI测试准确性研究。

主要发现

  • 三项回顾性研究比较AI与原始放射科医生临床决策,纳入79 910名女性,其中1 878例在筛查时或筛查后12个月内检出筛查癌或间期癌。
  • 五项较小研究(1 086名女性,520例癌症)存在高偏倚风险和低临床推广性,报告所有五个AI系统(独立替代放射科医生或作为读片辅助)在实验室测试集中比单个放射科医生更准确。
  • 三项研究中,AI用于分诊筛除了53%、45%和50%的低风险女性,但也漏检了放射科医生检出的10%、4%和0%的癌症。

关键数值与推荐

  • 参考标准为活检组织学或随访(针对筛查阴性女性)。
  • 结局包括测试准确性和检出的癌症类型。
  • 使用QUADAS-2工具评估方法学质量,两名评审独立评估纳入和研究质量。

临床怎么用

  • 目前AI系统不足以替代筛查项目中的放射科医生双读。
  • AI分诊可能筛除部分低风险女性,但需注意漏检癌症的风险。
  • 需前瞻性研究明确AI在临床路径中的最佳应用环节,并设置明确的停止规则以确保不降低项目特异性。

局限性

  • 未发现前瞻性筛查实践中的AI测试准确性研究。
  • 纳入研究方法学质量差。
  • 小研究存在高偏倚风险和低临床推广性,结果未在大研究中重复。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: To examine the accuracy of artificial intelligence (AI) for the detection of breast cancer in mammography screening practice. DESIGN: Systematic review of test accuracy studies. DATA SOURCES: Medline, Embase, Web of Science, and Cochrane Database of Systematic Reviews from 1 January 2010 to 17 May 2021. ELIGIBILITY CRITERIA: Studies reporting test accuracy of AI algorithms, alone or in combination with radiologists, to detect cancer in women's digital mammograms in screening practice, or in test sets. Reference standard was biopsy with histology or follow-up (for screen negative women). Outcomes included test accuracy and cancer type detected. STUDY SELECTION AND SYNTHESIS: Two reviewers independently assessed articles for inclusion and assessed the methodological quality of included studies using the QUality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool. A single reviewer extracted data, which were checked by a second reviewer. Narrative data synthesis was performed. RESULTS: Twelve studies totalling 131 822 screened women were included. No prospective studies measuring test accuracy of AI in screening practice were found. Studies were of poor methodological quality. Three retrospective studies compared AI systems with the clinical decisions of the original radiologist, including 79 910 women, of whom 1878 had screen detected cancer or interval cancer within 12 months of screening. Thirty four (94%) of 36 AI systems evaluated in these studies were less accurate than a single radiologist, and all were less accurate than consensus of two or more radiologists. Five smaller studies (1086 women, 520 cancers) at high risk of bias and low generalisability to the clinical context reported that all five evaluated AI systems (as standalone to replace radiologist or as a reader aid) were more accurate than a single radiologist reading a test set in the laboratory. In three studies, AI used for triage screened out 53%, 45%, and 50% of women at low risk but also 10%, 4%, and 0% of cancers detected by radiologists. CONCLUSIONS: Current evidence for AI does not yet allow judgement of its accuracy in breast cancer screening programmes, and it is unclear where on the clinical pathway AI might be of most benefit. AI systems are not sufficiently specific to replace radiologist double reading in screening programmes. Promising results in smaller studies are not replicated in larger studies. Prospective studies are required to measure the effect of AI in clinical practice. Such studies will require clear stopping rules to ensure that AI does not reduce programme specificity. STUDY REGISTRATION: Protocol registered as PROSPERO CRD42020213590.

来源:BMJ,查看原文。版权归原作者所有。

引用

  1. Freeman K, Geppert J, Stinton C, et al. Use of artificial intelligence for image analysis in breast cancer screening programmes: systematic review of test accuracy. BMJ. 2021. PMID: 34470740. doi:10.1136/bmj.n1872

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。