ScreenTrustCAD试验中的人机交互:AI CAD与放射科医师标记的筛查乳腺X线摄影的召回比例与阳性预测值
ScreenTrustCAD前瞻性研究纳入54991名女性,每例由两名放射科医师和AI CAD独立阅片后共识讨论。仅放射科医师标记的检查召回比例高于仅AI CAD标记(14.2% vs 4.6%),但阳性预测值更低(3.4% vs 22%);两名放射科医师标记较AI CAD加一名放射科医师标记召回比例更高(57.2% vs 38.6%)而阳性预测值更低(2.5% vs 25.0%)。
要点
- 仅AI CAD标记的检查召回比例低(4.6%)但阳性预测值高(22%),仅一名放射科医师标记则相反。
- 两名放射科医师标记的召回比例57.2%、阳性预测值2.5%;AI CAD加一名放射科医师标记为38.6%、25.0%。
- 三名阅片者均标记的检查召回比例82.6%,阳性预测值34.2%。
核心结论
- 放射科医师初始标记后召回的比例大于AI CAD标记,但检出癌症的比例更低。
研究设计与样本
- ScreenTrustCAD前瞻性试验,纳入2021年4月至2022年6月的54991名女性(中位年龄55岁,IQR 46-65岁),每例由两名放射科医师和AI CAD三名独立阅片者判读,阳性发现提交共识讨论,以病理评估证实的癌症为参考。
诊断标准与关键数值
- 仅一名阅片者标记时:一名放射科医师标记的召回比例14.2%(263/1858),AI CAD标记为4.6%(86/1886)(P < .001);乳腺癌阳性预测值分别为3.4%(9/263)与22%(19/86)(P < .001)。
- 两名阅片者标记时:两名放射科医师标记的召回比例57.2%(360/629),AI CAD加一名放射科医师标记为38.6%(244/632)(P < .001);阳性预测值分别为2.5%(9/360)与25.0%(61/244)(P < .001)。
- 三名阅片者均标记时:召回比例82.6%(400/484),阳性预测值34.2%(137/400)。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
Background The ScreenTrustCAD trial was a prospective study that evaluated the cancer detection rates for combinations of artificial intelligence (AI) computer-aided detection (CAD) and two radiologists. The results raised concerns about the tendency of radiologists to agree with AI CAD too much (when AI CAD made an erroneous flagging) or too little (when AI CAD made a correct flagging). Purpose To evaluate differences in recall proportion and positive predictive value (PPV) related to which reader flagged the mammogram for consensus discussion: AI CAD and/or radiologists. Materials and Methods Participants were enrolled from April 2021 to June 2022, and each examination was interpreted by three independent readers: two radiologists and AI CAD, after which positive findings were forwarded to the consensus discussion. For each combination of readers flagging an examination, the proportion recalled and the PPV were calculated by dividing the number of pathologic evaluation-verified cancers by the number of positive examinations. Results The study included 54 991 women (median age, 55 years [IQR, 46-65 years]), among whom 5489 were flagged for consensus discussion and 1348 were recalled. For examinations flagged by one reader, the proportion recalled after flagging by one radiologist was larger (14.2% [263 of 1858]) compared with flagging by AI CAD (4.6% [86 of 1886]) (P < .001), whereas the PPV of breast cancer was lower (3.4% [nine of 263] vs 22% [19 of 86]) (P < .001). For examinations flagged by two readers, the proportion recalled after flagging by two radiologists was larger (57.2% [360 of 629]) compared with flagging by AI CAD and one radiologist (38.6% [244 of 632]) (P < .001), whereas the PPV was lower (2.5% [nine of 360] vs 25.0% [61 of 244]) (P < .001). For examinations flagged by all three readers, the proportion recalled was 82.6% (400 of 484) and the PPV was 34.2 (137 of 400). Conclusion A larger proportion of participants were recalled after initial flagging by radiologists compared with those flagged by AI CAD, with a lower proportion of cancer. ClinicalTrials.gov Identifier: NCT04778670 © RSNA, 2025 See also the editorial by Grimm in this issue.
引用
- Dembrower KE, Crippa A, Eklund M, et al. Human-AI Interaction in the ScreenTrustCAD Trial: Recall Proportion and Positive Predictive Value Related to Screening Mammograms Flagged by AI CAD versus a Human Reader. Radiology. 2025. PMID: 40100021. doi:10.1148/radiol.242566
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。