真实世界临床实践中人工智能辅助判读对结直肠癌患者CT肺转移检出的诊断性能与临床效用
该回顾性研究纳入结直肠癌肺转移监测患者,比较常规判读(647例)与AI辅助判读(663例)的CT诊断性能。AI辅助组敏感度(72.4% vs 32.1%)和准确率(98.5% vs 96.0%)更高,管理改变频率更高(55.2% vs 25.0%),特异度无显著差异。AI假阳性极少被放射科医生采纳。
要点
- AI辅助判读使肺转移检出敏感度从32.1%提升至72.4%,准确率从96.0%提升至98.5%。
- AI辅助判读未显著降低特异度(99.7% vs 98.9%),假转诊率无显著差异(0.3% vs 1.1%)。
- 独立AI在634例无转移患者中产生381次假阳性,但仅1次被放射科医生报告为阳性。
核心结论
- AI辅助判读提高了结直肠癌肺转移监测的敏感度、准确率和管理改变频率,特异度无显著变化,假阳性AI结果对放射科医生判读影响极小。
研究设计与样本
- 回顾性研究,常规判读组647例(2020年5月至12月),AI辅助判读组663例(2022年5月至12月),期间机构引入商用AI肺结节检测系统,参考标准结合病理和临床随访。
诊断标准与关键数值
- AI辅助判读组敏感度72.4%,常规判读组32.1%(p=.008)。
- AI辅助判读组准确率98.5%,常规判读组96.0%(p=.005)。
- AI辅助判读组特异度99.7%,常规判读组98.9%(p=.11),无显著差异。
- AI辅助判读组管理改变频率55.2%,常规判读组25.0%(p=.02)。
- 诊断率AI辅助组3.2% vs 常规组1.4%(p=.30),假转诊率AI辅助组0.3% vs 常规组1.1%(p=.10),均无显著差异。
临床应用与阅片要点
- 放射科医生在AI辅助判读时对AI检测的结节是否报告行使临床判断,AI假阳性极少被采纳为阳性报告。
- AI辅助判读在真实世界临床实践中可提高结直肠癌肺转移监测的检出敏感度。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND. Studies of artificial intelligence (AI) for lung nodule detection on CT have primarily been conducted in investigational settings and/or focused on lung cancer screening. OBJECTIVE. The purpose of this study was to evaluate the impact of AI assistance on radiologists' diagnostic performance for detecting lung metastases on chest CT in patients with colorectal cancer (CRC) in real-world clinical practice and to assess the clinical utility of AI assistance in this setting. METHODS. This retrospective study included patients with CRC who underwent chest CT as surveillance for lung metastasis from May 2020 to December 2020 (conventional interpretation) or May 2022 to December 2022 (AI-assisted interpretation). Between the two periods, the institution implemented a commercial AI lung nodule detection system. During the second period, radiologists interpreted examinations concurrently with AI-generated reports, using clinical judgment regarding whether to report AI-detected nodules. The reference standard for metastasis incorporated pathologic and clinical follow-up criteria. Diagnostic performance (i.e., sensitivity, specificity, accuracy) and clinical utility (i.e., diagnostic yield, false-referral rate, management changes after positive reports) were compared between groups based on clinical radiology reports. Net benefit was estimated using a decision curve analysis equation. Stand-alone AI interpretation was evaluated. RESULTS. The conventional interpretation group included 647 patients (mean age, 64 ± 11 [SD] years; 394 men, 253 women; metastasis prevalence, 4.3%); the AI-assisted interpretation group included 663 patients (mean age, 63 ± 12 years; 381 men, 282 women; metastasis prevalence, 4.4%). The AI-assisted interpretation group compared with the conventional interpretation group showed higher sensitivity (72.4% vs 32.1%, respectively; p = .008), accuracy (98.5% vs 96.0%, p = .005), and frequency of management changes (55.2% vs 25.0%, p = .02), without significant difference in specificity (99.7% vs 98.9%, p = .11), diagnostic yield (3.2% vs 1.4%, p = .30), or false-referral rate (0.3% vs 1.1%, p = .10). AI-assisted interpretation had positive estimated net benefit across outcome ratios. Stand-alone AI correctly detected metastasis in 24 of 29 patients but had 381 false-positive detections in 634 patients without metastasis; only one AI false-positive was reported as positive by interpretating radiologists. CONCLUSION. AI assistance yielded increased sensitivity, accuracy, and frequency of management changes, without significantly changed specificity. False-positive AI results minimally impacted radiologists' interpretations. CLINICAL IMPACT. The findings support the clinical utility of AI assistance for CRC metastasis surveillance.
引用
- Jang S, Kim J, Lee JS, et al. Real-World Diagnostic Performance and Clinical Utility of Artificial Intelligence-Assisted Interpretation for Detection of Lung Metastasis on CT in Patients With Colorectal Cancer. AJR Am J Roentgenol. 2025. PMID: 40499025. doi:10.2214/AJR.25.33063
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。