多模态生成式人工智能模型为结核筛查患者创建胸部X线报告
本回顾性研究评估多模态生成式AI模型为800张结核筛查胸片创建自由文本报告的能力。AI报告诊断结核相关异常的敏感度95.2%、特异度86.7%、准确率90.8%,准确率显著低于两位放射科医师单独阅片(90.8% vs 93.4%和91.3%,p<.001),但一位医师使用AI报告后准确率显著提高(93.4%至94.1%,p=.03)。AI报告定位准确率63.3%显著低于医师单独阅片(79.8%和77.9%,p<.001),结论认为当前模型需人工监督。
要点
- AI生成报告诊断结核相关异常准确率90.8%,显著低于两位放射科医师单独阅片的93.4%和91.3%(p<.001)。
- AI报告定位准确率63.3%,显著低于医师单独阅片的79.8%和77.9%(p<.001)。
- 医师1使用AI报告后准确率由93.4%提高至94.1%(p=.03),医师2由91.3%提高至93.5%(p=.47)。
核心结论
- AI生成报告可能辅助放射科医师的诊断评估,但当前模型单独表现较差,需要人工监督。
研究设计与样本
- 回顾性研究,评估800张来自两个结核筛查项目公开数据集的胸片;生成式AI模型创建自由文本报告,两位放射科医师在不使用和使用AI报告两种情况下独立阅片,另两位放射科医师结合影像和临床判读确定参考标准。
关键影像表现/征象
- 参考标准判定800张胸片中378张为结核相关异常阳性。
- AI生成报告对结核相关异常的敏感度95.2%、特异度86.7%、准确率90.8%。
诊断标准与关键数值
- AI生成报告诊断结核相关异常:敏感度95.2%、特异度86.7%、准确率90.8%。
- 医师1单独阅片:敏感度93.1%、特异度93.6%、准确率93.4%;使用AI报告后:敏感度93.1%、特异度95.0%、准确率94.1%。
- 医师2单独阅片:敏感度95.8%、特异度87.2%、准确率91.3%;使用AI报告后:敏感度95.8%、特异度91.5%、准确率93.5%。
- AI报告定位准确率63.3%,医师1单独阅片79.8%、使用AI报告后78.7%(p=.71),医师2单独阅片77.9%、使用AI报告后81.5%(p=.23)。
临床应用与阅片要点
- 医师1对正常和异常胸片分别接受91.7%和52.4%的AI生成报告,医师2分别接受83.2%和37.0%。
- 作者认为AI生成报告可能辅助放射科医师诊断评估,但当前模型单独表现较差,需要人工监督。
- 作者指出该生成式AI模型可能有助于医疗资源不足地区的结核筛查项目,但仍需技术改进。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND. Chest radiographs play a crucial role in tuberculosis screening in high-prevalence regions, although widespread radiographic screening requires expertise that may be unavailable in settings with limited medical resources. OBJECTIVE. The purpose of this study was to evaluate a multimodal generative artificial intelligence (AI) model for detecting tuberculosis-associated abnormalities on chest radiography in patients undergoing tuberculosis screening. METHODS. This retrospective study evaluated 800 chest radiographs obtained from two public datasets originating from tuberculosis screening programs. A generative AI model was used to create free-text reports for the radiographs. AI-generated reports were classified in terms of presence versus absence and laterality of tuberculosis-related abnormalities. Two radiologists independently reviewed the radiographs for tuberculosis presence and laterality in separate sessions, without and with use of AI-generated reports, and recorded if they would accept the report without modification. Two additional radiologists reviewed radiographs and clinical readings from the datasets to determine the reference standard. RESULTS. By the reference standard, 378 of 800 radiographs were positive for tuberculosis-related abnormalities. For detection of tuberculosis-related abnormalities, sensitivity, specificity, and accuracy were 95.2%, 86.7%, and 90.8% for AI-generated reports; 93.1%, 93.6%, and 93.4% for reader 1 without AI-generated reports; 93.1%, 95.0%, and 94.1% for reader 1 with AI-generated reports; 95.8%, 87.2%, and 91.3% for reader 2 without AI-generated reports; and 95.8%, 91.5%, and 93.5% for reader 2 with AI-generated reports. Accuracy was significantly lower for AI-generated reports than for both readers alone (p < .001), but significantly higher with than without AI-generated reports for one reader (reader 1: p = .47; reader 2: p = .03). Localization performance was significantly lower (p < .001) for AI-generated reports (63.3%) than for reader 1 (79.8%) and reader 2 (77.9%) without AI-generated reports and did not significantly change for either reader with AI-generated reports (reader 1: 78.7%, p = .71; reader 2: 81.5%, p = .23). Among normal and abnormal radiographs, reader 1 accepted 91.7% and 52.4%, whereas reader 2 accepted 83.2% and 37.0%, respectively, of AI-generated reports. CONCLUSION. Although AI-generated reports may augment radiologists' diagnostic assessments, the current model requires human oversight, given inferior standalone performance. CLINICAL IMPACT. The generative AI model could have potential application to aid tuberculosis screening programs in medically underserved regions, although technical improvements remain required.
引用
- Hong EK, Kim HW, Song OK, et al. Multimodal Generative Artificial Intelligence Model for Creating Radiology Reports for Chest Radiographs in Patients Undergoing Tuberculosis Screening. AJR Am J Roentgenol. 2025. PMID: 40600508. doi:10.2214/AJR.25.33059
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。