文献速递骨肌技术与安全DR

人工智能用于临床实践中的骨折诊断:四种系统性人工智能实施方法及其对人工智能有效性的影响

AI for fracture diagnosis in clinical practice: Four approaches to systematic AI-implementation and their impact on AI-effectiveness.
PubMed 文献 · Eur J Radiol · 2025-04-14

该回顾性单中心研究基于2023年1月至3月所有连续疑似骨折的影像检查,用专用骨折检测人工智能独立分析,模拟四种实施方法并与放射科医生临床诊断比较。结果显示不同实施方法对人工智能有效性影响很大,以安全网模式(放射科医生诊断阴性时参考人工智能)假阴性最低(0.07%),但假阳性增加(7.6%);作者认为目前不应将人工智能用于问题解决或分诊。

要点

  • 人工智能安全网模式假阴性0.07%(1/1508),假阳性7.6%(115/1508),漏诊严重临床后果骨折最少。
  • 放射科医生单独诊断假阴性2.7%(40/1508,28例有临床后果),假阳性1.2%(18/1508)。
  • 作者认为目前不应将人工智能用于问题解决或分诊,独立人工智能表现优于两者。

核心结论

  • 实施方法对人工智能有效性影响很大;结果提示目前不应将人工智能用于问题解决或分诊,独立人工智能表现优于两者,可在无放射科医生时作为辅助来源;最佳结果为安全网模式,消除了具有严重临床后果的漏诊骨折,尽管假阳性增加,但不必要的治疗有限。

研究设计与样本

  • 回顾性单中心研究,纳入2023年1月至3月所有连续、全天候的疑似骨折放射学检查及相应临床实践放射科医生诊断,共1508个图像集(1227名独特患者,40名放射科读片者);由专用骨骨折检测人工智能独立分析,参考标准由两名资深肌骨放射科医生确定(意见不一致时协商一致)。

诊断标准与关键数值

  • 放射科医生结果:假阴性2.7%(40/1508),其中28例有临床后果;假阳性1.2%(18/1508),其中2例接受了完整骨折治疗(11.1%);人工智能独立:假阴性1.5%(23/1508,11例有临床后果),假阳性6.8%(103/1508);人工智能问题解决:假阴性3.2%(48/1508,31例有临床后果),假阳性0.6%(9/1508);人工智能分诊:假阴性2.1%(32/1508,18例有临床后果),假阳性1.7%(26/1508);人工智能安全网:假阴性0.07%(1/1508,1例有临床后果),假阳性7.6%(115/1508);所有方法总体假阴性和假阳性变化均有统计学显著性(p < 0.001)。

临床应用与阅片要点

  • 作者认为目前不应将人工智能用于问题解决或分诊;独立人工智能表现优于两者,可在放射科医生不可用时作为辅助来源;安全网模式(放射科医生诊断阴性时参考人工智能)消除了具有严重临床后果的漏诊骨折,尽管假阳性增加,但不必要的治疗有限。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

PURPOSE: Artificial Intelligence (AI) has been shown to enhance fracture-detection-accuracy, but the most effective AI-implementation in clinical practice is less well understood. In the current study, four approaches to AI-implementation are evaluated for their impact on AI-effectiveness.

MATERIALS AND METHODS: Retrospective single-center study based on all consecutive, around-the-clock radiographic examinations for suspected fractures, and accompanying clinical-practice radiologist-diagnoses, between January and March 2023. These image-sets were independently analysed by a dedicated bone-fracture-detection-AI. Findings were combined with radiologist clinical-practice diagnoses to simulate the four AI-implementation methods deemed most relevant to clinical workflows: AI-standalone (radiologist-findings not consulted); AI-problem-solving (AI-findings consulted when radiologist in doubt); AI-triage (radiologist-findings consulted when AI in doubt); and AI-safety net (AI-findings consulted when radiologist diagnosis negative). Reference-standard diagnoses were established by two senior musculoskeletal-radiologists (by consensus in cases of disagreement). Radiologist- and radiologist + AI diagnoses were compared for false negatives (FN), false positives (FP) and their clinical consequences. Experience-level-subgroups radiologists-in-training-, non-musculoskeletal-radiologists, and dedicated musculoskeletal-radiologists were analysed separately.

RESULTS: 1508 image-sets were included (1227 unique patients; 40 radiologist-readers). Radiologist results were: 2.7 % FN (40/1508), 28 with clinical consequences; 1.2 % FP (18/1508), 2 received full-fracture treatments (11.1 %). All AI-implementation methods changed overall FN and FP with statistical significance (p < 0.001): AI-standalone 1.5 % FN (23/1508; 11 consequences), 6.8 % FP (103/1508); AI-problem-solving 3.2 % FN (48/1508; 31 consequences), 0.6 % FP (9/1508); AI-triage 2.1 % FN (32/1508; 18 consequences), 1.7 % FP (26/1508); AI-safety net 0.07 % FN (1/1508; 1 consequence), 7.6 % FP (115/1508). Subgroups show similar trends, except AI-triage increased FN for all subgroups except radiologists-in-training.

CONCLUSION: Implementation methods have a large impact on AI-effectiveness. These results suggest AI should not be considered for problem-solving or triage at this time; AI standalone performs better than either and may be a source of assistance where radiologists are unavailable. Best results were obtained implementing AI as safety net, which eliminates missed fractures with serious clinical consequences; even though false positives are increased, unnecessary treatments are limited.

来源:Eur J Radiol,查看原文。版权归原作者所有。

引用

  1. Loeffen DV, Zijta FM, Boymans TA, et al. AI for fracture diagnosis in clinical practice: Four approaches to systematic AI-implementation and their impact on AI-effectiveness. Eur J Radiol. 2025. PMID: 40252277. doi:10.1016/j.ejrad.2025.112113

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。