文献速递胸部技术与安全DR

人工智能算法对放射科住院医师胸部X线判读的影响

The effect of an artificial intelligence algorithm on chest X-ray interpretation of radiology residents.
PubMed 文献 · Br J Radiol · 2022-10-05

本研究让10名放射科住院医师对确诊的后前位胸部X线片进行判读,比较有无AI辅助时的诊断表现。住院医师平均敏感度37.9%(AI辅助后39.8%),平均特异度均为93.9%,平均AUC 0.660(AI辅助后0.669),AI算法整体平均AUC为0.789。有无AI辅助的决策无显著差异,住院医师未因AI建议改变最终决定。

要点

  • AI算法整体诊断准确性(AUC 0.789)高于住院医师(AUC 0.660),但医师未采纳AI建议。
  • 住院医师对全部影像征象的平均敏感度仅37.9%,提示判读漏诊率较高。
  • AI辅助后敏感度、特异度和AUC均无显著改善,需更精准的AI提示才能改变决策。

局限性

  • 仅纳入10名放射科住院医师,样本量小。
  • 住院医师对全部影像征象的平均敏感度较低(37.9%)。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVE: Chest X-rays are the most commonly performed diagnostic examinations. An artificial intelligence (AI) system that evaluates the images fast and accurately help reducing workflow and management of the patients. An automated assistant may reduce the time of interpretation in daily practice. We aim to investigate whether radiology residents consider the recommendations of an AI system for their final decisions, and to assess the diagnostic performances of the residents and the AI system.

METHODS: Posteroanterior (PA) chest X-rays with confirmed diagnosis were evaluated by 10 radiology residents. After interpretation, the residents checked the evaluations of the AI Algorithm and made their final decisions. Diagnostic performances of the residents without AI and after checking the AI results were compared.

RESULTS: Residents' diagnostic performance for all radiological findings had a mean sensitivity of 37.9% (vs 39.8% with AI support), a mean specificity of 93.9% (vs 93.9% with AI support). The residents obtained a mean AUC of 0.660 vs 0.669 with AI support. The AI algorithm diagnostic accuracy, measured by the overall mean AUC, was 0.789. No significant difference was detected between decisions taken with and without the support of AI.

CONCLUSION: Although, the AI algorithm diagnostic accuracy were higher than the residents, the radiology residents did not change their final decisions after reviewing AI recommendations. In order to benefit from these tools, the recommendations of the AI system must be more precise to the user.

ADVANCES IN KNOWLEDGE: This research provides information about the willingness or resistance of radiologists to work with AI technologies via diagnostic performance tests. It also shows the diagnostic performance of an existing AI algorithm, determined by real-life data.

来源:Br J Radiol,查看原文。版权归原作者所有。

引用

  1. Pekçevik, Orbatu, Güngör, et al. The effect of an artificial intelligence algorithm on chest X-ray interpretation of radiology residents. Br J Radiol. 2022. PMID: 36062807. doi:10.1259/bjr.20210688

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。