交叉核对质量保证:通过警示放射科医师与人工智能在高急性度CT判读中的无意不一致来防止漏诊的质量保证工作流程
该研究在2020年3月1日至2022年9月20日期间,对111,674例高急性度成人CT检查在人工智能决策支持系统辅助下进行判读,实施并评估了一套利用自然语言处理的质量保证工作流程,用于快速发现放射科医师未查看AI输出且报告阴性而AI提示高概率阳性的不一致病例。结果显示漏诊频率为0.02%(26例),在12,412例AI优先提示阳性的CT中,0.4%(46例)被标记为不一致且未查看,其中57%(26/46)经二次审核确认为真阳性,85%的病例在初始报告签署后24小时内完成补遗和沟通记录。
要点
- AI决策支持系统提示高概率阳性而放射科医师报告阴性且未查看AI输出时,该工作流程可自动标记并邮件通知质量团队。
- 在高急性度CT中,该流程发现的漏诊(颅内出血、肺栓塞、颈椎骨折)频率为0.02%(26/111,674)。
- 被标记的不一致病例中57%(26/46)经二次审核为真阳性,85%在24小时内完成补遗和沟通记录。
核心结论
- 放射科医师与AI决策支持系统之间的无意不一致发生在少数病例中,该质量保证工作流程利用自然语言处理快速检测、通知并解决这些差异,以防止潜在漏诊。
研究设计与样本
- 在2020年3月1日至2022年9月20日期间,对一个医疗系统内所有连续的高急性度成人CT检查同时使用AI决策支持系统(Aidoc)进行判读,针对颅内出血、颈椎骨折和肺栓塞。
关键影像表现/征象
- CT检查满足以下三条标准时被标记进入该质量保证工作流程:放射科医师报告为阴性结果、AI决策支持系统提示高概率阳性结果、且AI输出未被查看。
- 被标记的病例通过自动电子邮件通知发送给质量团队,若二次审核确认不一致(初始漏诊),则进行补遗和沟通记录。
诊断标准与关键数值
- 在111,674例高急性度CT检查中,该工作流程发现的漏诊(颅内出血、肺栓塞、颈椎骨折)频率为0.02%(n=26)。
- 在12,412例被AI决策支持系统优先提示为阳性表现的CT检查中,0.4%(n=46)为不一致、未查看并被标记进行质量保证。
- 在这些不一致病例中,57%(26/46)被确定为真阳性。
- 在85%的这些病例中,补遗和沟通记录在初始报告签署后24小时内完成。
临床应用与阅片要点
- 该质量保证工作流程利用自然语言处理快速检测、通知并解决放射科医师与AI决策支持系统之间的无意不一致,以防止潜在漏诊。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
PURPOSE: The aim of this study was to implement and evaluate a quality assurance (QA) workflow that leverages natural language processing to rapidly resolve inadvertent discordance between radiologists and an artificial intelligence (AI) decision support system (DSS) in the interpretation of high-acuity CT studies when the radiologist does not engage with AI DSS output.
METHODS: All consecutive high-acuity adult CT examinations performed in a health system between March 1, 2020, and September 20, 2022, were interpreted alongside an AI DSS (Aidoc) for intracranial hemorrhage, cervical spine fracture, and pulmonary embolus. CT studies were flagged for this QA workflow if they met three criteria: (1) negative results by radiologist report, (2) a high probability of positive results by the AI DSS, and (3) unviewed AI DSS output. In these cases, an automated e-mail notification was sent to our quality team. If discordance was confirmed on secondary review-an initially missed diagnosis-addendum and communication documentation was performed.
RESULTS: Of 111,674 high-acuity CT examinations interpreted alongside the AI DSS over this 2.5-year time period, the frequency of missed diagnoses (intracranial hemorrhage, pulmonary embolus, and cervical spine fracture) uncovered by this workflow was 0.02% (n = 26). Of 12,412 CT studies prioritized as depicting positive findings by the AI DSS, 0.4% (n = 46) were discordant, unengaged, and flagged for QA. Among these discordant cases, 57% (26 of 46) were determined to be true positives. Addendum and communication documentation was performed within 24 hours of the initial report signing in 85% of these cases.
CONCLUSIONS: Inadvertent discordance between radiologists and the AI DSS occurred in a small number of cases. This QA workflow leveraged natural language processing to rapidly detect, notify, and resolve these discrepancies and prevent potential missed diagnoses.
引用
- Chekmeyan M, Baccei SJ, Garwood ER, et al. Cross-Check QA: A Quality Assurance Workflow to Prevent Missed Diagnoses by Alerting Inadvertent Discordance Between the Radiologist and Artificial Intelligence in the Interpretation of High-Acuity CT Scans. J Am Coll Radiol. 2023. PMID: 37423347. doi:10.1016/j.jacr.2023.06.010
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。