2022年ACR-RSNA人工智能安全性、有效性、可靠性与透明度研讨会论文集
2022年11月由ACR与RSNA共同组织的为期一天的研讨会,参与者包括学术与社区放射科医生、负责AI实施的信息学负责人、监管机构雇员及专业学会代表,围绕AI产品开发与临床实施两大主题讨论了安全性、有效性、可靠性与透明度问题,并预测在这些方面得到更充分解决之前,AI在放射科的临床实施将继续受限。
要点
- AI产品开发需明确临床任务定义、使用多样地理与经济及医疗环境下精心整理的数据、建立模型可靠性监测标准与机制。
- AI临床实施需强有力的机构治理、由本地团队进行系统评估选择与验证、无缝整合入临床工作流程。
- 研讨会参与者预测,在安全性、有效性、可靠性与透明度得到更充分解决之前,AI在放射科的临床实施将继续受限。
核心结论
- 研讨会参与者预测,在AI工具的安全性、有效性、可靠性与透明度得到更充分解决之前,AI在放射科的临床实施将继续受限。
研究设计与样本
- 2022年11月由ACR与RSNA共同组织的为期一天的研讨会,参与者包括学术与社区放射科执业的放射科医生、负责AI实施的信息学负责人、监管机构雇员及专业学会代表。
诊断标准与关键数值
- AI产品开发的关键方面包括明确的临床任务定义、来自多样地理经济与医疗环境的精心整理数据、监测模型可靠性的标准与机制、以及模型在受控与现实环境中性能的透明度。
- AI实施的关键方面包括强有力的机构治理、由本地团队进行的系统评估选择与验证方法、无缝整合入临床工作流程、本地团队的性能监测与支持、外部实体的性能监测、以及通过认证与报销对齐激励措施。
临床应用与阅片要点
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
Despite the surge in artificial intelligence (AI) development for health care applications, particularly for medical imaging applications, there has been limited adoption of such AI tools into clinical practice. During a 1-day workshop in November 2022, co-organized by the ACR and the RSNA, participants outlined experiences and problems with implementing AI in clinical practice, defined the needs of various stakeholders in the AI ecosystem, and elicited potential solutions and strategies related to the safety, effectiveness, reliability, and transparency of AI algorithms. Participants included radiologists from academic and community radiology practices, informatics leaders responsible for AI implementation, regulatory agency employees, and specialty society representatives. The major themes that emerged fell into two categories: (1) AI product development and (2) implementation of AI-based applications in clinical practice. In particular, participants highlighted key aspects of AI product development to include clear clinical task definitions; well-curated data from diverse geographic, economic, and health care settings; standards and mechanisms to monitor model reliability; and transparency regarding model performance, both in controlled and real-world settings. For implementation, participants emphasized the need for strong institutional governance; systematic evaluation, selection, and validation methods conducted by local teams; seamless integration into the clinical workflow; performance monitoring and support by local teams; performance monitoring by external entities; and alignment of incentives through credentialing and reimbursement. Participants predicted that clinical implementation of AI in radiology will continue to be limited until the safety, effectiveness, reliability, and transparency of such tools are more fully addressed.
引用
- Larson DB, Doo FX, Allen B, et al. Proceedings From the 2022 ACR-RSNA Workshop on Safety, Effectiveness, Reliability, and Transparency in AI. J Am Coll Radiol. 2024. PMID: 38354844. doi:10.1016/j.jacr.2024.01.024
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。