指南与共识技术与安全

AAPM 任务组 273 报告:医学影像计算机辅助诊断中人工智能与机器学习最佳实践建议

AAPM task group report 273: Recommendations on best practices for AI and machine learning for computer-aided diagnosis in medical imaging.
指南 / 共识 · Med Phys · 2023-01-06

AAPM 计算机辅助图像分析小组委员会发布任务组报告,针对使用传统机器学习与深度学习方法的 CAD-AI 临床决策支持系统,提出开发与性能评估的实践与标准建议。报告强调机器学习模型在临床部署前须经过适当训练并严格验证其泛化性与稳健性,目的是促进 CAD-AI 系统从实验室向临床转化。

要点

  • CAD-AI 模型临床部署前必须经过适当训练和严格验证泛化性与稳健性。
  • 报告覆盖传统机器学习与深度学习两类 CAD-AI 应用的开发与评估共性问题。
  • 目标是通过规范训练与验证加速 CAD-AI 系统在临床决策支持中的采用。

核心结论

  • 确保临床决策支持工具在用于患者诊疗前经过适当训练并严格验证其泛化性与稳健性至关重要。
  • 报告旨在引起对机器学习算法适当训练与验证的重视,以可能提高其泛化性与可靠性并加速 CAD-AI 系统用于临床决策支持的采用。

研究设计与样本

  • 美国医学物理学家协会(AAPM)计算机辅助图像分析小组委员会(CADSC)牵头制定的任务组报告。
  • 该委员会此前已发表两篇意见书,分别涉及 CAD 系统评估以及用户培训与临床质量保证相关问题。
  • 本报告考虑大多数(若非全部)CAD-AI 应用开发及其从实验室到临床转化所共有的更广泛问题。

临床应用与阅片要点

  • 日常阅片与报告中使用 CAD-AI 工具前,应确认其经过适当训练并已严格验证泛化性与稳健性。
  • 关注 CAD-AI 应用开发与性能评估的实践和标准,而非仅看开发阶段的研究结果。

局限性

  • 报告指出目前已发表的多数机器学习模型尚未准备好用于临床部署。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Rapid advances in artificial intelligence (AI) and machine learning, and specifically in deep learning (DL) techniques, have enabled broad application of these methods in health care. The promise of the DL approach has spurred further interest in computer-aided diagnosis (CAD) development and applications using both "traditional" machine learning methods and newer DL-based methods. We use the term CAD-AI to refer to this expanded clinical decision support environment that uses traditional and DL-based AI methods. Numerous studies have been published to date on the development of machine learning tools for computer-aided, or AI-assisted, clinical tasks. However, most of these machine learning models are not ready for clinical deployment. It is of paramount importance to ensure that a clinical decision support tool undergoes proper training and rigorous validation of its generalizability and robustness before adoption for patient care in the clinic. To address these important issues, the American Association of Physicists in Medicine (AAPM) Computer-Aided Image Analysis Subcommittee (CADSC) is charged, in part, to develop recommendations on practices and standards for the development and performance assessment of computer-aided decision support systems. The committee has previously published two opinion papers on the evaluation of CAD systems and issues associated with user training and quality assurance of these systems in the clinic. With machine learning techniques continuing to evolve and CAD applications expanding to new stages of the patient care process, the current task group report considers the broader issues common to the development of most, if not all, CAD-AI applications and their translation from the bench to the clinic. The goal is to bring attention to the proper training and validation of machine learning algorithms that may improve their generalizability and reliability and accelerate the adoption of CAD-AI systems for clinical decision support.

来源:Med Phys,查看原文。版权归原作者所有。

引用

  1. Hadjiiski, Cha, Chan, et al. AAPM task group report 273: Recommendations on best practices for AI and machine learning for computer-aided diagnosis in medical imaging. Med Phys. 2023. PMID: 36565447. doi:10.1002/mp.16188

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。