文献速递技术与安全

放射学人工智能中导致偏倚的「捷径」:原因、评估与缓解

"Shortcuts" Causing Bias in Radiology Artificial Intelligence: Causes, Evaluation, and Mitigation.
PubMed 文献 · J Am Coll Radiol · 2023-07-27

本文综述了放射学人工智能模型中「捷径学习」导致的偏倚,即模型利用图像中的虚假特征(如胸腔引流管和便携式摄影标记)而非真实病理进行预测。文章讨论了数据偏倚、建模偏倚和推理偏倚,并总结了预处理、模型开发和后处理中评估与缓解偏倚的工具,指出这些工具主要应用于非医学领域,需在医学人工智能中进一步评估。

要点

  • AI模型可能利用图像中的虚假特征(如胸腔引流管、便携式摄影标记)进行预测,而非识别真实病理。
  • AI模型能检测年龄、性别和种族等受保护属性,并对历史上服务不足的亚组表现出偏倚。
  • 偏倚可发生在数据、建模和推理阶段,需在AI全流程中理解、检测和缓解。

核心结论

  • 放射学AI中的捷径学习可导致对某些亚组的偏倚输出,需理解、检测和缓解数据、建模及推理阶段的偏倚,并需要多元研究团队审视整个人工智能流程。

研究设计与样本

  • 综述,讨论了AI模型开发不同阶段(数据偏倚、建模偏倚、推理偏倚)的偏倚类型,并总结了评估和缓解偏倚的工具包及技术。

局限性

  • 文中总结的评估和缓解偏倚的工具包主要应用于非医学领域,需要更多评估以用于医学人工智能。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Despite the expert-level performance of artificial intelligence (AI) models for various medical imaging tasks, real-world performance failures with disparate outputs for various subgroups limit the usefulness of AI in improving patients' lives. Many definitions of fairness have been proposed, with discussions of various tensions that arise in the choice of an appropriate metric to use to evaluate bias; for example, should one aim for individual or group fairness? One central observation is that AI models apply "shortcut learning" whereby spurious features (such as chest tubes and portable radiographic markers on intensive care unit chest radiography) on medical images are used for prediction instead of identifying true pathology. Moreover, AI has been shown to have a remarkable ability to detect protected attributes of age, sex, and race, while the same models demonstrate bias against historically underserved subgroups of age, sex, and race in disease diagnosis. Therefore, an AI model may take shortcut predictions from these correlations and subsequently generate an outcome that is biased toward certain subgroups even when protected attributes are not explicitly used as inputs into the model. As a result, these subgroups became nonprivileged subgroups. In this review, the authors discuss the various types of bias from shortcut learning that may occur at different phases of AI model development, including data bias, modeling bias, and inference bias. The authors thereafter summarize various tool kits that can be used to evaluate and mitigate bias and note that these have largely been applied to nonmedical domains and require more evaluation for medical AI. The authors then summarize current techniques for mitigating bias from preprocessing (data-centric solutions) and during model development (computational solutions) and postprocessing (recalibration of learning). Ongoing legal changes where the use of a biased model will be penalized highlight the necessity of understanding, detecting, and mitigating biases from shortcut learning and will require diverse research teams looking at the whole AI pipeline.

来源:J Am Coll Radiol,查看原文。版权归原作者所有。

引用

  1. Banerjee I, Bhattacharjee K, Burns JL, et al. "Shortcuts" Causing Bias in Radiology Artificial Intelligence: Causes, Evaluation, and Mitigation. J Am Coll Radiol. 2023. PMID: 37506964. doi:10.1016/j.jacr.2023.06.025

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。