人工智能与解释:如何、为何以及何时解释黑箱
该文讨论医学影像人工智能算法的黑箱特性,将其与物理学中自然定律的黑箱类比,阐述解释的形成过程及人类角色,并探讨可解释人工智能研究计划在其中的作用。
要点
- 人工智能黑箱特性可能影响发现错误、患者信任和新知识创造。
- 即使是最黑的黑箱,也存在理解它们的希望。
- 放射科医生在提供人工智能模型持续改进的健康系统中扮演关键角色。
核心结论
- 即使是最黑的黑箱模型,也存在理解它们的希望,类似于理解物理学中的自然定律。
- 解释的形成过程涉及人类角色,放射科医生在人工智能模型持续改进中发挥关键作用。
研究设计与样本
- 本文为论述性文章,通过将理解黑箱模型与理解物理学自然定律进行类比来展开讨论。
临床应用与阅片要点
- 放射科医生在提供人工智能模型持续改进的健康系统中扮演关键角色。
- 可解释人工智能研究计划的作用需在更广泛背景下探索。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
Artificial intelligence (AI) is infiltrating nearly all fields of science by storm. One notorious property that AI algorithms bring is their so-called black box character. In particular, they are said to be inherently unexplainable algorithms. Of course, such characteristics would pose a problem for the medical world, including radiology. The patient journey is filled with explanations along the way, from diagnoses to treatment, follow-up, and more. If we were to replace part of these steps with non-explanatory algorithms, we could lose grip on vital aspects such as finding mistakes, patient trust, and even the creation of new knowledge. In this article, we argue that, even for the darkest of black boxes, there is hope of understanding them. In particular, we compare the situation of understanding black box models to that of understanding the laws of nature in physics. In the case of physics, we are given a 'black box' law of nature, about which there is no upfront explanation. However, as current physical theories show, we can learn plenty about them. During this discussion, we present the process by which we make such explanations and the human role therein, keeping a solid focus on radiological AI situations. We will outline the AI developers' roles in this process, but also the critical role fulfilled by the practitioners, the radiologists, in providing a healthy system of continuous improvement of AI models. Furthermore, we explore the role of the explainable AI (XAI) research program in the broader context we describe.
引用
- Marcus E, Teuwen J. Artificial intelligence and explanation: How, why, and when to explain black boxes. Eur J Radiol. 2024. PMID: 38417186. doi:10.1016/j.ejrad.2024.111393
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。