相信黑箱:医疗机器学习无需可解释性即可成为循证依据
本文探讨可解释性在医疗机器学习(MLHC)中的作用及其对有效和伦理应用的必要性与意义。通过聚焦叙述性综述梳理支持与反对可解释性的论点,发现对可解释性的担忧不仅限于MLHC,也延伸至众多经过充分验证的治疗干预及人类临床判断本身。结论认为可解释性的价值并非内在固有,而是实现性能与信任等更高目标的工具性手段,并告诫不应无妥协地追求可解释性,而应倡导发展稳健的实证方法来评估日益不可解释的算法系统。
要点
- 对可解释性的担忧不限于医疗机器学习,也涉及众多经过充分验证的治疗干预及人类临床判断本身。
- 可解释性在医疗机器学习中的价值并非内在固有,而是实现性能与信任等更高目标的工具性手段。
- 告诫不应无妥协地追求可解释性,倡导发展稳健的实证方法来评估日益不可解释的算法系统。
核心结论
- 可解释性在医疗机器学习中的价值并非内在固有,而是实现性能与信任等更高目标的工具性手段。
- 告诫不应无妥协地追求可解释性,倡导发展稳健的实证方法来评估日益不可解释的算法系统。
研究设计与样本
- 本文为聚焦叙述性综述,围绕医疗机器学习与人工智能在医学中应用的文献,梳理支持与反对可解释性的论点。
主要发现
- 对可解释性的担忧不仅限于医疗机器学习,也延伸至众多经过充分验证的治疗干预及人类临床判断本身。
- 本文考察了循证医学在评估不可解释的治疗与技术中的作用,并强调医疗机器学习中的可解释性概念与循证医学中机制推理概念之间的类比。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: To examine the role of explainability in machine learning for healthcare (MLHC), and its necessity and significance with respect to effective and ethical MLHC application. STUDY DESIGN AND SETTING: This commentary engages with the growing and dynamic corpus of literature on the use of MLHC and artificial intelligence (AI) in medicine, which provide the context for a focused narrative review of arguments presented in favour of and opposition to explainability in MLHC. RESULTS: We find that concerns regarding explainability are not limited to MLHC, but rather extend to numerous well-validated treatment interventions as well as to human clinical judgment itself. We examine the role of evidence-based medicine in evaluating inexplicable treatments and technologies, and highlight the analogy between the concept of explainability in MLHC and the related concept of mechanistic reasoning in evidence-based medicine. CONCLUSION: Ultimately, we conclude that the value of explainability in MLHC is not intrinsic, but is instead instrumental to achieving greater imperatives such as performance and trust. We caution against the uncompromising pursuit of explainability, and advocate instead for the development of robust empirical methods to successfully evaluate increasingly inexplicable algorithmic systems.
引用
- McCoy LG, Brenna CTA, Chen SS, et al. Believing in black boxes: machine learning for healthcare does not need explainability to be evidence-based. J Clin Epidemiol. 2021. PMID: 34748907. doi:10.1016/j.jclinepi.2021.11.001
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。