为医疗保健中难以解释的黑箱预测模型谦逊辩护
该文论述医疗预测模型(含或不含人工智能技术)日益复杂,推动使用可解释人工智能(XAI)打开黑箱。作者认为XAI未必提供与医疗决策相关的洞见,可能导致盲目信任和误读模型可用性。信任应建立在严格的预测模型验证和评估模型对医疗共享决策有效性的影响研究上。
要点
- XAI未必提供与医疗决策相关的洞见,可能导致盲目信任和误读模型可用性。
- XAI难以避免因果解释,可能因解释与临床知识冲突而产生确认偏倚或错误否定模型。
- 信任应基于严格的预测模型验证和评估模型对医疗共享决策有效性的影响研究。
核心结论
- 作者谦逊地为医疗保健中难以解释的黑箱预测模型辩护,认为不应期待XAI为患者和医疗提供者生成对黑箱预测模型的信任。
研究设计与样本
- 本文为论述性文章,未报告系统检索范围或样本量。
主要发现
- XAI未必提供与医疗决策相关的洞见,可能导致盲目信任和误读模型可用性。
- XAI的重要局限是难以避免因果解释,可能因解释与临床知识冲突而产生确认偏倚或错误否定模型。
临床怎么用
- 作者认为信任应建立在严格的预测模型验证和评估模型对医疗共享决策有效性的影响研究上,而非期待XAI生成信任。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
The increasing complexity of prediction models for healthcare purposes - whether developed with or without artificial intelligence (AI) techniques - drives the urge to open complex "black box" models using eXplainable AI (XAI) techniques. In this paper, we argue that XAI may not necessarily provide insights relevant to decision-making in the medical setting and can lead to misplaced trust and misinterpretation of the model's usability. An important limitation of XAI is the difficulty in avoiding causal interpretation, which may result in confirmation bias or false dismissal of the model when explanations conflict with clinical knowledge. Rather than expecting XAI to generate trust in black box prediction models to patients and healthcare providers, trust should be grounded in rigorous prediction model validations and model impact studies assessing the model's effectiveness on medical shared decision-making. In this paper, we therefore humbly defend the "unexplainable" prediction models in healthcare.
引用
- van Royen FS, Weerts HJP, de Hond AAH, et al. In humble defense of unexplainable black box prediction models in healthcare. J Clin Epidemiol. 2025. PMID: 41077324. doi:10.1016/j.jclinepi.2025.112013
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。