可解释AI对皮肤科诊断的影响在临床医生与公众间存在差异
两项大规模实验分别纳入623名公众和153名基层医生,考察公平性约束的皮肤科诊断AI模型联合不同可解释AI(XAI)解释(含多模态大语言模型)对诊断表现的影响。结果显示,公平性训练后AI辅助提升了两类人群的最终诊断准确率并缩小肤色相关差异;大语言模型解释对公众产生自动化偏差,对经验丰富的基层医生则无此负面影响。
要点
- 公平性约束训练的AI模型可提升公众与基层医生的皮肤科诊断准确率并缩小肤色差异。
- 大语言模型解释对公众诱发自动化偏差,AI正确时准确率提升、错误时下降。
- 经验丰富的基层医生对AI错误更稳健,无论AI是否正确均能获益。
核心结论
- 公平性约束的AI辅助能提升公众和基层医生的皮肤科诊断准确率并减少肤色相关差异。
- 大语言模型解释对公众产生自动化偏差,而对经验丰富的基层医生无此负面影响。
- AI预测呈现时机可能影响锚定偏差,XAI效果取决于使用者专业水平与呈现时序。
研究设计与样本
- 两项大规模实验,分别纳入623名公众和153名基层医生(PCPs)。
- 实验将公平性约束的皮肤科诊断AI模型与不同XAI解释(含多模态大语言模型)组合。
- 考察XAI辅助对诊断表现的影响。
主要发现
- 公平性约束训练后,AI模型在不同肤色间表现均衡,辅助提升两类人群最终诊断准确率并缩小肤色相关差异。
- 在此设置下,大语言模型解释效果分化:公众出现自动化偏差,AI正确时准确率提升、错误时下降。
- 经验丰富的基层医生保持稳健,无论AI模型是否正确均能获益。
- 先呈现AI模型诊断再让人决策可能导致更强的锚定偏差。
临床怎么用
- 对公众用户使用AI皮肤科诊断时需警惕自动化偏差,尤其AI可能出错时。
- 对经验丰富的基层医生,AI辅助可在AI正确或错误时均带来获益。
- 设计人机协作系统时应考虑AI预测呈现时机以减少锚定偏差。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
Artificial intelligence (AI) is increasingly permeating healthcare, from serving as a physician assistant to powering consumer applications. The opacity of AI algorithms makes the ability of humans to interact with AI algorithms challenging. To overcome this limitation, explainable AI (XAI) provides insight into AI decision-making, but evidence suggests that XAI can paradoxically induce bias in the human decision-making process. Here we present results from two large-scale experiments, involving 623 lay people and 153 primary care physicians (PCPs), respectively, in which a fairness-based AI model for dermatological diagnoses and different XAI-based explanations were combined to examine how XAI assistance, particularly multimodal large language models (LLMs), influences diagnostic performance. With fairness-constrained model training, assistance from an AI model that achieved balanced performance across skin tones improved final diagnostic accuracy and reduced skin-tone-related performance disparities among both lay people and PCPs. In this setting, LLM explanations yielded divergent effects: lay users showed higher automation bias-accuracy was boosted when the diagnoses provided by the AI model were correct but was reduced when the model erred-whereas experienced PCPs remained resilient, benefiting irrespective of the AI model's accuracy. In addition, presenting the AI model's diagnosis before human decision-making may lead to stronger anchoring bias. These findings highlight XAI's varying impacts based on human expertise and the timing of when the AI-based prediction is provided, underscoring the concept that LLMs can act as a 'double-edged sword' in medical AI and informing future human-AI collaborative system design.
引用
- Xu X', Hu H, Zhang H, et al. Divergent impacts of explainable AI for dermatological diagnosis on clinicians versus lay people. Nat Med. 2026. PMID: 42552380. doi:10.1038/s41591-026-04553-w
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。