揭示大型语言模型健康公平性危害与偏见的工具箱
本文提出用于揭示大型语言模型(LLM)生成的长篇医学回答中可能引发公平性相关危害的偏见资源与方法,并基于Med-PaLM 2开展大规模实证案例研究。贡献包括多因素人工评估框架和EquityMedQA(七个富含对抗性查询的数据集),二者均基于迭代参与式方法和Med-PaLM 2回答审查。研究发现该方法能揭示较窄评估方法可能遗漏的偏见,并强调使用多样评估方法和不同背景与专长评估者的重要性。
要点
- 提出多因素人工评估框架与EquityMedQA数据集以揭示LLM医学回答中的公平性偏见。
- 基于Med-PaLM 2的实证研究表明该方法能发现较窄评估方法可能遗漏的偏见。
- 强调使用多样评估方法和不同背景与专长评估者对公平性评估的重要性。
核心结论
- 该方法能揭示较窄评估方法可能遗漏的偏见,但不足以全面评估AI系统部署是否促进公平健康结局,作者希望其能被利用和构建以实现促进可及和公平医疗的LLM。
研究设计与样本
- 本文提出用于揭示LLM生成的长篇医学回答中公平性相关危害偏见的资源与方法,并基于Med-PaLM 2 LLM开展大规模实证案例研究。
- 贡献包括多因素人工评估框架和EquityMedQA(七个富含对抗性查询的数据集),二者均基于迭代参与式方法和Med-PaLM 2回答审查。
主要发现
- 实证研究发现该方法能揭示较窄评估方法可能遗漏的偏见。
- 作者经验强调使用多样评估方法和不同背景与专长评估者的重要性。
临床怎么用
- 原文未据此给出推荐。
局限性
- 该方法不足以全面评估AI系统部署是否促进公平健康结局。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
Large language models (LLMs) hold promise to serve complex health information needs but also have the potential to introduce harm and exacerbate health disparities. Reliably evaluating equity-related model failures is a critical step toward developing systems that promote health equity. We present resources and methodologies for surfacing biases with potential to precipitate equity-related harms in long-form, LLM-generated answers to medical questions and conduct a large-scale empirical case study with the Med-PaLM 2 LLM. Our contributions include a multifactorial framework for human assessment of LLM-generated answers for biases and EquityMedQA, a collection of seven datasets enriched for adversarial queries. Both our human assessment framework and our dataset design process are grounded in an iterative participatory approach and review of Med-PaLM 2 answers. Through our empirical study, we find that our approach surfaces biases that may be missed by narrower evaluation approaches. Our experience underscores the importance of using diverse assessment methodologies and involving raters of varying backgrounds and expertise. While our approach is not sufficient to holistically assess whether the deployment of an artificial intelligence (AI) system promotes equitable health outcomes, we hope that it can be leveraged and built upon toward a shared goal of LLMs that promote accessible and equitable healthcare.
引用
- Pfohl SR, Cole-Lewis H, Sayres R, et al. A toolbox for surfacing health equity harms and biases in large language models. Nat Med. 2024. PMID: 39313595. doi:10.1038/s41591-024-03258-2
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。