文献速递重症综合管理与镇静镇痛

人工智能对重症医师的种族/民族、性别和年龄的表征:两项文本到图像模型的横断面研究

Representation of intensivists' race/ethnicity, sex, and age by artificial intelligence: a cross-sectional study of two text-to-image models.
PubMed 文献 · Crit Care · 2024-11-11
一句话结论ChatGPT DALL-E 2与Midjourney生成的重症医师图像在性别、种族和年龄上与实际美国重症医学队伍存在显著偏差,可能固化医疗工作者刻板印象。

这项横断面研究于2024年5月至7月开展,利用美国劳动力报告(2022年)和重症医学受训者(2021年)的人口学数据,比较了Midjourney v6.0和ChatGPT 4.0 DALL-E 2两种AI文本到图像模型生成的1,400张重症医学亚专业图像与实际重症医师人口学特征。结果显示,ChatGPT-DALL-E2生成的女性比例更低(17.3% vs 32.2%,p<0.0001)、白人比例更高(61% vs 55.1%,p=0.002)、年轻医生比例更高(53.3% vs 23.9%,p<0.001);Midjourney生成的女性比例更高(47.6% vs 32.2%,p<0.001)、白人比例更高(60.9% vs 55.1%,p=0.003)、年轻医生比例更高(49.3% vs 23.9%,p<0.001)。两种模型在亚专业间也观察到显著差异,且两模型相互比较时对重症医师的描绘也存在显著差异。作者认为这些偏差反映了更广泛的文化问题,并强调需要确保AI在医疗应用中公平、问责、透明和合乎伦理。

要点

  • ChatGPT DALL-E 2生成的重症医师图像中女性占17.3%,低于实际的32.2%(p<0.0001);白人占61%,高于实际的55.1%(p=0.002);年轻医生占53.3%,高于实际的23.9%(p<0.001)。
  • Midjourney生成的重症医师图像中女性占47.6%,高于实际的32.2%(p<0.001);白人占60.9%,高于实际的55.1%(p=0.003);年轻医生占49.3%,高于实际的23.9%(p<0.001)。
  • 两种模型在重症医学亚专业之间的图像表征存在显著差异,且两模型相互比较时对重症医师的描绘也存在显著差异。
  • 作者认为这些AI图像中的显著偏差反映了更广泛的文化问题,可能在社会中固化医疗工作者的刻板印象。
  • 作者强调需要一种确保AI医疗应用中公平、问责、透明和合乎伦理的方法。

适用人群与场景

  • 研究对象为AI文本到图像模型Midjourney v6.0和ChatGPT 4.0 DALL-E 2生成的重症医师图像,比较基准为美国劳动力报告(2022年)和重症医学受训者(2021年)的人口学数据。

研究设计与关键结果

  • 研究类型为横断面研究,于2024年5月至7月开展,共生成1,400张图像,覆盖重症医学亚专业,结局为AI生成图像中性别、种族/民族和年龄表征与实际劳动力人口学数据的比较。
  • ChatGPT-DALL-E2生成图像中女性占17.3%,实际为32.2%(p<0.0001);白人占61%,实际为55.1%(p=0.002);年轻医生占53.3%,实际为23.9%(p<0.001)。
  • Midjourney生成图像中女性占47.6%,实际为32.2%(p<0.001);白人占60.9%,实际为55.1%(p=0.003);年轻医生占49.3%,实际为23.9%(p<0.001)。
  • 两种模型在重症医学亚专业之间的图像表征存在显著差异。
  • 两模型相互比较时,对重症医师的描绘存在显著差异。

证据类型、等级与局限

  • 证据类型:横断面研究。
  • 局限:原文未报告局限性。

对床旁实践的改变

  • 作者认为,ChatGPT DALL-E 2和Midjourney生成的重症医师图像存在显著偏差,反映了更广泛的文化问题,可能固化医疗工作者的刻板印象。
  • 作者认为,本研究凸显需要一种确保AI医疗应用中公平、问责、透明和合乎伦理的方法。

提炼说明

  • 本条依据论文摘要整理;摘要未涉及「诊断标准与关键阈值」「处置流程与药物剂量」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开

BACKGROUND: Integrating artificial intelligence (AI) into intensive care practices can enhance patient care by providing real-time predictions and aiding clinical decisions. However, biases in AI models can undermine diversity, equity, and inclusion (DEI) efforts, particularly in visual representations of healthcare professionals. This work aims to examine the demographic representation of two AI text-to-image models, Midjourney and ChatGPT DALL-E 2, and assess their accuracy in depicting the demographic characteristics of intensivists.

METHODS: This cross-sectional study, conducted from May to July 2024, used demographic data from the USA workforce report (2022) and intensive care trainees (2021) to compare real-world intensivist demographics with images generated by two AI models, Midjourney v6.0 and ChatGPT 4.0 DALL-E 2. A total of 1,400 images were generated across ICU subspecialties, with outcomes being the comparison of sex, race/ethnicity, and age representation in AI-generated images to the actual workforce demographics.

RESULTS: The AI models demonstrated noticeable biases when compared to the actual U.S. intensive care workforce data, notably overrepresenting White and young doctors. ChatGPT-DALL-E2 produced less female (17.3% vs 32.2%, p < 0.0001), more White (61% vs 55.1%, p = 0.002) and younger (53.3% vs 23.9%, p < 0.001) individuals. While Midjourney depicted more female (47.6% vs 32.2%, p < 0.001), more White (60.9% vs 55.1%, p = 0.003) and younger intensivist (49.3% vs 23.9%, p < 0.001). Substantial differences between the specialties within both models were observed. Finally when compared together, both models showed significant differences in the Portrayal of intensivists.

CONCLUSIONS: Significant biases in AI images of intensivists generated by ChatGPT DALL-E 2 and Midjourney reflect broader cultural issues, potentially perpetuating stereotypes of healthcare worker within the society. This study highlights the need for an approach that ensures fairness, accountability, transparency, and ethics in AI applications for healthcare.

来源:Crit Care,查看原文。版权归原作者所有。

参考来源

  1. Gisselbaek M, Suppan M, Minsart L, et al. Representation of intensivists' race/ethnicity, sex, and age by artificial intelligence: a cross-sectional study of two text-to-image models. Crit Care. 2024. PMID: 39529104. doi:10.1186/s13054-024-05134-4

供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。