基于生物标志物的人工智能与视网膜图像中种族偏倚风险的关联
本研究收集245名新生儿共4095张视网膜眼底图像,用卷积神经网络从彩色眼底图和视网膜血管图中推断自我报告的种族。结果显示,卷积神经网络几乎能完美推断种族,血管图信息量略低但仍能学习种族信息,提示从眼底照片中去除种族相关信息非常困难。
要点
- 卷积神经网络从彩色眼底图推断自我报告种族的图像级AUC-PR为0.999(95%CI 0.999-1.000)。
- 原始视网膜血管图推断种族的图像级AUC-PR为0.938(95%CI 0.926-0.950)。
- 无论是否去除颜色、统一血管亮度或宽度,卷积神经网络仍能学习图像来自黑人还是白人婴儿。
核心结论
- 这项诊断研究的结果提示,从眼底照片中去除与自我报告种族相关的信息可能非常具有挑战性,因此基于眼底照片训练的人工智能算法在实践中可能存在偏倚表现,即使基于生物标志物而非原始图像也是如此。
- 无论训练人工智能使用何种方法,在相关亚群体中评估性能至关重要。
研究设计与样本
- 本研究收集了父母报告为黑人(94名,38.4%;平均[SD]年龄27.2[2.3]周;多数性别55名,58.5%)或白人(151名,61.6%;平均[SD]年龄27.6[2.3]周;多数性别80名,53.0%)的245名新生儿的4095张视网膜眼底图像。
- 使用u-net(一种卷积神经网络)将视网膜眼底图像中的主要动脉和静脉分割为灰度视网膜血管图,随后进行阈值化、二值化和/或骨架化处理。
- 卷积神经网络在彩色视网膜眼底图像、原始视网膜血管图以及阈值化、二值化或骨架化的视网膜血管图上,使用患者的自我报告种族标签进行训练。
- 研究数据分析时间为2021年7月1日至2021年9月28日。
主要发现
- 卷积神经网络从视网膜眼底图像推断自我报告种族几乎完美:图像级AUC-PR为0.999(95%CI 0.999-1.000),婴儿级AUC-PR为1.000(95%CI 0.999-1.000)。
- 原始视网膜血管图的信息量与彩色视网膜眼底图像接近:图像级AUC-PR为0.938(95%CI 0.926-0.950),婴儿级AUC-PR为0.995(95%CI 0.992-0.998)。
- 最终,卷积神经网络能够学习图像来自黑人还是白人婴儿,无论图像是否包含颜色、血管分割亮度差异是否被消除、或血管分割宽度是否统一。
关键数值与推荐
- 主要结局指标为图像水平和眼水平分类自我报告种族的精确率-召回率曲线下面积(AUC-PR)和受试者工作特征曲线下面积(AUROC)。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
IMPORTANCE: Although race is a social construct, it is associated with variations in skin and retinal pigmentation. Image-based medical artificial intelligence (AI) algorithms that use images of these organs have the potential to learn features associated with self-reported race (SRR), which increases the risk of racially biased performance in diagnostic tasks; understanding whether this information can be removed, without affecting the performance of AI algorithms, is critical in reducing the risk of racial bias in medical AI. OBJECTIVE: To evaluate whether converting color fundus photographs to retinal vessel maps (RVMs) of infants screened for retinopathy of prematurity (ROP) removes the risk for racial bias. DESIGN, SETTING, AND PARTICIPANTS: The retinal fundus images (RFIs) of neonates with parent-reported Black or White race were collected for this study. A u-net, a convolutional neural network (CNN) that provides precise segmentation for biomedical images, was used to segment the major arteries and veins in RFIs into grayscale RVMs, which were subsequently thresholded, binarized, and/or skeletonized. CNNs were trained with patients' SRR labels on color RFIs, raw RVMs, and thresholded, binarized, or skeletonized RVMs. Study data were analyzed from July 1 to September 28, 2021. MAIN OUTCOMES AND MEASURES: Area under the precision-recall curve (AUC-PR) and area under the receiver operating characteristic curve (AUROC) at both the image and eye level for classification of SRR. RESULTS: A total of 4095 RFIs were collected from 245 neonates with parent-reported Black (94 [38.4%]; mean [SD] age, 27.2 [2.3] weeks; 55 majority sex [58.5%]) or White (151 [61.6%]; mean [SD] age, 27.6 [2.3] weeks, 80 majority sex [53.0%]) race. CNNs inferred SRR from RFIs nearly perfectly (image-level AUC-PR, 0.999; 95% CI, 0.999-1.000; infant-level AUC-PR, 1.000; 95% CI, 0.999-1.000). Raw RVMs were nearly as informative as color RFIs (image-level AUC-PR, 0.938; 95% CI, 0.926-0.950; infant-level AUC-PR, 0.995; 95% CI, 0.992-0.998). Ultimately, CNNs were able to learn whether RFIs or RVMs were from Black or White infants regardless of whether images contained color, vessel segmentation brightness differences were nullified, or vessel segmentation widths were uniform. CONCLUSIONS AND RELEVANCE: Results of this diagnostic study suggest that it can be very challenging to remove information relevant to SRR from fundus photographs. As a result, AI algorithms trained on fundus photographs have the potential for biased performance in practice, even if based on biomarkers rather than raw images. Regardless of the methodology used for training AI, evaluating performance in relevant subpopulations is critical.
引用
- Coyner AS, Singh P, Brown JM, et al. Association of Biomarker-Based Artificial Intelligence With Risk of Racial Bias in Retinal Images. JAMA Ophthalmol. 2023. PMID: 37140902. doi:10.1001/jamaophthalmol.2023.1310
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。