深度学习从胸部X线片预测患者人口学特征
该研究基于MIMIC-CXR数据库的55,174张胸片训练深度学习模型,用于从胸片分类自报性别、年龄、自报族裔和保险状态,并在CheXpert及多医院城市医疗系统两个外部数据库验证。模型预测性别AUC近0.999,年龄和族裔AUC在0.854-0.911之间,保险状态AUC中等(0.675-0.705)。结论认为深度学习可从胸片预测人口学特征,并可用于确保训练数据多样性。
要点
- 深度学习可从胸片高精度预测性别(AUC近0.999),年龄和族裔预测精度较高。
- 保险状态预测精度中等(AUC 0.675-0.705),临床直接应用价值有限。
- 可视化技术有助于确认模型关注解剖区域,确保模型按预期工作。
核心结论
- 深度学习模型能够从胸部X线片预测患者的年龄、自报性别、自报族裔和保险状态。
- 可视化技术有助于确保深度学习模型按预期工作并展示感兴趣的解剖区域。
- 这些模型可用于确保训练数据的多样性,从而保证人工智能模型在不同人群中有效。
研究设计与样本
- 研究为深度学习模型开发与验证研究,训练和测试使用MIMIC-CXR数据库的55,174张胸片。
- 外部验证数据来自CheXpert数据库和另一多医院城市医疗保健系统数据库(经机构审查委员会批准)。
- 采用宏平均曲线下面积(AUC)评估模型性能,代码开源。
诊断标准与关键数值
- 性别预测:在留出测试数据上AUC为0.999(95%CI:0.99-0.99),外部验证数据AUC分别为0.994(0.99-0.99)和0.997(0.99-0.99)。
- 年龄和族裔预测:AUC范围为0.854(0.80-0.91)至0.911(0.88-0.94)。
- 保险状态预测:留出测试数据AUC为0.705(0.60-0.81),外部验证数据AUC为0.675(0.54-0.79)。
临床应用与阅片要点
- 日常阅片和报告中无需常规使用该模型,但需警惕模型可能从胸片推断人口学特征,影响公平性。
- 构建或使用AI模型时,应利用此类方法评估训练数据多样性,避免对 underrepresented 人群性能下降。
局限性
- 研究为回顾性设计,外部验证数据来源有限,未报告多中心前瞻性验证结果。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND: Deep learning models are increasingly informing medical decision making, for instance, in the detection of acute intracranial hemorrhage and pulmonary embolism. However, many models are trained on medical image databases that poorly represent the diversity of the patients they serve. In turn, many artificial intelligence models may not perform as well on assisting providers with important medical decisions for underrepresented populations.
PURPOSE: Assessment of the ability of deep learning models to classify the self-reported gender, age, self-reported ethnicity, and insurance status of an individual patient from a given chest radiograph.
METHODS: Models were trained and tested with 55,174 radiographs in the MIMIC Chest X-ray (MIMIC-CXR) database. External validation data came from two separate databases, one from CheXpert and another from a multihospital urban health care system after institutional review board approval. Macro-averaged area under the curve (AUC) values were used to evaluate performance of models. Code used for this study is open-source and available at https://github.com/ai-bias/cxr-bias, and pixelstopatients.com/models/demographics.
RESULTS: Accuracy of models to predict gender was nearly perfect, with 0.999 (95% confidence interval: 0.99-0.99) AUC on held-out test data and 0.994 (0.99-0.99) and 0.997 (0.99-0.99) on external validation data. There was high accuracy to predict age and ethnicity, ranging from 0.854 (0.80-0.91) to 0.911 (0.88-0.94) AUC, and moderate accuracy to predict insurance status, with AUC ranging from 0.705 (0.60-0.81) on held-out test data to 0.675 (0.54-0.79) on external validation data.
CONCLUSIONS: Deep learning models can predict the age, self-reported gender, self-reported ethnicity, and insurance status of a patient from a chest radiograph. Visualization techniques are useful to ensure deep learning models function as intended and to demonstrate anatomical regions of interest. These models can be used to ensure that training data are diverse, thereby ensuring artificial intelligence models that work on diverse populations.
引用
- Adleberg, Wardeh, Doo, et al. Predicting Patient Demographics From Chest Radiographs With Deep Learning. J Am Coll Radiol. 2022. PMID: 35964688. doi:10.1016/j.jacr.2022.06.008
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。