开发和验证卷积神经网络模型用以预测晚期癌症患者股骨近端病理性骨折:基于腹部和骨盆CT图像
该研究利用三家医院2011年1月至2021年12月接受股骨近端放疗的392例晚期癌症患者的2945次腹部和骨盆CT,生成数字重建放射图,训练并外部验证三种卷积神经网络(CNN)模型预测3个月内病理性骨折。DenseNet121表现最佳,其受试者工作特征曲线下面积(AUC)大于VGG16和ResNet50,且在特异性、精确率和F1分数上优于临床医生。作者认为CNN模型或能准确预测临床医生未能预见的即将发生的病理性骨折,从而辅助医疗、放射和骨科肿瘤科医生临床工作。
要点
- DenseNet121的AUC为0.77±0.07(95%CI 0.75-0.79),大于VGG16的0.71±0.08(95%CI 0.69-0.73)和ResNet50的0.72±0.09(95%CI 0.69-0.74),p值均为0.001。
- DenseNet121特异性为0.98±0.01(95%CI 0.98-0.99),优于临床医生的0.86±0.09(95%CI 0.81-0.91),p=0.01。
- DenseNet121精确率为0.72±0.19(95%CI 0.67-0.77),优于临床医生的0.11±0.10(95%CI 0.05-0.17),p=0.0001;F1分数为0.34±0.10(95%CI 0.31-0.37),优于临床医生的0.17±0.15(95%CI 0.08-0.26),p=0.0001。
核心结论
- CNN模型或能准确从腹部和骨盆CT图像的数字重建放射图中预测临床医生可能未预见的即将发生的病理性骨折,这可在临床上辅助医疗、放射和骨科肿瘤科医生。
- 为达到更好性能,应开发和验证使用患者病史知识的集成学习模型。
研究设计与样本
- 研究纳入三家医院2011年1月至2021年12月接受股骨近端放疗的392例晚期癌症患者的2945次腹部和骨盆CT扫描。
- 排除无法确定CT扫描后3个月内是否发生病理性骨折的33%(974次)CT扫描后,最终纳入1971例病例,平均年龄59±12岁,其中47%(936例)为女性。
- CT扫描后3个月内发生病理性骨折的病例占3%(60/1971),无病理性骨折的病例为1911例。
- 使用一家医院的1557张图像作为训练集,其他医院的414张图像作为外部验证集,并通过数据增强方法将有无病理性骨折组的图像数量分别从1911增至22932、从60增至720。
- 对VGG16、ResNet50和DenseNet121三种CNN模型进行微调,主要用受试者工作特征曲线下面积评估性能,并用约登J统计量计算最佳准确率、敏感性和特异性。
主要发现
- DenseNet121识别病理性骨折的AUC为0.77±0.07(95%CI 0.75-0.79),大于VGG16的0.71±0.08(95%CI 0.69-0.73),p=0.001;也大于ResNet50的0.72±0.09(95%CI 0.69-0.74),p=0.001。
- DenseNet121的敏感性为0.22±0.07(95%CI 0.20-0.24),精确率为0.72±0.19(95%CI 0.67-0.77),F1分数为0.34±0.10(95%CI 0.31-0.37),均在各模型中最高,且模型准确聚焦于预期病理性骨折区域。
- DenseNet121比临床医生更少错误预测无病理性骨折的病例,其特异性为0.98±0.01(95%CI 0.98-0.99),优于临床医生的0.86±0.09(95%CI 0.81-0.91),p=0.01。
- DenseNet121的精确率为0.72±0.19(95%CI 0.67-0.77),优于临床医生的0.11±0.10(95%CI 0.05-0.17),p=0.0001;F1分数为0.34±0.10(95%CI 0.31-0.37),优于临床医生的0.17±0.15(95%CI 0.08-0.26),p=0.0001。
临床怎么用
- 作者认为CNN模型或能准确预测临床医生可能未预见的即将发生的病理性骨折,从而辅助医疗、放射和骨科肿瘤科医生临床工作。
- 作者建议为达到更好性能,应开发和验证使用患者病史知识的集成学习模型。
- 原文未据此给出其他推荐。
局限性
- 原文在结论中提出应开发和验证使用患者病史知识的集成学习模型以达更好性能,但未明确陈述研究局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Improvement in survival in patients with advanced cancer is accompanied by an increased probability of bone metastasis and related pathologic fractures (especially in the proximal femur). The few systems proposed and used to diagnose impending fractures owing to metastasis and to ultimately prevent future fractures have practical limitations; thus, novel screening tools are essential. A CT scan of the abdomen and pelvis is a standard modality for staging and follow-up in patients with cancer, and radiologic assessments of the proximal femur are possible with CT-based digitally reconstructed radiographs. Deep-learning models, such as convolutional neural networks (CNNs), may be able to predict pathologic fractures from digitally reconstructed radiographs, but to our knowledge, they have not been tested for this application. QUESTIONS/PURPOSES: (1) How accurate is a CNN model for predicting a pathologic fracture in a proximal femur with metastasis using digitally reconstructed radiographs of the abdomen and pelvis CT images in patients with advanced cancer? (2) Do CNN models perform better than clinicians with varying backgrounds and experience levels in predicting a pathologic fracture on abdomen and pelvis CT images without any knowledge of the patients' histories, except for metastasis in the proximal femur? METHODS: A total of 392 patients received radiation treatment of the proximal femur at three hospitals from January 2011 to December 2021. The patients had 2945 CT scans of the abdomen and pelvis for systemic evaluation and follow-up in relation to their primary cancer. In 33% of the CT scans (974), it was impossible to identify whether a pathologic fracture developed within 3 months after each CT image was acquired, and these were excluded. Finally, 1971 cases with a mean age of 59 ± 12 years were included in this study. Pathologic fractures developed within 3 months after CT in 3% (60 of 1971) of cases. A total of 47% (936 of 1971) were women. Sixty cases had an established pathologic fracture within 3 months after each CT scan, and another group of 1911 cases had no established pathologic fracture within 3 months after CT scan. The mean age of the cases in the former and latter groups was 64 ± 11 years and 59 ± 12 years, respectively, and 32% (19 of 60) and 53% (1016 of 1911) of cases, respectively, were female. Digitally reconstructed radiographs were generated with perspective projections of three-dimensional CT volumes onto two-dimensional planes. Then, 1557 images from one hospital were used for a training set. To verify that the deep-learning models could consistently operate even in hospitals with a different medical environment, 414 images from other hospitals were used for external validation. The number of images in the groups with and without a pathologic fracture within 3 months after each CT scan increased from 1911 to 22,932 and from 60 to 720, respectively, using data augmentation methods that are known to be an effective way to boost the performance of deep-learning models. Three CNNs (VGG16, ResNet50, and DenseNet121) were fine-tuned using digitally reconstructed radiographs. For performance measures, the area under the receiver operating characteristic curve, accuracy, sensitivity, specificity, precision, and F1 score were determined. The area under the receiver operating characteristic curve was used to evaluate three CNN models mainly, and the optimal accuracy, sensitivity, and specificity were calculated using the Youden J statistic. Accuracy refers to the proportion of fractures in the groups with and without a pathologic fracture within 3 months after each CT scan that were accurately predicted by the CNN model. Sensitivity and specificity represent the proportion of accurately predicted fractures among those with and without a pathologic fracture within 3 months after each CT scan, respectively. Precision is a measure of how few false-positives the model produces. The F1 score is a harmonic mean of sensitivity and precision, which have a tradeoff relationship. Gradient-weighted class activation mapping images were created to check whether the CNN model correctly focused on potential pathologic fracture regions. The CNN model with the best performance was compared with the performance of clinicians. RESULTS: DenseNet121 showed the best performance in identifying pathologic fractures; the area under the receiver operating characteristic curve for DenseNet121 was larger than those for VGG16 (0.77 ± 0.07 [95% CI 0.75 to 0.79] versus 0.71 ± 0.08 [95% CI 0.69 to 0.73]; p = 0.001) and ResNet50 (0.77 ± 0.07 [95% CI 0.75 to 0.79] versus 0.72 ± 0.09 [95% CI 0.69 to 0.74]; p = 0.001). Specifically, DenseNet121 scored the highest in sensitivity (0.22 ± 0.07 [95% CI 0.20 to 0.24]), precision (0.72 ± 0.19 [95% CI 0.67 to 0.77]), and F1 score (0.34 ± 0.10 [95% CI 0.31 to 0.37]), and it focused accurately on the region with the expected pathologic fracture. Further, DenseNet121 was less likely than clinicians to mispredict cases in which there was no pathologic fracture than cases in which there was a fracture; the performance of DenseNet121 was better than clinician performance in terms of specificity (0.98 ± 0.01 [95% CI 0.98 to 0.99] versus 0.86 ± 0.09 [95% CI 0.81 to 0.91]; p = 0.01), precision (0.72 ± 0.19 [95% CI 0.67 to 0.77] versus 0.11 ± 0.10 [95% CI 0.05 to 0.17]; p = 0.0001), and F1 score (0.34 ± 0.10 [95% CI 0.31 to 0.37] versus 0.17 ± 0.15 [95% CI 0.08 to 0.26]; p = 0.0001). CONCLUSION: CNN models may be able to accurately predict impending pathologic fractures from digitally reconstructed radiographs of the abdomen and pelvis CT images that clinicians may not anticipate; this can assist medical, radiation, and orthopaedic oncologists clinically. To achieve better performance, ensemble-learning models using knowledge of the patients' histories should be developed and validated. The code for our model is publicly available online at https://github.com/taehoonko/CNN_path_fx_prediction . LEVEL OF EVIDENCE: Level III, diagnostic study.
引用
- Joo MW, Ko T, Kim MS, et al. Development and Validation of a Convolutional Neural Network Model to Predict a Pathologic Fracture in the Proximal Femur Using Abdomen and Pelvis CT Images of Patients With Advanced Cancer. Clin Orthop Relat Res. 2023. PMID: 37615504. doi:10.1097/CORR.0000000000002771
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。