优化卷积神经网络在腹部平片上检测小肠梗阻的表现
本研究在一家机构既往经三名腹部放射科医师共识分类的2210张腹部平片基础上,用同机构13935张临床图像筛选出的5558张图像扩充训练集至7768张,以提升卷积神经网络检测高级别小肠梗阻的能力;在1453张保留测试集上,仅用图像集1训练的模型ROC AUC为0.803,第二阶段训练后最佳模型ROC AUC达0.971,测试集敏感度91.4%、特异度91.9%。
要点
- 第二阶段训练后最佳模型在测试集检测高级别小肠梗阻的敏感度91.4%、特异度91.9%。
- ROC AUC由仅用图像集1训练模型的0.803提升至第二阶段最佳模型的0.971。
- 分类性能随训练集规模增加而提升,阳性训练样本超过200例后达到平台期。
核心结论
- 卷积神经网络检测腹部平片上高级别小肠梗阻的准确率随阳性训练平片数量增加而显著提升。
研究设计与样本
- 研究论文;图像集1为同一机构2210张腹部平片,经三名腹部放射科医师共识分类为梗阻与非梗阻;另从同机构13935张临床图像中主要保留初始分类器判为肠梗阻阳性的图像,缩减为5558张(图像集2),由一名腹部放射科医师分类;合计7768张用于第二阶段训练;测试集为图像集1中留出的1453张腹部平片。
诊断标准与关键数值
- 仅用图像集1训练的神经网络ROC AUC为0.803;第二阶段训练后最佳模型ROC AUC为0.971;以验证集约登J指数最大化为操作点,第二阶段训练模型测试集敏感度91.4%、特异度91.9%。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVE: The purpose of this study was to evaluate improvement of convolutional neural network detection of high-grade small-bowel obstruction on conventional radiographs with increased training set size.
MATERIALS AND METHODS: A set of 2210 abdominal radiographs from one institution (image set 1) had been previously classified into obstructive and nonobstructive categories by consensus judgments of three abdominal radiologists. The images were used to fine-tune an initial convolutional neural network classifier (stage 1). An additional set of 13,935 clinical images from the same institution was reduced to 5558 radiographs (image set 2) primarily by retaining only images classified positive for bowel obstruction by the initial classifier. These images were classified into obstructive and nonobstructive categories by an abdominal radiologist. The combined 7768 radiographs were used to train additional classifiers (stage 2 training). The best classifiers from stage 1 and stage 2 training were evaluated on a held-out test set of 1453 abdominal radiographs from image set 1.
RESULTS: The ROC AUC for the neural network trained on image set 1 was 0.803; after stage 2, the ROC AUC of the best model was 0.971. By use of an operating point based on maximizing the validation set Youden J index, the stage 2-trained model had a test set sensitivity of 91.4% and specificity of 91.9%. Classification performance increased with training set size, reaching a plateau with over 200 positive training examples.
CONCLUSION: Accuracy of detection of high-grade small-bowel obstruction with a convolutional neural network improves significantly with the number of positive training radiographs.
引用
- Cheng PM, Tran KN, Whang G, et al. Refining Convolutional Neural Network Detection of Small-Bowel Obstruction in Conventional Radiography. AJR Am J Roentgenol. 2018. PMID: 30476452. doi:10.2214/AJR.18.20362
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。