深度学习自动诊断早产儿视网膜病变附加病变
研究训练深度卷积神经网络,基于5511张视网膜照片自动诊断早产儿视网膜病变附加病变,用5折交叉验证和100张独立测试集评估。算法诊断附加病变的敏感度93%、特异度94%,二次加权κ系数0.92,优于8名专家中的6名。
要点
- 算法诊断附加病变的敏感度93%、特异度94%。
- 算法与参考标准诊断的二次加权κ系数为0.92。
- 算法性能优于8名ROP专家中的6名。
核心结论
- 该全自动算法诊断ROP附加病变的准确性与人类专家相当或更优,可能在有ROP风险的婴儿中用于疾病检测、监测和预后。
研究设计与样本
- 研究为深度学习算法开发与验证研究,使用5511张视网膜照片训练深度卷积神经网络。
- 每张图像由3名专家图像分级共识和1名专家临床诊断确定参考标准诊断(正常、附加病变前期或附加病变)。
- 算法通过5折交叉验证评估,并在100张图像的独立测试集上测试。
- 图像来自参与ROP成像与信息学(i-ROP)队列研究的8家学术机构。
- 算法与8名ROP专家(每人均有超过10年临床经验、超过5篇ROP同行评议论文)对比测试。
主要发现
- 5511张照片中,根据参考标准诊断,4535张(82.3%)为正常,805张(14.6%)为附加病变前期,172张(3.1%)为附加病变。
- 诊断正常(对比附加病变前期或附加病变)的平均(标准差)受试者工作特征曲线下面积统计量为0.94(0.01)。
- 诊断附加病变(对比正常或附加病变前期)的平均(标准差)受试者工作特征曲线下面积统计量为0.98(0.01)。
- 在100张视网膜图像的独立测试集中诊断附加病变,算法敏感度为93%、特异度为94%。
- 检测附加病变前期或更严重病变,敏感度和特异度分别为100%和94%。
关键数值与推荐
- 诊断附加病变的敏感度93%、特异度94%(独立测试集100张图像)。
- 检测附加病变前期或更严重病变的敏感度100%、特异度94%。
- 与参考标准诊断的二次加权κ系数0.92(独立测试集100张图像)。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
IMPORTANCE: Retinopathy of prematurity (ROP) is a leading cause of childhood blindness worldwide. The decision to treat is primarily based on the presence of plus disease, defined as dilation and tortuosity of retinal vessels. However, clinical diagnosis of plus disease is highly subjective and variable. OBJECTIVE: To implement and validate an algorithm based on deep learning to automatically diagnose plus disease from retinal photographs. DESIGN, SETTING, AND PARTICIPANTS: A deep convolutional neural network was trained using a data set of 5511 retinal photographs. Each image was previously assigned a reference standard diagnosis (RSD) based on consensus of image grading by 3 experts and clinical diagnosis by 1 expert (ie, normal, pre-plus disease, or plus disease). The algorithm was evaluated by 5-fold cross-validation and tested on an independent set of 100 images. Images were collected from 8 academic institutions participating in the Imaging and Informatics in ROP (i-ROP) cohort study. The deep learning algorithm was tested against 8 ROP experts, each of whom had more than 10 years of clinical experience and more than 5 peer-reviewed publications about ROP. Data were collected from July 2011 to December 2016. Data were analyzed from December 2016 to September 2017. EXPOSURES: A deep learning algorithm trained on retinal photographs. MAIN OUTCOMES AND MEASURES: Receiver operating characteristic analysis was performed to evaluate performance of the algorithm against the RSD. Quadratic-weighted κ coefficients were calculated for ternary classification (ie, normal, pre-plus disease, and plus disease) to measure agreement with the RSD and 8 independent experts. RESULTS: Of the 5511 included retinal photographs, 4535 (82.3%) were graded as normal, 805 (14.6%) as pre-plus disease, and 172 (3.1%) as plus disease, based on the RSD. Mean (SD) area under the receiver operating characteristic curve statistics were 0.94 (0.01) for the diagnosis of normal (vs pre-plus disease or plus disease) and 0.98 (0.01) for the diagnosis of plus disease (vs normal or pre-plus disease). For diagnosis of plus disease in an independent test set of 100 retinal images, the algorithm achieved a sensitivity of 93% with 94% specificity. For detection of pre-plus disease or worse, the sensitivity and specificity were 100% and 94%, respectively. On the same test set, the algorithm achieved a quadratic-weighted κ coefficient of 0.92 compared with the RSD, outperforming 6 of 8 ROP experts. CONCLUSIONS AND RELEVANCE: This fully automated algorithm diagnosed plus disease in ROP with comparable or better accuracy than human experts. This has potential applications in disease detection, monitoring, and prognosis in infants at risk of ROP.
引用
- Brown JM, Campbell JP, Beers A, et al. Automated Diagnosis of Plus Disease in Retinopathy of Prematurity Using Deep Convolutional Neural Networks. JAMA Ophthalmol. 2018. PMID: 29801159. doi:10.1001/jamaophthalmol.2018.1934
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。