视网膜专科医生与人工智能检测OCT视网膜积液的头对头比较:AREDS2十年随访研究
该研究基于AREDS2十年随访中651例受试者1127只眼的SD-OCT扫描,以阅片中心分级为金标准,比较视网膜专科医生与Notal OCT Analyzer(NOA)算法检测视网膜积液的表现。结果显示医生检测积液的准确率为0.805、敏感度仅0.468,NOA准确率0.851、敏感度0.822;医生对层间积液敏感度低至0.403,NOA对网膜下积液特异度低于医生。人工智能检测整体准确率更高,可辅助医生识别积液。
要点
- 医生检测任何视网膜积液的敏感度仅0.468,NOA为0.822,AI漏诊更少。
- 医生对层间积液敏感度仅0.403,对网膜下积液敏感度0.583,均低于NOA。
- NOA对网膜下积液特异度0.857,低于医生的0.973,需注意假阳性。
核心结论
- 在此大型且具有挑战性的SD-OCT样本中,视网膜专科医生检测视网膜积液的准确率不完美且敏感度低,层间积液和困难病例尤为明显。
- 基于人工智能的检测达到了更高水平的准确率,该软件工具可辅助医生检测视网膜积液。
研究设计与样本
- 研究为前瞻性比较,比较人类视网膜专科医生与Notal OCT Analyzer(NOA)对2种常见设备SD-OCT扫描的视网膜积液分级。
- 样本为AREDS2十年随访研究的651例受试者共1127只眼,以阅片中心分级者判读结果作为金标准。
主要发现
- 1127只眼中32.8%存在视网膜积液。
- 检测任何视网膜积液:医生准确率0.805(95%CI 0.780-0.828)、敏感度0.468(95%CI 0.416-0.520)、特异度0.970(95%CI 0.955-0.981)。
- 检测任何视网膜积液:NOA准确率0.851(95%CI 0.829-0.871)、敏感度0.822(95%CI 0.779-0.859)、特异度0.865(95%CI 0.839-0.889)。
- 检测层间积液:医生准确率0.815(95%CI 0.792-0.837)、敏感度0.403(95%CI 0.349-0.459)、特异度0.978(95%CI 0.966-0.987);NOA分别为0.877(95%CI 0.857-0.896)、0.763(95%CI 0.713-0.808)、0.922(95%CI 0.902-0.940)。
- 检测网膜下积液:医生准确率0.946(95%CI 0.931-0.958)、敏感度0.583(95%CI 0.471-0.690)、特异度0.973(95%CI 0.962-0.982);NOA分别为0.863(95%CI 0.842-0.882)、0.940(95%CI 0.867-0.980)、0.857(95%CI 0.835-0.877)。
关键数值与推荐
- 以阅片中心分级者判读的SD-OCT积液存在与否作为金标准。
- 主要结局指标为准确率,次要指标包括敏感度、特异度、精确率和F1分数。
- 积液检测按任何积液、层间积液、网膜下积液分别评估。
临床怎么用
- AI软件可作为辅助工具帮助医生检测视网膜积液,尤其层间积液和低积液量的困难病例。
- 医生对层间积液敏感度低,阅片时需警惕漏诊,可结合AI提示复核。
- NOA对网膜下积液特异度低于医生,对AI阳性结果仍需医生确认以减少假阳性。
局限性
- 原文未报告研究局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
PURPOSE: To evaluate the performance of retinal specialists in detecting retinal fluid presence in spectral domain OCT (SD-OCT) scans from eyes with age-related macular degeneration (AMD) and compare performance with an artificial intelligence algorithm. DESIGN: Prospective comparison of retinal fluid grades from human retinal specialists and the Notal OCT Analyzer (NOA) on SD-OCT scans from 2 common devices. PARTICIPANTS: A total of 1127 eyes of 651 Age-Related Eye Disease Study 2 10-year Follow-On Study (AREDS2-10Y) participants with SD-OCT scans graded by reading center graders (as the ground truth). METHODS: The AREDS2-10Y investigators graded each SD-OCT scan for the presence/absence of intraretinal and subretinal fluid. Separately, the same scans were graded by the NOA. MAIN OUTCOME MEASURES: Accuracy (primary), sensitivity, specificity, precision, and F1-score. RESULTS: Of the 1127 eyes, retinal fluid was present in 32.8%. For detecting retinal fluid, the investigators had an accuracy of 0.805 (95% confidence interval [CI], 0.780-0.828), a sensitivity of 0.468 (95% CI, 0.416-0.520), a specificity of 0.970 (95% CI, 0.955-0.981). The NOA metrics were 0.851 (95% CI, 0.829-0.871), 0.822 (95% CI, 0.779-0.859), 0.865 (95% CI, 0.839-0.889), respectively. For detecting intraretinal fluid, the investigator metrics were 0.815 (95% CI, 0.792-0.837), 0.403 (95% CI, 0.349-0.459), and 0.978 (95% CI, 0.966-0.987); the NOA metrics were 0.877 (95% CI, 0.857-0.896), 0.763 (95% CI, 0.713-0.808), and 0.922 (95% CI, 0.902-0.940), respectively. For detecting subretinal fluid, the investigator metrics were 0.946 (95% CI, 0.931-0.958), 0.583 (95% CI, 0.471-0.690), and 0.973 (95% CI, 0.962-0.982); the NOA metrics were 0.863 (95% CI, 0.842-0.882), 0.940 (95% CI, 0.867-0.980), and 0.857 (95% CI, 0.835-0.877), respectively. CONCLUSIONS: In this large and challenging sample of SD-OCT scans obtained with 2 common devices, retinal specialists had imperfect accuracy and low sensitivity in detecting retinal fluid. This was particularly true for intraretinal fluid and difficult cases (with lower fluid volumes appearing on fewer B-scans). Artificial intelligence-based detection achieved a higher level of accuracy. This software tool could assist physicians in detecting retinal fluid, which is important for diagnostic, re-treatment, and prognostic tasks.
引用
- Keenan TDL, Clemons TE, Domalpally A, et al. Retinal Specialist versus Artificial Intelligence Detection of Retinal Fluid from OCT: Age-Related Eye Disease Study 2: 10-Year Follow-On Study. Ophthalmology. 2020. PMID: 32598950. doi:10.1016/j.ophtha.2020.06.038
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。