数字射线:利用风格迁移生成对抗网络增强白内障眼底图像以改善视网膜病变检测
本研究基于白内障患者术前与术后图像对,采用风格迁移生成对抗网络(CycleGAN及改良C2ycleGAN)开发数字射线以增强白内障眼底图像。共纳入959对彩色眼底照片(CFP)和1009对超广角(UWF)图像用于模型开发,结果显示生成图像质量改善,视网膜病变检测准确率CFP从78%升至91%,UWF从91%升至93%。
要点
- 数字射线可生成逼真的术后CFP和UWF图像,仅24.8%的生成CFP和13.8%的生成UWF被识别为合成。
- CFP中质量不足图像比例从32%降至18.8%,UWF从18.7%降至14.7%。
- 视网膜病变检测准确率CFP从78%升至91%,UWF从91%升至93%,CFP改善更明显。
核心结论
- 数字射线可生成逼真的术后CFP和UWF图像,提高图像质量及视网膜病变整体检测和亚型诊断的准确率,对CFP尤其明显。
研究设计与样本
- 基于术前和术后图像对,采用原始CycleGAN和改良C2ycleGAN框架进行图像生成,并使用FID和KID定量比较。
- 模型开发纳入959对CFP和1009对UWF图像,另用另一白内障队列的CFP和UWF图像测试模型性能。
- 由不同眼科医生小组评估生成图像的质量、真实性和诊断效能。
- 研究注册于ClinicalTrials.gov(NCT05491798)。
主要发现
- FID和KID表明C2ycleGAN生成的图像质量显著改善。
- 基于眼科医生平均评分,质量不足图像比例CFP从32%降至18.8%,UWF从18.7%降至14.7%。
- 仅24.8%的生成CFP和13.8%的生成UWF图像可被识别为合成。
- 视网膜病变检测准确率CFP从78%升至91%,UWF从91%升至93%。
- 视网膜病变亚型诊断准确率CFP从87%-94%升至91%-100%,UWF从87%-95%升至93%-97%。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND/AIMS: The aim of this study was to develop and evaluate digital ray, based on preoperative and postoperative image pairs using style transfer generative adversarial networks (GANs), to enhance cataractous fundus images for improved retinopathy detection. METHODS: For eligible cataract patients, preoperative and postoperative colour fundus photographs (CFP) and ultra-wide field (UWF) images were captured. Then, both the original CycleGAN and a modified CycleGAN (C2ycleGAN) framework were adopted for image generation and quantitatively compared using Frechet Inception Distance (FID) and Kernel Inception Distance (KID). Additionally, CFP and UWF images from another cataract cohort were used to test model performances. Different panels of ophthalmologists evaluated the quality, authenticity and diagnostic efficacy of the generated images. RESULTS: A total of 959 CFP and 1009 UWF image pairs were included in model development. FID and KID indicated that images generated by C2ycleGAN presented significantly improved quality. Based on ophthalmologists' average ratings, the percentages of inadequate-quality images decreased from 32% to 18.8% for CFP, and from 18.7% to 14.7% for UWF. Only 24.8% and 13.8% of generated CFP and UWF images could be recognised as synthetic. The accuracy of retinopathy detection significantly increased from 78% to 91% for CFP and from 91% to 93% for UWF. For retinopathy subtype diagnosis, the accuracies also increased from 87%-94% to 91%-100% for CFP and from 87%-95% to 93%-97% for UWF. CONCLUSION: Digital ray could generate realistic postoperative CFP and UWF images with enhanced quality and accuracy for overall detection and subtype diagnosis of retinopathies, especially for CFP.\ TRIAL REGISTRATION NUMBER: This study was registered with ClinicalTrials.gov (NCT05491798).
引用
- Liu L, Hong J, Wu Y, et al. Digital ray: enhancing cataractous fundus images using style transfer generative adversarial networks to improve retinopathy detection. Br J Ophthalmol. 2024. PMID: 38839251. doi:10.1136/bjo-2024-325403
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。