多模态人工智能结合眼底成像与患者问卷诊断视网膜脱离
本研究在津崎医院收集视网膜脱离患者与健康对照的超广角眼底图像和综合患者问卷,基于对比语言-图像预训练框架开发多模态模型分类视网膜脱离,并与仅图像模型和仅问卷模型比较。多模态模型在逐图像和逐受试者分析中均优于单模态模型,整体诊断准确率略低于人类临床医生,但召回率更高。
要点
- 多模态模型逐图像分析准确率0.899±0.054、召回率0.902±0.043、F1分数0.902±0.048。
- 多模态模型逐受试者分析准确率0.893±0.071、召回率0.949±0.044、F1分数0.873±0.074。
- AI模型整体诊断准确率略低于人类临床医生,但召回率更高。
核心结论
- 将眼底成像与患者问卷数据整合可显著改善基于人工智能的视网膜脱离诊断。
- 未来研究需聚焦于扩展数据集并优化问卷设计以进一步提升模型性能。
研究设计与样本
- 在津崎医院收集视网膜脱离患者与健康对照的超广角眼底图像和综合患者问卷。
- 基于对比语言-图像预训练框架开发多模态模型分类视网膜脱离,并建立仅图像模型和仅问卷模型作为对照。
- 进行逐图像和逐受试者分析以评估模型性能。
主要发现
- 多模态模型在逐图像和逐受试者评估中均优于单模态模型。
- 逐图像分析中多模态模型准确率0.899±0.054、召回率0.902±0.043、F1分数0.902±0.048。
- 逐受试者分析中多模态模型准确率0.893±0.071、召回率0.949±0.044、F1分数0.873±0.074。
- AI模型整体诊断准确率略低于人类临床医生,但召回率更高,表明真实视网膜脱离病例的检出改善。
关键数值与推荐
- 多模态模型逐图像分析准确率0.899±0.054、召回率0.902±0.043、F1分数0.902±0.048。
- 多模态模型逐受试者分析准确率0.893±0.071、召回率0.949±0.044、F1分数0.873±0.074。
局限性
- 未来研究需聚焦于扩展数据集并优化问卷设计以进一步提升模型性能。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND/AIMS: This study aimed to develop a multimodal artificial intelligence (AI) system that integrates fundus imaging and patient questionnaire data to achieve clinician-level diagnostic accuracy for diagnosing retinal detachment (RD). METHODS: Ultra-widefield fundus images and comprehensive patient questionnaires were collected from patients with RD and healthy controls at Tsukazaki Hospital. A multimodal model was developed using the Contrastive Language-Image Pretraining framework to classify RD cases, alongside separate image-only and questionnaire-only models for comparison. Per-image and per-subject analyses were conducted to assess model performance. RESULTS: The multimodal model outperformed single-modal models in per-image and per-subject assessments. It achieved accuracy, recall and F1 scores of 0.899±0.054, 0.902±0.043 and 0.902±0.048 in the per-image analysis and 0.893±0.071, 0.949±0.044 and 0.873±0.074 in the per-subject analysis, respectively. The AI model's overall diagnostic accuracy was slightly lower than that of human clinicians; however, it exhibited a higher recall rate, indicating improved detection of true RD cases. CONCLUSION: Integrating fundus imaging with patient questionnaire data significantly improves AI-based RD diagnosis. Future research needs to focus on expanding the dataset and refining the questionnaire design to further improve model performance.
引用
- Yonemaru N, Tabuchi H, Deguchi H, et al. Multimodal artificial intelligence for retinal detachment diagnosis using fundus imaging and patient questionnaires. Br J Ophthalmol. 2026. PMID: 41203264. doi:10.1136/bjo-2025-327506
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。