不完全外层视网膜萎缩(iRORA)判读的评估者间变异性
该横断面评估者间一致性研究使用60张富含iRORA特征的非渗出性AMD眼OCT B扫描,由5名国际视网膜专家按CAM标准独立判读。平均两两Cohen Kappa为0.425(范围0.19-0.73),提示轻度一致;与多数票一致性Kappa为0.48-0.67,敏感度0.59-0.83,特异度0.85-0.96。结论认为尽管有标准化定义,iRORA判读可重复性仍有限。
要点
- 5名专家对60张OCT B扫描判读iRORA,平均两两Kappa仅0.425,一致性轻度。
- 与多数票一致Kappa 0.48-0.67,敏感度0.59-0.83,特异度0.85-0.96。
- 判读决策与多数共识一致时标注时间通常更短。
核心结论
- 尽管采用标准化CAM定义,iRORA检测的评估者间可重复性仍然有限,反映早期萎缩一致识别的挑战。
- 完善判读指南并整合自动检测系统可能提高AMD临床试验和临床实践中的可靠性。
研究设计与样本
- 横断面评估者间一致性研究,使用60张来自非渗出性AMD眼的OCT B扫描,富含iRORA特征。
- 5名国际视网膜专家在标准化在线标注平台上按当前CAM标准独立判读iRORA存在与否。
- 采用Cohen Kappa评估两两一致性,并用留一法计算与多数票的一致性、敏感度和特异度;记录标注提前时间以探索决策速度与判读一致性的关联。
主要发现
- 平均两两Cohen Kappa为0.425(范围0.19-0.73),提示轻度一致。
- 与多数票的一致性Kappa范围为0.48-0.67,分类准确度在0.73至0.83之间。
- 敏感度范围为0.59-0.83,特异度保持较高水平(0.85-0.96)。
- 当判读者决策与多数共识一致时,标注提前时间通常更短。
关键数值与推荐
- iRORA判读依据当前CAM标准定义。
- 平均两两Cohen Kappa为0.425(范围0.19-0.73)。
- 与多数票一致性Kappa为0.48-0.67,分类准确度0.73-0.83。
- 敏感度0.59-0.83,特异度0.85-0.96。
临床怎么用
- 临床与试验中判读iRORA需注意评估者间一致性有限,可能影响早期萎缩终点可靠性。
- 可考虑完善判读指南或引入自动检测系统以提高判读一致性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND/AIMS: To assess the intergrader variability in detecting incomplete outer retinal atrophy (iRORA), an optical coherence tomography (OCT) biomarker for early atrophic changes in age-related macular degeneration (AMD) and a potential clinical trial endpoint. METHODS: We performed a cross-sectional intergrader agreement study using 60 OCT B-scans enriched for iRORA features from non-exudative AMD eyes. Five international retinal experts independently graded images for iRORA presence according to the current Classification of Atrophy Meeting (CAM) criteria, using a standardised online annotation platform. Pairwise agreement was assessed with Cohen's Kappa; agreement with the majority vote, sensitivity and specificity were calculated using a leave-one-out approach. Annotation lead times were recorded to explore links between decision speed and grading consistency. RESULTS: Mean pairwise Cohen's Kappa was 0.425 (range 0.19-0.73), indicating mild agreement. Agreement with the majority vote ranged from κ=0.48 to 0.67, with classification accuracy between 0.73 and 0.83. Sensitivity varied from 0.59 to 0.83, while specificity remained high (0.85-0.96). Annotation lead times were generally shorter when grader decisions aligned with the majority consensus. CONCLUSION: Despite standardised CAM definitions, intergrader reproducibility for iRORA detection remains limited, reflecting challenges in consistent early atrophy identification. Refinement of grading guidelines and integration of automated detection systems could improve reliability for AMD clinical trials and clinical practice.
引用
- Ferro Desideri L, Scandella D, Anguita R, et al. Assessing intergrader variability in incomplete outer retinal atrophy (iRORA) grading. Br J Ophthalmol. 2026. PMID: 42135020. doi:10.1136/bjo-2025-328470
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。