北美学术临床环境中在职放射科医师对O-RADS评分系统的诊断准确性与观察者间信度
研究评估3名无O-RADS经验的在职放射科医师在自学指南和30例培训后,对50例盆腔超声按O-RADS评分。特异度92%–100%、NPV 92%–100%,敏感度72%–100%、PPV 66%–100%;以O-RADS 4和5预测恶性,AUC 0.94–0.98(p<0.001),总体观察者间一致性k=0.82(95%CI 0.73–0.90,p<0.001)。150个病灶中14个误分类,最常见为实性不规则外轮廓病灶被低估。
要点
- 以O-RADS 4和5预测恶性,各读片者AUC为0.94–0.98(p<0.001)。
- 总体观察者间一致性k=0.82(95%CI 0.73–0.90),两两一致性k=0.86–0.92。
- 最常见误分类为实性、外轮廓不规则的病灶被低估评分。
核心结论
- 即使未经专门培训,有经验的超声读片者通过自学指南和病例可达到优秀诊断性能和高观察者间信度;研究支持ACR O-RADS作为放射科医师分层工具的效用并支持其继续在实践使用。
研究设计与样本
- 由3名完成专科培训、 board-certified 的在职放射科医师在独立复习ACR O-RADS出版物和30例培训病例后,对50例盆腔超声检查按O-RADS评分;分析每位读片者的诊断准确性和ROC曲线下面积,以及总体和两两读片者间一致性。
诊断标准与关键数值
- 特异度92%–100%,NPV 92%–100%,敏感度72%–100%,PPV 66%–100%。
- 以O-RADS 4和O-RADS 5作为恶性预测指标,各读片者AUC为0.94–0.98(p<0.001)。
- 3名读片者总体观察者间一致性为「很好」,k=0.82(95%CI 0.73–0.90,p<0.001)。
- 读片者两两一致性也为「很好」,k=0.86–0.92。
- 150个病灶中14个被误分类,最常见错误为实性、外轮廓不规则的病灶被低估评分。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
PURPOSE: The objective of this study is to evaluate the diagnostic accuracy, interobserver variability, and common lexicon pitfalls of the ACR O-RADS scoring system among staff radiologists without prior experience to O-RADS.
MATERIALS AND METHODS: After independent review of the ACR O-RADS publications and 30 training cases, three fellowship-trained, board-certified staff radiologists scored 50 pelvic ultrasound exams using the O-RADS system. The diagnostic accuracy and area under receiver operating characteristic were analyzed for each reader. Overall agreement and pair-wise agreement between readers were also analyzed.
RESULTS: Excellent specificities (92 to 100%), NPVs (92 to 100%), and variable sensitivities (72 to 100%), PPVs (66 to 100%) were observed. Considering O-RADS 4 and O-RADS 5 as predictors of malignancy, individual reader AUC values range from 0.94 to 0.98 (p < 0.001). Overall inter-reader agreement for all 3 readers was "very good," k = 0.82 (0.73 to 0.90, 95% CI, p < 0.001). Pair-wise agreement between readers were also "very good," k = 0.86-0.92. 14 out of 150 lesions were misclassified, with the most common error being down-scoring of a solid lesion with irregular outer contours.
CONCLUSION: Even without specific training, experienced ultrasound readers can achieve excellent diagnostic performance and high inter-reader reliability with self-directed review of guidelines and cases. The study highlights the effectiveness of ACR O-RADS as a stratification tool for radiologists and supports its continued use in practice.
引用
- Pi Y, Wilson MP, Katlariwala P, et al. Diagnostic accuracy and inter-observer reliability of the O-RADS scoring system among staff radiologists in a North American academic clinical setting. Abdom Radiol (NY). 2021. PMID: 34185128. doi:10.1007/s00261-021-03193-7
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。