文献速递神经肿瘤小儿神经外科与脑积水

胶样囊肿风险评分的评分者间与评分者内信度研究

Interrater and Intrarater Reliability of the Colloid Cyst Risk Score.
PubMed 文献 · Neurosurgery · 2020-01-01

本研究独立评估胶样囊肿风险评分(CCRS)的评分者间与评分者内信度。三名评分者回顾病历与影像,对53例观察(含5例重复)评定年龄、头痛、囊肿直径、FLAIR高信号及位置。总分信度极强(W=0.83)且良好(ICC=0.74,P<.001),但各条目信度不一,头痛仅为一般一致。

要点

  • CCRS总分评分者间信度极强(W=0.83)且良好(ICC=0.74,P<.001)。
  • 年龄与FLAIR高信号信度近乎完美,头痛条目信度仅为一般(κ=0.26)。
  • CCRS效度仍需独立评估。

核心结论

  • CCRS在独立样本中具有良好评分者间与评分者内信度,但各条目一致强度不一。
  • CCRS的效度仍需独立评估。

研究设计与样本

  • 从账单记录与影像档案中识别胶样囊肿患者,三名独立评分者回顾电子病历进行评定。
  • 共53次观察,含5次重复观察;名义变量用Fleiss广义κ,总分用Kendall协调系数W与组内相关系数ICC。

主要发现

  • 总分评分者间信度:Kendall W=0.83,ICC=0.74(P<.001)。
  • 各条目评分者间信度:年龄κ=1.00,FLAIR高信号κ=0.89,轴位直径κ=0.63,风险区κ=0.51,头痛κ=0.26。
  • 总分评分者内信度:Kendall W极强,ICC良好至优秀,加权κ一般至中等。

临床怎么用

  • CCRS总分信度良好,可用于胶样囊肿患者风险分层,但头痛条目信度较低需谨慎解读。

局限性

  • CCRS的效度尚未在本研究中独立评估。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: The Colloid Cyst Risk Score (CCRS) was developed to identify symptomatic patients and stratify risk of hydrocephalus among patients with colloid cysts. Its components consider patient age, cyst diameter, presence/absence of headache, fluid-attenuated inversion recovery (FLAIR) hyperintensity, and location within the third ventricle. OBJECTIVE: To independently evaluate the inter- and intrarater reliability of the CCRS. METHODS: Patients with a colloid cyst were identified from billing records and radiology archives. Three independent raters reviewed electronic medical records to determine age, presence/absence of headache, cyst diameter (mm), FLAIR hyperintensity, and risk zone location. Raters made 53 observations, including 5 repeat observations.Fleiss' generalized kappa (κ) was calculated for all of the nominal criteria, whereas Kendall's coefficient of concordance (W) and the intraclass correlation coefficient (ICC) were calculated for the overall score. RESULTS: Total CCRS score demonstrated extremely strong agreement (W = 0.83) using Kendall's W coefficient and good agreement (ICC = 0.74) using the ICC (P < .001). For interrater reliability of individual criteria, age (κ = 1.00) and FLAIR hyperintensity (κ = 0.89) demonstrated near perfect agreement. Axial diameter (κ = 0.63) demonstrated substantial agreement, whereas agreement was moderate for risk zone (κ = 0.51) and fair for headache (κ = 0.26). Intrarater reliability for total CCRS score was extremely strong using Kendall's W, good to excellent using ICC, and fair to substantial using weighted kappa. CONCLUSION: The CCRS has good inter- and intrarater reliability when tested in an independent sample of patients, though strength of agreement varies among individual criteria. The validity of the CCRS requires independent evaluation.

来源:Neurosurgery,查看原文。版权归原作者所有。

引用

  1. Alford EN, Rotman LE, Lepard JR, et al. Interrater and Intrarater Reliability of the Colloid Cyst Risk Score. Neurosurgery. 2020. PMID: 31552408. doi:10.1093/neuros/nyz399

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。