广义线性混合效应模型下评分者间一致性指标的基准置信区间
本文在多层设计中推广了经典一致性相关系数(CCC),该设计涉及多名评分者对每名受试者随时间多次评分,且每次测量时每名评分者对每名受试者多次评分。基于模型线性化与基准推断方法构建CCC的区间估计,其置信区间在中等样本量下覆盖概率满意且期望宽度短于Fisher Z变换区间。文中讨论了两个实际应用:膝骨关节炎试验中手动与计算机测量关节间隙宽度的评分者间一致性,以及皮质脊髓束纤维数量测量中技术员与神经放射科医师的一致性。
要点
- 基准推断法构建的CCC置信区间在中等样本量下覆盖概率满意且宽度更短。
- 方法适用于离散或连续评分、多评分者、多时间点、每时间点多次评分的三层设计。
- 相比Fisher Z变换区间,新方法在期望宽度上更具优势。
核心结论
- 基于模型线性化与基准推断的CCC区间估计在中等样本量下表现优于Fisher Z变换区间。
研究设计与样本
- 方法学研究,针对三层设计(受试者、时间点、评分者内重复)推广经典一致性相关系数。
- 通过模型线性化与基准推断方法构建CCC的置信区间。
- 使用两个文献中的实际应用进行展示:膝骨关节炎临床试验与皮质脊髓束纤维数量测量。
主要发现
- 新置信区间在中等样本量下覆盖概率满意且期望宽度短于Fisher Z变换区间。
- 膝骨关节炎应用中,CCC用于评估两名评分者手动测量与计算机生成测量关节间隙宽度的一致性。
- 皮质脊髓束应用中,CCC评估技术员与神经放射科医师测量左右皮质脊髓束纤维数量的一致性。
临床怎么用
- 在多层评分设计(多评分者、多时间点、重复测量)中评估一致性时,可考虑使用基准推断法构建CCC置信区间。
- 该方法适用于离散或连续评分数据,并可在中等样本量下提供较窄的置信区间。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
A generalization of the classical concordance correlation coefficient (CCC) is considered under a three-level design where multiple raters rate every subject over time, and each rater is rating every subject multiple times at each measuring time point. The ratings can be discrete or continuous. A methodology is developed for the interval estimation of the CCC based on a suitable linearization of the model along with an adaptation of the fiducial inference approach. The resulting confidence intervals have satisfactory coverage probabilities and shorter expected widths compared to the interval based on Fisher's Z-transformation, even under moderate sample sizes. Two real applications available in the literature are discussed. The first application is based on a clinical trial to determine if various treatments are more effective than a placebo for treating knee pain associated with osteoarthritis. The CCC was used to assess agreement among the manual measurements of the joint space widths on plain radiographs by two raters, and the computer-generated measurements of digitalized radiographs. The second example is on a corticospinal tractography and the CCC was once again applied in order to evaluate the agreement between a well-trained technologist and a neuroradiologist regarding the measurements of fiber number in both the right and left corticospinal tracts. Other relevant applications of our general approach are highlighted in many areas including artificial intelligence.
引用
- Sahu S, Mathew T, Bhaumik DK, et al. Fiducial Confidence Intervals for Agreement Measures Among Raters Under a Generalized Linear Mixed Effects Model. Stat Med. 2026. PMID: 42068150. doi:10.1002/sim.70578
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。