COSMOS:新型轻型卒中结局量表的评定者间与评定者内信度研究
结果显示评定者间信度(加权κ 0.88)和评定者内信度(加权κ 0.92)均近乎完美,组内相关系数为0.95,提示该量表信度良好,值得在轻型卒中队列和临床试验中进一步研究。
要点
- COSMOS为7点评分(0无症至6日常活动丧失独立),涵盖爱好、就业等表现受限。
- 评定者间一致性80.5%,Cohen κ 0.77,加权κ 0.88,信度较高。
- 评定者内一致性87.1%,Cohen κ 0.85,加权κ 0.92,信度近乎完美。
核心结论
- COSMOS量表在评定者间和评定者内均表现出高度信度,值得在轻型卒中的队列研究和临床试验中进一步验证。
研究设计与样本
- 开发加拿大轻型卒中结局量表(COSMOS),并开展评定者间与评定者内信度研究。
- 共33名参与者(18名主治医师、9名卒中研究员、6名研究 staff/护士),中位经验12.5年。
主要发现
- 评定者间一致性80.5%(95%CI 75.7%-85.3%),Cohen κ 0.77(95%CI 0.72-0.84)。
- 评定者内一致性87.1%(95%CI 84.4%-89.7%),Cohen κ 0.85(95%CI 0.82-0.88)。
- 加权κ:评定者间0.88(95%CI 0.85-0.92),评定者内0.92(95%CI 0.90-0.94)。
- 组内相关系数(同时评估评定者内/间机会校正一致性)为0.95(95%CI 0.94-0.97)。
- 基于职位(主治、研究员、研究护士/staff)和经验的亚组分析结果相似,一致性为中等至近乎完美。
关键数值与推荐
- COSMOS为7点评分,范围0(无症状)至6(工具性或基本日常生活活动丧失独立性或更差)。
- 量表除日常生活活动外,还涵盖表现限制以及爱好/热情、就业、教育、服务或照护追求的丧失。
临床怎么用
- COSMOS可用于评估轻型卒中患者的功能结局,弥补改良Rankin量表(0-1/0-2)虽判为良好但患者仍不满意的不足。
- 评定者间和评定者内信度均较高,不同职位和经验水平的评定者均可使用。
局限性
- 研究使用病例场景而非真实患者,可能无法完全反映临床实际情况。
- 研究未报告量表的效度、 responsiveness 等其他心理测量学特性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
The vast majority of patients with minor stroke achieve what are considered good or excellent outcomes on the modified Rankin Scale (0-1/0-2), yet many are dissatisfied with their outcomes. There is a need for a functional outcome measure tailored for minor stroke that better reflects the spectrum of clinical outcomes within this population. We developed the Canadian Outcome Scale for Minor Stroke (COSMOS) and performed an interrater and intrarater reliability study. COSMOS is a 7-point scale ranging from 0 (no symptoms) to 6 (loss of independence for an instrumental or basic activity of daily living or worse), which accounts for performance limitations and losses of a person's hobbies or passions and of their employment, educational, service, or caregiving pursuits, besides just activities of daily living. One hundred test case vignettes were developed. Stroke physicians, fellows, and research nurses/staff were invited to review training materials and provide the COSMOS grade for 20 cases representing all COSMOS grades (0-6). After a minimum 2 weeks' wash-out period, participants were asked to grade the same 20 cases again. Interrater and intrarater agreement were assessed using Cohen κ, weighted κ, percentage agreement, and intraclass correlation coefficient. Among 33 participants (18 attending physicians, 9 stroke fellows, and 6 research staff/nurses; median 12.5 years of experience), COSMOS had substantial interrater reliability (80.5% agreement [95% CI, 75.7%-85.3%]; Cohen κ, 0.77 [95% CI, 0.72-0.84]) and almost-perfect intrarater reliability overall (87.1% agreement [95% CI, 84.4%-89.7%]; Cohen κ, 0.85 [95% CI, 0.82-0.88]); weighted κ showed almost perfect agreement for both interrater (0.88 [95% CI, 0.85-0.92]) and intrarater reliability (0.92 [95% CI, 0.90-0.94]). The overall chance-adjusted simultaneous intrarater/interrater agreement using intraclass correlation coefficient was 0.95 (95% CI, 0.94-0.97). Results were similar with substantial to almost-perfect agreement when considering key subgroups based on position (attendings, fellows, research nurses/staff) and years of experience. In conclusion, the newly proposed COSMOS scale demonstrated substantial interrater and intrarater reliability. The scale merits further study in cohort studies and clinical trials of minor stroke.
引用
- Goyal M, Ganesh A, Bosshart SL, et al. COSMOS: Interrater and Intrarater Reliability Study of a Novel Outcome Measure. Stroke. 2025. PMID: 40549842. doi:10.1161/STROKEAHA.125.049454
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。