脊髓损伤运动指数保真度评估的初步研制与检验
本研究基于干预保真度评估框架,通过4轮改良德尔菲调查(3名专家)研制脊髓损伤运动指数(SCI-MovIn)的保真度评估清单,并由3名评分者对21个测试会话(394个条目)进行评分者间一致性测试。结果显示,总体绝对精确一致率为79.33%,13项标准中9项一致率超过75%。
要点
- 基于干预保真度框架研制SCI-MovIn保真度评估清单。
- 经4轮改良德尔菲调查达到100%专家一致性。
- 3名评分者间总体绝对精确一致率为79.33%。
核心结论
- SCI-MovIn保真度评估基于改编的干预保真度框架开发,经4轮改良德尔菲过程完善后进行了评分者间一致性现场测试,总体绝对精确一致率为79.33%。
研究设计与样本
- 研究采用改编自干预保真度评估指南的框架开发保真度清单,通过迭代改良德尔菲调查(3名熟悉SCI-MovIn的人员参与)完善标准,再由3名保真度评分者观看相同的视频记录测试会话进行评分者间一致性测试。
主要发现
- 经4轮调查后,受访者对所有保真度标准在相关性、清晰性、具体性和与反应量表一致性方面达到100%同意。
- 3名评分者对21个会话(394个条目)的保真度评分总体绝对精确一致率为79.33%。
- 13项标准中有9项的一致率超过75%。
关键数值与推荐
- 改良德尔菲调查共进行4轮,直至100%同意所有标准相关、清晰、具体且与反应量表一致。
- 评分者间总体绝对精确一致率为79.33%(21个会话,394个条目,3名评分者)。
- 13项保真度标准中9项的一致率>75%。
临床怎么用
- 该保真度评估可用于检查SCI-MovIn测试实施是否符合标准,但评分者间一致性尚需进一步验证。
局限性
- 德尔菲调查仅纳入3名专家,评分者间一致性测试仅由3名评分者完成,样本量小。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: The study aimed to describe the development and refinement of a fidelity assessment for a novel performance-based item pool, the Spinal Cord Injury Movement Index (SCI-MovIn), and report on its interrater agreement. DESIGN: Guidance for the development of intervention fidelity assessments was adapted to create a framework for the development of an assessment fidelity checklist. An initial draft of the SCI-MovIn fidelity checklist was drafted. The set-up and administration fidelity criteria were exposed to iterative modified Delphi surveys with individuals knowledgeable about the SCI-MovIn. Interrater agreement was then assessed through field-testing of the fidelity assessment by fidelity raters who viewed the same video-recorded SCI-MovIn testing sessions. SETTING: Academic institution in an urban area. PARTICIPANTS: Three individuals participated in the modified Delphi survey (purposeful sample). Three individuals served as fidelity raters for interrater agreement testing. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: The modified Delphi technique was completed iteratively until 100% agreement among respondents was reached that every criterion on the fidelity assessment was relevant, clear, specific, and in alignment with the response scale. Descriptive statistics were used to examine exact percent interrater agreement for the ratings on the SCI-MovIn fidelity assessment across 3 raters. RESULTS: Four survey rounds were iteratively completed until 100% agreement among respondents was reached that fidelity criteria were relevant, clear, specific, and aligned with the fidelity response scale. Across 21 sessions (394 items), raters' total absolute exact percent agreement on scores of fidelity was 79.33%. Nine of 13 criteria had >75% agreement. CONCLUSIONS: The SCI-MovIn fidelity assessment was developed using a framework modified from guidance for intervention fidelity assessments. It was refined over 4 rounds of a modified Delphi process and then exposed to field-testing for rater agreement.
引用
- Gerhardt NM, Kim RY, Capron M, et al. Development and Preliminary Examination of a Fidelity Assessment for the Spinal Cord Injury Movement Index. Arch Phys Med Rehabil. 2025. PMID: 40653185. doi:10.1016/j.apmr.2025.06.010
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。