PRECIS-2工具具有良好评分者间信度和适度区分效度
研究旨在验证PRECIS-2工具,检验其区分效度和评分者间信度。超过80名国际试验人员、方法学家、临床医生和政策制定者共同创建PRECIS-2以确保表面效度和内容效度。19名经验丰富的试验人员使用PRECIS-2对15项随机对照试验方案进行评分,评分者间信度总体良好,九个领域中七个的组内相关系数超过0.65。
要点
- 19名评分者对15项随机对照试验方案使用PRECIS-2评分,九个领域中七个的组内相关系数超过0.65。
- 灵活性和招募领域的置信区间较宽,评分者认为这些领域难以评分并希望获得更多信息。
- 九个PRECIS-2领域均能以优于随机的区分能力区分更实用性或更解释性的试验。
核心结论
- 已评估PRECIS-2的效度和信度,一项详细阐述研究和网站为未来使用者提供指导,该工具正持续被试验团队、系统评价者和资助者测试。
研究设计与样本
- 超过80名国际试验人员、方法学家、临床医生和政策制定者创建PRECIS-2以确保表面效度和内容效度。
- 19名经验丰富的试验人员使用PRECIS-2对15项随机对照试验方案进行评分以测量评分者间信度。
- 由两名评分者独立判断试验方案更实用还是更解释,以19名评分者对15项试验的评分作为实用性的预测因子来检验区分效度。
主要发现
- 评分者间信度总体良好,九个领域中有七个的组内相关系数超过0.65。
- 灵活性和招募领域的置信区间较宽,评分者认为这些领域难以评分并希望获得更多信息。
- 九个PRECIS-2领域均能以优于随机的区分能力区分更实用性或更解释性的试验。
关键数值与推荐
- 九个领域中有七个的组内相关系数超过0.65。
- 九个PRECIS-2领域均能以优于随机的区分能力区分试验的实用性或解释性。
临床怎么用
- 原文未据此给出推荐。
局限性
- 灵活性和招募领域的置信区间较宽,评分者认为这些领域难以评分并希望获得更多信息。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: PRagmatic Explanatory Continuum Indicator Summary (PRECIS)-2 is a tool that could improve design insight for trialists. Our aim was to validate the PRECIS-2 tool, unlike its predecessor, testing the discriminant validity and interrater reliability. STUDY DESIGN AND SETTING: Over 80 international trialists, methodologists, clinicians, and policymakers created PRECIS-2 helping to ensure face validity and content validity. The interrater reliability of PRECIS-2 was measured using 19 experienced trialists who used PRECIS-2 to score a diverse sample of 15 randomized controlled trial protocols. Discriminant validity was tested with two raters to independently determine if the trial protocols were more pragmatic or more explanatory, with scores from the 19 raters for the 15 trials as predictors of pragmatism. RESULTS: Interrater reliability was generally good, with seven of nine domains having an intraclass correlation coefficient over 0.65. Flexibility (adherence) and recruitment had wide confidence intervals, but raters found these difficult to rate and wanted more information. Each of the nine PRECIS-2 domains could be used to differentiate between trials taking more pragmatic or more explanatory approaches with better than chance discrimination for all domains. CONCLUSION: We have assessed the validity and reliability of PRECIS-2. An elaboration study and web site provide guidance to help future users of the tool which is continuing to be tested by trial teams, systematic reviewers, and funders.
引用
- Loudon K, Zwarenstein M, Sullivan FM, et al. The PRECIS-2 tool has good interrater reliability and modest discriminant validity. J Clin Epidemiol. 2017. PMID: 28603007. doi:10.1016/j.jclinepi.2017.06.001
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。