非随机干预研究偏倚风险评估工具的心理测量学特性:COSMIN系统综述与Meta分析
该系统综述依据COSMIN框架,系统评价用于评估非随机干预研究(NRSI)方法学质量(MQ)和偏倚风险(RoB)工具的心理测量学特性。
要点
- MINORS是评估NRSI方法学质量最稳健的工具。
- ROBINS-I在评估NRSI偏倚风险方面证据最强。
- 现有NRSI评估工具均未全面验证所有COSMIN测量属性。
核心结论
- MINORS是评估NRSI方法学质量最稳健的工具,ROBINS-I在偏倚风险评估中表现突出。
- ASSESS和MMERSQI提供了充分的内容效度证据。
- 仅小部分NRSI评估工具经过正式心理测量学验证,需进一步研究。
研究设计与样本
- 系统综述与Meta分析,依据COSMIN倡议分三部分:文献检索(PRISMA及PRISMA-COSMIN检索扩展)、方法学质量与测量属性评估(COSMIN RoB工具及GRADE证据确定性分级)、可定量合并时进行测量属性Meta分析。
主要发现
- MINORS、MMERSQI和ASSESS在MQ评估中显示最高质量证据,ROBINS-I在RoB评估中证据最强。
- 对ROBINS-I等数据充足的工具进行评分者间信度系数Meta分析,选择和暴露领域显示中等一致性,研究间异质性较大。
临床怎么用
- 评估NRSI方法学质量可优先选用MINORS,评估偏倚风险可优先选用ROBINS-I。
- 选择工具时需考虑其心理测量学证据的充分性,ASSESS和MMERSQI内容效度证据较充分。
局限性
- 多数NRSI评估工具未经过全面心理测量学验证,测量证据基础有限。
- 部分工具可合并数据不足,未能进行Meta分析。
- 评分者间信度Meta分析显示研究间异质性较大。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: Nonrandomized studies of interventions (NRSIs) provide valuable evidence in health sciences but are prone to biases that affect validity. Multiple instruments have been developed for critical appraisal, although their measurement properties remain insufficiently investigated. These instruments typically aim to evaluate two key theoretical constructs: methodological quality (MQ) and risk of bias (RoB), which reflect different but complementary dimensions of study rigor and internal validity. The COnsensus-basedStandards for the selection of health Measurement INstruments (COSMIN) framework offers internationally recognized standards for evaluating instrument robustness, thus enhancing transparency and comparability in their selection. This systematic review specifically focused on identifying and critically evaluating studies that have empirically tested the measurement properties of instruments developed to assess MQ and/or RoB in NRSIs. STUDY DESIGN: A systematic review and meta-analysis was conducted in accordance with the COSMIN initiative, which is structured in three parts: (1) a literature search reported according to the Preferred Reporting Items for Systematic Reviews andMeta-Analyses (PRISMA) and the PRISMA-COSMIN search extension; (2) an assessment of methodological quality (MQ-COSMIN) and measurement properties using the COSMIN Risk of Bias tool, together with an evaluation of the certainty of evidence (CoE) following the Grading of Recommendations Assessment,Development, and Evaluation(GRADE), and (3) a meta-analysis of measurement properties when sufficient quantitative data were available across validation studies for a given instrument. RESULTS: Eleven instruments for critical appraisal of NRSIs were identified. None were evaluated for all COSMIN measurement properties; instrument development, content validity, and reliability were most consistently reported. The Methodological Index forNon-RandomizedStudies (MINORS), the Modified Medical Education Research Study Quality Instrument (MMERSQI), and the AcomprehensSive tool tosupport rEporting and critical appraiSal of qualitative, quantitative, and mixed methods implementation reSearch outcomes (ASSESS) showed the highest quality evidence for MQ assesment, while the Risk of Bias inNon-randomisedStudies of InterventionsI (ROBINS-I) provided the strongest evidence for RoB assessment. For instruments with sufficient comparable data, such as ROBINS-I, a meta-analysis of inter-rater reliability coefficients was conducted, showing moderate agreement for selection and exposure domains, with substantial heterogeneity across studies. CONCLUSION: MINORS emerged as the most robust instrument for critical appraisal of MQ, whereas ROBINS-I stood out for RoB. ASSESS and MMERSQI provided adequate and sufficient evidence of content validity. Further assessment of different psychometric properties is needed, highlighting that only a small subset of available tools for NRSIs have undergone formal psychometric validation. Further research is needed to strengthen the measurement evidence base for these instruments.
引用
- Sánchez-Marco M, Montoro-Pérez N, Rubio-Aparicio M, et al. Psychometric properties of instruments for assessing the methodological quality and risk of bias in non-randomized studies of interventions: a systematic review and meta-analysis in accordance with the COSMIN guideline. J Clin Epidemiol. 2026. PMID: 41850546. doi:10.1016/j.jclinepi.2026.112230
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。