系统评价与网状Meta分析的关键评价工具及使用指南范围综述:方法学空白与工具开发方向
该系统评价范围综述检索至2025年8月,纳入34篇文章描述的22个工具(11个网状Meta分析专用、9个系统评价与Meta分析专用、2个两者兼顾),按结构式工具与解释性指南分类,并评估其测量学性能数据。网状Meta分析工具虽新增网络几何、传递性和一致性等领域,但对传递性评价、发表偏倚和排序的指导有限或无效;仅9个工具报告测量学性能数据,效度和信度差异较大。
要点
- 共识别22个评价工具,其中11个为网状Meta分析专用。
- 网状Meta分析工具对传递性评价、发表偏倚和排序的指导有限或无效。
- 仅9个工具报告测量学性能数据,效度和信度差异较大。
核心结论
- 该首份系统评价与Meta分析及网状Meta分析评价资源的综合图谱表明,需要更清晰的操作标准、结构化决策规则和整合的评价者培训,以提高信度并使系统评价基础领域与网状Meta分析特有内容相衔接。
研究设计与样本
- 方法学范围综述,检索从建库至2025年8月,覆盖主要数据库、注册库、机构网站和参考文献列表,纳入英文发表的针对系统评价(含或不含网状Meta分析专用领域)、面向综述作者、临床医生、指南制定者或卫生技术评估评估者的结构化评价工具或解释性指南。
- 两名评价者独立筛选记录,一人提取数据并由第二人核对,结果以叙述性方式综合。
主要发现
- 34篇文章描述了22个工具,其中11个为网状Meta分析专用、9个为系统评价与Meta分析专用、2个同时涵盖系统评价与Meta分析和网状Meta分析。
- 网状Meta分析工具新增了网络几何、传递性和一致性等领域,但对传递性评价、发表偏倚和排序的指导有限或无效。
- 面向综述作者的工具为结构化设计并设有明确回答选项,而面向临床医生的指南提出评价问题并附解释但无规定回答。
- 9个工具报告了测量学性能数据,效度和信度差异较大。
关键数值与推荐
- 22个工具中11个为网状Meta分析专用、9个为系统评价与Meta分析专用、2个两者兼顾。
- 9个工具报告测量学性能数据,效度和信度差异较大。
- 报告清单(如系统评价与Meta分析优先报告条目网状Meta分析扩展版)规定应报告哪些信息,但不规定呈现质量。
- 确定性框架(如推荐分级的评估、制定与评价或网状Meta分析置信度)概述如何跨不一致性或不精确性等领域对结果置信度进行评级,但不解释或标准化这些领域的不同评价方式。
临床怎么用
- 指南制定者、卫生技术评估评估者和临床医生应寻求与具有网状Meta分析经验的统计学家合作,并优先选用具有清晰决策规则和用户培训的工具。
- 作者指出,经过更好检验、更清晰的工具将使网状Meta分析评价更加一致和可信。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Systematic reviews (SRs) with network meta-analyses (NMAs) are increasingly used to inform guidelines, health technology assessments (HTAs), and policy decisions. Their methodological complexity, as well as the difficulty in assessing the exchangeability assumption and the large amount of results, makes appraisal more challenging than for SRs with pairwise NMAs. Numerous SR- and NMA-specific appraisal tools exist, but they vary in scope, intended users, and methodological guidance, and few have been validated. OBJECTIVES: To identify and describe appraisal instruments and interpretive guides for SRs and NMAs specifically, summarizing their characteristics, domain coverage, development methods, and measurement-property evaluations. METHODS: We conducted a methodological scoping review which included structured appraisal instruments or interpretive guides for SRs with or without NMA-specific domains, aimed at review authors, clinicians, guideline developers, or HTA assessors from published or gray literature in English. Searches (inception-August 2025) covered major databases, registries, organizational websites, and reference lists. Two reviewers independently screened records; data were extracted by one and checked by a second. We synthesized the findings narratively. First, we classified tools as either structured instruments or interpretive guides. Second, we grouped them according to their intended audience and scope. Third, we assessed available measurement-property data using relevant COnsensus-based Standards for the selection of health Measurement INstruments items. RESULTS: Thirty-four articles described 22 instruments (11 NMA-specific, nine systematic reviews with meta-analysis-specific, 2 encompassing both systematic reviews with meta-analysis and NMA). NMA tools added domains such as network geometry, transitivity, and coherence, but guidance on transitivity evaluation, publication bias, and ranking was either limited or ineffective. Reviewer-focused tools were structured with explicit response options, whereas clinician-oriented guides posed appraisal questions with explanations but no prescribed response. Nine instruments reported measurement-property data, with validity and reliability varying widely. CONCLUSION: This first comprehensive map of systematic reviews with meta-analysis and NMA appraisal resources highlights the need for clearer operational criteria, structured decision rules, and integrated rater training to improve reliability and align foundational SR domains with NMA-specific content. PLAIN LANGUAGE SUMMARY: NMA is a way to compare many treatments at once by combining results from multiple studies-even when some treatments have not been directly compared head-to-head. Because NMAs are complex, users need clear tools to judge whether an analysis is trustworthy. We reviewed and mapped 22 instruments published over the last 3 decades that are used to appraise or interpret SRs and NMAs. About half were designed specifically for NMAs; the rest were general SR tools that are applicable to NMAs. Most tools cover the basics of good reviews (clear question, fair search, bias assessment, and transparent synthesis). NMA-specific tools also address issues unique to networks, such as how the network is connected, whether indirect and direct evidence agree (consistency), and how to interpret treatment rankings. However, important gaps remain. Few tools give step-by-step checks for transitivity/consistency, network-level publication bias, or ranking uncertainty, and reported reliability between raters is inconsistent. Reporting checklists (eg, Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Network Meta-Analyses) specify what information should be reported but not how well it should be presented. Certainty frameworks (eg, Grading of Recommendations Assessment, Development, and Evaluation or Confidence in Network Meta-Analysis) outline how confidence in results is rated across domains such as inconsistency or imprecision, but they do not explain or standardize the different ways these domains are evaluated. What this means: guideline developers, HTA assessors, and clinicians should seek collaboration with statisticians experienced in NMA, and favor instruments with clear decision rules and user training. Better-tested, clearer tools will make NMA assessments more consistent and trustworthy.
引用
- Mondragon KM, Tan-Lim CS, Velasco R, et al. A scoping review of critical appraisal tools and user guides for systematic reviews with network meta-analysis: methodological gaps and directions for tool development. J Clin Epidemiol. 2025. PMID: 41274385. doi:10.1016/j.jclinepi.2025.112056
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。