文献速递医学教育与科研方法

评估用于评价PRISMA 2020依从性的工具发现方法不一致且工具可实施性差:系统综述的第一部分

Evaluation of tools used to assess adherence to PRISMA 2020 reveals inconsistent methods and poor tool implementability: part I of a systematic review.
PubMed 文献 · J Clin Epidemiol · 2026-01-09

该系统综述检索MEDLINE、Embase和PsycINFO至2025年1月20日,纳入24项meta研究,这些研究评估了2766篇发表于1989至2024年的系统综述对PRISMA 2020的依从性。多数研究(15/24,63%)评估整体依从性,仅5项(21%)报告心理测量学检验,仅1项(4%)报告所有条目应答选项的操作化方法;按预设标准仅1个工具被归类为可实施。作者已启动标准化PRISMA 2020评估工具的研制工作,并 interim 提供报告建议。

要点

  • 24项meta研究评估2766篇系统综述对PRISMA 2020的依从性,方法学差异大。
  • 仅5项(21%)报告工具的心理测量学检验,均为评分者间信度。
  • 仅1项(4%)报告所有条目应答选项的操作化方法,仅1个工具符合可实施标准。

核心结论

  • 用于评估系统综述对PRISMA 2020依从性的工具在方法和报告上存在差异与不足。
  • 作者已启动标准化PRISMA 2020评估工具的研制工作,以促进准确一致的依从性评估。
  • 在标准化工具出台前,作者为有兴趣评估PRISMA 2020依从性的meta研究者提供了透明报告评估结果的建议。

研究设计与样本

  • 系统综述,检索MEDLINE、Embase和PsycINFO(均通过Ovid),检索日期为2025年1月20日。
  • 纳入评估健康干预系统综述对PRISMA 2020依从性的研究,由两位作者独立筛选记录并提取数据。
  • 共纳入24项meta研究,评估了2766篇发表于1989年至2024年的系统综述。
  • 从三个方面检查评估工具:工具特征、开发与验证方法、应用过程。
  • 将工具归类为可实施的标准为:作者报告每个条目的确切措辞、应答选项、所有应答选项的操作化指导以及用于汇总判断和量化依从性的算法。

主要发现

  • 多数研究评估整体PRISMA 2020依从性(15/24,63%),其余9项(37%)评估一个或部分领域(如摘要、检索方法、偏倚风险评估方法)。
  • 5项研究(21%)报告了评估工具的心理测量学检验,均评估评分者间信度。
  • 仅1项(4%)报告了所有条目应答选项的操作化方法。
  • 按预设标准,仅1个评估工具被归类为可实施(1/24,4%)。
  • 没有作者团队使用相同方法评估对PRISMA 2020的依从性;部分研究的工具特征信息不可获得。

关键数值与推荐

  • 可实施工具标准:报告每个条目的确切措辞、应答选项、所有应答选项的操作化指导以及汇总判断和量化依从性的算法。
  • 仅1/24(4%)工具符合可实施标准。

临床怎么用

  • 原文未据此给出临床推荐。
  • 作者建议有兴趣评估系统综述对PRISMA 2020依从性的meta研究者透明报告其评估结果。
  • 作者已启动标准化PRISMA 2020评估工具的研制工作。

局限性

  • 部分研究的工具特征信息不可获得。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND AND OBJECTIVES: Numerous studies have assessed the adherence of published systematic reviews to the PRISMA 2020 statement. We aimed to summarize the characteristics and methods of development of the tools used to assess adherence in these studies. METHODS: MEDLINE, Embase, and PsycINFO (all via Ovid) were searched on January 20, 2025, to locate studies that assessed adherence of systematic reviews of health interventions to the PRISMA 2020 statement. Two authors independently screened all records and extracted data. We examined three aspects of the tools used to assess adherence to PRISMA 2020: i) characteristics of the assessment tool, ii) methods used to develop and validate the tool, and iii) processes used to apply the tool. We classified a tool as "implementable" by researchers external to the tool developers if authors reported the exact wording of each item, its response options, guidance on how to operationalize all response options, and the algorithms used to aggregate judgments and quantify adherence. RESULTS: We included 24 meta-research studies that had assessed adherence to PRISMA 2020 in 2766 systematic reviews published between 1989 and 2024. Most authors assessed adherence to PRISMA 2020 in its entirety (N = 15/24, 63%), with the remaining nine (37%) assessing adherence to one or a subset of domains (eg, abstract, search methods, and risk of bias assessment methods). Psychometric testing of the assessment tool was reported by five studies (21%), all of which assessed the inter-rater reliability of the tool. Only one (4%) reported how response options for all items were operationalized. According to our criteria, only one assessment tool was classified as implementable (N = 1/24, 4%). No authorship team used the same methods to assess adherence to the PRISMA 2020 statement. However, information on some tool characteristics was unavailable for several studies. CONCLUSION: Our findings demonstrate variation and inadequacies in the methods and reporting of tools used to assess adherence to the PRISMA 2020 statement. We have commenced work on a standardized PRISMA 2020 assessment tool to facilitate accurate and consistent assessments of adherence of systematic reviews to PRISMA. In the interim, we provide some recommendations for how meta-researchers interested in assessing adherence of systematic reviews to the PRISMA 2020 statement can transparently report the findings of their assessments.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Hamilton DG, McKenzie JE, Nejstgaard CH, et al. Evaluation of tools used to assess adherence to PRISMA 2020 reveals inconsistent methods and poor tool implementability: part I of a systematic review. J Clin Epidemiol. 2026. PMID: 41520689. doi:10.1016/j.jclinepi.2026.112133

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。