COVID-19治疗系统评价中研究启示要素的临床与方法学意义常缺乏结构且报告不足:一项元研究
该元研究基于Living OVerview of the Evidence COVID-19数据库2021年5月收录的326篇COVID-19治疗系统评价,评估其是否包含研究启示(IfR)声明及IfR所涵盖的要素。284篇(87.1%)报告了IfR,但涉及PICO的IfR缺乏结构,GRADE相关概念极少被报告。作者认为考虑PICO要素和GRADE概念来推导IfR似乎是合理的起点。
要点
- 326篇COVID-19治疗系统评价中284篇(87.1%)报告了研究启示声明。
- IfR中常报告人群(68.7%)、干预(85.2%)和结局(44.7%),但对照仅10.2%。
- GRADE相关概念在IfR中极少报告,如偏倚风险4.9%、不精确性2.8%。
核心结论
- 近90%的COVID-19治疗系统评价报告了IfR。
- 涉及PICO的IfR声明在各系统评价中缺乏结构,GRADE相关概念极少被报告用于指导IfR。
- 需要进一步工作评估超越COVID-19的普适性,并更精确地定义应考虑哪些IfR要素及其在干预系统评价中的报告方式。
- 在此之前,考虑PICO要素和GRADE相关概念来推导IfR似乎是合理的起点。
研究设计与样本
- 本研究为一项元研究,基于另一研究项目(CRD42021240423)在2021年5月从Living OVerview of the Evidence COVID-19数据库中识别的COVID-19治疗系统评价。
- 共纳入326篇系统评价。
- IfR声明定义为至少一句包含至少一条对未来研究规划有启示信息的话。
- 三名作者在预试数据提取表后独立提取数据,通过每周讨论解决分歧以确保高质量数据提取。
主要发现
- 326篇系统评价中284篇(87.1%)报告了IfR。
- 284篇报告IfR的系统评价中,201篇(70.8%)报告使用了PRISMA,66篇(23.2%)使用了GRADE。
- IfR声明(n=284)涉及PICO时缺乏结构,常报告人群(n=195,68.7%)、干预(n=242,85.2%)和结局(n=127,44.7%),但未报告对照(n=29,10.2%)。
- GRADE相关概念在IfR声明(n=284)中报告频率低:偏倚风险(n=14,4.9%)、不精确性(n=8,2.8%)、不一致性(n=7,2.5%)、发表偏倚(n=3,1.1%)、间接性(n=1,0.4%)。
- IfR中提及的其他要素包括未来研究更好的报告(n=17,6.0%)和临床试验程序标准化(n=12,4.2%)。
关键数值与推荐
- IfR声明涉及PICO的报告中,人群为n=195(68.7%)、干预为n=242(85.2%)、结局为n=127(44.7%)、对照为n=29(10.2%)。
- GRADE相关概念在IfR声明中的报告率为:偏倚风险n=14(4.9%)、不精确性n=8(2.8%)、不一致性n=7(2.5%)、发表偏倚n=3(1.1%)、间接性n=1(0.4%)。
- 其他IfR要素:未来研究更好的报告n=17(6.0%)、临床试验程序标准化n=12(4.2%)。
临床怎么用
- 作者认为,在进一步工作明确IfR要素及其报告方式之前,考虑PICO要素和GRADE相关概念来推导IfR似乎是合理的起点。
局限性
- 需要进一步工作评估超越COVID-19的普适性。
- 需要进一步工作更精确地定义应考虑哪些IfR要素及其在干预系统评价中的报告方式。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: Numerous systematic reviews (SRs) have been published in the first months of the COVID-19 pandemic and clinical trials were designed rapidly highlighting the importance of informative implications for research (IfRs) sections in SRs. IfR is one item of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020 checklist and the Cochrane Handbook suggests considering population, intervention, control, outcome (PICO) and Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) domains when developing IfR. We aimed (1) to assess whether SRs on COVID-19 treatments included any IfR statements and, for SRs with an IfR statement, (2) to examine which elements informed the IfR statement. STUDY DESIGN AND SETTING: We conducted a metaresearch study based on SRs on COVID-19 treatment identified in the Living OVerview of the Evidence COVID-19 database in May 2021 as part of another research project (CRD42021240423). We defined an IfR statement as at least one sentence that contained at least one bit of information that could be informative for planning future research. We extracted any IfR statements anywhere in the SRs on predefined IfR variables, in particular PICO elements, study design, and concepts underlying GRADE domains. Three authors extracted data independently after piloting the data extraction form. We resolved discrepancies in weekly discussions to ensure a high-quality data extraction. RESULTS: We included 326 SRs, of which 284 SRs (87.1%) stated IfR. Of these 284 SRs, 201 (70.8%) reported using Preferred Reporting Items for Systematic Reviews and Meta-Analyses and 66 (23.2%) using GRADE. IfR statements (n = 284) addressing PICO were unstructured and commonly reported 'population' (n = 195, 68.7%), 'intervention' (n = 242, 85.2%), and 'outcome' (n = 127, 44.7%) but not 'control' (n = 29, 10.2%). Concepts underlying GRADE domains were infrequently reported in IfR statements of SRs (n = 284): 'risk of bias' (n = 14, 4.9%), 'imprecision' (n = 8, 2.8%), 'inconsistency' (n = 7, 2.5%), 'publication bias' (n = 3, 1.1%), and 'indirectness' (n = 1, 0.4%). Additional IfR elements mentioned in IfR were 'better reporting' of future studies (n = 17, 6.0%) and 'standardization of procedures in clinical trials' (n = 12, 4.2%). CONCLUSION: Almost 90% of SRs on COVID-19 treatments reported IfR. IfR statements addressing PICO were unstructured across SRs and concepts underlying GRADE were rarely reported to inform IfR. Further work is needed to assess generalizability beyond COVID-19 and to define more precisely which IfR elements should be considered, and how they should be reported in SRs of interventions. Until then, considering PICO elements and concepts underlying GRADE to derive IfR seems to be a sensible starting point.
引用
- Siemens W, Bantle G, Mahler S, et al. Clinical and methodological implications for research elements in systematic reviews on COVID-19 treatment were often unstructured and under-reported: a metaresearch study. J Clin Epidemiol. 2023. PMID: 38072174. doi:10.1016/j.jclinepi.2023.111236
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。