文献速递医学教育与科研方法流行病学与生物统计

开发用于评估诊断研究中目标病症适用性的框架

Developing a framework for assessing the applicability of the target condition in diagnostic research.
PubMed 文献 · J Clin Epidemiol · 2025-11-15

该研究对Cochrane图书馆中使用QUADAS-2且对参考标准域适用性判定为高度关注的诊断准确性系统评价进行方法学回顾,归纳出5类适用性关注主题,并开发了一个包含4个潜在适用性关注点的框架,以指导系统评价作者评估参考标准域的目标病症适用性。

要点

  • 在50篇符合条件的Cochrane诊断准确性系统评价中,归纳出5类参考标准适用性关注主题。
  • 常见问题包括参考标准阈值不同、错误分类、未应用于全部受试者、误解QUADAS-2及信息不足。
  • 开发的框架涵盖目标病症亚类、阈值、参考标准未全覆盖及错误分类四个适用性关注点。

核心结论

  • 适用性关注的来源可以明确识别,但部分Cochrane系统评价作者在识别和报告适用性关注方面存在困难。
  • 已开发一个适用性框架,用于指导系统评价作者评估QUADAS参考标准域的适用性关注。

研究设计与样本

  • 方法学回顾,纳入Cochrane Library中使用QUADAS-2且对参考标准域适用性判定为高度关注至少一项研究的诊断准确性系统评价,共纳入50篇系统评价。
  • 由一名评价者提取高度关注的理由,第二名评价者核对,两名评价者归纳分类主题,第三名评价者验证,讨论后形成框架。

主要发现

  • 共识别50篇符合条件的系统评价,归纳出5个主题:研究使用不同的参考标准阈值定义目标病症(6篇系统评价)、参考标准错误分类导致研究目标病症与系统评价问题不匹配(11篇系统评价)、参考标准无法应用于全部受试者导致目标病症不同(5篇系统评价)、误解QUADAS-2适用性(7篇系统评价)、信息不足(21篇系统评价)。

关键数值与推荐

  • 框架列出参考标准定义的目标病症适用性评估的四个潜在关注点:目标病症的不同亚类、定义目标病症所用的不同阈值、参考标准未应用于全部研究组、参考标准对目标病症的错误分类。

局限性

  • 原文未报告局限性

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: Assessment of the applicability of primary studies is an essential but often a challenging aspect of systematic reviews of diagnostic test accuracy studies (DTA reviews). We explored review authors' applicability assessments for the QUADAS-2 reference standard domain within Cochrane DTA reviews. We highlight applicability concerns, identify potential issues with assessment, and develop a framework for assessing the applicability of the target condition as defined by the reference standard. STUDY DESIGN AND SETTING: Methodological review. DTA reviews in the Cochrane Library that used QUADAS-2 and judged applicability for the reference standard domain as "high concern" for at least one study were eligible. One reviewer extracted the rationale for the "high concern" and this was checked by a second reviewer. Two reviewers categorized the rationale inductively into themes, and a third reviewer verified these. Discussions regarding the extracted information informed framework development. RESULTS: We identified 50 eligible reviews. Five themes emerged: study uses different reference standard threshold to define the target condition (six reviews), misclassification by the reference standard in the study such that the target condition in the study does not match the review question (11 reviews), reference standard could not be applied to all participants resulting in a different target condition (five reviews), misunderstanding QUADAS-2 applicability (seven reviews), and insufficient information (21 reviews). Our framework for researchers outlines four potential applicability concerns for the assessment of the target condition as defined by the reference standard: different sub-categories of the target condition, different threshold used to define the target condition, reference standard not applied to full study group, and misclassification of the target condition by the reference standard. CONCLUSION: Clear sources of applicability concerns are identifiable, but several Cochrane review authors struggle to adequately identify and report them. We have developed an applicability framework to guide review authors in their assessment of applicability concerns for the QUADAS reference standard domain. PLAIN LANGUAGE SUMMARY: What is the problem? Doctors use tests to help to decide if a person has a certain condition. They want to know how accurate the test is before they use it. This means how well it can tell people who have the condition from people who do not have it. This information can be found in "diagnostic systematic reviews". Diagnostic systematic reviews start with a research question. They bring together findings from studies that have already been done to try to answer this question. It is important for researchers to check that the studies match the review question. This is called an "applicability assessment". For example, if the review looks at children, it is important to check whether the studies look at children too. There is a tool named "QUADAS-2" that can be used to check how well the studies match the review question. This can be hard to do, and there are not many examples available to help people. What did we do? We wanted to know more about how people judge applicability concerns using the QUADAS-2 tool. We also wanted to write guidance to support judgments about applicability. What did we find? We found examples of how people are doing applicability assessment. Many reviews have not done it right, and we explain why this is. We also made guidance to help people with applicability assessment.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Tomlinson E, Holmes J, Rutjes AWS, et al. Developing a framework for assessing the applicability of the target condition in diagnostic research. J Clin Epidemiol. 2025. PMID: 41248868. doi:10.1016/j.jclinepi.2025.112059

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。