系统综述识别评估文献检索有效性的六种指标和一种方法,但对其适当使用未达成共识
OBJECTIVES: To identify the metrics or methods used by researchers to determine the effectiveness of literature searching where supplementary search methods are compared to bibliographic database searching.…
要点
- 评估文献检索有效性时需明确有效性阈值及评价与阈值的关系。
- 报告置信区间有助于解释有效性估计的不确定性。
- 检索方法应清晰报告并在研究中验证。
核心结论
- 研究评估文献检索有效性时应明确界定有效性阈值,并说明所报告的评价与该阈值的关系。
- 探究文献检索有效性的研究应报告置信区间以辅助解释结果的不确定性,且检索方法应清晰报告并在研究中验证。
主要发现
- 识别出六种指标:敏感度、特异度、精确度、准确度、需阅读文献数和产出率。
- 识别出一种方法:捕获-再捕获法。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To identify the metrics or methods used by researchers to determine the effectiveness of literature searching where supplementary search methods are compared to bibliographic database searching. We also aimed to determine which metrics or methods are summative or formative and how researchers defined effectiveness in their studies. STUDY DESIGN AND SETTING: Systematic review. We searched MEDLINE and Embase to identify published studies evaluating literature search effectiveness in health or allied topics. RESULTS: Fifty studies met full-text inclusion criteria. Six metrics (sensitivity, specificity, precision, accuracy, number needed to read, and yield) and one method (capture recapture) were identified. CONCLUSION: Studies evaluating effectiveness need to identify clearly the threshold at which they will define effectiveness and how the evaluation they report relates to this threshold. Studies that attempt to investigate literature search effectiveness should be informed by the reporting of confidence intervals, which aids interpretation of uncertainty around the result, and the search methods used to derive effectiveness estimates should be clearly reported and validated in studies.
引用
- Cooper C, Varley-Campbell J, Booth A, et al. Systematic review identifies six metrics and one method for assessing literature search effectiveness but no consensus on appropriate use. J Clin Epidemiol. 2018. PMID: 29526555. doi:10.1016/j.jclinepi.2018.02.025
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。