认真撰写摘要——摘要报告质量对半自动标题-摘要筛选工具可发现性的影响
本研究利用公开的半自动筛选工具ASReview和两项已发表预后模型系统综述的数据进行模拟,评估摘要报告质量(按TRIPOD评分)、摘要结构和术语使用与相关研究可发现性的关联。结果显示,摘要报告质量越好,半自动筛选工具的可发现性越高;使用摘要小标题也在较小程度上与可发现性相关,其他结构和术语特征无关联。
要点
- 摘要报告质量(TRIPOD评分)越好,半自动筛选工具越容易发现相关研究。
- 使用摘要小标题与可发现性相关,但关联程度较小。
- 其他摘要结构特征和术语使用与可发现性无关联。
核心结论
- 摘要报告质量越好,半自动标题-摘要筛选工具的可发现性越高。
- 作者强调应遵循摘要报告指南,既为报告一致透明,也为在证据合成中提高筛选工具识别相关研究的能力。
研究设计与样本
- 利用公开半自动筛选工具ASReview和两项已发表预后模型系统综述的数据进行模拟。
主要发现
- 更好的摘要报告质量与半自动筛选工具更高的可发现性明显相关。
- 使用摘要小标题也在较小程度上与可发现性相关。
- 其他摘要结构特征和摘要术语使用与可发现性无关联。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND OBJECTIVE: Evidence synthesis, such as the conduct of a systematic review or clinical guideline development, is time-consuming, laborious, and costly. This is largely due to the vast numbers of titles and abstracts that need to be screened. Semi-automated screening tools can accelerate this by prioritizing the most likely relevant abstracts by using an active learning strategy. The reliability of such tools in prioritizing abstracts is related to the modeling methods that the tool uses (ie, the ability of models to make reliable predictions of study relevance) and to the quality of the data that the modeling methods are applied to (ie, the consistency and completeness of reporting in the titles and abstracts of studies). Here, we aimed to gain insight into the latter by evaluating the association between abstract reporting characteristics and findability by semi-automated screening tools. METHODS: We tested the impact of reporting quality of abstracts on semi-automated screening tools by evaluating whether (I) abstract reporting quality (as scored by Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD)), (II) abstract structure, and (III) abstract terminology usage are associated with findability of relevant studies during semi-automated title-abstract screening. We performed simulations using a publicly available semi-automated screening tool, ASReview, and data from two previously conducted comprehensive systematic reviews of prognostic model studies. RESULTS: We found that better abstract reporting quality was clearly associated with greater findability by the semi-automated screening tool. To a smaller extent, the use of abstract subheadings was also associated with findability. Other abstract structure characteristics and abstract terminology usage were not associated with findability. CONCLUSION: We conclude that better reporting quality of abstracts is associated with better findability by semi-automated title-abstract screening tools. This stresses the importance of adhering to abstract reporting guidelines, not only for consistent and transparent reporting across studies in general but also for enhancing the identification of relevant studies by screening tools during evidence synthesis. PLAIN LANGUAGE SUMMARY: Systematic reviews summarize scientific evidence from literature to support clinical decision-making. In the conduct of a systematic review, thousands of papers have to be screened for relevance, making the process costly and laborious. To accelerate this process, several tools have been developed that can assist in identifying relevant scientific literature. Such tools screen through the abstracts of scientific papers and predict which papers are likely relevant for the systematic review. However, the performance of these screening tools may depend on whether information is accurately and completely reported in the abstracts. Here, we aimed to evaluate the impact of abstract reporting quality on the performance of screening tools. We used data from a set of scientific papers of which the abstract reporting quality was scored manually (following an existing reporting checklist called TRIPOD), and we applied an existing screening tool as an example. We simulated the procedure of conducting a scientific review and evaluated whether the relevance predictions by the screening tool were associated with abstract reporting quality. We found that relevant scientific papers with abstracts that had poor reporting quality were more difficult to identify as relevant by the screening tool. This finding highlights the importance of adhering to reporting guidelines, not only for transparency of scientific findings but also for optimal usage of screening tools in the conduct of a systematic review.
引用
- Spiero I, Leeuwenberg AM, Moons KGM, et al. Write your abstracts carefully-The impact of abstract reporting quality on findability by semi-automated title-abstract screening tools. J Clin Epidemiol. 2025. PMID: 41005462. doi:10.1016/j.jclinepi.2025.111987
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。