对TRIPOD+AI指南的依从性:一份更新的报告评估工具
该研究基于TRIPOD+AI完整报告指南及其解释与说明和摘要版,更新并扩展了2019年TRIPOD依从性工具,通过作者团队讨论和试点测试细化依从性要素与评分规则,形成包含37个主要条目和136个依从性要素的更新工具,并针对模型开发、模型评估及两者兼有的研究分别制定评估工具。
要点
- 更新工具包含37个主要条目和136个依从性要素,并纳入若干自动评分规则。
- 针对模型开发、模型评估及两者兼有的研究,分别制定了TRIPOD+AI依从性工具。
- 统一的报告依从性评估方法有助于跨领域比较、监测报告随时间的变化并激励作者遵守指南。
核心结论
- 对TRIPOD+AI报告依从性采用统一评估方法,可实现跨领域比较、随时间监测报告情况,并激励原始研究作者遵守指南。
研究设计与样本
- 基于TRIPOD+AI完整报告指南(含解释与说明)及TRIPOD+AI摘要版,更新并扩展原TRIPOD依从性工具,经作者团队讨论和试点测试细化依从性要素与评分规则。
主要发现
- 更新后的工具包含37个主要条目和136个依从性要素,并包括若干自动评分规则。
- 分别针对模型开发、模型评估以及单篇论文中同时描述两者的研究,制定了不同的TRIPOD+AI依从性工具。
关键数值与推荐
- 更新工具包含37个主要条目和136个依从性要素。
- 针对模型开发、模型评估及两者兼有的研究分别制定TRIPOD+AI依从性工具。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: Incomplete reporting of research limits its usefulness and contributes to research waste. Numerous reporting guidelines have been developed to support complete and accurate reporting of health-care research studies. Completeness of reporting can be measured by evaluating the adherence to reporting guidelines. However, assessing adherence to a reporting guideline often lacks uniformity. In 2019, we developed a reporting adherence tool for the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement. With recent advances in regression and artificial intelligence (AI)/machine learning (ML)-based methods, TRIPOD + AI (www.tripod-statment.org) was developed to replace the TRIPOD statement. The aim of this study was to develop an updated adherence tool for TRIPOD + AI. STUDY DESIGN AND SETTING: Based on the TRIPOD + AI full reporting guideline, including the accompanying explanation and elaboration light, and TRIPOD + AI for abstracts, we updated and expanded the original TRIPOD adherence tool and refined the adherence elements and their scoring rules through discussions within the author team and a pilot test. RESULTS: The updated tool comprises of 37 main items and 136 adherence elements and includes several automated scoring rules. We developed separate TRIPOD + AI adherence tools for model development, model evaluation, and for studies describing both in a single paper. CONCLUSION: A uniform approach to assessing reporting adherence of TRIPOD + AI allows for comparisons across various fields, monitor reporting over time, and incentivizes primary study authors to comply. PLAIN LANGUAGE SUMMARY: Accurate and complete reporting is crucial in biomedical research to ensure findings can be effectively used. To support researchers in reporting their findings well, reporting guidelines have been developed for different study types. One such guideline is TRIPOD, which focuses on research studies about medical prediction tools. In 2024, TRIPOD was updated to TRIPOD + AI to address the increasing use of AI and ML in prediction model studies. In 2019, we developed a scoring system to evaluate how well research papers on prediction tools adhered to the TRIPOD guideline, resulting in a reporting completeness score. This score allows for easier comparison of reporting completeness across various medical fields, and to monitor improvement in reporting over time. With the introduction of TRIPOD + AI, an update of the scoring system was required to align with the new reporting recommendations. We achieved this by reviewing our previous scoring system and incorporating the new items from TRIPOD + AI to better suit studies involving AI. We believe that this system will facilitate comparisons of prediction model reporting completeness across different fields and encourage improved reporting practices.
引用
- de Kanter E, Kaul T, Heus P, et al. Adherence to TRIPOD+AI guideline: an updated reporting assessment tool. J Clin Epidemiol. 2025. PMID: 41448505. doi:10.1016/j.jclinepi.2025.112118
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。