半自动化方法助力网络Meta分析中证据确定性评估:第2部分——间接与混合比较
研究开发并实施半自动化算法,用于评估两项类风湿关节炎活体网络Meta分析中间接和网络估计的证据确定性(CoE)。结果显示,审阅者对所有自动化CoE评级(不一致性n=34、网络估计n=34、不精确性n=1447)均表示同意,但对前两位直接估计总贡献较低(如<50%,占38%)时的不传递性算法存在分歧。结论认为自动化方法有助于间接和网络估计的CoE评级,但不传递性的合适算法仍需进一步研究。
要点
- 半自动化算法可生成间接和网络估计的证据确定性评级。
- 审阅者同意所有自动化评级:不一致性n=34、网络估计n=34、不精确性n=1447。
- 前两位直接估计总贡献低(如<50%)时不传递性算法存在分歧。
核心结论
- 自动化方法有助于间接和网络估计的证据确定性评级,但不传递性的合适算法仍需进一步研究。
研究设计与样本
- 在两项类风湿关节炎治疗的活体网络Meta分析中开发并实施半自动化算法,用于间接和网络估计的证据确定性评级。
主要发现
- 在1306项间接比较中,贡献矩阵识别出主导证据分支,无论是否存在单一一阶闭环(80%)。
- 审阅者同意所有自动化证据确定性评级:不一致性(n=34)、网络估计(n=34)和不精确性(n=1447)。
- 审阅者同意自动化不传递性算法,除非前两位直接估计的总贡献较低(如<50%,占38%的估计)。
关键数值与推荐
- 间接阶段输入包括直接估计的证据确定性评级和贡献矩阵。
- 不传递性评级基于贡献百分比最高的两项直接估计的间接性评级进行赋值。
- 在线工具(针对本项目定制)辅助评估网络估计的不精确性。
局限性
- 不传递性的合适算法仍需进一步研究。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To implement a semiautomated approach to facilitate rating the Grading, Recommendation, Assessment, Development and Evaluation certainty of evidence (CoE) for indirect and network meta-analysis (NMA) estimates. METHODS: We developed and implemented algorithms for generating automated ratings for the CoE for indirect and network estimates in two living NMAs of rheumatoid arthritis treatment. At the indirect stage, inputs included CoE ratings for direct estimates and the contribution matrix. Intransitivity ratings were assigned based on the indirectness ratings of the two direct estimates with the highest percent contribution. An online tool (customized to our project) facilitated assessment of imprecision on the network estimate. Automated ratings were reviewed by two independent experts. RESULTS: Across 1306 indirect comparisons, the contribution matrix identified the dominant branches of evidence regardless of whether a single first order loop was present (80%) or not. The reviewers agreed with all automated CoE ratings for incoherence (n = 34), network estimates (n = 34) and imprecision (n = 1447). They agreed with the automated intransitivity algorithm except when the total contribution of the top-two direct estimates was low (eg, <50%, which occurred in 38% of the estimates). CONCLUSION: Automated approaches facilitated CoE ratings for indirect and network estimates. Further work is required to define appropriate algorithms for intransitivity.
引用
- Kamso MM, Whittle SL, Pardo JP, et al. A semi-automated approach facilitated the assessment of the certainty of evidence in a network meta-analysis: Part 2 - Indirect and Mixed comparisons. J Clin Epidemiol. 2025. PMID: 41412485. doi:10.1016/j.jclinepi.2025.112110
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。