评估神经放射学跨模态图像转换研究中的偏倚与质量问题:一项系统综述
本系统综述检索 PubMed、Scopus 和 IEEE Xplore 至 2023 年 8 月 2 日,纳入 102 篇 2017 年 4 月至 2023 年 8 月发表的脑影像人工智能跨模态图像转换模型研究,用 CLAIM 和 PROBAST 评估质量与偏倚,发现几乎所有研究存在阻碍临床应用的关键问题。
要点
- CLAIM 相关条目中位依从性 69%,PROBAST 问题中位依从性 38%。
- 工程导向文章 CLAIM 依从性低于医学导向文章(65% vs 73%,P < .001)。
- 工程导向研究模型描述条目依从性更高,医学导向研究数据集与评估描述依从性更高。
核心结论
- 几乎所有研究均存在阻碍临床应用的关键问题,工程导向研究在技术模型描述上依从性更高但总体依从性显著低于医学导向研究,追求临床应用需两个领域合作改进报告。
研究设计与样本
- 系统综述,检索 PubMed、Scopus 和 IEEE Xplore 至 2023 年 8 月 2 日,纳入 102 篇 2017 年 4 月至 2023 年 8 月发表的放射学脑图像人工智能图像转换模型研究,使用 CLAIM 评估质量、PROBAST 评估偏倚,采用 Mann-Whitney U 检验比较医学导向与工程导向文章的总体依从性、Fisher 精确检验比较各条目。
诊断标准与关键数值
- CLAIM 相关条目中位依从性为 69%。
- PROBAST 问题中位依从性为 38%。
- 工程导向文章 CLAIM 依从性低于医学导向文章(65% vs 73%,P < .001)。
- 工程导向研究模型描述条目依从性更高,医学导向研究数据集与评估描述条目依从性更高。
局限性
- 本综述受研究设计和模型异质性限制。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND: Intermodality image-to-image translation is an artificial intelligence technique for generating one technique from another.
PURPOSE: This review was designed to systematically identify and quantify biases and quality issues preventing validation and clinical application of artificial intelligence models for intermodality image-to-image translation of brain imaging.
DATA SOURCES: PubMed, Scopus, and IEEE Xplore were searched through August 2, 2023, for artificial intelligence-based image translation models of radiologic brain images.
STUDY SELECTION: This review collected 102 works published between April 2017 and August 2023.
DATA ANALYSIS: Eligible studies were evaluated for quality using the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) and for bias using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). Medically-focused article adherence was compared with that of engineering-focused articles overall with the Mann-Whitney U test and for each criterion using the Fisher exact test.
DATA SYNTHESIS: Median adherence to the relevant CLAIM criteria was 69% and 38% for PROBAST questions. CLAIM adherence was lower for engineering-focused articles compared with medically-focused articles (65% versus 73%, P < .001). Engineering-focused studies had higher adherence for model description criteria, and medically-focused studies had higher adherence for data set and evaluation descriptions.
LIMITATIONS: Our review is limited by the study design and model heterogeneity.
CONCLUSIONS: Nearly all studies revealed critical issues preventing clinical application, with engineering-focused studies showing higher adherence for the technical model description but significantly lower overall adherence than medically-focused studies. The pursuit of clinical application requires collaboration from both fields to improve reporting.
引用
- Walston SL, Tatekawa H, Takita H, et al. Evaluating Biases and Quality Issues in Intermodality Image Translation Studies for Neuroradiology: A Systematic Review. AJNR Am J Neuroradiol. 2024. PMID: 38663993. doi:10.3174/ajnr.A8211
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。