人工智能在肾脏肿块表征中的应用:关于建模、性能评估、临床实用性和透明度的系统综述
该系统综述通过PubMed检索纳入30项原始研究,评估人工智能用于肾脏肿块表征时在建模、性能评估、临床实用性和透明度四类共15项方法学质量条目上的表现。结果显示建模和性能评估多数条目较好(均63%),但仅10%研究进行独立或外部验证,89%临床实用性条目和97%透明度条目表现不佳。作者认为未来研究需改进建模与性能评估策略并关注临床实用性和透明度。
要点
- 仅10%的研究进行了独立或外部验证以评估泛化能力。
- 87%的研究未与放射科医师评估比较,70%未与传统模型比较。
- 97%的研究未公开共享数据。
诊断标准与关键数值
- 建模和性能评估的方法学质量条目多数表现良好,均为63%。
- 仅10%的研究进行了独立或外部验证以评估泛化能力。
- 89%的研究在临床实用性评估条目上表现不佳。
- 97%的研究在透明度条目上表现不佳。
- 87%的研究缺乏与放射科医师评估的比较,70%缺乏与传统模型的比较。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVE. The objective of our study was to systematically review the literature about the application of artificial intelligence (AI) to renal mass characterization with a focus on the methodologic quality items. MATERIALS AND METHODS. A systematic literature search was conducted using PubMed to identify original research studies about the application of AI to renal mass characterization. Besides baseline study characteristics, a total of 15 methodologic quality items were extracted and evaluated on the basis of the following four main categories: modeling, performance evaluation, clinical utility, and transparency items. The qualitative synthesis was presented using descriptive statistics with an accompanying narrative. RESULTS. Thirty studies were included in this systematic review. Overall, the methodologic quality items were mostly favorable for modeling (63%) and performance evaluation (63%). Even so, the studies (57%) more frequently constructed their work on nonrobust features. Furthermore, only a few studies (10%) had a generalizability assessment with independent or external validation. The studies were mostly unsuccessful in terms of clinical utility evaluation (89%) and transparency (97%) items. For clinical utility, the interesting findings were lack of comparisons with both radiologists' evaluation (87%) and traditional models (70%) in most of the studies. For transparency, most studies (97%) did not share their data with the public. CONCLUSION. To bring AI-based renal mass characterization from research to practice, future studies need to improve modeling and performance evaluation strategies and pay attention to clinical utility and transparency issues.
引用
- Kocak B, Kaya OK, Erdim C, et al. Artificial Intelligence in Renal Mass Characterization: A Systematic Review of Methodologic Items Related to Modeling, Performance Evaluation, Clinical Utility, and Transparency. AJR Am J Roentgenol. 2020. PMID: 32960663. doi:10.2214/AJR.20.22847
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。