急诊与创伤影像中的人工智能:ASER人工智能/机器学习专家组关于研究指南、实践与优先级的德尔菲共识声明
ASER人工智能/机器学习专家组于2022至2024年开展德尔菲共识,经两轮匿名RAND/UCLA评分(第一轮81项、第二轮78项,分别有18/21和15名专家回复),就急诊与创伤影像AI研究达成65条共识,强调透明的方法学报告、外部数据验证泛化性与稳健性、以及采用适当指标和基线进行性能基准测试。
要点
- 共识围绕数据整理、有效性、人为因素、工作流程、障碍、未来方向与伦理等主题形成65条陈述。
- 一致共识的陈述集中于透明的方法学报告、用外部数据检验泛化性与稳健性、以及采用适当指标和基线进行性能基准测试。
- 该文件旨在作为框架,促进急诊与创伤影像AI研究者的最佳实践和进一步讨论。
核心结论
- 该共识文件旨在作为框架,促进急诊与创伤影像AI研究者之间的最佳实践和进一步讨论。
研究设计与样本
- ASER人工智能/机器学习专家组于2022至2024年开展德尔菲共识,第一阶段由7名专家组成指导委员会确立主题并生成陈述清单,第二阶段进行两轮匿名RAND/UCLA Likert评分(第一轮网络数据采集,第二轮使用带文献超链接的定制Excel文档),达到≥80%同意率的陈述纳入最终文件。
诊断标准与关键数值
- 德尔菲第一轮81项、第二轮78项,分别有18/21名专家(86%)和15名专家回复(脱落率17%)。
- 共识达成65条陈述,达到≥80%同意率方纳入最终文件。
- 一致共识的陈述集中于透明的方法学报告、用外部数据检验泛化性与稳健性、以及采用适当指标和基线进行性能基准测试。
临床应用与阅片要点
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND: Emergency/trauma radiology artificial intelligence (AI) is maturing along all stages of technology readiness, with research and development (R&D) ranging from data curation and algorithm development to post-market monitoring and retraining.
PURPOSE: To develop an expert consensus document on best research practices and methodological priorities for emergency/trauma radiology AI.
METHODS: A Delphi consensus exercise was conducted by the ASER AI/ML expert panel between 2022-2024. In phase 1, a steering committee (7 panelists) established key themes- curation; validity; human factors; workflow; barriers; future avenues; and ethics- and generated an edited, collated long-list of statements. In phase 2, two Delphi rounds using anonymous RAND/UCLA Likert grading were conducted with web-based data capture (round 1) and a bespoke excel document with literature hyperlinks (round 2). Between rounds, editing and knowledge synthesis helped maximize consensus. Statements reaching ≥80% agreement were included in the final document.
RESULTS: Delphi rounds 1 and 2 consisted of 81 and 78 items, respectively.18/21 expert panelists (86%) responded to round 1, and 15 to round 2 (17% drop-out). Consensus was reached for 65 statements. Observations were summarized and contextualized. Statements with unanimous consensus centered around transparent methodologic reporting; testing for generalizability and robustness with external data; and benchmarking performance with appropriate metrics and baselines. A manuscript draft was circulated to panelists for editing and final approval.
CONCLUSIONS: The document is meant as a framework to foster best-practices and further discussion among researchers working on various aspects of emergency and trauma radiology AI.
引用
- Dreizin D, Khatri G, Staziaki PV, et al. Artificial intelligence in emergency and trauma radiology: ASER AI/ML expert panel Delphi consensus statement on research guidelines, practices, and priorities. Emerg Radiol. 2024. PMID: 39714735. doi:10.1007/s10140-024-02306-1
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。