大型语言模型在放射学中的机遇与挑战综述:未来之路
本文综述了生成式人工智能,特别是大型语言模型(LLMs)及多模态大型语言模型(包括视觉语言模型)的基本术语与流程,并概述了其在影像领域的潜在应用与挑战。文章指出,这些模型在患者数据处理、报告与文献总结、诊断治疗随访建议及编码计费等辅助任务中具有潜在应用价值,但放射科医生进入这一充满希望却未知的领域时,必须熟悉其基本术语和流程。
要点
- LLMs(如ChatGPT、Med-PaLM、LLaMA)是基于大量文本数据训练的神经网络架构,擅长语言理解与生成。
- 多模态LLMs整合文本与图像等其他模态数据,可学习类似人类认知的通用表征。
- LLMs在医学领域潜在应用包括处理患者数据、总结报告与文献、提供诊断治疗随访建议及编码计费等辅助任务。
核心结论
- LLMs及其多模态版本在影像领域具有潜在应用价值,但放射科医生需熟悉其基本术语和流程以应对这一未知领域。
研究设计与样本
- 综述性文章,检索范围与纳入文献原文未报告。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
In recent years, generative artificial intelligence (AI), particularly large language models (LLMs) and their multimodal counterparts, multimodal large language models, including vision language models, have generated considerable interest in the global AI discourse. LLMs, or pre-trained language models (such as ChatGPT, Med-PaLM, LLaMA), are neural network architectures trained on extensive text data, excelling in language comprehension and generation. Multimodal LLMs, a subset of foundation models, are trained on multimodal data sets, integrating text with another modality, such as images, to learn universal representations akin to human cognition better. This versatility enables them to excel in tasks like chatbots, translation, and creative writing while facilitating knowledge sharing through transfer learning, federated learning, and synthetic data creation. Several of these models can have potentially appealing applications in the medical domain, including, but not limited to, enhancing patient care by processing patient data; summarizing reports and relevant literature; providing diagnostic, treatment, and follow-up recommendations; and ancillary tasks like coding and billing. As radiologists enter this promising but uncharted territory, it is imperative for them to be familiar with the basic terminology and processes of LLMs. Herein, we present an overview of the LLMs and their potential applications and challenges in the imaging domain.
引用
- Soni N, Ora M, Agarwal A, et al. A Review of the Opportunities and Challenges with Large Language Models in Radiology: The Road Ahead. AJNR Am J Neuroradiol. 2025. PMID: 39572201. doi:10.3174/ajnr.A8589
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。