生成对抗网络:放射科医师入门指南
该综述介绍生成对抗网络(GAN)的基本原理及其在放射学中的潜在应用。GAN由生成器和判别器两个神经网络联合优化、目标相反,可用于图像合成、加速采集、减少伪影、跨模态转换和异常识别。文中描述了条件GAN和循环一致GAN的原理,并讨论了临床潜力、未来应用及放射科医师应注意的陷阱。
要点
- GAN由生成器和判别器两个目标相反的神经网络联合优化组成。
- GAN可用于图像合成、加速采集、减少伪影和跨模态图像转换。
- 条件GAN和循环一致GAN是两类重要变体,需了解其原理与局限。
核心结论
- GAN作为深度学习方法在放射学中具有广泛的应用前景,包括图像合成、采集加速、伪影减少、跨模态转换和异常识别。
- 放射科医师应了解GAN的临床潜力、未来应用以及潜在的陷阱和注意事项。
研究设计与样本
- 本文为综述,介绍GAN和对抗深度学习方法及其在放射学图像分析中的应用。
- 文中提供了不同成像模态和任务的GAN应用示例,并讨论条件GAN和循环一致GAN的原理。
临床应用与阅片要点
- 放射科医师应了解GAN可用于图像合成、图像采集加速、伪影减少、跨模态图像转换和异常识别等任务。
- 在日常阅片和报告中需注意GAN应用的潜在陷阱和注意事项。
局限性
- 本文为综述,未报告原始研究的样本量、中心数或诊断效能数值。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
Artificial intelligence techniques involving the use of artificial neural networks-that is, deep learning techniques-are expected to have a major effect on radiology. Some of the most exciting applications of deep learning in radiology make use of generative adversarial networks (GANs). GANs consist of two artificial neural networks that are jointly optimized but with opposing goals. One neural network, the generator, aims to synthesize images that cannot be distinguished from real images. The second neural network, the discriminator, aims to distinguish these synthetic images from real images. These deep learning models allow, among other applications, the synthesis of new images, acceleration of image acquisitions, reduction of imaging artifacts, efficient and accurate conversion between medical images acquired with different modalities, and identification of abnormalities depicted on images. The authors provide an introduction to GANs and adversarial deep learning methods. In addition, the different ways in which GANs can be used for image synthesis and image-to-image translation tasks, as well as the principles underlying conditional GANs and cycle-consistent GANs, are described. Illustrated examples of GAN applications in radiologic image analysis for different imaging modalities and different tasks are provided. The clinical potential of GANs, future clinical GAN applications, and potential pitfalls and caveats that radiologists should be aware of also are discussed in this review. The online slide presentation from the RSNA Annual Meeting is available for this article. ©RSNA, 2021.
引用
- Wolterink JM, Mukhopadhyay A, Leiner T, et al. Generative Adversarial Networks: A Primer for Radiologists. Radiographics. 2021. PMID: 33891522. doi:10.1148/rg.2021200151
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。