文献速递生殖医学

生成式人工智能生成高保真囊胚期胚胎图像

Generative artificial intelligence to produce high-fidelity blastocyst-stage embryo images.
PubMed 文献 · Hum Reprod · 2024-01-01

本研究使用公共延时显微视频数据集中的136个视频,提取972张囊胚图像,微调基于风格的生成对抗网络,并用FID、KID和视觉图灵测试评估生成图像的质量与保真度。结果显示,AUG+Pretrained-R模型在评估的五种配置中表现最佳,FID为15.2、KID为0.004;胚胎学家、实验室技术员与非专家在特异性上表现相近。

要点

  • 生成式AI模型能够生成高保真人类囊胚图像,可用于构建训练数据集
  • AUG+Pretrained-R模型在5000次训练迭代后FID为15.2、KID为0.004
  • 视觉图灵测试中,不同背景评估者的特异性相近,准确性与敏感性存在边际差异

核心结论

  • 生成式AI模型具备生成高保真人类囊胚图像的能力,可提供充足的训练数据集,有助于开发稳健的AI模型并保护患者数据隐私。

研究设计与样本

  • 研究纳入公共延时显微(TLM)视频数据集中的囊胚图像(n=136),将基于风格的生成对抗网络(GAN)微调为生成模型。
  • 训练数据共整理972张囊胚图像,帧取自授精后110-120小时时间窗内、间隔1小时的TLM视频。
  • 模型配置数据增强(AUG)与预训练权重(Pretrained-T:平移等变;Pretrained-R:平移与旋转等变)进行比较。
  • 采用FID与KID评估生成图像质量与保真度,并通过视觉图灵测试评估模型的智能行为。
  • 60名具有临床胚胎学与IVF不同背景和专长的人员评估合成胚胎图像质量。

主要发现

  • 训练过程中,FID与KID评分显示图像质量持续改善。
  • Pretrained与AUG+Pretrained的初始FID和KID值显著低于Baseline与AUG+Baseline模型。
  • 5000次训练迭代后,AUG+Pretrained-R模型在评估的五种配置中表现最佳,FID为15.2、KID为0.004。
  • 视觉图灵测试中,IVF胚胎学家、IVF实验室技术员与非专家评估合成囊胚期胚胎图像,特异性表现相近,准确性与敏感性存在边际差异。

关键数值与推荐

  • AUG+Pretrained-R模型5000次训练迭代后FID为15.2、KID为0.004。
  • 训练图像统一调整为256×256像素分辨率以控制基于风格GAN模型的计算成本。

临床怎么用

  • 作者认为,生成式AI模型在生成高保真人类囊胚图像方面具有前景,可提供充足训练数据并保护患者数据隐私。
  • 作者认为,这有助于生成具有不同(罕见)异常特征的充足胚胎影像训练数据,如胚胎停育、三极细胞分裂,以避免类别不平衡并达到数据集均衡。
  • 作者认为,生成模型可能为改变胚胎选择流程、显著提升IVF结局提供有吸引力的机会。

局限性

  • 本研究训练数据主要集中于囊胚图像,因IVF胚胎主要在囊胚阶段评估。
  • 生成不同植入前阶段的一系列图像可进一步了解植入前胚胎发育与IVF成功。
  • 训练图像被调整为256×256像素分辨率,以控制基于风格GAN模型训练的计算成本。
  • 需要进一步研究纳入从合子形成到囊胚阶段的更广泛多样数据集,例如视频生成,并使用改进的图像分辨率。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

STUDY QUESTION: Can generative artificial intelligence (AI) models produce high-fidelity images of human blastocysts? SUMMARY ANSWER: Generative AI models exhibit the capability to generate high-fidelity human blastocyst images, thereby providing substantial training datasets crucial for the development of robust AI models. WHAT IS KNOWN ALREADY: The integration of AI into IVF procedures holds the potential to enhance objectivity and automate embryo selection for transfer. However, the effectiveness of AI is limited by data scarcity and ethical concerns related to patient data privacy. Generative adversarial networks (GAN) have emerged as a promising approach to alleviate data limitations by generating synthetic data that closely approximate real images. STUDY DESIGN, SIZE, DURATION: Blastocyst images were included as training data from a public dataset of time-lapse microscopy (TLM) videos (n = 136). A style-based GAN was fine-tuned as the generative model. PARTICIPANTS/MATERIALS, SETTING, METHODS: We curated a total of 972 blastocyst images as training data, where frames were captured within the time window of 110-120 h post-insemination at 1-h intervals from TLM videos. We configured the style-based GAN model with data augmentation (AUG) and pretrained weights (Pretrained-T: with translation equivariance; Pretrained-R: with translation and rotation equivariance) to compare their optimization on image synthesis. We then applied quantitative metrics including Fréchet Inception Distance (FID) and Kernel Inception Distance (KID) to assess the quality and fidelity of the generated images. Subsequently, we evaluated qualitative performance by measuring the intelligence behavior of the model through the visual Turing test. To this end, 60 individuals with diverse backgrounds and expertise in clinical embryology and IVF evaluated the quality of synthetic embryo images. MAIN RESULTS AND THE ROLE OF CHANCE: During the training process, we observed consistent improvement of image quality that was measured by FID and KID scores. Pretrained and AUG + Pretrained initiated with remarkably lower FID and KID values compared to both Baseline and AUG + Baseline models. Following 5000 training iterations, the AUG + Pretrained-R model showed the highest performance of the evaluated five configurations with FID and KID scores of 15.2 and 0.004, respectively. Subsequently, we carried out the visual Turing test, such that IVF embryologists, IVF laboratory technicians, and non-experts evaluated the synthetic blastocyst-stage embryo images and obtained similar performance in specificity with marginal differences in accuracy and sensitivity. LIMITATIONS, REASONS FOR CAUTION: In this study, we primarily focused the training data on blastocyst images as IVF embryos are primarily assessed in blastocyst stage. However, generation of an array of images in different preimplantation stages offers further insights into the development of preimplantation embryos and IVF success. In addition, we resized training images to a resolution of 256 × 256 pixels to moderate the computational costs of training the style-based GAN models. Further research is needed to involve a more extensive and diverse dataset from the formation of the zygote to the blastocyst stage, e.g. video generation, and the use of improved image resolution to facilitate the development of comprehensive AI algorithms and to produce higher-quality images. WIDER IMPLICATIONS OF THE FINDINGS: Generative AI models hold promising potential in generating high-fidelity human blastocyst images, which allows the development of robust AI models as it can provide sufficient training datasets while safeguarding patient data privacy. Additionally, this may help to produce sufficient embryo imaging training data with different (rare) abnormal features, such as embryonic arrest, tripolar cell division to avoid class imbalances and reach to even datasets. Thus, generative models may offer a compelling opportunity to transform embryo selection procedures and substantially enhance IVF outcomes. STUDY FUNDING/COMPETING INTEREST(S): This study was supported by a Horizon 2020 innovation grant (ERIN, grant no. EU952516) and a Horizon Europe grant (NESTOR, grant no. 101120075) of the European Commission to A.S. and M.Z.E., the Estonian Research Council (grant no. PRG1076) to A.S., and the EVA (Erfelijkheid Voortplanting & Aanleg) specialty program (grant no. KP111513) of Maastricht University Medical Centre (MUMC+) to M.Z.E. TRIAL REGISTRATION NUMBER: Not applicable.

来源:Hum Reprod,查看原文。版权归原作者所有。

引用

  1. Cao P, Derhaag J, Coonen E, et al. Generative artificial intelligence to produce high-fidelity blastocyst-stage embryo images. Hum Reprod. 2024. PMID: 38600621. doi:10.1093/humrep/deae064

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。