文献速递生殖医学

人工智能模型在体外受精胚胎选择中的稳定性与可靠性

Stability and reliability of artificial intelligence models in embryo selection for in vitro fertilization.
PubMed 文献 · Fertil Steril · 2025-08-26

本研究评估人工智能(AI)模型在体外受精(IVF)胚胎选择与排序中的稳定性与可靠性。训练50个初始化参数不同的卷积神经网络,在两个独立生殖中心数据集(马萨诸塞总医院1258例患者10713枚胚胎;康奈尔53例患者648枚胚胎)上测试。模型胚胎排序一致性差(肯德尔W约0.35),关键错误率约15%,模型间变异大,跨中心测试时误差方差增量为46.07%²。

要点

  • 50个卷积神经网络模型胚胎排序一致性差,肯德尔W约0.35。
  • 关键错误率约15%,常将低质量胚胎排在可存活胚胎之前。
  • 模型间变异大,跨中心测试误差方差增量为46.07%²。

核心结论

  • 单实例学习AI模型用于IVF胚胎选择表现出显著的不稳定性和不一致性,削弱其临床可靠性。
  • 模型间高变异和关键错误率引发对其实际部署适用性的担忧。
  • 研究强调需要更稳定的AI框架和针对IVF临床需求的稳健评估指标。

研究设计与样本

  • 基于实验室的研究,评估单实例学习模型的稳定性和一致性。
  • 训练并测试50个初始化参数不同的卷积神经网络。
  • 使用马萨诸塞总医院(1258例患者,10713枚胚胎)和康奈尔生殖中心(53例患者,648枚胚胎)的回顾性胚胎数据集。

主要发现

  • AI模型胚胎排序一致性差,肯德尔W约0.35。
  • 关键错误率约15%,常将低质量胚胎排在可存活胚胎之前。
  • 即使预测准确率相似(曲线下面积约60%),模型间仍存在显著变异。
  • 在另一生殖中心数据上测试时,模型不稳定性增加(误差方差增量46.07%²)。
  • 可解释性分析显示,尽管架构和训练方案相同,重复模型间决策策略存在分歧。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: To evaluate the stability and reliability of artificial intelligence (AI) models and approaches in embryo selection and rank ordering for in vitro fertilization (IVF). DESIGN: A laboratory-based study evaluating the stability and consistency of single instance learning models that assess embryos individually, predicting live-birth outcomes based solely on each embryo's morphological features. Fifty replicate convolutional neural networks with varying initialization parameters were trained and tested across two independent fertility center datasets. Model performance was assessed through embryo rank ordering, critical error rates, and intermodel variability. Interpretability analyses using gradient-weighted class activation mapping and t-distributed stochastic neighbor embedding were conducted to explore decision-making discrepancies among replicate models. SUBJECTS: The study utilized retrospective embryo datasets from Massachusetts General Hospital and Weill Cornell Fertility Center, including images from 1,258 patients and 10,713 embryos from Massachusetts General Hospital, and 53 patients with 648 embryos from Cornell. MAIN OUTCOME MEASURES: Consistency in embryo ranking (Kendall's W), frequency of critical errors (instances where low-quality embryos were top-ranked), and intermodel variability across datasets. RESULTS: The AI models demonstrated poor consistency in embryo rank ordering (Kendall's W approximately 0.35) and exhibited high critical error rates (approximately 15%), often ranking lower-quality embryos above viable ones. Significant intermodel variability was observed even among models with similar predictive accuracies (area under curve approximately 60%). When tested on data from a different fertility center, model instability increased (error variance delta: 46.07%2), highlighting sensitivity to distribution shifts. Interpretability analyses revealed divergent decision-making strategies among replicate models, despite identical architectures and training protocols. CONCLUSION: Single instance learning AI models for IVF embryo selection exhibit substantial instability and inconsistency, undermining their clinical reliability. High intermodel variability and critical error rates raise concerns about their suitability for real-world deployment. This study highlights the need for more stable AI frameworks and robust evaluation metrics tailored to the clinical demands of IVF.

来源:Fertil Steril,查看原文。版权归原作者所有。

引用

  1. Thirumalaraju P, Kanakasabapathy MK, Kandula H, et al. Stability and reliability of artificial intelligence models in embryo selection for in vitro fertilization. Fertil Steril. 2025. PMID: 40876725. doi:10.1016/j.fertnstert.2025.08.021

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。