文献速递生殖医学

混合人工智能模型利用多中心临床数据改善跨时差成像系统的胎心妊娠预测

A hybrid artificial intelligence model leverages multi-centric clinical data to improve fetal heart rate pregnancy prediction across time-lapse systems.
PubMed 文献 · Hum Reprod · 2023-01-01

本研究利用来自14个欧洲生育中心、5226例患者的9986枚胚胎数据,训练并验证了一种结合时差成像视频与31项临床特征的混合AI模型。该混合模型预测临床妊娠(胎心搏动)的平均AUC为0.727,显著高于仅用视频模型的0.684(P=0.015),且优于13名资深胚胎学家的表现。

要点

  • 混合模型平均AUC 0.727,显著高于视频模型的0.684(P=0.015)。
  • 混合模型在平衡准确率等指标上优于资深胚胎学家(P≤0.003)。
  • 模型预测性能在不同时差成像系统和不同发育阶段移植胚胎间无差异。

核心结论

  • 考虑临床数据可改善妊娠预测性能,除非各诊所操作差异极大,否则无需在诊所层面重新训练算法。

研究设计与样本

  • 使用来自14个欧洲生育中心(两个国家)、5226例患者的9986枚胚胎数据(95.60%已知临床妊娠结局,32.47%为冻融移植),采用三种不同时差成像系统记录,收集31项临床因素,训练并验证算法。

主要发现

  • 混合模型7折验证的平均AUC为0.727,显著高于视频模型的0.684(P=0.015;Wilcoxon检验)。
  • SHAP分析显示预测妊娠最重要的前六项特征依次为:胚胎形态动力学(视频评分)、卵母细胞年龄、促性腺激素总剂量、获胚数、获卵数和子宫内膜厚度。
  • 在平衡准确率等指标上,混合模型优于胚胎学家(P≤0.003;Wilcoxon检验)。
  • 混合模型评分与妊娠可能性呈线性相关,比值比随评分增加而升高(最大P值=0.001)。
  • 在诊所留出实验中,AUC范围为0.63至0.73;混合模型对年龄大于35岁的患者(P<0.001;Mann-Whitney检验)和新鲜移植(P<0.001;Mann-Whitney检验)表现更好。

临床怎么用

  • 作者认为,该AI模型可广泛使用,帮助胚胎学家在多种临床场景中标准化操作。
  • 作者认为,除非诊所操作差异极大,否则无需在诊所层面重新训练算法。

局限性

  • 参与中心位于两个国家,限制了结论推广至更广泛患者亚群。
  • 并非所有胚胎均具备全部临床特征,在某些情况下限制了混合模型的性能。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

STUDY QUESTION: Can artificial intelligence (AI) algorithms developed to assist embryologists in evaluating embryo morphokinetics be enriched with multi-centric clinical data to better predict clinical pregnancy outcome? SUMMARY ANSWER: Training algorithms on multi-centric clinical data significantly increased AUC compared to algorithms that only analyzed the time-lapse system (TLS) videos. WHAT IS KNOWN ALREADY: Several AI-based algorithms have been developed to predict pregnancy, most of them based only on analysis of the time-lapse recording of embryo development. It remains unclear, however, whether considering numerous clinical features can improve the predictive performances of time-lapse based embryo evaluation. STUDY DESIGN, SIZE, DURATION: A dataset of 9986 embryos (95.60% known clinical pregnancy outcome, 32.47% frozen transfers) from 5226 patients from 14 European fertility centers (in two countries) recorded with three different TLS was used to train and validate the algorithms. A total of 31 clinical factors were collected. A separate test set (447 videos) was used to compare performances between embryologists and the algorithm. PARTICIPANTS/MATERIALS, SETTING, METHODS: Clinical pregnancy (defined as a pregnancy leading to a fetal heartbeat) outcome was first predicted using a 3D convolutional neural network that analyzed videos of the embryonic development up to 2 or 3 days of development (33% of the database) or up to 5 or 6 days of development (67% of the database). The output video score was then fed as input alongside clinical features to a gradient boosting algorithm that generated a second score corresponding to the hybrid model. AUC was computed across 7-fold of the validation dataset for both models. These predictions were compared to those of 13 senior embryologists made on the test dataset. MAIN RESULTS AND THE ROLE OF CHANCE: The average AUC of the hybrid model across all 7-fold was significantly higher than that of the video model (0.727 versus 0.684, respectively, P = 0.015; Wilcoxon test). A SHapley Additive exPlanations (SHAP) analysis of the hybrid model showed that the six first most important features to predict pregnancy were morphokinetics of the embryo (video score), oocyte age, total gonadotrophin dose intake, number of embryos generated, number of oocytes retrieved, and endometrium thickness. The hybrid model was shown to be superior to embryologists with respect to different metrics, including the balanced accuracy (P ≤ 0.003; Wilcoxon test). The likelihood of pregnancy was linearly linked to the hybrid score, with increasing odds ratio (maximum P-value = 0.001), demonstrating the ranking capacity of the model. Training individual hybrid models did not improve predictive performance. A clinic hold-out experiment was conducted and resulted in AUCs ranging between 0.63 and 0.73. Performance of the hybrid model did not vary between TLS or between subgroups of embryos transferred at different days of embryonic development. The hybrid model did fare better for patients older than 35 years (P < 0.001; Mann-Whitney test), and for fresh transfers (P < 0.001; Mann-Whitney test). LIMITATIONS, REASONS FOR CAUTION: Participant centers were located in two countries, thus limiting the generalization of our conclusion to wider subpopulations of patients. Not all clinical features were available for all embryos, thus limiting the performances of the hybrid model in some instances. WIDER IMPLICATIONS OF THE FINDINGS: Our study suggests that considering clinical data improves pregnancy predictive performances and that there is no need to retrain algorithms at the clinic level unless they follow strikingly different practices. This study characterizes a versatile AI algorithm with similar performance on different time-lapse microscopes and on embryos transferred at different development stages. It can also help with patients of different ages and protocols used but with varying performances, presumably because the task of predicting fetal heartbeat becomes more or less hard depending on the clinical context. This AI model can be made widely available and can help embryologists in a wide range of clinical scenarios to standardize their practices. STUDY FUNDING/COMPETING INTEREST(S): Funding for the study was provided by ImVitro with grant funding received in part from BPIFrance (Bourse French Tech Emergence (DOS0106572/00), Paris Innovation Amorçage (DOS0132841/00), and Aide au Développement DeepTech (DOS0152872/00)). A.B.-C. is a co-owner of, and holds stocks in, ImVitro SAS. A.B.-C. and F.D.M. hold a patent for 'Devices and processes for machine learning prediction of in vitro fertilization' (EP20305914.2). A.D., N.D., M.M.F., and F.D.M. are or have been employees of ImVitro and have been granted stock options. X.P.-V. has been paid as a consultant to ImVitro and has been granted stocks options of ImVitro. L.C.-D. and C.G.-S. have undertaken paid consultancy for ImVitro SAS. The remaining authors have no conflicts to declare. TRIAL REGISTRATION NUMBER: N/A.

来源:Hum Reprod,查看原文。版权归原作者所有。

引用

  1. Duval A, Nogueira D, Dissler N, et al. A hybrid artificial intelligence model leverages multi-centric clinical data to improve fetal heart rate pregnancy prediction across time-lapse systems. Hum Reprod. 2023. PMID: 36763673. doi:10.1093/humrep/dead023

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。