深度学习用于二尖瓣反流的超声分析、追踪与评估(DELINEATE-MR)
研究开发了一种端到端深度学习系统,输入完整经胸超声心动图,识别彩色二尖瓣反流多普勒视频,并以心内科读片医师为参考标准,按4级序数分类(无/微量、轻度、中度、重度)评估反流严重程度。系统在内部测试集(n=8987)和外部测试集(n=8208)中分类性能较高,内部精确准确率82%、κ=0.84,外部精确准确率79%、κ=0.80;对中度及以上反流的AUC均为0.98。
要点
- 深度学习系统可基于完整经胸超声心动图自动分类二尖瓣反流严重程度。
- 内部与外部测试集精确准确率分别为82%和79%,κ分别为0.84和0.80。
- 多数误分类发生在无/微量与轻度反流之间。
核心结论
- 端到端深度学习系统可输入完整超声心动图检查,较准确地对二尖瓣反流严重程度进行分类,可能有助于临床医师优化反流评估。
研究设计与样本
- 开发深度学习系统,输入完整经胸超声心动图,识别彩色二尖瓣反流多普勒视频,并以读片心内科医师为参考标准,按4级序数分类(无/微量、轻度、中度、重度)评估反流严重程度。
- 性能评估采用与读片医师的一致性、加权κ值,以及中度及以上和重度反流二分类的受试者工作特征曲线下面积。
- 另研究6级二尖瓣反流评估模型,增加轻度-中度和中度-重度两个中间类别,以精确一致性和±1级一致性评估性能。
主要发现
- 内部测试集精确准确率82%,κ=0.84,中度及以上二尖瓣反流AUC为0.98。
- 外部测试集精确准确率79%,κ=0.80,中度及以上二尖瓣反流AUC为0.98。
- 多数误分类不一致发生在无/微量与轻度二尖瓣反流之间(内部63%,外部66%)。
- 使用多个经胸超声心动图视图分类准确率82%,仅用心尖四腔视图为80%。
- 6级分类系统内部和外部测试集精确准确率分别为80%和76%,±1级一致性分别为99%和98%。
临床怎么用
- 该深度学习系统可辅助临床医师对二尖瓣反流严重程度进行初步或补充评估,尤其在需要快速筛查或分级时。
- 对无/微量与轻度反流的区分需谨慎,因其为多数误分类发生之处。
局限性
- 研究为回顾性设计,参考标准为读片心内科医师判读,非独立核心实验室或临床结局。
- 偏心性二尖瓣反流病例中模型性能略低。
- 外部测试集虽独立,但仍需在不同设备、人群和临床场景中进一步验证。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Artificial intelligence, particularly deep learning (DL), has immense potential to improve the interpretation of transthoracic echocardiography (TTE). Mitral regurgitation (MR) is the most common valvular heart disease and presents unique challenges for DL, including the integration of multiple video-level assessments into a final study-level classification. METHODS: A novel DL system was developed to intake complete TTEs, identify color MR Doppler videos, and determine MR severity on a 4-step ordinal scale (none/trace, mild, moderate, and severe) using the reading cardiologist as a reference standard. This DL system was tested in internal and external test sets with performance assessed by agreement with the reading cardiologist, weighted κ, and area under the receiver-operating characteristic curve for binary classification of both moderate or greater and severe MR. In addition to the primary 4-step model, a 6-step MR assessment model was studied with the addition of the intermediate MR classes of mild-moderate and moderate-severe with performance assessed by both exact agreement and ±1 step agreement with the clinical MR interpretation. RESULTS: A total of 61 689 TTEs were split into train (n=43 811), validation (n=8891), and internal test (n=8987) sets with an additional external test set of 8208 TTEs. The model had high performance in MR classification in internal (exact accuracy, 82%; κ=0.84; area under the receiver-operating characteristic curve, 0.98 for moderate or greater MR) and external test sets (exact accuracy, 79%; κ=0.80; area under the receiver-operating characteristic curve, 0.98 for moderate or greater MR). Most (63% internal and 66% external) misclassification disagreements were between none/trace and mild MR. MR classification accuracy was slightly higher using multiple TTE views (accuracy, 82%) than with only apical 4-chamber views (accuracy, 80%). In subset analyses, the model was accurate in the classification of both primary and secondary MR with slightly lower performance in cases of eccentric MR. In the analysis of the 6-step classification system, the exact accuracy was 80% and 76% with a ±1 step agreement of 99% and 98% in the internal and external test set, respectively. CONCLUSIONS: This end-to-end DL system can intake entire echocardiogram studies to accurately classify MR severity and may be useful in helping clinicians refine MR assessments.
引用
- Long A, Haggerty CM, Finer J, et al. Deep Learning for Echo Analysis, Tracking, and Evaluation of Mitral Regurgitation (DELINEATE-MR). Circulation. 2024. PMID: 38881496. doi:10.1161/CIRCULATIONAHA.124.068996
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。