多机构验证:简易与机器学习方法改进膀胱输尿管反流评估
该研究从本机构收集排尿性膀胱尿道造影用于训练,并从5个外部数据集验证,由5至7名评分者确定共识膀胱输尿管反流分级,评估输尿管迂曲及近端、远端和最大扩张4个特征。机器学习模型qVUR预测反流分级AUROC=0.84,准确率0.62,可靠性较传统分级提高3.6倍(P<.001),但定量指标的附加预后价值需进一步研究。
要点
- 传统膀胱输尿管反流分级评分者间可靠性仅0.44,中位一致率0.71。
- 4个特征值越高,膀胱输尿管反流分级越高。
- qVUR准确率0.62(AUROC=0.84),可靠性较传统分级提高3.6倍(P<.001)。
核心结论
- 在多机构大型儿童人群中,基于机器学习的膀胱输尿管反流评估较现行分级方法提高了可靠性。
- qVUR具有泛化性和稳健性,准确性与临床医生相似,但定量指标的附加预后价值需进一步研究。
研究设计与样本
- 从本机构收集排尿性膀胱尿道造影用于训练,并从5个外部数据集进行验证。
- 每份排尿性膀胱尿道造影由5至7名评分者分级以确定共识膀胱输尿管反流分级标签,并评估评分者间和评分者内可靠性。
- 共收集1,492个肾脏和输尿管,产生8,230次独立分级。
主要发现
- 膀胱输尿管反流分级的内部评分者间可靠性为0.44,中位一致率为0.71,评分者内可靠性低。
- 4个特征(输尿管迂曲、近端扩张、远端扩张和最大扩张)值越高,膀胱输尿管反流分级越高。
- qVUR准确率为0.62(AUROC=0.84),在所有外部数据集中性能稳定。
- qVUR较传统分级将膀胱输尿管反流分级可靠性提高3.6倍(P<.001)。
临床怎么用
- 原文未据此给出推荐。
局限性
- 定量指标的附加预后价值需进一步研究。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
PURPOSE: Vesicoureteral reflux grading from voiding cystourethrograms is highly subjective with low reliability. We aimed to demonstrate improved reliability for vesicoureteral reflux grading with simple and machine learning approaches using ureteral tortuosity and dilatation on voiding cystourethrograms. MATERIALS AND METHODS: Voiding cystourethrograms were collected from our institution for training and 5 external data sets for validation. Each voiding cystourethrogram was graded by 5-7 raters to determine a consensus vesicoureteral reflux grade label and inter- and intra-rater reliability was assessed. Each voiding cystourethrogram was assessed for 4 features: ureteral tortuosity, proximal, distal, and maximum ureteral dilatation. The labels were then assigned to the combination of the 4 features. A machine learning-based model, qVUR, was trained to predict vesicoureteral reflux grade from these features and model performance was assessed by AUROC (area under the receiver-operator-characteristic). RESULTS: A total of 1,492 kidneys and ureters were collected from voiding cystourethrograms resulting in a total of 8,230 independent gradings. The internal inter-rater reliability for vesicoureteral reflux grading was 0.44 with a median percent agreement of 0.71 and low intra-rater reliability. Higher values for each feature were associated with higher vesicoureteral reflux grade. qVUR performed with an accuracy of 0.62 (AUROC=0.84) with stable performance across all external data sets. The model improved vesicoureteral reflux grade reliability by 3.6-fold compared to traditional grading (P < .001). CONCLUSIONS: In a large pediatric population from multiple institutions, we show that machine learning-based assessment for vesicoureteral reflux improves reliability compared to current grading methods. qVUR is generalizable and robust with similar accuracy to clinicians but the added prognostic value of quantitative measures warrants further study.
引用
- Khondker A, Kwong JCC, Yadav P, et al. Multi-institutional Validation of Improved Vesicoureteral Reflux Assessment With Simple and Machine Learning Approaches. J Urol. 2022. PMID: 36215077. doi:10.1097/JU.0000000000002987
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。