使用神经网络对溃疡性结肠炎临床试验视频进行中心判读
研究前瞻性收集14个国家249例患者参与米吉珠单抗2期试验的795段全长内镜视频,训练卷积与循环神经网络从视频预测内镜Mayo评分和UCEIS。模型与人类中心判读者的一致性优异,eMS的二次加权kappa为0.844,UCEIS为0.855。
要点
- 深度学习算法可从全长内镜视频预测溃疡性结肠炎内镜严重程度。
- 模型与人类中心判读者的一致性:eMS的QWK为0.844,UCEIS为0.855。
- 数据来自跨国临床试验的前瞻性收集,使用视频而非静态图像。
核心结论
- 深度学习算法可经训练从全长内镜视频预测溃疡性结肠炎严重程度。
- 模型性能指标达到或超过既往发表的溃疡性结肠炎严重程度评分机器学习算法。
研究设计与样本
- 视频来自米吉珠单抗2期试验,由专家中心判读者为每段视频各指定1个内镜Mayo评分和1个UCEIS评分。
- 先用卷积神经网络清洗视频数据并提取异常特征,再用循环神经网络基于特征从单段全长视频预测eMS和UCEIS。
主要发现
- 主要评价指标为二次加权kappa,比较机器判读与人类中心判读者评分的一致性。
- 模型对eMS的QWK为0.844(95%CI 0.787-0.901)。
- 模型对UCEIS的QWK为0.855(95%CI 0.80-0.91)。
关键数值与推荐
- 二次加权kappa对超过1个等级的不一致逐步加大惩罚。
- eMS一致性QWK为0.844(95%CI 0.787-0.901),UCEIS为0.855(95%CI 0.80-0.91)。
临床怎么用
- 原文未据此给出临床推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND AIMS: Endoscopic disease activity scoring in ulcerative colitis (UC) is useful in clinical practice but done infrequently. It is required in clinical trials, where it is expensive and slow because human central readers are needed. A machine learning algorithm automating the process could elevate clinical care and facilitate clinical research. Prior work using single-institution databases and endoscopic still images has been promising. METHODS: Seven hundred and ninety-five full-length endoscopy videos were prospectively collected from a phase 2 trial of mirikizumab with 249 patients from 14 countries, totaling 19.5 million image frames. Expert central readers assigned each full-length endoscopy videos 1 endoscopic Mayo score (eMS) and 1 Ulcerative Colitis Endoscopic Index of Severity (UCEIS) score. Initially, video data were cleaned and abnormality features extracted using convolutional neural networks. Subsequently, a recurrent neural network was trained on the features to predict eMS and UCEIS from individual full-length endoscopy videos. RESULTS: The primary metric to assess the performance of the recurrent neural network model was quadratic weighted kappa (QWK) comparing the agreement of the machine-read endoscopy score with the human central reader score. QWK progressively penalizes disagreements that exceed 1 level. The model's agreement metric was excellent, with a QWK of 0.844 (95% confidence interval, 0.787-0.901) for eMS and 0.855 (95% confidence interval, 0.80-0.91) for UCEIS. CONCLUSIONS: We found that a deep learning algorithm can be trained to predict levels of UC severity from full-length endoscopy videos. Our data set was prospectively collected in a multinational clinical trial, videos rather than still images were used, UCEIS and eMS were reported, and machine learning algorithm performance metrics met or exceeded those previously published for UC severity scores.
引用
- Gottlieb K, Requa J, Karnes W, et al. Central Reading of Ulcerative Colitis Clinical Trial Videos Using Neural Networks. Gastroenterology. 2020. PMID: 33098883. doi:10.1053/j.gastro.2020.10.024
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。