深度学习算法用于儿童中耳感染诊断的「人机对比」验证
该回顾性队列研究比较了人类临床医生与神经网络算法在儿童鼓膜图像诊断中的表现。模型在区分正常、非化脓性和化脓性积液时平均预测准确率为80.8%(95%CI 77.0%-84.6%),Google商业模型为85.4%;在22张内镜耳图像验证集中,39名临床医生平均诊断准确率为65.0%,而本模型达95.5%。
要点
- 本模型平均预测准确率80.8%(95%CI 77.0%-84.6%),Google模型为85.4%。
- 39名临床医生在22张内镜耳图像上平均诊断准确率为65.0%,本模型在同一数据集上为95.5%。
- 作者认为机器学习模型减少诊断错误可能有助于减少误诊、漏诊、不必要抗生素处方和手术。
核心结论
- 本模型在评估儿童鼓膜积液图像时优于某些组别的人类临床医生。
研究设计与样本
- 回顾性队列研究,2018年至2021年在一家三级学术医疗中心开展。
主要发现
- 本模型平均预测准确率为80.8%(95%CI 77.0%-84.6%)。
- Google模型预测准确率为85.4%。
- 39名临床医生在22张内镜耳图像样本上的平均诊断准确率为65.0%,本模型在同一数据集上准确率为95.5%。
关键数值与推荐
- 训练集为639张鼓膜图像,代表正常、渗出性中耳炎(OME)和急性中耳炎(AOM)。
- 模型诊断预测性能按分类准确率评分,区分正常、非化脓性和化脓性积液。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: We compared the diagnostic performance of human clinicians with that of a neural network algorithm developed using a library of tympanic membrane images derived from children taken to the operating room with the intent of performing myringotomy and possible tube placement for recurrent acute otitis media (AOM) or otitis media with effusion (OME). STUDY DESIGN: Retrospective cohort study. SETTING: Tertiary academic medical center from 2018 to 2021. METHODS: A training set of 639 images of tympanic membranes representing normal, OME, and AOM was used to train a neural network as well as a proprietary commercial image classifier from Google. Model diagnostic prediction performance in differentiating normal vs nonpurulent vs purulent effusion was scored based on classification accuracy. A web-based survey was developed to test human clinicians' diagnostic accuracy on a novel image set, and this was compared head to head against our model. RESULTS: Our model achieved a mean prediction accuracy of 80.8% (95% CI, 77.0%-84.6%). The Google model achieved a prediction accuracy of 85.4%. In a validation survey of 39 clinicians analyzing a sample of 22 endoscopic ear images, the average diagnostic accuracy was 65.0%. On the same data set, our model achieved an accuracy of 95.5%. CONCLUSION: Our model outperformed certain groups of human clinicians in assessing images of tympanic membranes for effusions in children. Reduced diagnostic error rates using machine learning models may have implications in reducing rates of misdiagnosis, potentially leading to fewer missed diagnoses, unnecessary antibiotic prescriptions, and surgical procedures.
引用
- Crowson MG, Bates DW, Suresh K, et al. "Human vs Machine" Validation of a Deep Learning Algorithm for Pediatric Middle Ear Infection Diagnosis. Otolaryngol Head Neck Surg. 2023. PMID: 35972815. doi:10.1177/01945998221119156
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。