人工智能在骨科创伤影像骨折检测与分类中的应用与局限:一项系统综述
该系统综述检索了PubMed、Embase和Cochrane数据库至2018年9月6日,纳入10项研究,评估人工智能在骨折检测与分类中的性能。骨折检测的AUC在5项研究中为0.95-1.0,准确率在7项研究中为83%-98%;骨折分类的AUC在1项研究中为0.94,准确率在2项研究中为77%-90%。两项研究中AI在髋部与肱骨近端骨折的检测和分类上优于人类检查者,一项研究显示在腕部、手部和踝部骨折检测上性能相当。
要点
- 骨折检测的AUC在5项研究中为0.95-1.0,准确率在7项研究中为83%-98%。
- 骨折分类的AUC在1项研究中为0.94,准确率在2项研究中为77%-90%。
- 两项研究中AI在髋部与肱骨近端骨折的检测和分类上优于人类检查者。
核心结论
- 使用AI进行骨折检测和分类的初步经验显示出有希望的性能。
- AI可能增强医学中概率任务的处理和沟通,包括骨科手术。
- 目前,训练和测试AI的参考标准分配不足是整合到临床工作流程之前最大的障碍。
- 下一步将是在缺乏确定性的更具挑战性的诊断和治疗场景中应用AI。
- 未来研究还应寻求解决法律监管问题并更好地确定在临床实践中实施的可行性。
研究设计与样本
- 系统综述,检索PubMed、Embase和Cochrane数据库从各库起始至2018年9月6日,使用与「骨折」「人工智能」和「检测、预测或评估」相关的术语。
- 从1221项识别的研究中保留10项研究:8项涉及骨折检测(踝部、手部、髋部、脊柱、腕部和尺骨),1项涉及骨折分类(股骨干),1项同时涉及骨折检测和分类(肱骨近端)。
- 在数据收集前注册综述(PROSPERO: CRD42018110167),并使用PRISMA。
- 使用基于修改的非随机研究方法学指数工具(MINORS)的七项清单进行质量评估。
主要发现
- 骨折检测:5项研究的AUC反映接近完美预测(范围0.95-1.0),7项研究的准确率范围为83%至98%。
- 骨折分类:1项研究的AUC为0.94,2项研究的准确率范围为77%至90%。
- 两项研究中AI在检测和分类髋部与肱骨近端骨折方面优于人类检查者,一项研究显示在检测腕部、手部和踝部骨折方面性能相当。
关键数值与推荐
- AUC为1.0表示完美预测,而0.5表示预测不比抛硬币好。
- 骨折检测的AUC在5项研究中范围为0.95-1.0,准确率在7项研究中范围为83%-98%。
- 骨折分类的AUC在1项研究中为0.94,准确率在2项研究中范围为77%-90%。
临床怎么用
- 原文未据此给出推荐。
局限性
- 训练和测试AI的参考标准分配不足是整合到临床工作流程之前最大的障碍。
- 未来研究应寻求解决法律监管问题并更好地确定在临床实践中实施的可行性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Artificial-intelligence algorithms derive rules and patterns from large amounts of data to calculate the probabilities of various outcomes using new sets of similar data. In medicine, artificial intelligence (AI) has been applied primarily to image-recognition diagnostic tasks and evaluating the probabilities of particular outcomes after treatment. However, the performance and limitations of AI in the automated detection and classification of fractures has not been examined comprehensively. QUESTION/PURPOSES: In this systematic review, we asked (1) What is the proportion of correctly detected or classified fractures and the area under the receiving operating characteristic (AUC) curve of AI fracture detection and classification models? (2) What is the performance of AI in this setting compared with the performance of human examiners? METHODS: The PubMed, Embase, and Cochrane databases were systematically searched from the start of each respective database until September 6, 2018, using terms related to "fracture", "artificial intelligence", and "detection, prediction, or evaluation." Of 1221 identified studies, we retained 10 studies: eight studies involved fracture detection (ankle, hand, hip, spine, wrist, and ulna), one addressed fracture classification (diaphyseal femur), and one addressed both fracture detection and classification (proximal humerus). We registered the review before data collection (PROSPERO: CRD42018110167) and used the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA). We reported the range of the accuracy and AUC for the performance of the predicted fracture detection and/or classification task. An AUC of 1.0 would indicate perfect prediction, whereas 0.5 would indicate a prediction is no better than a flip-of-a-coin. We conducted quality assessment using a seven-item checklist based on a modified methodologic index for nonrandomized studies instrument (MINORS). RESULTS: For fracture detection, the AUC in five studies reflected near perfect prediction (range, 0.95-1.0), and the accuracy in seven studies ranged from 83% to 98%. For fracture classification, the AUC was 0.94 in one study, and the accuracy in two studies ranged from 77% to 90%. In two studies AI outperformed human examiners for detecting and classifying hip and proximal humerus fractures, and one study showed equivalent performance for detecting wrist, hand and ankle fractures. CONCLUSIONS: Preliminary experience with fracture detection and classification using AI shows promising performance. AI may enhance processing and communicating probabilistic tasks in medicine, including orthopaedic surgery. At present, inadequate reference standard assignments to train and test AI is the biggest hurdle before integration into clinical workflow. The next step will be to apply AI to more challenging diagnostic and therapeutic scenarios when there is absence of certitude. Future studies should also seek to address legal regulation and better determine feasibility of implementation in clinical practice. LEVEL OF EVIDENCE: Level II, diagnostic study.
引用
- Langerhuizen DWG, Janssen SJ, Mallee WH, et al. What Are the Applications and Limitations of Artificial Intelligence for Fracture Detection and Classification in Orthopaedic Trauma Imaging? A Systematic Review. Clin Orthop Relat Res. 2019. PMID: 31283727. doi:10.1097/CORR.0000000000000848
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。