AI能否区分骨X线片与花或车的照片?骨龄深度学习模型在不适当输入下的评估
评估一个公开可用的深度卷积神经网络骨龄应用在放射学和非放射学不适当输入下的行为。该应用对50张左手X线片和七类不适当图像均计算了骨龄,未能区分适当与不适当输入,平均推理时间均为1.1秒(p=1)。结论提示自动化骨龄判断需在数据输入和验证阶段进行适当监督。
要点
- DCNN骨龄应用对不适当图像(如胸片、街景数字)仍输出骨龄值,无法识别输入错误。
- 所有类别平均推理时间均为1.1秒,输入类型不影响处理速度。
- 自动化骨龄流程需在输入和输出阶段人工核查,避免未识别的错误结果。
关键影像表现/征象
- 应用对所有儿童手部X线片均计算骨龄,平均推理时间1.1秒。
- 应用未区分儿童手部X线片与不适当图像类型(包括放射学和非放射学领域)。
- 应用对所有不适当图像类型均不恰当地计算骨龄,各类型平均推理时间均为1.1秒(p=1)。
临床应用与阅片要点
- 日常阅片或自动化骨龄报告中,需在数据输入阶段确认图像类型正确,避免非手部X线片被误分析。
- 对DCNN输出应进行验证,警惕不适当输入导致的未识别错误结果。
局限性
- 仅评估了一个公开可用的DCNN骨龄应用,结论外推需谨慎。
- 样本量有限(50张适当图像及七类不适当图像),未报告不适当图像的具体数量。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVE: To evaluate the behavior of a publicly available deep convolutional neural network (DCNN) bone age algorithm when presented with inappropriate data inputs in both radiological and non-radiological domains.
METHODS: We evaluated a publicly available DCNN-based bone age application. The DCNN was trained on 12,612 pediatric hand radiographs and won the 2017 RSNA Pediatric Bone Age Challenge (concordance of 0.991 with radiologist ground-truth). We used the application to analyze 50 left-hand radiographs (appropriate data inputs) and seven classes of inappropriate data inputs in radiological (i.e., chest radiographs) and non-radiological (i.e., image of street numbers) domains. For each image, we noted if (1) the application distinguished between appropriate and inappropriate data inputs and (2) inference time per image. Mean inference times were compared using ANOVA.
RESULTS: The 16Bit Bone Age application calculated bone age for all pediatric hand radiographs with mean inference time of 1.1 s. The application did not distinguish between pediatric hand radiographs and inappropriate image types, including radiological and non-radiological domains. The application inappropriately calculated bone age for all inappropriate image types, with mean inference time of 1.1 s for all categories (p = 1).
CONCLUSION: A publicly available DCNN-based bone age application failed to distinguish between appropriate and inappropriate data inputs and calculated bone age for inappropriate images. The awareness of inappropriate outputs based on inappropriate DCNN input is important if tasks such as bone age determination are automated, emphasizing the need for appropriate oversight at the data input and verification stage to avoid unrecognized erroneous results.
引用
- Yi PH, Arun A, Hafezi-Nejad N, et al. Can AI distinguish a bone radiograph from photos of flowers or cars? Evaluation of bone age deep learning model on inappropriate data inputs. Skeletal Radiol. 2021. PMID: 34351456. doi:10.1007/s00256-021-03880-y
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。