文献速递儿科影像骨肌技术与安全DR

数据输入方式影响深度学习骨龄应用预测的一致性

Your mileage may vary: impact of data input method for a deep learning bone age app's predictions.
PubMed 文献 · Skeletal Radiol · 2021-09-03

本研究评估16Bit Bone Age应用在三种数据输入方式下预测骨龄的一致性,收集50张儿童手部X线片,由3名观察者分别用直接上传、读片室手机拍照和诊所手机拍照三种方式评估。结果显示直接上传和读片室拍照的观察者间一致性优秀(ICC分别为1.00和0.96),诊所拍照一致性良好(ICC=0.82);观察者内一致性因观察者而异(ICC分别为0.95、0.96和0.57)。不同输入方式可导致骨龄预测不一致。

要点

  • 直接上传图像时观察者间一致性最高(ICC=1.00),诊所手机拍照降至0.82。
  • 同一观察者跨输入方式的内部一致性可低至0.57,提示输入方式影响预测。
  • 使用深度学习骨龄应用时应优先直接上传原始图像,避免手机拍照。

诊断标准与关键数值

  • 观察者间一致性:直接上传ICC=1.00,读片室拍照ICC=0.96,诊所拍照ICC=0.82。
  • 观察者内一致性:三名观察者跨三种输入方式的ICC分别为0.95、0.96和0.57。

局限性

  • 样本量较小(50张图像),仅评估单一应用。
  • 未评估输入方式对骨龄预测准确性的影响,仅评估一致性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVE: The purpose of this study was to evaluate agreement in predictions made by a bone age prediction application ("app") among three data input methods.

METHODS: The 16Bit Bone Age app is a browser-based deep learning application for predicting bone age on pediatric hand radiographs; recommended data input methods are direct image file upload or smartphone-capture of image. We collected 50 hand radiographs, split equally among 5 bone age groups. Three observers used the 16Bit Bone Age app to assess these images using 3 different data input methods: (1) direct image upload, (2) smartphone photo of image in radiology reading room, and (3) smartphone photo of image in a clinic.

RESULTS: Interobserver agreement was excellent for direct upload (ICC = 1.00) and for photos in reading room (ICC = 0.96) and good for photos in clinic (ICC = 0.82), respectively. Intraobserver agreement for the entire test set across the 3 data input methods was variable with ICCs of 0.95, 0.96, and 0.57 for the 3 observers, respectively.

DISCUSSION: Our findings indicate that different data input methods can result in discordant bone age predictions from the 16Bit Bone Age app. Further study is needed to determine the impact of data input methods, such as smartphone image capture, on deep learning app performance and accuracy.

来源:Skeletal Radiol,查看原文。版权归原作者所有。

引用

  1. Yi PH, Yu AC, Dunn EA, et al. Your mileage may vary: impact of data input method for a deep learning bone age app's predictions. Skeletal Radiol. 2021. PMID: 34476558. doi:10.1007/s00256-021-03897-3

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。