深度学习检测系统对胸部X线片主要异常检出价值的随机交叉研究
该研究采用随机交叉设计,纳入回顾性收集的114例正常和114例异常胸部X线片,由6名观察者(含胸部放射科医师)分别在不使用和使用深度学习检测系统的情况下阅片。使用DLD系统后,观察者的JAFROC FOM从0.90提高至0.95,AUC从0.93提高至0.98,病灶水平敏感度从83%提高至89.1%,图像水平敏感度从80%提高至89%,特异度从89.3%提高至96.6%,阅片时间缩短。DLD系统单独表现优于汇总观察者(JAFROC FOM 0.96 vs 0.90)。
要点
- DLD系统辅助使JAFROC FOM从0.90升至0.95,AUC从0.93升至0.98,诊断准确性提高。
- 病灶水平敏感度从83%升至89.1%,图像水平敏感度从80%升至89%,特异度从89.3%升至96.6%。
- 阅片时间从10-65秒缩短至6-27秒,DLD系统单独表现优于汇总观察者。
局限性
- 原文未述局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
Background Previous studies assessing the effects of computer-aided detection on observer performance in the reading of chest radiographs used a sequential reading design that may have biased the results because of reading order or recall bias. Purpose To compare observer performance in detecting and localizing major abnormal findings including nodules, consolidation, interstitial opacity, pleural effusion, and pneumothorax on chest radiographs without versus with deep learning-based detection (DLD) system assistance in a randomized crossover design. Materials and Methods This study included retrospectively collected normal and abnormal chest radiographs between January 2016 and December 2017 (https://cris.nih.go.kr/; registration no. KCT0004147). The radiographs were randomized into two groups, and six observers, including thoracic radiologists, interpreted each radiograph without and with use of a commercially available DLD system by using a crossover design with a washout period. Jackknife alternative free-response receiver operating characteristic (JAFROC) figure of merit (FOM), area under the receiver operating characteristic curve (AUC), sensitivity, specificity, false-positive findings per image, and reading times of observers with and without the DLD system were compared by using McNemar and paired t tests. Results A total of 114 normal (mean patient age ± standard deviation, 51 years ± 11; 58 men) and 114 abnormal (mean patient age, 60 years ± 15; 75 men) chest radiographs were evaluated. The radiographs were randomized to two groups: group A (n = 114) and group B (n = 114). Use of the DLD system improved the observers' JAFROC FOM (from 0.90 to 0.95, P = .002), AUC (from 0.93 to 0.98, P = .002), per-lesion sensitivity (from 83% [822 of 990 lesions] to 89.1% [882 of 990 lesions], P = .009), per-image sensitivity (from 80% [548 of 684 radiographs] to 89% [608 of 684 radiographs], P = .009), and specificity (from 89.3% [611 of 684 radiographs] to 96.6% [661 of 684 radiographs], P = .01) and reduced the reading time (from 10-65 seconds to 6-27 seconds, P < .001). The DLD system alone outperformed the pooled observers (JAFROC FOM: 0.96 vs 0.90, respectively, P = .007; AUC: 0.98 vs 0.93, P = .003). Conclusion Observers including thoracic radiologists showed improved performance in the detection and localization of major abnormal findings on chest radiographs and reduced reading time with use of a deep learning-based detection system. © RSNA, 2021 Online supplemental material is available for this article.
引用
- Sung J, Park S, Lee SM, et al. Added Value of Deep Learning-based Detection System for Multiple Major Findings on Chest Radiographs: A Randomized Crossover Study. Radiology. 2021. PMID: 33754828. doi:10.1148/radiol.2021202818
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。