文献速递泌尿生殖腹部MR

放射科住院医师与深度学习系统在前列腺癌检测中的伪前瞻性辅助临床互动:经验、性能及间歇性重新校准需求的识别

Pseudoprospective Paraclinical Interaction of Radiology Residents With a Deep Learning System for Prostate Cancer Detection: Experience, Performance, and Identification of the Need for Intermittent Recalibration.
PubMed 文献 · Invest Radiol · 2022-04-21

研究纳入2019年11月至2020年9月连续201例接受临床多参数前列腺MRI的男性,由卷积神经网络(CNN)在图像采集后自动分析双参数部分,放射科住院医师在查看CNN结果前后独立进行两次研究性PI-RADS评估并填写问卷。结果显示CNN患者水平AUC为0.77,以PI-RADS≥3概率阈值时敏感度81.8%、特异度54.8%,与临床常规PI-RADS≥4评估的90.9%和54.8%无统计学差异;住院医师查看CNN前后性能相似,但临床评估在前列腺六分仪水平AUC最高(0.82),显著高于住院医师。CNN总体性能得以保持,但观察到校准漂移,提示需要持续质量控制和重新校准。

要点

  • CNN患者水平AUC为0.77,以PI-RADS≥3概率阈值时敏感度81.8%、特异度54.8%,与临床常规PI-RADS≥4评估无统计学差异。
  • 住院医师查看CNN结果前后敏感度和特异度相似,问卷显示CNN被认为有帮助且临床有用。
  • 前列腺六分仪水平临床评估AUC为0.82,显著高于住院医师查看CNN前后(AUC均为0.76,P≤0.03)。

核心结论

  • 伪前瞻性辅助临床整合全自动CNN检测前列腺多参数MRI可疑病灶在住院医师中接受度良好,但住院医师性能无显著改善;CNN总体性能得以保持,但观察到校准漂移,识别出持续质量控制和重新校准的需求。

研究设计与样本

  • 伪前瞻性、辅助临床设计,连续纳入2019年11月至2020年9月201例男性的临床多参数前列腺MRI,由CNN在图像采集后自动分析双参数(T2加权和扩散加权)部分。

诊断标准与关键数值

  • CNN患者水平AUC为0.77。
  • CNN使用PI-RADS≥3概率阈值(c3)时患者水平敏感度81.8%、特异度54.8%。
  • 临床常规PI-RADS≥4评估患者水平敏感度90.9%、特异度54.8%,与CNN无统计学差异(P=0.30/P=1.0)。
  • 前列腺六分仪水平临床评估AUC为0.82,高于CNN(AUC=0.76,P=0.21),显著高于住院医师查看CNN前后(AUC=0.76/0.76,P≤0.03)。
  • 临床显著前列腺癌定义为联合靶向和扩展系统经会阴MRI/经直肠超声融合活检中国际泌尿病理学会分级2级或以上前列腺癌。

临床应用与阅片要点

  • 住院医师在查看CNN结果前后独立进行两次研究性PI-RADS评估(辅助临床设计),临床报告独立于研究评估。
  • 问卷结果显示住院医师认为CNN有帮助且临床有用。
  • CNN校准漂移的观察提示需要持续质量控制和间歇性重新校准。

局限性

  • 观察到CNN校准发生漂移,识别出持续质量控制和重新校准的需求。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVES: The aim of this study was to estimate the prospective utility of a previously retrospectively validated convolutional neural network (CNN) for prostate cancer (PC) detection on prostate magnetic resonance imaging (MRI).

MATERIALS AND METHODS: The biparametric (T2-weighted and diffusion-weighted) portion of clinical multiparametric prostate MRI from consecutive men included between November 2019 and September 2020 was fully automatically and individually analyzed by a CNN briefly after image acquisition (pseudoprospective design). Radiology residents performed 2 research Prostate Imaging Reporting and Data System (PI-RADS) assessments of the multiparametric dataset independent from clinical reporting (paraclinical design) before and after review of the CNN results and completed a survey. Presence of clinically significant PC was determined by the presence of an International Society of Urological Pathology grade 2 or higher PC on combined targeted and extended systematic transperineal MRI/transrectal ultrasound fusion biopsy. Sensitivities and specificities on a patient and prostate sextant basis were compared using the McNemar test and compared with the receiver operating characteristic (ROC) curve of CNN. Survey results were summarized as absolute counts and percentages.

RESULTS: A total of 201 men were included. The CNN achieved an ROC area under the curve of 0.77 on a patient basis. Using PI-RADS ≥3-emulating probability threshold (c3), CNN had a patient-based sensitivity of 81.8% and specificity of 54.8%, not statistically different from the current clinical routine PI-RADS ≥4 assessment at 90.9% and 54.8%, respectively ( P = 0.30/ P = 1.0). In general, residents achieved similar sensitivity and specificity before and after CNN review. On a prostate sextant basis, clinical assessment possessed the highest ROC area under the curve of 0.82, higher than CNN (AUC = 0.76, P = 0.21) and significantly higher than resident performance before and after CNN review (AUC = 0.76 / 0.76, P ≤ 0.03). The resident survey indicated CNN to be helpful and clinically useful.

CONCLUSIONS: Pseudoprospective paraclinical integration of fully automated CNN-based detection of suspicious lesions on prostate multiparametric MRI was demonstrated and showed good acceptance among residents, whereas no significant improvement in resident performance was found. General CNN performance was preserved despite an observed shift in CNN calibration, identifying the requirement for continuous quality control and recalibration.

来源:Invest Radiol,查看原文。版权归原作者所有。

引用

  1. Zhang, Schelb, Netzer, et al. Pseudoprospective Paraclinical Interaction of Radiology Residents With a Deep Learning System for Prostate Cancer Detection: Experience, Performance, and Identification of the Need for Intermittent Recalibration. Invest Radiol. 2022. PMID: 35467572. doi:10.1097/RLI.0000000000000878

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。