人工智能辅助前列腺多参数MRI缩小经验差距:前瞻性多读者比较研究
前瞻性观察200例前列腺mpMRI,由1名专家和4名新手读者在有无AI辅助软件(Quantib® Prostate)下按PI-RADS v2.1评分,比较不同PI-QUAL评级和信心等级下的读者间一致性及报告时间。结果显示AI对部分新手读者的一致性有提升,对另一些则降低,总体结论认为AI作为PACS补充可能有助于改善经验不足读者的读者间一致性。
要点
- AI辅助对新手读者间PI-RADS评分一致性的影响因人而异,并非普遍提升。
- 以PI-RADS≥4为活检 cut-off,使用AI时AUC范围为0.799至0.820。
- 在不同PI-QUAL评分下,使用Quantib后读者间一致性更高,尤其对读者1和4。
局限性
- 单中心前瞻性观察研究。
- 样本量200例,读者数量有限。
- AI辅助对读者间一致性的影响在个别读者中呈负向。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
PURPOSE: The aim of the study was to determine the impact of using a semi-automatic commercially available AI-assisted software (Quantib® Prostate) on inter-reader agreement in PI-RADS scoring at different PI-QUAL ratings and grades of reader confidence and on reporting times among novice readers in multiparametric prostate MRI.
METHODS: A prospective observational study, with a final cohort of 200 patients undergoing mpMRI scans, was performed at our institution. An expert fellowship-trained urogenital radiologist interpreted all 200 scans based on PI-RADS v2.1. The scans were divided into four equal batches of 50 patients. Four independent readers evaluated each batch with and without the use of AI-assisted software, blinded to expert and individual reports. Dedicated training sessions were held before and after each batch. Image quality rated according to PI-QUAL and reporting times were recorded. Readers' confidence was also evaluated. A final evaluation of the first batch was conducted at the end of the study to assess for any changes in performance.
RESULTS: The overall kappa coefficient differences in PI-RADS scoring agreement without and with Quantib® were 0.673 to 0.736 for Reader 1, 0.628 to 0.483 for Reader 2, 0.603 to 0.292 for Reader 3 and 0.586 to 0.613 for Reader 4. Using PI-RADS ≥ 4 as cut-off for biopsy, the AUCs with AI ranged from 0.799 (95 % CI: 0.743, 0.856) to 0.820 (95 % CI: 0.765, 0.874). Inter-reader agreements at different PI-QUAL scores were higher with the use of Quantib, particularly for readers 1 and 4, with Kappa coefficient values showing moderate to slight agreement.
CONCLUSION: Quantib® Prostate could potentially be useful in improving inter-reader agreement among less experienced to completely novice readers if used as a supplement to PACS.
引用
- Forookhi, Laschena, Pecoraro, et al. Bridging the experience gap in prostate multiparametric magnetic resonance imaging using artificial intelligence: A prospective multi-reader comparison study on inter-reader agreement in PI-RADS v2.1, image quality and reporting time between novice and expert readers. Eur J Radiol. 2023. PMID: 36812699. doi:10.1016/j.ejrad.2023.110749
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。