基于规则算法评估PI-RADS标准化报告的应用价值
本研究纳入2015年至2021年杜克大学健康系统的6264份前列腺mpMRI报告,采用基于正则表达式的规则算法自动提取PI-RADS分类。与人工审查相比,算法总体准确率92.6%,平均精确率88.8%,平均召回率85.6%,F1分数0.871。在344份被归类为「无可用信息」的报告中,150份报告的印象部分确实未包含任何病灶的数值PI-RADS评分。
要点
- 规则算法可高精度自动提取PI-RADS评分,总体准确率92.6%。
- 约150份报告印象部分缺失数值PI-RADS评分,提示报告规范有改进空间。
- 自然语言处理可用于大规模前列腺mpMRI报告质量评估。
局限性
- 单中心研究,结论外推需谨慎。
- 算法性能评估基于分层随机抽样的502份报告,非全样本人工验证。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
RATIONALE AND OBJECTIVES: Adoption of the Prostate Imaging Reporting & Data System (PI-RADS) has been shown to increase detection of clinically significant prostate cancer on prostate mpMRI. We propose that a rule-based algorithm based on Regular Expression (RegEx) matching can be used to automatically categorize prostate mpMRI reports into categories as a means by which to assess for opportunities for quality improvement.
MATERIALS AND METHODS: All prostate mpMRIs performed in the Duke University Health System from January 2, 2015, to January 29, 2021, were analyzed. Exclusion criteria were applied, for a total of 5343 male patients and 6264 prostate mpMRI reports. These reports were then analyzed by our RegEx algorithm to be categorized as PI-RADS 1 through PI-RADS 5, Recurrent Disease, or "No Information Available." A stratified, random sample of 502 mpMRI reports was reviewed by a blinded clinical team to assess performance of the RegEx algorithm.
RESULTS: Compared to manual review, the RegEx algorithm achieved overall accuracy of 92.6%, average precision of 88.8%, average recall of 85.6%, and F1 score of 0.871. The clinical team also reviewed 344 cases that were classified as "No Information Available," and found that in 150 instances, no numerical PI-RADS score for any lesion was included in the impression section of the mpMRI report.
CONCLUSION: Rule-based processing is an accurate method for the large-scale, automated extraction of PI-RADS scores from the text of radiology reports. These natural language processing approaches can be used for future initiatives in quality improvement in prostate mpMRI reporting with PI-RADS.
引用
- Zhang, Neely, Lo, et al. Utility of a Rule-Based Algorithm in the Assessment of Standardized Reporting in PI-RADS. Acad Radiol. 2022. PMID: 35909050. doi:10.1016/j.acra.2022.06.024
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。