文献速递外周血管腹部技术与安全CTMRUS

利用放射学报告的自然语言处理识别腹主动脉瘤的大小与存在:系统综述与Meta分析

Identifying abdominal aortic aneurysm size and presence using Natural Language Processing of radiology reports: a systematic review and meta-analysis.
PubMed 文献 · Abdom Radiol (NY) · 2025-01-30

该Meta分析纳入截至2024年3月的文献,评估自然语言处理(NLP)从放射学报告中识别腹主动脉瘤存在与否及测量最大腹主动脉直径的效能,共纳入39,094例腹主动脉瘤患者。汇总敏感度0.89、特异度0.88、精确率0.92、准确率0.91,NLP实施前后随访报告的动脉瘤直径差异为缩小0.05 cm且具统计学显著性。作者认为NLP在自动化检测方面潜力大,但报告格式与术语变异、非结构化数据及对高质量标注训练集的依赖仍限制其准确性,需人工监督。

要点

  • 汇总敏感度0.89(95%CI 0.88-0.91)、特异度0.88(95%CI 0.87-0.89),可用于从放射学报告中筛查腹主动脉瘤的存在与否。
  • 汇总精确率0.92(95%CI 0.89-0.95)、准确率0.91(95%CI 0.89-0.93)。
  • NLP实施前后随访报告的动脉瘤直径差异为缩小0.05 cm,具统计学显著性。

核心结论

  • NLP在从放射学报告中自动化检测腹主动脉瘤的大小与存在方面具有较大潜力,较人工审阅可提升效率与可扩展性,但报告格式、术语及非结构化数据的变异可损害准确性,且NLP模型依赖可能不完整或不具代表性的高质量标注训练数据集;NLP虽有助于识别腹主动脉瘤相关数据,仍需人工监督以确保决策结合患者更广泛的临床背景,持续算法改进与无缝整合入临床工作流程是提升其效用与可靠性的关键。

研究设计与样本

  • 系统综述与Meta分析,检索PubMed、Scopus、Web of Science、Embase和Science Direct数据库至2024年3月,使用RAY YAN智能系统综述工具筛选研究,采用STATA v18软件进行Meta分析,以Egger检验评估发表偏倚,以Newcastle Ottawa量表评估纳入研究质量,并使用绘图数字化工具提取数字数据。

诊断标准与关键数值

  • 所实施NLP模型的汇总敏感度为0.89(95%CI 0.88-0.91)、特异度为0.88(95%CI 0.87-0.89)、精确率为0.92(95%CI 0.89-0.95)、准确率为0.91(95%CI 0.89-0.93)。
  • 纳入研究中NLP实施前后随访报告的动脉瘤直径大小差异为缩小0.05 cm,具统计学显著性。

临床应用与阅片要点

  • NLP可用于从放射学报告中自动化识别腹主动脉瘤的存在与大小,较人工审阅提升效率与可扩展性。
  • 报告格式、术语及非结构化数据的变异可损害NLP准确性,NLP模型依赖高质量标注训练数据集。
  • NLP识别腹主动脉瘤相关数据时仍需人工监督,以确保决策结合患者更广泛的临床背景。

局限性

  • 报告格式、术语及非结构化数据的变异可损害准确性。
  • NLP模型依赖高质量、标注的训练数据集,这些数据集可能不完整或不具代表性。
  • NLP虽有助于识别腹主动脉瘤相关数据,仍需人工监督以确保决策结合患者更广泛的临床背景。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

BACKGROUND AND AIM: Prior investigations of the natural history of abdominal aortic aneurysms (AAAs) have been constrained by small sample sizes or uneven assessments of aggregated data. Natural language processing (NLP) can significantly enhance the investigation and treatment of patients with AAAs by swiftly and effectively collecting imaging data from health records. This meta-analysis aimed to evaluate the efficacy of NLP techniques in reliably identifying the existence or absence of AAAs and measuring the maximal abdominal aortic diameter in extensive datasets of radiology study reports.

METHOD: The PubMed, Scopus, Web of Science, Embase, and Science Direct databases were searched until March 2024 to obtain pertinent papers. The RAYYAN intelligent tool for systematic reviews was utilized to screen the studies. The meta-analysis was conducted using STATA v18 software. Egger's test was employed to evaluate publication bias. The Newcastle Ottawa Scale was employed to assess the quality of the listed studies. A plot digitizer was employed to extract digital data.

RESULT: A total of 39,094 individuals with AAA were included in this analysis. Twenty-seven thousand three hundred twenty-six patients were male, and 11,383 were female. The mean age of the total participants was 73.1 ± 1.25 years. Analysis results for pooled estimation of performance variables such as: The sensitivity, specificity, precision, and accuracy of the implemented NLP model were analyzed as follows: 0.89(0.88-0.91), 0.88 (0.87-0.89), 0.92 (0.89-0.95), and 0.91 (0.89-0.93) respectively. The aneurysm diameter size difference reported in follow-up before and after NLP implementation in the included studies showed a 0.05 cm reduction in size, which was statistically significant.

CONCLUSION: NLP holds great potential for automating the detection of AAA size and presence in radiology reports, enhancing efficiency and scalability over manual review. However, challenges persist. Variability in report formats, terminology, and unstructured data can compromise accuracy. Additionally, NLP models rely on high-quality, annotated training datasets, which may be incomplete or unrepresentative. While NLP aids in identifying AAA-related data, human oversight is essential to ensure decisions are informed by the patient's broader clinical context. Ongoing algorithm refinement and seamless integration into clinical workflows are key to improving NLP's utility and reliability in this field.

来源:Abdom Radiol (NY),查看原文。版权归原作者所有。

引用

  1. Sajjadi SM, Mohebbi A, Ehsani A, et al. Identifying abdominal aortic aneurysm size and presence using Natural Language Processing of radiology reports: a systematic review and meta-analysis. Abdom Radiol (NY). 2025. PMID: 39883167. doi:10.1007/s00261-025-04810-5

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。