文献速递围术期管理与 ERAS胃肠外科急腹症与外科感染

自然语言处理在手术中的应用:系统评价与荟萃分析

Natural Language Processing in Surgery: A Systematic Review and Meta-analysis.
PubMed 文献 · Ann Surg · 2021-01-01

该系统评价与荟萃分析检索2000年起发表的使用自然语言处理(NLP)评估围手术期手术结局的文献,共纳入29篇文章,其中15篇发表于2018年后。最常见的结局是术后并发症(n=14)。与传统非NLP模型相比,NLP模型识别术后并发症的灵敏度更高[0.92(0.87-0.95)vs 0.58(0.33-0.79),P < 0.001],特异度相当[0.99(0.96-1.00)vs 0.98(0.95-0.99)]。NLP可用于确认和排除手术结局/诊断的记录,而非NLP模型仅适用于确认。

要点

  • NLP识别术后并发症的灵敏度显著高于传统非NLP模型。
  • NLP与传统的特异度相当,但NLP可可靠用于排除结局记录。
  • NLP在手术结局研究中的应用正在加速。

核心结论

  • NLP用于提取手术结局尤其是术后并发症的应用正在加速。
  • NLP与传统非NLP方法性能指标相似,但NLP在排除手术结局记录方面更优。

研究设计与样本

  • 系统评价与荟萃分析,检索PubMed、MEDLINE、Web of Science和Embase自2000年起发表的使用NLP模型评估围手术期手术结局的文章。
  • 共纳入29篇文章,其中超过一半(n=15)发表于2018年之后。

主要发现

  • 使用NLP识别的最常见结局是术后并发症(n=14)。
  • 与传统非NLP模型相比,NLP模型识别术后并发症的灵敏度更高[0.92(0.87-0.95)vs 0.58(0.33-0.79),P < 0.001]。
  • 两者特异度相当,分别为0.99(0.96-1.00)和0.98(0.95-0.99)。
  • 基于似然比矩阵汇总,传统非NLP模型可用于确认结局/诊断的记录,而NLP模型可可靠用于确认和排除结局/诊断的记录。

临床怎么用

  • 在手术结局研究中,可考虑使用NLP模型从电子健康记录自由文本中提取术后并发症等结局。
  • NLP模型可用于排除手术结局/诊断的记录,而传统非NLP模型仅适用于确认。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: The aim of this study was to systematically assess the application and potential benefits of natural language processing (NLP) in surgical outcomes research. SUMMARY BACKGROUND DATA: Widespread implementation of electronic health records (EHRs) has generated a massive patient data source. Traditional methods of data capture, such as billing codes and/or manual review of free-text narratives in EHRs, are highly labor-intensive, costly, subjective, and potentially prone to bias. METHODS: A literature search of PubMed, MEDLINE, Web of Science, and Embase identified all articles published starting in 2000 that used NLP models to assess perioperative surgical outcomes. Evaluation metrics of NLP systems were assessed by means of pooled analysis and meta-analysis. Qualitative synthesis was carried out to assess the results and risk of bias on outcomes. RESULTS: The present study included 29 articles, with over half (n = 15) published after 2018. The most common outcome identified using NLP was postoperative complications (n = 14). Compared to traditional non-NLP models, NLP models identified postoperative complications with higher sensitivity [0.92 (0.87-0.95) vs 0.58 (0.33-0.79), P < 0.001]. The specificities were comparable at 0.99 (0.96-1.00) and 0.98 (0.95-0.99), respectively. Using summary of likelihood ratio matrices, traditional non-NLP models have clinical utility for confirming documentation of outcomes/diagnoses, whereas NLP models may be reliably utilized for both confirming and ruling out documentation of outcomes/diagnoses. CONCLUSIONS: NLP usage to extract a range of surgical outcomes, particularly postoperative complications, is accelerating across disciplines and areas of clinical outcomes research. NLP and traditional non-NLP approaches demonstrate similar performance measures, but NLP is superior in ruling out documentation of surgical outcomes.

来源:Ann Surg,查看原文。版权归原作者所有。

引用

  1. Mellia JA, Basta MN, Toyoda Y, et al. Natural Language Processing in Surgery: A Systematic Review and Meta-analysis. Ann Surg. 2021. PMID: 33074901. doi:10.1097/SLA.0000000000004419

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。