文献速递关节外科

自然语言处理算法识别全髋关节置换术手术记录常见数据元素

Use of Natural Language Processing Algorithms to Identify Common Data Elements in Operative Notes for Total Hip Arthroplasty.
PubMed 文献 · J Bone Joint Surg Am · 2019-01-01

本研究以2000至2015年单中心初次全髋关节置换术手术记录为对象,开发并验证三种自然语言处理(NLP)算法,分别提取手术入路、固定方式和摩擦界面类别,以人工病历回顾为金标准。结果显示三种算法准确率分别为99.2%、90.7%和95.8%,外部机构数据验证性能相当。

要点

  • 手术入路算法准确率99.2%(95%CI 97.1%-99.9%)。
  • 固定技术算法准确率90.7%(95%CI 86.8%-93.8%)。
  • 摩擦界面算法准确率95.8%(95%CI 92.7%-97.8%)。

核心结论

  • NLP算法是替代人工病历回顾从骨科手术记录中识别常见数据元素的有前景方法。
  • 本研究为NLP在临床研究和注册登记开发中可靠、快速、经济地提取数据提供了概念验证。

研究设计与样本

  • 研究纳入2000至2015年单中心初次全髋关节置换术手术记录。
  • 随机选取手术报告作为训练样本开发原型NLP算法,另随机选取报告作为测试样本。
  • 创建三种独立算法,分别针对手术入路、固定方法和摩擦界面类别,并应用外部机构电子健康记录数据验证外部效度。
  • 以人工病历回顾为金标准计算准确率等统计量,算法应用于29位不同外科医生的手术记录。

主要发现

  • 手术入路算法准确率为99.2%(95%CI 97.1%至99.9%)。
  • 固定技术算法准确率为90.7%(95%CI 86.8%至93.8%)。
  • 摩擦界面算法准确率为95.8%(95%CI 92.7%至97.8%)。
  • NLP算法应用于其他机构手术报告时性能相当,显示外部效度。

临床怎么用

  • NLP算法可在临床研究和注册登记中用于从手术记录中提取手术入路、固定方法和摩擦界面信息。
  • NLP方法有望替代人工病历回顾,实现快速且经济的数据提取。

局限性

  • 原文未述局限性

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Manual chart review is labor-intensive and requires specialized knowledge possessed by highly trained medical professionals. Natural language processing (NLP) tools are distinctive in their ability to extract critical information from raw text in electronic health records (EHRs). As a proof of concept for the potential application of this technology, we examined the ability of NLP to correctly identify common elements described by surgeons in operative notes for total hip arthroplasty (THA). METHODS: We evaluated primary THAs that had been performed at a single academic institution from 2000 to 2015. A training sample of operative reports was randomly selected to develop prototype NLP algorithms, and additional operative reports were randomly selected as the test sample. Three separate algorithms were created with rules aimed at capturing (1) the operative approach, (2) the fixation method, and (3) the bearing surface category. The algorithms were applied to operative notes to evaluate the language used by 29 different surgeons at our center and were applied to EHR data from outside facilities to determine external validity. Accuracy statistics were calculated with use of manual chart review as the gold standard. RESULTS: The operative approach algorithm demonstrated an accuracy of 99.2% (95% confidence interval [CI], 97.1% to 99.9%). The fixation technique algorithm demonstrated an accuracy of 90.7% (95% CI, 86.8% to 93.8%). The bearing surface algorithm demonstrated an accuracy of 95.8% (95% CI, 92.7% to 97.8%). Additionally, the NLP algorithms applied to operative reports from other institutions yielded comparable performance, demonstrating external validity. CONCLUSIONS: NLP-enabled algorithms are a promising alternative to the current gold standard of manual chart review for identifying common data elements from orthopaedic operative notes. The present study provides a proof of concept for use of NLP techniques in clinical research studies and registry-development endeavors to reliably extract data of interest in an expeditious and cost-effective manner.

来源:J Bone Joint Surg Am,查看原文。版权归原作者所有。

引用

  1. Wyles CC, Tibbo ME, Fu S, et al. Use of Natural Language Processing Algorithms to Identify Common Data Elements in Operative Notes for Total Hip Arthroplasty. J Bone Joint Surg Am. 2019. PMID: 31567670. doi:10.2106/JBJS.19.00071

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。