文献速递关节外科

使用自然语言处理算法识别膝关节置换术手术记录中的常见数据元素

Use of Natural Language Processing Algorithms to Identify Common Data Elements in Operative Notes for Knee Arthroplasty.
PubMed 文献 · J Arthroplasty · 2020-10-10

本研究在2000至2017年一家大型三级机构的20000份膝关节置换术手术记录中,随机选取独立配对的训练集与测试集(规模420至1592台手术),开发基于规则的自然语言处理(NLP)算法提取五类数据元素,并以机构注册数据为金标准评估;手术类别、侧别、限制类型和髌骨置换算法的准确率分别为98.3%、99.5%、99.2%和99.4%,植入物型号算法的F1分数为99.9%。作者认为NLP算法是替代昂贵人工病历审查、自动提取手术记录内嵌信息的有前景方案,并指出需在其他医院环境中进一步验证以促进广泛实施。

要点

  • 手术类别、侧别、限制类型、髌骨置换的NLP算法在测试集准确率分别为98.3%、99.5%、99.2%、99.4%。
  • 植入物型号算法的F1分数为99.9%。
  • 作者认为NLP算法是替代人工病历审查的有前景方案,需在其他医院环境进一步验证。

核心结论

  • NLP算法是替代昂贵人工病历审查、自动提取膝关节置换术手术记录内嵌信息的有前景方案。
  • 需在其他医院环境中进一步验证,以促进广泛实施并提升研究与临床数据采集效率。

研究设计与样本

  • 在2000至2017年一家大型三级机构的20000份膝关节置换术手术记录队列中,随机选取独立配对的训练集与测试集开发并评估NLP算法。
  • 训练集与测试集规模相近,范围为420至1592台手术。
  • 采用基于手术记录中关键词的专家规则实现NLP算法,捕获五类主要数据元素。
  • 以机构注册数据作为金标准评估NLP算法。

主要发现

  • 手术类别检测算法在测试集上准确率为98.3%。
  • 侧别检测算法在测试集上准确率为99.5%。
  • 限制类型检测算法在测试集上准确率为99.2%。
  • 髌骨置换检测算法在测试集上准确率为99.4%。
  • 植入物型号算法F1分数(精确率与召回率的调和平均数)为99.9%。

关键数值与推荐

  • NLP算法捕获的五类数据元素为:手术类别(全膝关节置换术、单髁膝关节置换术、髌股关节置换术)、手术侧别、限制类型、髌骨置换是否存在、植入物型号(目录号)。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 需在其他医院环境中进一步验证,以促进广泛实施并提升研究与临床数据采集效率。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Natural language processing (NLP) methods have the capability to process clinical free text in electronic health records, decreasing the need for costly manual chart review, and improving data quality. We developed rule-based NLP algorithms to automatically extract surgery specific data elements from knee arthroplasty operative notes. METHODS: Within a cohort of 20,000 knee arthroplasty operative notes from 2000 to 2017 at a large tertiary institution, we randomly selected independent pairs of training and test sets to develop and evaluate NLP algorithms to detect five major data elements. The size of the training and test datasets were similar and ranged between 420 to 1592 surgeries. Expert rules using keywords in operative notes were used to implement NLP algorithms capturing: (1) category of surgery (total knee arthroplasty, unicompartmental knee arthroplasty, patellofemoral arthroplasty), (2) laterality of surgery, (3) constraint type, (4) presence of patellar resurfacing, and (5) implant model (catalog numbers). We used institutional registry data as our gold standard to evaluate the NLP algorithms. RESULTS: NLP algorithms to detect the category of surgery, laterality, constraint, and patellar resurfacing achieved 98.3%, 99.5%, 99.2%, and 99.4% accuracy on test datasets, respectively. The implant model algorithm achieved an F1-score (harmonic mean of precision and recall) of 99.9%. CONCLUSIONS: NLP algorithms are a promising alternative to costly manual chart review to automate the extraction of embedded information within knee arthroplasty operative notes. Further validation in other hospital settings will enhance widespread implementation and efficiency in data capture for research and clinical purposes. LEVEL OF EVIDENCE: Level III.

来源:J Arthroplasty,查看原文。版权归原作者所有。

引用

  1. Sagheb E, Ramazanian T, Tafti AP, et al. Use of Natural Language Processing Algorithms to Identify Common Data Elements in Operative Notes for Knee Arthroplasty. J Arthroplasty. 2020. PMID: 33051119. doi:10.1016/j.arth.2020.09.029

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。