文献速递关节外科

利用自然语言处理从关节置换患者非结构化病历中回顾性收集登记与质量审查数据

Data for registry and quality review can be retrospectively collected using natural language processing from unstructured charts of arthroplasty patients.
PubMed 文献 · Bone Joint J · 2020-01-01

研究从8名外科医生2012至2018年行初次关节置换患者的病历中随机选取1000份临床与医院记录,人工提取19项术前、17项术中和2项术后变量,并构建自然语言处理(NLP)算法在训练样本上学习、在随机测试样本上验证。NLP算法在随机测试数据集上提取变量的准确率96.3%、敏感度95.2%、特异度97.4%,对结构化模板化数据(如活动度、假体品牌)准确率98%,对因记录者不同而书写有差异的数据(如深静脉血栓形成)准确率90%。作者认为NLP自动算法可帮助骨科实践回顾性收集登记与质量改进所需信息。

要点

  • NLP算法在关节置换非结构化病历随机测试集上提取变量准确率96.3%、敏感度95.2%、特异度97.4%。
  • 结构化模板化数据提取准确率高:活动度98%、假体品牌98%;书写差异大的深静脉血栓形成为90%。
  • 作者认为NLP自动算法可帮助骨科实践回顾性收集登记与质量改进信息。

核心结论

  • 本研究使用的NLP算法能够从随机选取的关节置换非结构化病历中识别部分变量,准确率高于90%。
  • 对部分变量如客观检查数据,准确率非常高。
  • 作者认为使用NLP的自动算法可帮助骨科实践回顾性收集登记与质量改进所需信息。

研究设计与样本

  • 从8名不同外科医生处随机选取2012至2018年间行初次关节置换患者的1000份临床与医院病历。
  • 人工从这些病历中提取19项术前、17项术中和2项术后变量。
  • 创建NLP算法从训练样本中自动提取这些变量,并在随机测试样本上测试。
  • 在统计分析系统(SAS)中计算所收集变量的准确率、算法在病历中确有该信息时收集正确信息的能力(敏感度)以及病历中无该数据元素时算法不收集该元素的能力(特异度)。

主要发现

  • NLP算法在随机测试数据集上提取非结构化数据表现良好:准确率96.3%、敏感度95.2%、特异度97.4%。
  • 对结构化模板化格式数据提取表现更好:活动度准确率98%、假体品牌准确率98%。
  • 对因记录作者不同而书写有差异的数据提取表现较差:深静脉血栓形成准确率90%。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

AIMS: Natural Language Processing (NLP) offers an automated method to extract data from unstructured free text fields for arthroplasty registry participation. Our objective was to investigate how accurately NLP can be used to extract structured clinical data from unstructured clinical notes when compared with manual data extraction. METHODS: A group of 1,000 randomly selected clinical and hospital notes from eight different surgeons were collected for patients undergoing primary arthroplasty between 2012 and 2018. In all, 19 preoperative, 17 operative, and two postoperative variables of interest were manually extracted from these notes. A NLP algorithm was created to automatically extract these variables from a training sample of these notes, and the algorithm was tested on a random test sample of notes. Performance of the NLP algorithm was measured in Statistical Analysis System (SAS) by calculating the accuracy of the variables collected, the ability of the algorithm to collect the correct information when it was indeed in the note (sensitivity), and the ability of the algorithm to not collect a certain data element when it was not in the note (specificity). RESULTS: The NLP algorithm performed well at extracting variables from unstructured data in our random test dataset (accuracy = 96.3%, sensitivity = 95.2%, and specificity = 97.4%). It performed better at extracting data that were in a structured, templated format such as range of movement (ROM) (accuracy = 98%) and implant brand (accuracy = 98%) than data that were entered with variation depending on the author of the note such as the presence of deep-vein thrombosis (DVT) (accuracy = 90%). CONCLUSION: The NLP algorithm used in this study was able to identify a subset of variables from randomly selected unstructured notes in arthroplasty with an accuracy above 90%. For some variables, such as objective exam data, the accuracy was very high. Our findings suggest that automated algorithms using NLP can help orthopaedic practices retrospectively collect information for registries and quality improvement (QI) efforts. Cite this article: Bone Joint J 2020;102-B(7 Supple B):99-104.

来源:Bone Joint J,查看原文。版权归原作者所有。

引用

  1. Shah RF, Bini S, Vail T, et al. Data for registry and quality review can be retrospectively collected using natural language processing from unstructured charts of arthroplasty patients. Bone Joint J. 2020. PMID: 32600201. doi:10.1302/0301-620X.102B7.BJJ-2019-1574.R1

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。