使用自然语言处理自动检测假体周围关节感染及数据要素
本研究在2000至2017年间单中心全关节置换术中,用1208例手术(170例假体周围关节感染)训练自然语言处理算法,以1179例手术(150例感染)测试,算法依据骨骼肌肉感染学会标准判定感染,f1分数为0.911,各数据要素f1分数0.771至0.982。
要点
- 自然语言处理算法依据骨骼肌肉感染学会标准识别假体周围关节感染,f1分数为0.911。
- 提取窦道、脓性分泌物、病理炎症记录和培养微生物生长的f1分数为0.771至0.982。
- 作者认为该算法有潜力自动化感染诊断要素的数据收集,但需在其他医院环境中进一步验证。
核心结论
- 自然语言处理算法有潜力自动化假体周围关节感染诊断要素的数据收集,可能直接改善患者照护并加强队列监测和研究工作。
- 作者指出需在其他医院环境中进一步验证。
研究设计与样本
- 研究为诊断性研究,证据等级为III级。
- 在2000至2017年间单中心所有全关节置换术中识别假体周围关节感染,手动提取构成骨骼肌肉感染学会标准的数据要素作为验证金标准。
- 随机选取1208例全关节置换术(170例假体周围关节感染)作为训练样本开发原型自然语言处理算法,另随机选取1179例手术(150例感染)作为测试样本。
- 算法应用于所有会诊记录、手术记录、病理报告和微生物报告,依据骨骼肌肉感染学会标准预测假体周围关节感染状态。
主要发现
- 依据骨骼肌肉感染学会标准识别假体周围关节感染的算法f1分数为0.911。
- 提取受累全关节置换术中窦道、脓性分泌物、病理炎症记录和培养微生物生长的算法f1分数范围为0.771至0.982。
- 上述数据要素提取的敏感度范围为0.730至1.000,特异度范围为0.947至1.000。
关键数值与推荐
- 骨骼肌肉感染学会标准数据要素被手动提取并用作验证金标准。
- 算法识别假体周围关节感染的f1分数为0.911。
- 数据要素提取的f1分数范围为0.771至0.982,敏感度范围为0.730至1.000,特异度范围为0.947至1.000。
临床怎么用
- 原文未据此给出推荐。
局限性
- 作者指出需在其他医院环境中进一步验证。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Periprosthetic joint infection (PJI) data elements are contained in both structured and unstructured documents in electronic health records and require manual data collection. The goal of this study is to develop a natural language processing (NLP) algorithm to replicate manual chart review for PJI data elements. METHODS: PJI was identified among all total joint arthroplasty (TJA) procedures performed at a single academic institution between 2000 and 2017. Data elements that comprise the Musculoskeletal Infection Society (MSIS) criteria were manually extracted and used as the gold standard for validation. A training sample of 1208 TJA surgeries (170 PJI cases) was randomly selected to develop the prototype NLP algorithms and an additional 1179 surgeries (150 PJI cases) were randomly selected as the test sample. The algorithms were applied to all consultation notes, operative notes, pathology reports, and microbiology reports to predict the correct status of PJI based on MSIS criteria. RESULTS: The algorithm, which identified patients with PJI based on MSIS criteria, achieved an f1-score (harmonic mean of precision and recall) of 0.911. Algorithm performance in extracting the presence of sinus tract, purulence, pathologic documentation of inflammation, and growth of cultured organisms from the involved TJA achieved f1-scores that ranged from 0.771 to 0.982, sensitivity that ranged from 0.730 to 1.000, and specificity that ranged from 0.947 to 1.000. CONCLUSION: NLP-enabled algorithms have the potential to automate data collection for PJI diagnostic elements, which could directly improve patient care and augment cohort surveillance and research efforts. Further validation is needed in other hospital settings. LEVEL OF EVIDENCE: Level III, Diagnostic.
引用
- Fu S, Wyles CC, Osmon DR, et al. Automated Detection of Periprosthetic Joint Infections and Data Elements Using Natural Language Processing. J Arthroplasty. 2020. PMID: 32854996. doi:10.1016/j.arth.2020.07.076
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。