在美国退伍军人电子病历中识别中轴型脊柱关节炎
本研究基于2005至2015年美国退伍军人健康管理局电子病历自由文本,开发自然语言处理(NLP)方法识别中轴型脊柱关节炎(axial SpA)概念。临床专家选定骶髂关节炎、spond*前缀词和HLA-B27阳性三个概念,监督机器学习模型在独立验证中准确率分别为92.0%、91.0%和99.0%。结论认为这些方法可行且准确,但需进一步研究概念组合以准确识别axial SpA表型。
要点
- NLP模型识别骶髂关节炎、spond*和HLA-B27+的独立验证准确率分别为92.0%、91.0%、99.0%。
- 临床专家选定了骶髂关节炎、spond*前缀词和HLA-B27阳性三个axial SpA概念。
- 尚需研究概念组合以准确识别axial SpA表型,方可支持观察性研究。
核心结论
- 开发了可行且准确的方法,用于在临床笔记自由文本中识别中轴型脊柱关节炎概念。
- 需进一步研究概念组合以准确识别中轴型脊柱关节炎表型。
研究设计与样本
- 纳入2005年1月1日至2015年6月30日期间在国家退伍军人健康管理局企业数据仓库中有文档的退伍军人。
- 临床专家标注包含有意义术语的文本片段,并用自然语言处理工具训练计算机复制专家分类。
主要发现
- 监督机器学习模型在标注片段上的准确率:骶髂关节炎91.1%、spond* 93.5%、HLA-B27+ 97.2%。
- 独立验证准确率:骶髂关节炎92.0%、spond* 91.0%、HLA-B27+ 99.0%。
关键数值与推荐
- 临床专家选定三个中轴型脊柱关节炎概念:骶髂关节炎、包含spond*前缀的术语、HLA-B27阳性。
- 独立验证准确率:骶髂关节炎92.0%、spond* 91.0%、HLA-B27+ 99.0%。
临床怎么用
- 这些方法可促进此前难以开展的中轴型脊柱关节炎观察性研究。
- 方法可能应用于其他疾病的研究。
局限性
- 尚需额外研究确定能准确识别中轴型脊柱关节炎表型的概念组合。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: Large database research in axial spondyloarthritis (SpA) is limited by a lack of methods for identifying most types of axial SpA. Our objective was to develop methods for identifying axial SpA concepts in the free text of documents from electronic medical records. METHODS: Veterans with documents in the national Veterans Health Administration Corporate Data Warehouse between January 1, 2005 and June 30, 2015 were included. Methods were developed for exploring, selecting, and extracting meaningful terms that were likely to represent axial SpA concepts. With annotation, clinical experts reviewed sections of text containing the meaningful terms (snippets) and classified the snippets according to whether or not they represented the intended axial SpA concept. With natural language processing (NLP) tools, computers were trained to replicate the clinical experts' snippet classifications. RESULTS: Three axial SpA concepts were selected by clinical experts, including sacroiliitis, terms including the prefix spond*, and HLA-B27 positivity (HLA-B27+). With supervised machine learning on annotated snippets, NLP models were developed with accuracies of 91.1% for sacroiliitis, 93.5% for spond*, and 97.2% for HLA-B27+. With independent validation, the accuracies were 92.0% for sacroiliitis, 91.0% for spond*, and 99.0% for HLA-B27+. CONCLUSION: We developed feasible and accurate methods for identifying axial SpA concepts in the free text of clinical notes. Additional research is required to determine combinations of concepts that will accurately identify axial SpA phenotypes. These novel methods will facilitate previously impractical observational research in axial SpA and may be applied to research with other diseases.
引用
- Walsh JA, Shao Y, Leng J, et al. Identifying Axial Spondyloarthritis in Electronic Medical Records of US Veterans. Arthritis Care Res (Hoboken). 2017. PMID: 27813310. doi:10.1002/acr.23140
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。