基于电子健康记录数据识别眼部疾病的算法评估
本研究利用 Sight Outcomes 研究协作眼科数据仓库中 122 339 例患者的电子健康记录(EHR)数据,开发了一种搜索结构化与非结构化数据的算法,用于识别剥脱综合征(XFS)的存在与否。算法经青光眼专家验证,阳性预测值为 95.0%(95%CI,89.5%-97.7%),阴性预测值为 100%(95%CI,91.2%-100%)。结论认为该算法在识别 XFS 方面优于仅依赖账单编码的传统方法。
要点
- 算法在 122 339 例患者中识别 XFS 的阳性预测值为 95.0%,阴性预测值为 100%。
- 当 ICD-9 或 ICD-10 账单编码记录 XFS 时,86% 或 96% 的记录中 EHR 其他位置也有 XFS 证据。
- 当临床检查或自由文本有 XFS 证据时,仅约 40% 的情况使用 ICD-9 编码记录,ICD-10 编码记录更少。
核心结论
- 该算法在识别 EHR 数据中 XFS 的存在或缺失方面似乎优于仅评估账单编码的传统方法。
研究设计与样本
- 回顾性分析 Sight Outcomes 研究协作眼科数据仓库中 122 339 例在参与学术医疗中心接受眼保健的患者 EHR 数据,时间范围为 2012 年 8 月 1 日至 2017 年 8 月 31 日。
- 开发搜索结构化与非结构化 EHR 数据的算法,在 200 例有或无 XFS 的患者样本中训练,使用 LASSO 回归估计 XFS 概率,并由青光眼专家审查 EHR 进行验证。
主要发现
- 算法为 121 085 例患者(99.0%)分配了低于 10% 的 XFS 概率,为 543 例(0.4%)分配了高于 75% 的概率,353 例(0.3%)高于 90%,83 例(0.07%)高于 99%。
- 经青光眼专家验证,算法阳性预测值为 95.0%(95%CI,89.5%-97.7%),阴性预测值为 100%(95%CI,91.2%-100%)。
- 当 ICD-9 或 ICD-10 账单编码记录 XFS 时,86% 或 96% 的记录中 EHR 其他位置也有 XFS 证据;当临床检查或自由文本有 XFS 证据时,仅约 40% 的情况使用 ICD-9 编码记录,ICD-10 编码记录更少。
关键数值与推荐
- 算法阳性预测值为 95.0%(95%CI,89.5%-97.7%),阴性预测值为 100%(95%CI,91.2%-100%)。
临床怎么用
- 在利用 EHR 大数据研究眼病时,可考虑使用该算法提高识别 XFS 等眼部疾病的准确性,而非仅依赖账单编码。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
IMPORTANCE: For research involving big data, researchers must accurately identify patients with ocular diseases or phenotypes of interest. Reliance on administrative billing codes alone for this purpose is limiting. OBJECTIVE: To develop a method to accurately identify the presence or absence of ocular conditions of interest using electronic health record (EHR) data. DESIGN, SETTING, AND PARTICIPANTS: This study is a retrospective analysis of the EHR data of patients (n = 122 339) in the Sight Outcomes Research Collaborative Ophthalmology Data Repository who received eye care at participating academic medical centers between August 1, 2012, and August 31, 2017. An algorithm that searches structured and unstructured (free-text) EHR data for conditions of interest was developed and then tested to determine how well it could detect the presence or absence of exfoliation syndrome (XFS). The algorithm was trained to search for evidence of XFS among a sample of patients with and without XFS (n = 200) by reviewing International Classification of Diseases, Ninth Revision or International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-9 or ICD-10) billing codes, the patient's problem list, and text within the ocular examination section and unstructured (free-text) data in the EHR. The likelihood that each patient had XFS was estimated using logistic least absolute shrinkage and selection operator (LASSO) regression. The EHR data of all patients were run through the algorithm to generate an XFS probability score for each patient. The algorithm was validated with review of EHRs by glaucoma specialists. MAIN OUTCOMES AND MEASURES: Positive predictive value (PPV) and negative predictive value (NPV) of the algorithm were computed as the proportion of patients correctly classified with XFS or without XFS. RESULTS: This study included 122 339 patients, with a mean (SD) age of 52.4 (25.1) years. Of these patients, 69 002 (56.4%) were female and 99 579 (81.4%) were white. The algorithm assigned a less than 10% probability of XFS for 121 085 patients (99.0%) as well as an XFS probability score of more than 75% for 543 patients (0.4%), more than 90% for 353 patients (0.3%), and more than 99% for 83 patients (0.07%). Validated by glaucoma specialists, the algorithm had a PPV of 95.0% (95% CI, 89.5%-97.7%) and an NPV of 100% (95% CI, 91.2%-100%). When there was ICD-9 or ICD-10 billing code documentation of XFS, in 86% or 96% of the records, respectively, evidence of XFS was also recorded elsewhere in the EHR. Conversely, when there was clinical examination or free-text evidence of XFS, it was documented with ICD-9 codes only approximately 40% of the time and even less often with ICD-10 codes. CONCLUSIONS AND RELEVANCE: The algorithm developed, tested, and validated in this study appears to be better at identifying the presence or absence of XFS in EHR data than the conventional approach of assessing only billing codes; such an algorithm may enhance the ability of investigators to use EHR data to study patients with ocular diseases.
引用
- Stein JD, Rahman M, Andrews C, et al. Evaluation of an Algorithm for Identifying Ocular Conditions in Electronic Health Record Data. JAMA Ophthalmol. 2019. PMID: 30789656. doi:10.1001/jamaophthalmol.2018.7051
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。