基于基层电子健康档案的老年人跌倒预测模型外部验证
本研究在荷兰59家全科诊所2015至2020年间65岁及以上人群的匿名电子健康档案数据中,对既往开发的跌倒预测模型进行外部验证。共纳入39342名社区老年人,1年随访期间5124人(13.4%)发生跌倒。验证队列ROC-AUC为0.690,校准-in-the-large为0.012,校准斜率为0.878,提示模型外部效度良好,但高风险组存在过预测。
要点
- 验证队列1年跌倒发生率为13.4%(5124/39342)。
- 模型判别力ROC-AUC为0.690,与开发队列0.705接近。
- 校准斜率为0.878,高风险小组存在过预测现象。
核心结论
- 既往开发的跌倒预测模型在基层电子健康档案数据中重现了预测性能,外部效度良好。
- 在完成影响评估后,可考虑将该模型应用于基层医疗场景。
研究设计与样本
- 基于电子健康档案数据的前瞻性队列回顾性分析,数据来自荷兰59家全科诊所2015至2020年间≥65岁人群。
主要发现
- 39342名老年人中,5124人(13.4%)在1年随访内发生跌倒。
- 验证队列与开发队列特征相似,ROC-AUC分别为0.690和0.705。
- 校准-in-the-large为0.012,校准斜率为0.878。
- 校准图显示少数高风险个体存在过预测。
关键数值与推荐
- 结局为1年跌倒,从自由文本中提取。
临床怎么用
- 该模型可用于基层电子健康档案数据识别跌倒高风险老年人,但应用前需进行影响评估。
局限性
- 常规收集数据不受控,可能影响模型表现。
- 高风险组存在过预测,需关注校准问题。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: Early identification of older people at risk of falling is the cornerstone of fall prevention. Many fall prediction tools exist but their external validity is lacking. External validation is a prerequisite before application in clinical practice. Models developed with electronic health record (EHR) data are especially challenging because of the uncontrolled nature of routinely collected data. We aimed to externally validate our previously developed and published prediction model for falls, using a large cohort of community-dwelling older people derived from primary care EHR data. DESIGN: Retrospective analysis of a prospective cohort drawn from EHR data. SETTING AND PARTICIPANTS: Pseudonymized EHR data were collected from individuals aged ≥65 years, who were enlisted in any of the participating 59 general practices between 2015 and 2020 in the Netherlands. METHODS: Ten predictors were defined and obtained using the same methods as in the development study. The outcome was 1-year fall and was obtained from free text. Both reproducibility and transportability were evaluated. Model performance was assessed in terms of discrimination using the area under the receiver operating characteristic curve (ROC-AUC), and in terms of calibration, using calibration-in-the-large, calibration slope and calibration plots. RESULTS: Among 39,342 older people, 5124 (13.4%) fell in the 1-year follow-up. The characteristics of the validation and the development cohorts were similar. ROC-AUCs of the validation and development cohort were 0.690 and 0.705, respectively. Calibration-in-the-large and calibration slope were 0.012 and 0.878, respectively. Calibration plots revealed overprediction for high-risk groups in a small number of individuals. CONCLUSIONS AND IMPLICATIONS: Our previously developed prediction model for falls demonstrated good external validity by reproducing its predictive performance in the validation cohort. The implementation of this model in the primary care setting could be considered after impact assessment.
引用
- Dormosh N, Heymans MW, van der Velde N, et al. External Validation of a Prediction Model for Falls in Older People Based on Electronic Health Records in Primary Care. J Am Med Dir Assoc. 2022. PMID: 35963283. doi:10.1016/j.jamda.2022.07.002
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。