介入放射学患者安全监测电子不良事件模型的开发与验证
基于退伍军人健康管理局2017年10月至2019年9月的135283例门诊介入放射操作,以电子触发标志潜在不良事件并抽样病历审查,构建混合效应逻辑回归模型;模型预测概率阈值>50%时阳性预测值68.9%、敏感度38.3%、特异度95.3%,验证期阳性预测值63%。
要点
- 模型以预测概率>50%为阈值判定可能不良事件,开发样本阳性预测值68.9%、敏感度38.3%、特异度95.3%。
- 验证期预测概率>50%的病例阳性预测值63%(n=203)。
- 2017年10月至2020年3月期间模型每月识别约70例可能发生不良事件的门诊介入放射病例。
核心结论
- 这种基于电子触发的不良事件监测方法可用于患者安全报告和质量审查。
研究设计与样本
- 研究为回顾性电子监测模型的开发与验证,数据来自退伍军人健康管理局2017年10月至2019年9月门诊介入放射操作(n=135,283)。
- 从触发标志病例中随机抽取n=1,500、未触发病例中随机抽取n=600进行病历审查以识别不良事件。
- 将病历审查病例与患者、操作和机构因素合并,估计混合效应逻辑回归模型以预测不良事件是否发生。
- 依据模型拟合和标准效度确定识别可能不良事件的最佳预测概率阈值。
- 2019年10月至2020年3月(n=20,849)随机抽取阈值以上200例和阈值以下100例进行模型验证。
诊断标准与关键数值
- 开发样本共2,096例(主要为触发标志病例),其中444例(21.8%)发生不良事件。
- 监测模型判定可能不良事件的最佳预测概率阈值为>50%,阳性预测值68.9%、敏感度38.3%、特异度95.3%。
- 验证期病历审查病例中不良事件预测概率>50%者阳性预测值为63%(n=203)。
临床应用与阅片要点
- 该电子触发监测方法可用于患者安全报告和质量审查。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND: Comprehensive adverse event (AE) surveillance programs in interventional radiology (IR) are rare. Our aim was to develop and validate a retrospective electronic surveillance model to identify outpatient IR procedures that are likely to have an AE, to support patient safety and quality improvement.
METHODS: We identified outpatient IR procedures performed in the period from October 2017 to September 2019 from the Veterans Health Administration (n = 135,283) and applied electronic triggers based on posyprocedure care to flag cases with a potential AE. From the trigger-flagged cases, we randomly sampled n = 1,500 for chart review to identify AEs. We also randomly sampled n = 600 from the unflagged cases. Chart-reviewed cases were merged with patient, procedure, and facility factors to estimate a mixed-effects logistic regression model designed to predict whether an AE occurred. Using model fit and criterion validity, we determined the best predicted probability threshold to identify cases with a likely AE. We reviewed a random sample of 200 cases above the threshold and 100 cases from below the threshold from October 2019 to March 2020 (n = 20,849) for model validation.
RESULTS: In our development sample of mostly trigger-flagged cases, 444 of 2,096 cases (21.8%) had an AE. The optimal predicted probability threshold for a likely AE from our surveillance model was >50%, with positive predictive value of 68.9%, sensitivity of 38.3%, and specificity of 95.3%. In validation, chart-reviewed cases with AE probability >50% had a positive predictive value of 63% (n = 203). For the period from October 2017 to March 2020, the model identified approximately 70 IR cases per month that were likely to have an AE.
CONCLUSIONS: This electronic trigger-based approach to AE surveillance could be used for patient-safety reporting and quality review.
引用
- Mull HJ, Foster MV, Higgins MCSS, et al. Development and Validation of an Electronic Adverse Event Model for Patient Safety Surveillance in Interventional Radiology. J Am Coll Radiol. 2023. PMID: 38157954. doi:10.1016/j.jacr.2023.12.022
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。