文献速递围术期管理与 ERAS急腹症与外科感染

半自动机器学习方法加速手术部位感染数据抽象

Accelerating Surgical Site Infection Abstraction With a Semi-automated Machine-learning Approach.
PubMed 文献 · Ann Surg · 2020-10-14

结果显示,该方法减少超过90%的人工抽象工作量,阴性组假阴性率低于1%,灵敏度为82%。结论认为半自动机器学习辅助SSI抽象可大幅加速流程并达到良好性能。

要点

  • 半自动机器学习方法减少超过90%的人工SSI抽象工作量。
  • 阴性组假阴性率低于1%,灵敏度为82%。
  • 对可能组10%进行盲审,与金标准高度一致,提示可仅审阅关键图表部分提效。

核心结论

  • 半自动机器学习辅助SSI抽象大幅加速流程并达到良好性能,可推广至其他术后结局并降低ACS-NSQIP广泛采用的成本障碍。

研究设计与样本

  • 评估数据集根据截断分数分为「阴性」和「可能」SSI组,仅对「可能」组进行人工数据抽象。
  • 对「可能」组10%进行盲审,仅考虑算法选择的特征,与基于完整图表抽象的金标准比较。

主要发现

  • 应用截断分数后,人工抽象量减少超过90%。
  • 「阴性」组假阴性率低于1%,灵敏度为82%。
  • 对「可能」组10%的盲审显示与金标准高度一致,提示抽象者审阅有限关键图表部分可额外提效。

临床怎么用

  • 可采用半自动机器学习辅助SSI抽象,减少人工工作量并维持较高灵敏度。
  • 抽象者可能仅需审阅算法选出的有限关键图表部分,以提高效率。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: To demonstrate that a semi-automated approach to health data abstraction provides significant efficiencies and high accuracy. BACKGROUND: Surgical outcome abstraction remains laborious and a barrier to the sustainment of quality improvement registries like ACS-NSQIP. A supervised machine learning algorithm developed for detecting SSi using structured and unstructured electronic health record data was tested to perform semi-automated SSI abstraction. METHODS: A Lasso-penalized logistic regression model with 2011-3 data was trained (baseline performance measured with 10-fold cross-validation). A cutoff probability score from the training data was established, dividing the subsequent evaluation dataset into "negative" and "possible" SSI groups, with manual data abstraction only performed on the "possible" group. We evaluated performance on data from 2014, 2015, and both years. RESULTS: Overall, 6188 patients were in the 2011-3 training dataset and 5132 patients in the 2014-5 evaluation dataset. With use of the semi-automated approach, applying the cut-off score decreased the amount of manual abstraction by >90%, resulting in < 1% false negatives in the "negative" group and a sensitivity of 82%. A blinded review of 10% of the "possible" group, considering only the features selected by the algorithm, resulted in high agreement with the gold standard based on full chart abstraction, pointing towards additional efficiency in the abstraction process by making it possible for abstractors to review limited, salient portions of the chart. CONCLUSION: Semi-automated machine learning-aided SSI abstraction greatly accelerates the abstraction process and achieves very good performance. This could be translated to other post-operative outcomes and reduce cost barriers for wider ACS-NSQIP adoption.

来源:Ann Surg,查看原文。版权归原作者所有。

引用

  1. Skube SJ, Hu Z, Simon GJ, et al. Accelerating Surgical Site Infection Abstraction With a Semi-automated Machine-learning Approach. Ann Surg. 2020. PMID: 33074897. doi:10.1097/SLA.0000000000004354

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。