文献速递临床生化质量管理与危急值

利用机器学习开发临床生化实验室自动审核系统

Using machine learning to develop an autoverification system in a clinical biochemistry laboratory.
PubMed 文献 · Clin Chem Lab Med · 2020-11-26

该研究从实验室信息系统和Roche Cobas® IT 3000提取2018年6月1日至2019年8月30日包含52个检测项目及人口学信息的检测数据,通过两轮建模训练不同机器学习算法并筛选前三名组成集成模型。双盲测试显示AI系统通过率89.60%、假阴性率0.95‰,较规则引擎降低约80%无效报告。

要点

  • AI自动审核系统双盲测试通过率89.60%,假阴性率0.95‰。
  • 较规则引擎减少约80%无效报告,提升效率并降低工作量。
  • 机器学习算法用于自动审核具有高准确性和可行性。

核心结论

  • 机器学习算法用于自动审核系统具有高准确性和效率,可行。

研究设计与样本

  • 研究提取2018年6月1日至2019年8月30日实验室信息系统和Roche Cobas® IT 3000中52个检测项目及人口学信息的检测数据。
  • 进行两轮建模训练不同机器学习算法并测试其区分无效报告的能力,选取表现前三的算法组成最终集成模型。
  • 开展经验实验室人员与AI自动审核系统的双盲测试,记录通过率和假阴性率,并分析工作效率和工作量减少情况。

主要发现

  • 最终AI系统双盲测试通过率为89.60%,假阴性率为0.95 per mille。
  • AI系统较规则引擎评估降低约80%的无效报告数量。
  • AI系统提升了生化实验室工作效率并减少了工作量。

临床怎么用

  • 可将机器学习集成模型用于临床生化实验室自动审核,以降低无效报告数量并减少人工审核工作量。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: Autoverification systems have greatly improved laboratory efficiency. However, the long-developed rule-based autoverfication models have limitations. The machine learning (ML) algorithm possesses unique advantages in the evaluation of large datasets. We investigated the utility of ML algorithms for developing an artificial intelligence (AI) autoverification system to support laboratory testing. The accuracy and efficiency of the algorithm model were also validated. METHODS: Testing data, including 52 testing items with demographic information, were extracted from the laboratory information system and Roche Cobas® IT 3000 from June 1, 2018 to August 30, 2019. Two rounds of modeling were conducted to train different ML algorithms and test their abilities to distinguish invalid reports. Algorithms with the top three best performances were selected to form the finalized ensemble model. Double-blind testing between experienced laboratory personnel and the AI autoverification system was conducted, and the passing rate and false-negative rate (FNR) were documented. The working efficiency and workload reduction were also analyzed. RESULTS: The final AI system showed a 89.60% passing rate and 0.95 per mille FNR, in double-blind testing. The AI system lowered the number of invalid reports by approximately 80% compared to those evaluated by a rule-based engine, and therefore enhanced the working efficiency and reduced the workload in the biochemistry laboratory. CONCLUSIONS: We confirmed the feasibility of the ML algorithm for autoverification with high accuracy and efficiency.

来源:Clin Chem Lab Med,查看原文。版权归原作者所有。

引用

  1. Wang H, Wang H, Zhang J, et al. Using machine learning to develop an autoverification system in a clinical biochemistry laboratory. Clin Chem Lab Med. 2020. PMID: 33554565. doi:10.1515/cclm-2020-0716

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。