文献速递临床微生物分子诊断质量管理与危急值

基于GPT-4的AI智能体:检测抗菌药物耐药机制的新专家系统?

GPT-4-based AI agents-the new expert system for detection of antimicrobial resistance mechanisms?
PubMed 文献 · J Clin Microbiol · 2024-10-17

该研究以225株革兰阴性菌为对象,比较了经EUCAST指南定制的GPT智能体、微生物学家和未定制GPT-4对纸片扩散法进行β-内酰胺酶预分类的表现。微生物学家一致性更高、推理更简洁,定制GPT智能体对ESBL和AmpC的特异性较低,可能导致额外检测和诊断延迟。

要点

  • 微生物学家对ESBL、AmpC和碳青霉烯酶的中位敏感性/特异性均较高。
  • 定制GPT智能体对ESBL和AmpC特异性偏低,可能增加额外检测。
  • 未定制GPT-4仅能解读部分类别,且未获监管批准。

核心结论

  • 微生物学家在一致性、推理简洁性和特异性方面优于GPT智能体。
  • GPT智能体对ESBL和AmpC的不特异性标记可能导致额外检测、诊断延迟和成本增加。
  • GPT-4尚未获监管机构批准,大语言模型需要验证。

研究设计与样本

  • 研究纳入225株革兰阴性菌分离株,基于表型耐药分配至无、ESBL、AmpC或碳青霉烯酶机制。
  • 定制GPT智能体使用EUCAST指南和折点表v13.1,并与常规诊断、微生物学家和未定制GPT-4比较。

主要发现

  • 三名微生物学家在814/862(94.4%)表型类别中一致,推理中位8词(IQR 4-11)。
  • 微生物学家对ESBL、AmpC和碳青霉烯酶的中位敏感性/特异性分别为98%/99.1%、96.8%/97.1%和95.5%/98.5%。
  • 定制GPT智能体三次提示在706/862(81.9%)类别中一致,推理中位158词(IQR 140-174)。
  • 定制GPT智能体对ESBL、AmpC和碳青霉烯酶预测的敏感性/特异性分别为95.4%/69.23%、96.9%/86.3%和100%/98.8%。
  • 未定制GPT-4解读169/862(19.6%)类别,其中137/169(81.1%)与常规诊断一致,推理中位85词(IQR 72-105)。

关键数值与推荐

  • EUCAST推荐两步法检测革兰阴性菌β-内酰胺酶:筛查疑似ESBL、质粒介导AmpC或碳青霉烯酶生产,再进行确认。

临床怎么用

  • GPT智能体目前不适用于替代微生物学家进行β-内酰胺酶预分类。
  • 使用GPT智能体辅助时需注意其低特异性可能导致的额外检测和延迟。

局限性

  • GPT-4未获监管机构批准。
  • 研究仅评估预分类,未涉及临床结局。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

UNLABELLED: The European Committee on Antimicrobial Susceptibility Testing (EUCAST) recommends two steps for detecting beta-lactamases in Gram-negative bacteria. Screening for potential extended-spectrum beta-lactamase (ESBL), plasmid-mediated AmpC beta-lactamase, or carbapenemase production is confirmed. We aimed to validate generative pre-trained transformer (GPT)-4 and GPT-agent for pre-classification of disk diffusion to indicate potential beta-lactamases. We assigned 225 Gram-negative isolates based on phenotypic resistances against beta-lactam antibiotics and additional tests to one or more resistance mechanisms as follows: "none," "ESBL," "AmpC," or "carbapenemase." Next, we customized a GPT-agent with EUCAST guidelines and breakpoint table (v13.1). We compared routine diagnostics (reference) to those of (i) EUCAST-GPT-expert, (ii) microbiologists, and (iii) non-customized GPT-4. We determined sensitivities and specificities to flag suspect resistances. Three microbiologists showed concordance in 814/862 (94.4%) phenotypic categories and were used in median eight words (interquartile range [IQR] 4-11) for reasoning. Median sensitivity/specificity for ESBL, AmpC, and carbapenemase were 98%/99.1%, 96.8%/97.1%, and 95.5%/98.5%, respectively. Three prompts of EUCAST-GPT-expert showed concordance in 706/862 (81.9%) categories but were used in median 158 words (IQR 140-174) for reasoning. Sensitivity/specificity for ESBL, AmpC, and carbapenemase prediction were 95.4%/69.23%, 96.9%/86.3%, and 100%/98.8%, respectively. Non-customized GPT-4 could interpret 169/862 (19.6%) categories, and 137/169 (81.1%) agreed with routine diagnostics. Non-customized GPT-4 was used in median 85 words (IQR 72-105) for reasoning. Microbiologists showed higher concordance and shorter argumentations compared to GPT-agents. Humans showed higher specificities compared to GPT-agents. GPT-agent's unspecific flagging of ESBL and AmpC potentially results in additional testing, diagnostic delays, and higher costs. GPT-4 is not approved by regulatory bodies, but validation of large language models is needed. IMPORTANCE: The study titled "GPT-4-based AI agents-the new expert system for detection of antimicrobial resistance mechanisms?" is critically important as it explores the integration of advanced artificial intelligence (AI) technologies, like generative pre-trained transformer (GPT)-4, into the field of laboratory medicine, specifically in the diagnostics of antimicrobial resistance (AMR). With the growing challenge of AMR, there is a pressing need for innovative solutions that can enhance diagnostic accuracy and efficiency. This research assesses the capability of AI to support the existing two-step confirmatory process recommended by the European Committee on Antimicrobial Susceptibility Testing for detecting beta-lactamases in Gram-negative bacteria. By potentially speeding up and improving the precision of initial screenings, AI could reduce the time to appropriate treatment interventions. Furthermore, this study is vital for validating the reliability and safety of AI tools in clinical settings, ensuring they meet stringent regulatory standards before they can be broadly implemented. This could herald a significant shift in how laboratory diagnostics are performed, ultimately leading to better patient outcomes.

来源:J Clin Microbiol,查看原文。版权归原作者所有。

引用

  1. Giske CG, Bressan M, Fiechter F, et al. GPT-4-based AI agents-the new expert system for detection of antimicrobial resistance mechanisms? J Clin Microbiol. 2024. PMID: 39417635. doi:10.1128/jcm.00689-24

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。