指南与共识重症综合管理与镇静镇痛

量化带解释的AI推荐对处方决策的影响

Quantifying the impact of AI recommendations with explanations on prescription decision making.
指南 / 共识 · NPJ Digit Med · 2023-11-07
一句话结论在模拟ICU处方实验中,AI推荐显著影响医生的处方剂量,但简单可解释AI(XAI)并未比单纯AI推荐产生更大影响。

研究采用改良被试间设计,86名重症医学科医生对16个试验各看到一例患者病例,并被要求为两种药物开具连续剂量值。采用四臂多因素实验设计:基线对照、同行人类医生处方场景、AI建议、XAI建议,每位医生在不同患者子集上体验全部四臂。结果显示额外信息(同行、AI或XAI)对处方有强烈影响,其中AI建议的影响显著,同行信息则未达显著;简单XAI并未比单纯AI产生更高影响。医生对AI的态度或临床经验与AI支持下的决策无相关性,医生自报XAI有用程度与XAI是否实际影响处方也无相关性。

要点

  • 86名重症医学科医生参与模拟处方实验,每位医生在24例患者的不同子集上体验全部四臂,每臂16个试验。
  • 额外信息(同行、AI或XAI)对处方剂量有强烈影响,其中AI建议的影响显著,同行信息则未达显著。
  • 简单XAI(采用简单特征重要性)并未比单纯AI建议产生更高影响。
  • 医生对AI的态度或临床经验与AI支持下的决策无相关性。
  • 医生自报XAI有用程度与XAI是否实际影响处方无相关性,提示自报指标可能不适合评估临床专家中的XAI。

适用人群与场景

  • 重症医学科医生(N = 86),在计算机上对16个试验各看到一例患者病例并被要求为两种药物开具连续剂量值。
  • 每位医生在24例患者的不同子集上体验全部四臂。

研究设计与关键结果

  • 研究采用改良被试间设计、四臂多因素实验设计,四臂为:基线对照、同行人类医生处方场景、AI建议、XAI建议(采用简单特征重要性)。
  • 额外信息(同行、AI或XAI)对处方有强烈影响,其中AI建议的影响显著,同行信息则未达显著。
  • 简单XAI并未比单纯AI建议产生更高影响。
  • 医生对AI的态度或临床经验与AI支持下的决策无相关性。
  • 医生自报XAI有用程度与XAI是否实际影响处方无相关性。

证据类型、等级与局限

  • 证据类型:实验研究(改良被试间设计、四臂多因素实验设计)。
  • 作者认为:在此情境下简单XAI的边际影响较低,并对自报指标作为评估临床专家中XAI的有效指标提出质疑。
  • 局限:原文未报告局限性。

对床旁实践的改变

  • 作者认为:在此情境下简单XAI的边际影响较低,并对自报指标作为评估临床专家中XAI的有效指标提出质疑。

提炼说明

  • 本条依据论文摘要整理;摘要未涉及「诊断标准与关键阈值」「处置流程与药物剂量」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开

The influence of AI recommendations on physician behaviour remains poorly characterised. We assess how clinicians' decisions may be influenced by additional information more broadly, and how this influence can be modified by either the source of the information (human peers or AI) and the presence or absence of an AI explanation (XAI, here using simple feature importance). We used a modified between-subjects design where intensive care doctors (N = 86) were presented on a computer for each of 16 trials with a patient case and prompted to prescribe continuous values for two drugs. We used a multi-factorial experimental design with four arms, where each clinician experienced all four arms on different subsets of our 24 patients. The four arms were (i) baseline (control), (ii) peer human clinician scenario showing what doses had been prescribed by other doctors, (iii) AI suggestion and (iv) XAI suggestion. We found that additional information (peer, AI or XAI) had a strong influence on prescriptions (significantly for AI, not so for peers) but simple XAI did not have higher influence than AI alone. There was no correlation between attitudes to AI or clinical experience on the AI-supported decisions and nor was there correlation between what doctors self-reported about how useful they found the XAI and whether the XAI actually influenced their prescriptions. Our findings suggest that the marginal impact of simple XAI was low in this setting and we also cast doubt on the utility of self-reports as a valid metric for assessing XAI in clinical experts.

来源:NPJ Digit Med,查看原文。版权归原作者所有。

参考来源

  1. Nagendran M, Festor P, Komorowski M, et al. Quantifying the impact of AI recommendations with explanations on prescription decision making. NPJ Digit Med. 2023. PMID: 37935953. doi:10.1038/s41746-023-00955-z

供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。