文献速递咽喉与嗓音

耳鼻咽喉科医生对机器学习驱动的临床决策支持工具的信任

Trust in Machine Learning Driven Clinical Decision Support Tools Among Otolaryngologists.
PubMed 文献 · Laryngoscope · 2024-01-17

本研究招募美国45名耳鼻咽喉科医生,对12段视频频闪喉镜进行诊断,随后展示无解释、一般解释或具体解释的机器学习驱动临床决策支持工具(ML-CDST)随机诊断。结果显示,医生信心较低时更易改变诊断判断(p=0.001),且具体逻辑解释时更易改变判断(p=0.048)。

要点

  • 信心较低时(268次观察)较信心较高时(238次观察)更易改变诊断判断(p=0.001)。
  • 呈现ML-CDST具体逻辑解释时,医生更易改变诊断判断(p=0.048)。
  • 耳鼻咽喉科医生易接受ML-CDST诊断建议,尤其信心较低时。

核心结论

  • 耳鼻咽喉科医生易接受ML-CDST诊断建议,尤其信心较低时;伴随具体逻辑解释时信任增加。

研究设计与样本

  • 在美国虚拟招募45名耳鼻咽喉科医生,开展人机交互实验。
  • 参与者观看12段视频频闪喉镜检查,患者已诊断喉咽反流或声带麻痹,要求判断疾病存在与否。
  • 随后暴露于随机ML-CDST诊断,可修改诊断,输出呈现方式为无解释、一般解释或具体解释。

主要发现

  • 信心较低时(268次观察)较信心较高时(238次观察)更易改变诊断判断(p=0.001)。
  • 呈现具体解释时较其他解释方式更易改变诊断判断(p=0.048)。

关键数值与推荐

  • 使用McNemar检验评估ML-CDST对诊断判断的影响。
  • 证据等级为2级。

临床怎么用

  • 原文未据此给出临床推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Machine learning driven clinical decision support tools (ML-CDST) are on the verge of being integrated into clinical settings, including in Otolaryngology-Head & Neck Surgery. In this study, we investigated whether such CDST may influence otolaryngologists' diagnostic judgement. METHODS: Otolaryngologists were recruited virtually across the United States for this experiment on human-AI interaction. Participants were shown 12 different video-stroboscopic exams from patients with previously diagnosed laryngopharyngeal reflux or vocal fold paresis and asked to determine the presence of disease. They were then exposed to a random diagnosis purportedly resulting from an ML-CDST and given the opportunity to revise their diagnosis. The ML-CDST output was presented with no explanation, a general explanation, or a specific explanation of its logic. The ML-CDST impact on diagnostic judgement was assessed with McNemar's test. RESULTS: Forty-five participants were recruited. When participants reported less confidence (268 observations), they were significantly (p = 0.001) more likely to change their diagnostic judgement after exposure to ML-CDST output compared to when they reported more confidence (238 observations). Participants were more likely to change their diagnostic judgement when presented with a specific explanation of the CDST logic (p = 0.048). CONCLUSIONS: Our study suggests that otolaryngologists are susceptible to accepting ML-CDST diagnostic recommendations, especially when less confident. Otolaryngologists' trust in ML-CDST output is increased when accompanied with a specific explanation of its logic. LEVEL OF EVIDENCE: 2 Laryngoscope, 134:2799-2804, 2024.

来源:Laryngoscope,查看原文。版权归原作者所有。

引用

  1. Chen H, Ma X, Rives H, et al. Trust in Machine Learning Driven Clinical Decision Support Tools Among Otolaryngologists. Laryngoscope. 2024. PMID: 38230948. doi:10.1002/lary.31260

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。