耳鼻咽喉科医生对机器学习驱动的临床决策支持工具的信任
本研究招募美国45名耳鼻咽喉科医生,对12段视频频闪喉镜进行诊断,随后展示无解释、一般解释或具体解释的机器学习驱动临床决策支持工具(ML-CDST)随机诊断。结果显示,医生信心较低时更易改变诊断判断(p=0.001),且具体逻辑解释时更易改变判断(p=0.048)。
要点
- 信心较低时(268次观察)较信心较高时(238次观察)更易改变诊断判断(p=0.001)。
- 呈现ML-CDST具体逻辑解释时,医生更易改变诊断判断(p=0.048)。
- 耳鼻咽喉科医生易接受ML-CDST诊断建议,尤其信心较低时。
核心结论
- 耳鼻咽喉科医生易接受ML-CDST诊断建议,尤其信心较低时;伴随具体逻辑解释时信任增加。
研究设计与样本
- 在美国虚拟招募45名耳鼻咽喉科医生,开展人机交互实验。
- 参与者观看12段视频频闪喉镜检查,患者已诊断喉咽反流或声带麻痹,要求判断疾病存在与否。
- 随后暴露于随机ML-CDST诊断,可修改诊断,输出呈现方式为无解释、一般解释或具体解释。
主要发现
- 信心较低时(268次观察)较信心较高时(238次观察)更易改变诊断判断(p=0.001)。
- 呈现具体解释时较其他解释方式更易改变诊断判断(p=0.048)。
关键数值与推荐
- 使用McNemar检验评估ML-CDST对诊断判断的影响。
- 证据等级为2级。
临床怎么用
- 原文未据此给出临床推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Machine learning driven clinical decision support tools (ML-CDST) are on the verge of being integrated into clinical settings, including in Otolaryngology-Head & Neck Surgery. In this study, we investigated whether such CDST may influence otolaryngologists' diagnostic judgement. METHODS: Otolaryngologists were recruited virtually across the United States for this experiment on human-AI interaction. Participants were shown 12 different video-stroboscopic exams from patients with previously diagnosed laryngopharyngeal reflux or vocal fold paresis and asked to determine the presence of disease. They were then exposed to a random diagnosis purportedly resulting from an ML-CDST and given the opportunity to revise their diagnosis. The ML-CDST output was presented with no explanation, a general explanation, or a specific explanation of its logic. The ML-CDST impact on diagnostic judgement was assessed with McNemar's test. RESULTS: Forty-five participants were recruited. When participants reported less confidence (268 observations), they were significantly (p = 0.001) more likely to change their diagnostic judgement after exposure to ML-CDST output compared to when they reported more confidence (238 observations). Participants were more likely to change their diagnostic judgement when presented with a specific explanation of the CDST logic (p = 0.048). CONCLUSIONS: Our study suggests that otolaryngologists are susceptible to accepting ML-CDST diagnostic recommendations, especially when less confident. Otolaryngologists' trust in ML-CDST output is increased when accompanied with a specific explanation of its logic. LEVEL OF EVIDENCE: 2 Laryngoscope, 134:2799-2804, 2024.
引用
- Chen H, Ma X, Rives H, et al. Trust in Machine Learning Driven Clinical Decision Support Tools Among Otolaryngologists. Laryngoscope. 2024. PMID: 38230948. doi:10.1002/lary.31260
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。