文献速递技术与安全DR

放射学中人工智能的可解释性:眼动数据驱动的深度学习系统综述与分类

Shedding light on ai in radiology: A systematic review and taxonomy of eye gaze-driven interpretability in deep learning.
PubMed 文献 · Eur J Radiol · 2024-02-01

该研究通过PRISMA系统综述60项将眼动追踪数据与深度学习方法结合的研究,分析眼动数据处理技术及深度学习架构在不同放射学任务中的应用。研究提出按任务分类的体系,并评估眼动数据对提升放射学AI可解释性的作用,指出文献中矛盾结果源于数据处理方式、架构选择和应用目标的不同。

要点

  • 眼动数据可映射专家关注区域,辅助深度学习模型实现异常检测与可解释性提升。
  • 眼动数据处理方式和深度学习架构选择需与具体放射学任务匹配。
  • 该综述提出按任务分类的体系,为不同应用场景提供架构与数据处理指南。
英文原文(摘要)· 点击展开

X-ray imaging plays a crucial role in diagnostic medicine. Yet, a significant portion of the global population lacks access to this essential technology due to a shortage of trained radiologists. Eye-tracking data and deep learning models can enhance X-ray analysis by mapping expert focus areas, guiding automated anomaly detection, optimizing workflow efficiency, and bolstering training methods for novice radiologists. However, the literature shows contradictory results regarding the usefulness of eye-tracking data in deep-learning architectures for abnormality detection. We argue that these discrepancies between studies in the literature are due to (a) the way eye-tracking data is (or is not) processed, (b) the types of deep learning architectures chosen, and (c) the type of application that these architectures will have. We conducted a systematic literature review using PRISMA to address these contradicting results. We analyzed 60 studies that incorporated eye-tracking data in a deep-learning approach for different application goals in radiology. We performed a comparative analysis to understand if eye gaze data contains feature maps that can be useful under a deep learning approach and whether they can promote more interpretable predictions. To the best of our knowledge, this is the first survey in the area that performs a thorough investigation of eye gaze data processing techniques and their impacts in different deep learning architectures for applications such as error detection, classification, object detection, expertise level analysis, fatigue estimation and human attention prediction in medical imaging data. Our analysis resulted in two main contributions: (1) taxonomy that first divides the literature by task, enabling us to analyze the value eye movement can bring for each case and build guidelines regarding architectures and gaze processing techniques adequate for each application, and (2) an overall analysis of how eye gaze data can promote explainability in radiology.

来源:Eur J Radiol,查看原文。版权归原作者所有。

引用

  1. Neves J, Hsieh C, Nobre IB, et al. Shedding light on ai in radiology: A systematic review and taxonomy of eye gaze-driven interpretability in deep learning. Eur J Radiol. 2024. PMID: 38340426. doi:10.1016/j.ejrad.2024.111341

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。