RADHawk——一种基于人工智能的知识推荐器,用于支持精准教育、提高报告效率并降低认知负荷
一项前瞻性混合方法研究将放射科受训学员分为干预组(n=28,使用RADHawk)和对照组(n=29,不使用),在轮转月末进行模拟PACS报告评估。干预组每例报告时间减少162秒(95%CI -275.76至-52.40秒,P=0.002),准确率评分提高14%(95%CI 8.1-19.8%,P<0.001),且心理需求、努力和挫折感更低(均P=0.030)。
要点
- 干预组每例报告时间较对照组减少162秒(95%CI -275.76至-52.40秒,P=0.002)。
- 干预组准确率评分较对照组提高14%(95%CI 8.1-19.8%,P<0.001)。
- 干预组心理需求、努力和挫折感均较低(均P=0.030),89%的干预组参与者要求下次轮转使用RADHawk。
核心结论
- RADHawk作为首个报道的用于放射学教育的AI衍生知识推荐器,显著减少报告时间并提高报告准确性,同时降低放射科受训学员的整体工作负荷和心理需求。
研究设计与样本
- 前瞻性混合方法研究,将受训学员分配到干预组(n=28,使用RADHawk)和对照组(n=29,不使用RADHawk),在轮转开始和结束时通过验证问卷及模拟PACS报告评估技术接受度、报告质量、报告时间、检索时间、认知负荷和学习策略态度。
诊断标准与关键数值
- 轮转结束时,干预组每例报告时间减少162秒(95%CI -275.76至-52.40秒,P=0.002),准确率评分提高14%(95%CI 8.1-19.8%,P<0.001),心理需求、努力和挫折感均较低(均P=0.030)。
临床应用与阅片要点
- 作者认为RADHawk的高接受度提示其可能支持自主学习;作者结论指出需在更大的外部队列中进一步测试以支持更广泛实施。
局限性
- 原文结论指出需在更大的外部队列中进一步测试以支持更广泛实施。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND: Using artificial intelligence (AI) to augment knowledge is key to establishing precision education in modern radiology training. Our department has developed a novel AI-derived knowledge recommender, the first reported precision education program in radiology, RADHawk (RH), that augments the training of radiology residents and fellows by pushing personalized and relevant educational content in real-time and in context with the case being interpreted.
PURPOSE: To assess the impact on trainees of an AI-based knowledge recommender compared to traditional knowledge sourcing for radiology reporting through reporting time, quality, cognitive load, and learning experiences.
MATERIALS AND METHODS: A mixed methods prospective study allocated trainees to intervention and control groups, working with and without access to RH, respectively. Validated questionnaires and observed and graded simulated picture archiving and communication system (PACS)-based reporting at the start and end of a month's rotation assessed technology acceptance, case report quality, case report time and sourcing time, cognitive load, and attitudes toward modified learning strategies. Non-parametric regression analyses and Mann-Whitney tests were used to compare outcomes between groups, with significance set at P<0.05.
RESULTS: The intervention group (n=28) demonstrated a statistically significant reduction in the case report time by -162 s per case (95%CI -275.76 s to -52.40 s) (P-value = 0.002) and an increase of 14% (95%CI 8.1-19.8%) (P-value <0.001) in accuracy scores compared to the control group (n=29) at the end of the rotation. The intervention group also showed lower levels of mental demand (P=0.030) and experienced less effort (P=0.030) and frustration (P=0.030) while reporting. Additionally, >78% of the intervention group gave positive ratings on RH's effectiveness, increase in productivity, job usefulness, and ease of use. Eighty-nine percent of participants in the intervention group requested access to RH for their next rotation.
CONCLUSION: This study demonstrates that RH, as the first reported AI-derived knowledge recommender for radiology education, significantly reduces reporting time and improves reporting accuracy while reducing overall workload and mental demand for radiology trainees. The high acceptance among trainees suggests its potential for supporting self-directed learning. Further testing of a larger external cohort will support more widespread implementation of RH for precision education.
引用
- Lopez-Rippe J, Reddy M, Velez-Florez MC, et al. RADHawk-an AI-based knowledge recommender to support precision education, improve reporting productivity, and reduce cognitive load. Pediatr Radiol. 2024. PMID: 39644355. doi:10.1007/s00247-024-06116-y
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。