指南与共识腹部技术与安全US

提高放射学报告对社会指南的依从性:基于超声放射学家学会胆囊息肉指南的可行性研究

Increasing Adherence to Societal Recommendations in Radiology Reporting: A Feasibility Study Using Society of Radiologists in Ultrasound Guidelines for Incidentally Detected Gallbladder Polyps.
指南 / 共识 · Ultrasound Q · 2024-12-17

该可行性研究回顾性分析了2022年成人急诊患者的胆囊超声检查,开发了基于检索增强生成和提示工程的交互式工具GB-PRL,用于将2021年SRU胆囊息肉指南整合到放射学报告中。GB-PRL在风险分类和随访建议上达到100%准确率,优于主流大语言模型(P < 0.001),在回顾性数据上也优于放射学报告(P = 0.04),但清晰度和一致性改善未达统计学显著(P = 0.22)。

要点

  • GB-PRL工具在假设查询的风险分类和随访建议上准确率达100%。
  • 回顾性数据中GB-PRL准确率优于放射学报告(P = 0.04)。
  • 清晰度和一致性改善较放射学报告未达统计学显著(P = 0.22)。

核心结论

  • 基于大语言模型的GB-PRL工具在将SRU指南整合到放射学报告方面是可行的,其在风险分类和随访建议上的准确率优于主流大语言模型和回顾性放射学报告,但清晰度和一致性改善未达统计学显著,需前瞻性测试后才能整合到临床实践。

研究设计与样本

  • 经机构审查委员会批准,回顾性审查2022年成人急诊患者的胆囊超声检查,开发使用检索增强生成和提示工程的交互式工具GB-PRL,由 board-certified 放射科医师测试准确性,由 board-certified 急诊科医师评估清晰度和一致性。

诊断标准与关键数值

  • GB-PRL在假设用户查询的风险分类和随访建议上准确率为100%(P < 0.001)。
  • GB-PRL在回顾性数据上的准确率优于放射学报告(P = 0.04)。
  • GB-PRL的清晰度和一致性改善较放射学报告未达统计学显著(P = 0.22)。

局限性

  • 需在整合到临床实践前对GB-PRL进行前瞻性测试。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Incidental findings in diagnostic imaging are common, but follow-up recommendations often lack consistency. The Society of Radiologists in Ultrasound (SRU) issued guidelines in 2021 for managing incidentally detected gallbladder polyps, aiming to balance follow-up with avoiding overtreatment. There is variable adherence to these guidelines in radiology reports, however, which makes it difficult for the clinician to pursue appropriate follow-up for the patient. The purpose of this project is to test the feasibility of a Large Language Model (LLM)-based tool to incorporate SRU guidelines into radiology reports. Additionally, we propose a framework for closely integrating societal follow-up recommendations into radiology reports, using this tool as an example.Following institutional review board approval, we retrospectively reviewed gallbladder ultrasound examinations performed on adult ED patients in 2022. Data on patient demographics and radiology report content were collected. Using the 2021 SRU guidelines, we developed an interactive tool employing a retriever-augmented generator (RAG) and prompt engineering. A board-certified radiologist tested the accuracy, whereas a board-certified emergency medicine physician assessed the clarity and consistency of the recommendations.The interactive tool, GB-PRL, outperformed leading closed-source and open-source LLMs, achieving 100% accuracy in risk categorization and follow-up recommendations on hypothetical user queries (P < 0.001). The tool also showed superior accuracy compared to radiology reports on retrospective data (P = 0.04). Although GB-PRL demonstrated greater clarity and consistency, the improvement from the radiology reports was not statistically significant (P = 0.22). Further work is needed for prospective testing of GB-PRL before integrating it into clinical practice.

来源:Ultrasound Q,查看原文。版权归原作者所有。

引用

  1. Mugu VK, Carr BM, Olson MC, et al. Increasing Adherence to Societal Recommendations in Radiology Reporting: A Feasibility Study Using Society of Radiologists in Ultrasound Guidelines for Incidentally Detected Gallbladder Polyps. Ultrasound Q. 2024. PMID: 39690147. doi:10.1097/RUQ.0000000000000699

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。