大语言模型自动分类前列腺癌水凝胶直肠间隔物不良事件
本研究评估大语言模型(LLM)分析直肠水凝胶间隔物(SpaceOAR)相关不良事件(AE)的性能。结果显示最常见问题为凝胶位置异常(58.7%)、感染/炎症/脓肿(10.4%)、瘘(7.1%)和直肠溃疡(4.7%),ICU级别护理和死亡分别报告0.1%和0.3%。
要点
- GPT-4o分类AE的总体评分4.96,接近人类评审的4.99。
- 全部1455份报告中凝胶位置异常最常见(58.7%)。
- 严重AE包括ICU护理(0.1%)和死亡(0.3%)。
核心结论
- 大语言模型有望自动化耗时的器械相关AE汇总过程。
- SpaceOAR相关严重AE报告提示需持续动态监测并审慎选择水凝胶间隔物。
主要发现
- 全部1455份报告中,最常见主要问题为凝胶位置异常(58.7%)、感染/炎症/脓肿(10.4%)、瘘(7.1%)、直肠溃疡(4.7%)。
- ICU级别护理和死亡分别报告0.1%和0.3%。
关键数值与推荐
- LLM正确识别AE结局的能力汇总为总体评分,GPT-4o得分4.96,人类评审得分4.99。
- 主要问题占比:凝胶位置异常58.7%,感染/炎症/脓肿10.4%,瘘7.1%,直肠溃疡4.7%。
- ICU级别护理报告率0.1%,死亡报告率0.3%。
临床怎么用
- LLM可辅助自动化器械相关AE的汇总分析,提高效率。
- 临床选用水凝胶间隔物时应关注严重AE风险并加强监测。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: To examine the performance of large language models (LLMs) for the analysis of adverse events (AEs) associated with a perirectal hydrogel spacer (SpaceOAR) prior to prostate radiation. METHODS: We queried the Food and Drug Administration's (FDA's) Manufacturer and User Facility Device Experience (MAUDE) database to extract reports related to "SpaceOAR". Ninety-seven reports were initially manually abstracted to classify the problems associated with each event, subsequent modifications in radiation timing, and severity using the Common Terminology Criteria for Adverse Events (CTCAE) score. We compared the accuracy of 3 families of LLMs when compared to human abstraction. The highest-performing LLM was then used to classify AEs based on all available MAUDE data for spaceOAR (n = 1455) from January 2015 to December 2024. RESULTS: The ability of LLMs to correctly identify the AE outcomes was aggregated into an overall score. The highest-performing model was GPT-4o, with an overall score of 4.96 (σ = 0.00526) compared to the human reviewers who had an overall score of 4.99 (σ =.216). When run on all 1455 reports, GPT-4o revealed that the most common primary problems were malpositioned gel (58.7%), infection/inflammation/abscess (10.4%), fistula (7.1%), and rectal ulcer (4.7%). ICU level care and death were reported 0.1% and 0.3% of the time, respectively. CONCLUSION: These findings highlight the potential for LLMs to automate the time-consuming process of tabulating device-related AEs. Reported serious AEs associated with spaceOAR underscore potential safety concerns, warranting dynamic ongoing surveillance and careful consideration when opting to implement hydrogel spacers.
引用
- Sohoni N, Sohoni NS, Sutherland RA, et al. Automated Classification of Adverse Events After Hydrogel Perirectal Spacer Insertion for Prostate Cancer Using Large Language Models. Urology. 2026. PMID: 41565161. doi:10.1016/j.urology.2026.01.008
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。