通过自然语言处理从神经放射学MRI报告中自动生成结论
本研究回顾性应用微调的Text-To-Text Transfer Transformer(T5)模型,对232,425份西班牙语神经放射学MRI报告进行抽象摘要,自动生成结论。模型在BLEU-1、METEOR、ROUGE-L、CIDEr和余弦相似度上分别达到0.46、0.28、0.52、2.45和0.87;放射专家评估中,75%的生成结论与人工结论相当或更好。作者认为定制预训练模型可生成接近专家质量的自动MRI报告结论。
要点
- 微调的T5模型可为西班牙语神经放射学MRI报告自动生成结论。
- 自动结论在75%的专家评估病例中与人工结论相当或更好。
- BLEU-1 0.46、ROUGE-L 0.52、余弦相似度0.87提示与参考结论高度接近。
核心结论
- 定制预训练的T5模型能生成接近专家质量的神经放射学MRI报告自动结论,凸显为放射学报告摘要设计和预训练专用语言模型的重要性。
研究设计与样本
- 回顾性研究,使用232,425份西班牙语神经放射学MRI报告,比较多种预训练T5模型(包括多语言T5和新适配西班牙语的模型),以BLEU、METEOR、ROUGE-L、CIDEr和余弦相似度及放射专家评估进行评价。
诊断标准与关键数值
- 微调后的神经放射学MRI模型在BLEU-1为0.46、METEOR为0.28、ROUGE-L为0.52、CIDEr为2.45、余弦相似度为0.87;放射专家评估中75%的病例生成结论与人工结论相当或更好。
临床应用与阅片要点
- 作者认为该方法显示出定制最先进预训练模型用于神经放射学的潜力和有效性,可生成接近专家质量的自动MRI报告结论。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
PURPOSE: The conclusion section of a radiology report is crucial for summarizing the primary radiological findings in natural language and essential for communicating results to clinicians. However, creating these summaries is time-consuming, repetitive, and prone to variability and errors among different radiologists. To address these issues, we evaluated a fine-tuned Text-To-Text Transfer Transformer (T5) model for abstractive summarization to automatically generate conclusions for neuroradiology MRI reports in a low-resource language.
METHODS: We retrospectively applied our method to a dataset of 232,425 neuroradiology MRI reports in Spanish. We compared various pre-trained T5 models, including multilingual T5 and those newly adapted for Spanish. For precise evaluation, we employed BLEU, METEOR, ROUGE-L, CIDEr, and cosine similarity metrics alongside expert radiologist assessments.
RESULTS: The findings are promising, with the models specifically fine-tuned for neuroradiology MRI achieving scores of 0.46, 0.28, 0.52, 2.45, and 0.87 in the BLEU-1, METEOR, ROUGE-L, CIDEr, and cosine similarity metrics, respectively. In the radiological experts' evaluation, they found that in 75% of the cases evaluated, the conclusions generated by the system were as good as or even better than the manually generated conclusions.
CONCLUSION: The methods demonstrate the potential and effectiveness of customizing state-of-the-art pre-trained models for neuroradiology, yielding automatic MRI report conclusions that nearly match expert quality. Furthermore, these results underscore the importance of designing and pre-training a dedicated language model for radiology report summarization.
引用
- López-Úbeda P, Martín-Noguerol T, Escartín J, et al. Automatic generation of conclusions from neuroradiology MRI reports through natural language processing. Neuroradiology. 2024. PMID: 38381144. doi:10.1007/s00234-024-03312-3
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。