自然语言处理流程从临床记录中提取前列腺癌相关信息
这项回顾性研究纳入2017至2022年间接受前列腺MRI的23225例患者,开发基于BERT句子级模型和树模型的患者级流程,从英文临床记录中提取癌症危险因素、MRI前前列腺病理及治疗史。句子级AUC均≥0.94;患者级提取癌症危险因素敏感度高于放射科医生(如前列腺癌家族史96.5% vs 77.9%,p<0.001),但分类MRI前前列腺病理(92.5% vs 95.9%,p=0.002)和治疗史(95.5% vs 97.7%,p=0.03)准确率低于放射科医生。
要点
- 该流程提取前列腺癌危险因素的敏感度高于放射科医生(家族史96.5% vs 77.9%)。
- 流程分类MRI前前列腺病理准确率低于放射科医生(92.5% vs 95.9%)。
- 流程分类前列腺癌治疗史准确率低于放射科医生(95.5% vs 97.7%)。
核心结论
- 所提出的流程表现有前景,尤其在从患者临床记录中提取癌症危险因素方面。
研究设计与样本
- 回顾性研究,纳入2017至2022年间接受前列腺MRI的23225例患者;从MRI前一年内的英文自由文本临床记录中提取信息;使用基于BERT的句子级模型微调,患者级输出由树模型汇总多个句子级输出确定;句子级性能在15%的句子级数据集(句子级测试集)上评估,患者级性能在放射科医生审阅603例患者临床记录创建的患者级测试集上评估。
诊断标准与关键数值
- 句子级分类的受试者工作特征曲线下面积(AUC)均≥0.94。
- 患者级提取癌症危险因素的敏感度:前列腺癌家族史96.5% vs 放射科医生77.9%(p<0.001)。
- 患者级分类MRI前前列腺病理的准确率:流程92.5% vs 放射科医生95.9%(p=0.002)。
- 患者级分类前列腺癌治疗史的准确率:流程95.5% vs 放射科医生97.7%(p=0.03)。
临床应用与阅片要点
- 该自然语言处理流程在提取前列腺癌危险因素方面敏感度高于放射科医生,可能有助于在解读前列腺MRI时高效收集相关文本信息。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVES: To develop an automated pipeline for extracting prostate cancer-related information from clinical notes.
MATERIALS AND METHODS: This retrospective study included 23,225 patients who underwent prostate MRI between 2017 and 2022. Cancer risk factors (family history of cancer and digital rectal exam findings), pre-MRI prostate pathology, and treatment history of prostate cancer were extracted from free-text clinical notes in English as binary or multi-class classification tasks. Any sentence containing pre-defined keywords was extracted from clinical notes within one year before the MRI. After manually creating sentence-level datasets with ground truth, Bidirectional Encoder Representations from Transformers (BERT)-based sentence-level models were fine-tuned using the extracted sentence as input and the category as output. The patient-level output was determined by compilation of multiple sentence-level outputs using tree-based models. Sentence-level classification performance was evaluated using the area under the receiver operating characteristic curve (AUC) on 15% of the sentence-level dataset (sentence-level test set). The patient-level classification performance was evaluated on the patient-level test set created by radiologists by reviewing the clinical notes of 603 patients. Accuracy and sensitivity were compared between the pipeline and radiologists.
RESULTS: Sentence-level AUCs were ≥ 0.94. The pipeline showed higher patient-level sensitivity for extracting cancer risk factors (e.g., family history of prostate cancer, 96.5% vs. 77.9%, p < 0.001), but lower accuracy in classifying pre-MRI prostate pathology (92.5% vs. 95.9%, p = 0.002) and treatment history of prostate cancer (95.5% vs. 97.7%, p = 0.03) than radiologists, respectively.
CONCLUSION: The proposed pipeline showed promising performance, especially for extracting cancer risk factors from patient's clinical notes.
CLINICAL RELEVANCE STATEMENT: The natural language processing pipeline showed a higher sensitivity for extracting prostate cancer risk factors than radiologists and may help efficiently gather relevant text information when interpreting prostate MRI.
KEY POINTS: When interpreting prostate MRI, it is necessary to extract prostate cancer-related information from clinical notes. This pipeline extracted the presence of prostate cancer risk factors with higher sensitivity than radiologists. Natural language processing may help radiologists efficiently gather relevant prostate cancer-related text information.
引用
- Nakai H, Suman G, Adamo DA, et al. Natural language processing pipeline to extract prostate cancer-related information from clinical notes. Eur Radiol. 2024. PMID: 38842692. doi:10.1007/s00330-024-10812-6
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。