基于规则的自然语言处理用于卒中数据提取自动化:一项验证研究
本研究外部验证了基于规则的NLP算法CHARTextract从自由文本CT血管造影和灌注报告中提取卒中相关变量的准确性。以2015年至2021年连续接受血管内取栓的急性缺血性卒中患者的报告为对象,手动提取作为参考标准。算法对远端前循环闭塞、后循环闭塞、出血和ASPECTS的准确率超过90%,对近端前循环闭塞、缺血存在和侧支循环状态的准确率分别为85%、74%和79%。
要点
- 基于规则的NLP对卒中影像报告结构化提取具有中等至良好性能。
- 远端前循环闭塞、后循环闭塞、出血和ASPECTS的提取准确率超过90%。
- 报告风格和术语不一致会影响算法准确性。
核心结论
- 基于规则的NLP算法CHARTextract从自由文本影像报告中提取卒中相关数据具有中等至良好的性能。
- 算法准确性受报告医师间报告风格和术语不一致的影响。
研究设计与样本
- 外部验证研究,纳入2015年1月至2021年连续因急性缺血性卒中在某区域卒中中心接受血管内取栓的患者。
- 分析CT血管造影和CT灌注的自由文本报告,以手动提取的临床报告数据作为参考标准。
- 评估基于规则NLP算法提取卒中相关变量的准确性、特异度、敏感度、阳性预测值和阴性预测值。
诊断标准与关键数值
- NLP算法识别远端前循环闭塞、后循环闭塞、出血和ASPECTS的准确率均超过90%。
- NLP算法识别近端前循环闭塞的准确率为85%。
- NLP算法识别缺血存在的准确率为74%。
- NLP算法识别侧支循环状态的准确率为79%。
- 算法确认报告中变量缺失的准确率为87%至100%。
临床应用与阅片要点
- 在报告结构化提取中可辅助自动化获取卒中关键变量,但需注意报告风格和术语不一致对准确性的影响。
- 对缺血存在和侧支循环状态的提取准确性相对较低,日常应用时应加强人工核对。
局限性
- 算法准确性受报告医师间报告风格和术语不一致的影响。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
PURPOSE: Data extraction from radiology free-text reports is time consuming when performed manually. Recently, more automated extraction methods using natural language processing (NLP) are proposed. A previously developed rule-based NLP algorithm showed promise in its ability to extract stroke-related data from radiology reports. We aimed to externally validate the accuracy of CHARTextract, a rule-based NLP algorithm, to extract stroke-related data from free-text radiology reports.
METHODS: Free-text reports of CT angiography (CTA) and perfusion (CTP) studies of consecutive patients with acute ischemic stroke admitted to a regional stroke center for endovascular thrombectomy were analyzed from January 2015 to 2021. Stroke-related variables were manually extracted as reference standard from clinical reports, including proximal and distal anterior circulation occlusion, posterior circulation occlusion, presence of ischemia or hemorrhage, Alberta stroke program early CT score (ASPECTS), and collateral status. These variables were simultaneously extracted using a rule-based NLP algorithm. The NLP algorithm's accuracy, specificity, sensitivity, positive predictive value (PPV), and negative predictive value (NPV) were assessed.
RESULTS: The NLP algorithm's accuracy was > 90% for identifying distal anterior occlusion, posterior circulation occlusion, hemorrhage, and ASPECTS. Accuracy was 85%, 74%, and 79% for proximal anterior circulation occlusion, presence of ischemia, and collateral status respectively. The algorithm confirmed the absence of variables from radiology reports with an 87-100% accuracy.
CONCLUSIONS: Rule-based NLP has a moderate to good performance for stroke-related data extraction from free-text imaging reports. The algorithm's accuracy was affected by inconsistent report styles and lexicon among reporting radiologists.
引用
- Gunter, Puac-Polanco, Miguel, et al. Rule-based natural language processing for automation of stroke data extraction: a validation study. Neuroradiology. 2022. PMID: 35913525. doi:10.1007/s00234-022-03029-1
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。