基于双层次嵌入的分层循环神经网络从电子健康记录中检测不良药物事件
该研究针对电子健康记录(EHR)文本噪声大、现成工具预处理影响后续ADE检测性能的问题,在MADE1.0挑战中开发了基于规则的句词分词技术,并采用三层深度学习架构(字符级Bi-LSTM、词级Bi-LSTM、条件随机场)进行ADE检测。系统在命名实体识别任务中排名第一,官方micro-averaged F1-score为0.8290,表明双层次嵌入与互补序列标注技术结合可提升EHR信息抽取准确性。
要点
- 基于规则的句词分词可处理EHR文本噪声,避免现成工具对ADE检测的负面影响。
- 三层架构结合字符级与词级Bi-LSTM及CRF,在MADE1.0挑战中NER任务排名第一。
- 双层次嵌入(字符级和词级)及领域与通用预训练词嵌入的整合提升ADE检测性能。
核心结论
- 整合互补的序列标注技术与双层次嵌入(字符级和词级)的深度学习架构,对EHR笔记可实现优异的信息抽取准确性。
研究设计与样本
- 研究基于MADE1.0挑战,开发规则驱动的句词分词技术处理EHR文本噪声,并构建三层深度学习架构进行ADE检测。
主要发现
- 系统在MADE1.0挑战的命名实体识别任务中排名第一,官方micro-averaged F1-score为0.8290。
- 实验表明整合领域特定与通用预训练词嵌入对从EHR中检测ADE有影响。
临床怎么用
- 临床药学智能体可借鉴双层次嵌入与规则分词方法,提升从EHR文本中识别ADE信号的准确性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
INTRODUCTION: Adverse drug event (ADE) detection is a vital step towards effective pharmacovigilance and prevention of future incidents caused by potentially harmful ADEs. The electronic health records (EHRs) of patients in hospitals contain valuable information regarding ADEs and hence are an important source for detecting ADE signals. However, EHR texts tend to be noisy. Yet applying off-the-shelf tools for EHR text preprocessing jeopardizes the subsequent ADE detection performance, which depends on a well tokenized text input. OBJECTIVE: In this paper, we report our experience with the NLP Challenges for Detecting Medication and Adverse Drug Events from Electronic Health Records (MADE1.0), which aims to promote deep innovations on this subject. In particular, we have developed rule-based sentence and word tokenization techniques to deal with the noise in the EHR text. METHODS: We propose a detection methodology by adapting a three-layered, deep learning architecture of (1) recurrent neural network [bi-directional long short-term memory (Bi-LSTM)] for character-level word representation to encode the morphological features of the medical terminology, (2) Bi-LSTM for capturing the contextual information of each word within a sentence, and (3) conditional random fields for the final label prediction by also considering the surrounding words. We experiment with different word embedding methods commonly used in word-level classification tasks and demonstrate the impact of an integrated usage of both domain-specific and general-purpose pre-trained word embedding for detecting ADEs from EHRs. RESULTS: Our system was ranked first for the named entity recognition task in the MADE1.0 challenge, with a micro-averaged F1-score of 0.8290 (official score). CONCLUSION: Our results indicate that the integration of two widely used sequence labeling techniques that complement each other along with dual-level embedding (character level and word level) to represent words in the input layer results in a deep learning architecture that achieves excellent information extraction accuracy for EHR notes.
引用
- Wunnava S, Qin X, Kakar T, et al. Adverse Drug Event Detection from Electronic Health Records Using Hierarchical Recurrent Neural Networks with Dual-Level Embedding. Drug Saf. 2019. PMID: 30649736. doi:10.1007/s40264-018-0765-9
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。