应用光学字符识别与自然语言处理对结肠镜报告进行大规模质量指标数据提取
本研究在克利夫兰诊所和明尼苏达大学回顾性抽取门诊筛查结肠镜及病理报告,比较人工提取与OCR/NLP混合方法提取息肉、腺瘤等变量的准确性,结果显示各变量准确率均超过95%,为从扫描报告提取质量指标提供了验证。
要点
- OCR/NLP混合方法检测息肉准确率95.8%,腺瘤98.5%,无蒂锯齿状息肉99.3%。
- 高级腺瘤准确率98%,肠道准备不充分98.4%,盲肠插管失败99%。
- 仅用NLP与混合方法相比,几乎所有变量准确率均超过99%。
核心结论
- 本研究首次验证了一种独特的OCR/NLP混合技术,可从图像格式的扫描操作和病理报告中提取所需变量,准确率超过95%。
研究设计与样本
- 回顾性研究,在克利夫兰诊所(美国俄亥俄州克利夫兰)和明尼苏达大学(美国明尼苏达州明尼阿波利斯)进行。
- 随机抽取门诊筛查结肠镜操作和病理报告列表,先由两名研究人员手动审查报告收集目标变量,再用OCR/NLP算法从机构使用的3个电子健康记录系统(Epic、ProVation、Sunquest PowerPath)中获取相同变量。
主要发现
- 与人工数据提取相比,OCR/NLP混合方法检测息肉的准确率为95.8%,腺瘤为98.5%,无蒂锯齿状息肉为99.3%,高级腺瘤为98%,肠道准备不充分为98.4%,盲肠插管失败为99%。
- 仅用NLP收集的数据集与OCR/NLP混合方法收集的数据集相比,几乎所有变量的准确率均超过99%。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND AIMS: Colonoscopy is commonly performed for colorectal cancer screening in the United States. Reports are often generated in a non-standardized format and are not always integrated into electronic health records. Thus, this information is not readily available for streamlining quality management, participating in endoscopy registries, or reporting of patient- and center-specific risk factors predictive of outcomes. We aim to demonstrate the use of a new hybrid approach using natural language processing of charts that have been elucidated with optical character recognition processing (OCR/NLP hybrid) to obtain relevant clinical information from scanned colonoscopy and pathology reports, a technology co-developed by Cleveland Clinic and eHealth Technologies (West Henrietta, NY, USA). METHODS: This was a retrospective study conducted at Cleveland Clinic, Cleveland, Ohio, and the University of Minnesota, Minneapolis, Minnesota. A randomly sampled list of outpatient screening colonoscopy procedures and pathology reports was selected. Desired variables were then collected. Two researchers first manually reviewed the reports for the desired variables. Then, the OCR/NLP algorithm was used to obtain the same variables from 3 electronic health records in use at our institution: Epic (Verona, Wisc, USA), ProVation (Minneapolis, Minn, USA) used for endoscopy reporting, and Sunquest PowerPath (Tucson, Ariz, USA) used for pathology reporting. RESULTS: Compared with manual data extraction, the accuracy of the hybrid OCR/NLP approach to detect polyps was 95.8%, adenomas 98.5%, sessile serrated polyps 99.3%, advanced adenomas 98%, inadequate bowel preparation 98.4%, and failed cecal intubation 99%. Comparison of the dataset collected via NLP alone with that collected using the hybrid OCR/NLP approach showed that the accuracy for almost all variables was >99%. CONCLUSIONS: Our study is the first to validate the use of a unique hybrid OCR/NLP technology to extract desired variables from scanned procedure and pathology reports contained in image format with an accuracy >95%.
引用
- Laique SN, Hayat U, Sarvepalli S, et al. Application of optical character recognition with natural language processing for large-scale quality metric data extraction in colonoscopy reports. Gastrointest Endosc. 2020. PMID: 32891620. doi:10.1016/j.gie.2020.08.038
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。