自然语言处理识别电子健康记录中衰老综合征的系统综述
该系统综述依据PRISMA指南检索多个数据库至2023年9月,纳入22项研究,评估自然语言处理算法识别电子健康记录中肌少症、衰弱、跌倒等衰老综合征的可行性。结果显示算法灵敏度为57.1%-100%,特异度为84.0%-100%,但研究设计质量不一且外部验证较少,提示需更严谨的诊断准确性研究。
要点
- 自然语言处理算法可识别电子健康记录中的衰老综合征。
- 纳入研究中跌倒最多(12项),其次为谵妄、痴呆等。
- 灵敏度57.1%-100%,特异度84.0%-100%,但报告不完整。
核心结论
- 当前证据表明自然语言处理算法能够识别电子健康记录中的衰老综合征。
- 但算法需在严谨设计的诊断准确性研究中测试并报告适当指标。
研究设计与样本
- 系统综述,遵循PRISMA指南和预设方案,检索PubMed、Medline、Embase、CINAHL、ACM digital library、IEEE Xplore和Scopus从建库至2023年9月底。
- 由两位作者独立筛选文献并提取计算方法和性能指标等数据,按衰老综合征和计算方法进行叙述性综合。
- 从1030条题录中筛选出22项符合纳入标准的研究。
主要发现
- 22项研究中,1项聚焦肌少症,1项衰弱,12项跌倒,5项谵妄,5项痴呆,4项失禁。
- 20项研究报告了算法与参考标准比较的灵敏度,范围为57.1%-100%。
- 仅12项研究报告了特异度,范围为84.0%-100%。
- 研究设计质量参差不齐,诊断准确性相关结果并非全部报告,且极少有研究进行外部验证。
关键数值与推荐
- 灵敏度范围为57.1%-100%(20项研究),特异度范围为84.0%-100%(12项研究)。
- 研究按衰老综合征和计算方法进行叙述性综合,符合Studies Without Meta-analysis指南。
临床怎么用
- 自然语言处理算法有望辅助电子健康记录中衰老综合征的识别与编码,改善记录不足的现状。
- 临床应用中需注意现有算法多缺乏外部验证,诊断准确性证据尚不充分。
局限性
- 研究设计质量不一,诊断准确性结果报告不完整。
- 仅少数研究进行了算法外部验证。
- 各衰老综合征和计算方法的研究数量不均,证据有限。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Recording and coding of ageing syndromes in hospital records is known to be suboptimal. Natural Language Processing algorithms may be useful to identify diagnoses in electronic healthcare records to improve the recording and coding of these ageing syndromes, but the feasibility and diagnostic accuracy of such algorithms are unclear. METHODS: We conducted a systematic review according to a predefined protocol and in line with Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. Searches were run from the inception of each database to the end of September 2023 in PubMed, Medline, Embase, CINAHL, ACM digital library, IEEE Xplore and Scopus. Eligible studies were identified via independent review of search results by two coauthors and data extracted from each study to identify the computational method, source of text, testing strategy and performance metrics. Data were synthesised narratively by ageing syndrome and computational method in line with the Studies Without Meta-analysis guidelines. RESULTS: From 1030 titles screened, 22 studies were eligible for inclusion. One study focussed on identifying sarcopenia, one frailty, twelve falls, five delirium, five dementia and four incontinence. Sensitivity (57.1%-100%) of algorithms compared with a reference standard was reported in 20 studies, and specificity (84.0%-100%) was reported in only 12 studies. Study design quality was variable with results relevant to diagnostic accuracy not always reported, and few studies undertaking external validation of algorithms. CONCLUSIONS: Current evidence suggests that Natural Language Processing algorithms can identify ageing syndromes in electronic health records. However, algorithms require testing in rigorously designed diagnostic accuracy studies with appropriate metrics reported.
引用
- Osman M, Cooper R, Sayer AA, et al. The use of natural language processing for the identification of ageing syndromes including sarcopenia, frailty and falls in electronic healthcare records: a systematic review. Age Ageing. 2024. PMID: 38970549. doi:10.1093/ageing/afae135
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。