人工智能罕见事件识别的批判性评估:原理与药物警戒案例研究
本文针对罕见事件识别中AI模型表面准确率掩盖实际价值的问题,提出从问题定义、测试集设计、患病率感知统计评估、稳健性评估及人机工作流整合等维度进行批判性评估的框架。作者引入结构化病例级审查(SCLE)补充统计评估,并以药物警戒中基于规则检索、机器学习结合概率记录 linkage 去重、LLM 自动脱敏三个案例说明罕见事件场景的陷阱及成本敏感目标如何对齐操作价值。
要点
- 罕见事件场景下需采用患病率感知的统计评估,避免因类别不平衡导致乐观偏倚。
- 测试集应包含困难阳性对照,结构化病例级审查可补充统计性能评估。
- 成本敏感目标有助于将模型性能与药物警戒操作价值对齐。
核心结论
- AI在罕见事件识别中的表面准确率可能掩盖有限的实际价值,需从多维度进行批判性评估。
- 结构化病例级审查(SCLE)可补充统计性能评估,成本敏感目标能对齐模型性能与操作价值。
研究设计与样本
- 本文为方法学框架与案例研究,提出AI罕见事件识别的批判性评估维度及结构化病例级审查方法。
- 在药物警戒中实例化框架,引用三项研究:基于规则检索妊娠相关报告、机器学习结合概率记录 linkage 去重、使用LLM自动脱敏人名。
主要发现
- 罕见事件场景的陷阱包括不现实的类别平衡带来的乐观偏倚及测试集缺乏困难阳性对照。
- 成本敏感目标可帮助模型性能与操作价值对齐。
临床怎么用
- 在采购或开发罕见事件识别AI模型时,应评估问题定义、测试集设计、患病率感知统计评估、稳健性及人机工作流整合。
- 可采用结构化病例级审查补充统计评估,并设定成本敏感目标以反映操作价值。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
Many high-stakes artificial intelligence (AI) applications target low-prevalence events, where apparent accuracy can conceal limited real-world value. Relevant AI models range from expert-defined rules and traditional machine learning to generative large language models (LLMs) constrained for classification. As the effort and expertise required to develop modern AI decrease, there is a risk that organizations devote too little time to understanding their limitations and sources of error. We outline key dimensions for critical appraisal of AI in rare-event recognition, including problem framing and test set design, prevalence-aware statistical evaluation, robustness assessment, and integration into human workflows. In addition, we propose an approach to structured case-level examination (SCLE), to complement statistical performance evaluation, and a set of considerations to guide procurement or development of AI models for rare-event recognition. We instantiate the framework in pharmacovigilance, drawing on three studies: rule-based retrieval of pregnancy-related reports, duplicate detection combining machine learning with probabilistic record linkage, and automated redaction of person names using an LLM. We highlight pitfalls specific to the rare-event setting including optimism from unrealistic class balance and lack of difficult positive controls in test sets-and show how cost-sensitive targets align model performance with operational value. While grounded in pharmacovigilance practice, the principles generalize to domains where positives are scarce, and error costs may be asymmetric.
引用
- Norén GN, Meldau EL, Ellenius J, et al. Critical Appraisal of Artificial Intelligence for Rare-Event Recognition: Principles and Pharmacovigilance Case Studies. Drug Saf. 2026. PMID: 41811678. doi:10.1007/s40264-026-01649-7
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。