基于非参数推断的AFROC曲线评估AI医疗器械定位信息
针对AFROC曲线现有推断依赖同主体观测独立性和参数模型假设的问题,提出非参数推断方法,推导经验AFROC曲线的渐近性质,并用新自助法构建置信区间和置信带。模拟显示假设违背时方法显著优于参数法,并以AI辅助肺结节诊断实例说明实用性。
要点
- AFROC曲线可同时评价诊断试验的检测与定位性能。
- 新非参数推断不依赖同主体观测独立性和参数模型假设。
- 自助法可构建AFROC曲线相关指标的置信区间和置信带。
核心结论
- 提出AFROC曲线的非参数推断方法,在合理假设下推导经验AFROC曲线的渐近性质并用于推断。
研究设计与样本
- 方法学研究,提出非参数推断与自助法,并通过模拟和AI辅助肺结节诊断实例验证。
主要发现
- 模拟显示当现有参数法假设被违背时,新方法显著优于参数法。
- 以AI辅助肺结节诊断的诊断试验实例说明方法的实际适用性。
临床怎么用
- 可用于AI医疗器械检测与定位性能的AFROC曲线推断,构建相关指标置信区间和曲线置信带。
局限性
- 方法依赖合理假设,模拟与实例仅涉及AI辅助肺结节诊断场景。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
The alternative free-response receiver operating characteristic (AFROC) curve is a popular method for evaluating the performance of diagnostic tests concerning detecting and locating abnormal lesions. However, the existing inferences for the AFROC curve rely on the assumptions of the independence of the observations within the same subject and certain parametric models, which are hard to test and may not be true in practice. In this article, we propose nonparametric inferences for the AFROC curve. Under reasonable assumptions, we derive the asymptotic properties for the empirical AFROC curve and use them to make inferences about the AFROC curve and its related indices. We propose a new bootstrap method to construct the confidence intervals of the indices related to the AFROC curve and the confidence band for the AFROC curve. Simulations show that our method significantly outperforms the existing parametric approach when its assumptions are violated. We also provide a real-world example, that is, a diagnostic test investigating AI-assisted pulmonary nodule diagnosis, to illustrate the practical applicability of our method.
引用
- Liu K, Zhou XH. Evaluation of AI-Based Medical Device Concerning Localization Information Using Nonparametric Inference for the Alternative Free-Response ROC Curve. Stat Med. 2026. PMID: 41923470. doi:10.1002/sim.70502
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。