诊断性能指标变化在实验室与临床影像阅片研究中的可重复性
该元研究比较了乳腺影像(屏片乳腺X线、数字乳腺X线、乳腺断层合成、超声)在实验室回顾性研究与观察性临床研究中敏感度、假阳性分数、ROC曲线下面积和期望效用的相对变化可重复性。结果显示ROC曲线下面积比值与期望效用比值在两类研究间可重复,而敏感度与假阳性分数不可重复。
要点
- ROC曲线下面积比值与期望效用比值在实验室与临床研究间可重复。
- 敏感度与假阳性分数的相对变化在实验室与临床研究间不可重复。
- 比较诊断影像系统时应优先关注ROC曲线下面积与期望效用等指标。
核心结论
- ROC曲线下面积比值与期望效用比值在实验室与临床研究间可重复,而敏感度与假阳性分数不可重复。
研究设计与样本
- 元研究,纳入多种乳腺影像模态(屏片乳腺X线、数字乳腺X线、乳腺断层合成、超声)的实验室回顾性研究与观察性临床研究,比较相对敏感度、假阳性分数、ROC曲线下面积和期望效用的可重复性。
诊断标准与关键数值
- 所有类型研究中,假阳性分数变化具有共同均值的概率非常小。
- 超声与断层合成研究中相对敏感度相同的概率低。
- 在任何研究集内均未发现相对ROC曲线下面积或相对期望效用均值不同的证据。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
RATIONALE AND OBJECTIVES: In this paper we examine which comparisons of reading performance between diagnostic imaging systems made in controlled retrospective laboratory studies may be representative of what we observe in later clinical studies. The change in a meaningful diagnostic figure of merit between two diagnostic modalities should be qualitatively or quantitatively comparable across all kinds of studies.
MATERIALS AND METHODS: In this meta-study we examine the reproducibility of relative measures of sensitivity, false positive fraction (FPF), area under the receiver operating characteristic (ROC) curve, and expected utility across laboratory and observational clinical studies for several different breast imaging modalities, including screen film mammography, digital mammography, breast tomosynthesis, and ultrasound.
RESULTS: Across studies of all types, the changes in the FPFs yielded very small probabilities of having a common mean value. The probabilities of relative sensitivity being the same across ultrasound and tomosynthesis studies were low. No evidence was found for different mean values of relative area under the ROC curve or relative expected utility within any of the study sets.
CONCLUSION: The comparison demonstrates that the ratios of areas under the ROC curve and expected utilities are reproducible across laboratory and clinical studies, whereas sensitivity and FPF are not.
引用
- Samuelson FW, Abbey CK. The Reproducibility of Changes in Diagnostic Figures of Merit Across Laboratory and Clinical Imaging Reader Studies. Acad Radiol. 2017. PMID: 28666723. doi:10.1016/j.acra.2017.05.007
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。