文献速递技术与安全神经骨肌CT

放射科医师观察者研究中项目反应理论的贝叶斯统计模型

Bayesian Statistical Model of Item Response Theory in Observer Studies of Radiologists.
PubMed 文献 · Acad Radiol · 2019-05-28

本研究从已发表的多阅读者多病例观察者研究获取两个数据集,用Stan软件对二值化判读结果拟合贝叶斯项目反应理论模型,计算时间减影效应的95%可信区间。骨转移检测效应均值0.913(95%CI 0.243-1.745),脑梗死检测效应均值2.524(95%CI 1.827-3.310),两者可信区间均不含零,提示时间减影显著提高诊断能力。结论与既往两项研究一致,该模型可判断新模态的有用性。

要点

  • 时间减影对骨转移检测的效应均值为0.913(95%可信区间0.243-1.745),可信区间不含零。
  • 时间减影对脑梗死检测的效应均值为2.524(95%可信区间1.827-3.310)。
  • 贝叶斯项目反应理论模型可用于评估新模态在放射科医师观察者研究中的有用性。

核心结论

  • 基于贝叶斯项目反应理论模型的判断与既往两项研究结果相符,该模型可判断新模态的有用性。

研究设计与样本

  • 从已发表论文获取两个临床观察者研究数据集,采用多阅读者多病例范式评估放射科医师检测能力,将判读结果记录为每例二值(1=正确,0=错误),使用Stan软件拟合贝叶斯项目反应理论模型。

诊断标准与关键数值

  • 骨转移检测中时间减影效应的均值0.913、中位数0.885、95%可信区间0.243-1.745。
  • 脑梗死检测中时间减影效应的均值2.524、中位数2.50、95%可信区间1.827-3.310。
  • 两项检测研究的95%可信区间均不含零,提示时间减影显著改善诊断能力。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

RATIONALE AND OBJECTIVES: The purpose of this study was to validate a Bayesian statistical model of item response theory (IRT). IRT was used to evaluate a new modality (temporal subtraction, TS) in observer studies of radiologists, compared with a conventional modality (computed tomography).

MATERIALS AND METHODS: From previously published papers, we obtained two datasets of clinical observer studies of radiologists. Those studies used a multi-reader and multi-case paradigm to evaluate radiologists' detection abilities, primarily to determine if TS could enhance the detectability of bone metastasis or brain infarctions. We applied IRT to these studies' datasets using Stan software. Before applying IRT, the radiologists' responses were recorded as binaries for each case (1 = correct, 0 = incorrect). Effect of TS on detectability was evaluated by using our IRT model and calculating the 95% credible interval of the effect.

RESULTS: The mean, median, and 95% credible interval of the effect of TS were 0.913, 0.885, and 0.243-1.745 for the bone metastasis detection, and 2.524, 2.50, and 1.827-3.310, for the brain infarction detection. For both detection studies, the 95% credible intervals of the effect of TS did not include zero, indicating that TS significantly improved diagnostic ability.

CONCLUSION: Judgments based on the present study results were compatible with the two previous studies. Our study results demonstrated that the Bayesian statistical model of IRT could judge a new modality's usefulness.

来源:Acad Radiol,查看原文。版权归原作者所有。

引用

  1. Nishio M, Akasaka T, Sakamoto R, et al. Bayesian Statistical Model of Item Response Theory in Observer Studies of Radiologists. Acad Radiol. 2019. PMID: 31147237. doi:10.1016/j.acra.2019.04.014

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。