神经放射学同行评议中的偏倚:「被差评」对「差评他人」的影响
该研究分析了13名神经放射学医生在2016至2018年间匿名提交的同行评议报告,发现收到临床不显著的差异报告与在同一半月时段内提交差异报告的可能性呈正相关,预期相对增加14%(95%CI 8%-21%),而收到临床显著的差异报告则无此关联。
要点
- 收到临床不显著的差异报告后,同一时段内提交差异报告的可能性增加14%。
- 差异报告定义为检测遗漏或解读遗漏(无论临床显著与否)。
- 收到临床显著的差异报告与提交差异报告无显著相关性。
核心结论
- 收到临床不显著的差异报告会导致提交差异报告的可能性增加,这种增加的动机应被探索以发现潜在偏倚。
研究设计与样本
- 研究分析13名神经放射学医生在2016至2018年间按半月时段提交的匿名同行评议报告,采用随机效应泊松回归分析。
诊断标准与关键数值
- 差异报告定义为满足以下任一条件:1)检测遗漏,临床显著;2)检测遗漏,临床不显著;3)解读遗漏,临床显著;4)解读遗漏,临床不显著。
- 共提交468份差异报告,其中161份在收到差异报告的同一半月时段提交,325份不在同一时段提交。
- 收到差异报告对提交差异报告有正向效应,预期相对增加14%(95%CI 8%-21%)。
- 收到临床不显著的差异报告与同一时段内提交差异报告显著正相关(系数=0.13;95%CI 0.05-0.22),收到临床显著的差异报告则无此相关性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND AND PURPOSE: The validity of radiology peer review requires an unbiased assessment of studies in an environment that values the process. We assessed radiologists' behavior reviewing colleagues' reports. We hypothesized that when a radiologist receives a discrepant peer review, he is more likely to submit a discrepant review about another radiologist.
MATERIALS AND METHODS: We analyzed the anonymous peer review submissions of 13 neuroradiologists in semimonthly blocks of time from 2016 to 2018. We defined a discrepant review as any one of the following: 1) detection miss, clinically significant; 2) detection miss, clinically not significant; 3) interpretation miss, clinically significant; or 4) interpretation miss, clinically not significant. We used random-effects Poisson regression analysis to determine whether a neuroradiologist was more likely to submit a discrepant report during the semimonthly block in which he or she received one versus the semimonthly block thereafter.
RESULTS: Four hundred sixty-eight discrepant peer review reports were submitted; 161 were submitted in the same semimonthly block of receipt of a discrepant report and 325 were not. Receiving a discrepant report had a positive effect on submitting discrepant reports: an expected relative increase of 14% (95% CI, 8%-21%). Notably, receiving a clinically not significant discrepant report (coefficient = 0.13; 95% CI, 0.05-0.22) significantly and positively correlated with submitting a discrepant report within the same time block, but this was not true of clinically significant reports.
CONCLUSIONS: The receipt of a clinically not significant discrepant report leads to a greater likelihood of submitting a discrepant report. The motivation for such an increase should be explored for potential bias.
引用
- Charkhchi P, Wang B, Caffo B, et al. Bias in Neuroradiology Peer Review: Impact of a "Ding" on "Dinging" Others. AJNR Am J Neuroradiol. 2018. PMID: 30523137. doi:10.3174/ajnr.A5908
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。