影像亚专科期刊中双盲同行评审的有效性
该研究分析了2015年1月至6月投稿至《美国神经放射学杂志》(AJNR)的稿件,审稿人在提交评审后填写匿名问卷,评估其是否熟悉研究或了解作者及机构。共1079份问卷回复率98.8%,审稿人正确识别作者的比例为90.3%,正确识别机构的比例为86.8%;当审稿人认识或怀疑认识作者时稿件接受率为41.6%(57/137),不认识时为28.2%(262/929),机构熟悉与否的接受率分别为36.8%(60/163)和28.7%(259/903),Fisher精确检验显示作者(P < .038)和机构(P < .039)熟悉度与更高接受率相关。结论认为AJNR的双盲评审流程最大限度减少了审稿人偏倚,但感知到作者和机构信息与更高的稿件接受率相关。
要点
- 审稿人认识或怀疑认识作者时稿件接受率为41.6%(57/137),不认识时为28.2%(262/929)。
- 审稿人认识或怀疑认识机构时接受率为36.8%(60/163),不认识时为28.7%(259/903)。
- 作者熟悉度(P < .038)和机构熟悉度(P < .039)与更高接受率相关。
核心结论
- AJNR的双盲同行评审流程最大限度减少了审稿人偏倚,但感知到作者和机构信息与更高的稿件接受率相关。
研究设计与样本
- 针对2015年1月至6月投稿至《美国神经放射学杂志》(AJNR)的稿件,审稿人在提交评审后完成简短匿名问卷,评估是否熟悉研究或了解作者及机构;共发放1079份问卷,回复率98.8%。
诊断标准与关键数值
- 审稿人认识或怀疑认识作者时稿件接受率为57/137(41.6%),不认识时为262/929(28.2%)。
- 审稿人认识或怀疑认识机构时稿件接受率为60/163(36.8%),不认识时为259/903(28.7%)。
- 审稿人正确识别作者的比例为90.3%,正确识别机构的比例为86.8%。
- 因自引导致盲法失效的比例在作者和机构两方面均为34.1%。
- Fisher精确检验显示作者熟悉度(P < .038)和机构熟悉度(P < .039)与更高稿件接受率相关。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND AND PURPOSE: Many scientific journals use double-blind peer review to minimize potential reviewer bias concerning publication recommendations. However, because neuroradiology is a relatively small subspecialty, this process may be limited by prior knowledge of the authors' work or associated institutions. We sought to investigate the efficacy of reviewer blinding and determine the impact that unblinding may have on manuscript acceptance.
MATERIALS AND METHODS: For manuscripts submitted to the American Journal of Neuroradiology (AJNR) from January through June 2015, reviewers completed a brief anonymous questionnaire after submitting their evaluations, assessing whether they were familiar with the research or had knowledge of the authors or institutions from which the work originated.
RESULTS: The response rate for 1079 questionnaires was 98.8%; 12.9% of reviewers knew or suspected that they knew authors, and 15.3% knew or suspected that they knew the associated institutions. Reviewers correctly identified the authors in 90.3% of cases and correctly stated the institutions in 86.8% of cases. Unblinding resulted from self-citation in 34.1% for both authorship and institutions. The acceptance rate when reviewers knew or suspected that they knew the authors was 57/137 (41.6%) and 262/929 (28.2%) when reviewers did not. The acceptance rate when reviewers knew or suspected that they knew the institutions was 60/163 (36.8%) and 259/903 (28.7%) when they did not. The Fisher exact test showed that author (P < .038) and institution (P < .039) familiarity was associated with greater manuscript acceptance.
CONCLUSIONS: While the AJNR process of double-blind peer review minimizes reviewer bias, perceived knowledge of the author and institution is associated with a higher rate of manuscript acceptance.
引用
- O'Connor EE, Cousar M, Lentini JA, et al. Efficacy of Double-Blind Peer Review in an Imaging Subspecialty Journal. AJNR Am J Neuroradiol. 2016. PMID: 27856433. doi:10.3174/ajnr.A5017
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。