文献速递疼痛医学

同行评审评分与论文影响力关联性分析

How predictive is peer review for gauging impact? The association between reviewer rating scores, publication status, and article impact measured by citations in a pain subspecialty journal.
PubMed 文献 · Reg Anesth Pain Med · 2025-10-06

该研究分析了2018年8月至2021年10月间提交至《Regional Anesthesia & Pain Medicine》的3173篇稿件,最终422篇纳入分析。结果显示,同行评审评分与Clarivate两年引用数、Google Scholar引用数及Altmetric评分均无显著相关性;被拒后发表于影响因子>3.7期刊的稿件与接受稿件的两年引用数无显著差异。

要点

  • 同行评审评分与论文引用数无显著相关性。
  • 被拒稿件若发表于影响因子>3.7的期刊,引用数与接受稿件相当。
  • RAPM发表论文的Altmetric评分显著高于被拒论文。

核心结论

  • 同行评审评分与引用数无显著关联,但评审对质量的影响及其他指标关联仍不明确。

研究设计与样本

  • 分析2018年8月至2021年10月提交至RAPM的3173篇稿件,422篇符合纳入标准。
  • 根据评审推荐赋值:接受5分、小修3分、大修2分、拒稿0分,计算平均分。

主要发现

  • 评审评分与Clarivate两年引用数无显著相关(r=0.038,p=0.47)。
  • 评审评分与Google Scholar引用数无显著相关(r=0.053,p=0.31)。
  • 评审评分与Altmetric评分无显著相关(p=0.38)。
  • 接受稿件(中位引用5,IQR 2-10)与被拒后发表于影响因子>3.7期刊的稿件(中位5,IQR 2-7)两年Clarivate引用无显著差异(p=0.39)。
  • RAPM发表论文Altmetric评分中位10(IQR 5-17),显著高于被拒论文的1(IQR 0-2)(p<0.001)。

临床怎么用

  • 同行评审评分不宜作为预测论文影响力的唯一依据。
  • 被拒稿件可能在其他期刊获得相当影响力,提示评审决策需综合考量。

局限性

  • 仅纳入有摘要的稿件,可能引入选择偏倚。
  • 引用数仅观察两年,长期影响力未评估。
  • 单中心、特定专科期刊结果,外推需谨慎。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Peer review represents a cornerstone of the scientific process, yet few studies have evaluated its association with scientific impact. The objective of this study is to assess the association of peer review scores with measures of impact for manuscripts submitted and ultimately published. METHODS: 3173 manuscripts submitted to Regional Anesthesia & Pain Medicine (RAPM) between August 2018 and October 2021 were analyzed, with those containing an abstract included. Articles were categorized by topic, type, acceptance status, author demographics and open-access status. Articles were scored based on means for the initial peer review where each reviewer's recommendation was assigned a number: 5 for 'accept', 3 for 'minor revision', 2 for 'major revision' and 0 for 'reject'. Articles were further classified by whether any reviewers recommended 'reject'. Rejected articles were analyzed to determine whether they were subsequently published in an indexed journal, and their citations were compared with those of accepted articles when the impact factor was <1.4 points lower than RAPM's 5.1 impact factor. The main outcome measure was the number of Clarivate citations within 2 years from publication. Secondary outcome measures were Google Scholar citations within 2 years and Altmetric score. RESULTS: 422 articles met inclusion criteria for analysis. There was no significant correlation between the number of Clarivate 2-year review citations and reviewer rating score (r=0.038, p=0.47), Google Scholar citations (r=0.053, p=0.31) or Altmetric score (p=0.38). There was no significant difference in 2-year Clarivate citations between accepted (median (IQR) 5 (2-10)) and rejected manuscripts published in journals with impact factors >3.7 (median 5 (2-7); p=0.39). Altmetric score was significantly higher for RAPM-published papers compared with RAPM-rejected ones (median 10 (5-17) vs 1 (0-2); p<0.001). CONCLUSIONS: Peer review rating scores were not associated with citations, though the impact of peer review on quality and association with other metrics remains unclear.

来源:Reg Anesth Pain Med,查看原文。版权归原作者所有。

引用

  1. Weitzner AS, Davis M, Han AH, et al. How predictive is peer review for gauging impact? The association between reviewer rating scores, publication status, and article impact measured by citations in a pain subspecialty journal. Reg Anesth Pain Med. 2025. PMID: 38942427. doi:10.1136/rapm-2024-105490

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。