同行评审中公开作者利益冲突对评审的影响:随机对照试验
在《急诊医学年鉴》的稿件评审流程中开展随机对照试验,将838名审稿人随机分为接收或不接收作者利益冲突声明两组,评估其对稿件质量评分的影响。结果显示,公开利益冲突声明未影响审稿人对稿件质量的均值评分,其他七项质量评分亦无影响;审稿人自认能校正利益冲突,但其反事实评分与实际评分无差异。
要点
- 向审稿人提供作者利益冲突声明未影响稿件总体质量评分(均差0.04,95%CI -0.05至0.14)。
- 对于存在已公开利益冲突的稿件,提供声明亦未影响评分(均差0.11,95%CI -0.05至0.26)。
- 审稿人反事实评分与实际评分无差异(均差0.02,95%CI 0.01至0.02)。
核心结论
- 在当前实施方式下,向同行评审专家公开作者利益冲突声明对真实稿件的各项质量评分均无影响。
研究设计与样本
- 随机对照试验,在《急诊医学年鉴》的稿件评审流程中开展,共纳入838名审稿人,评审2014年6月2日至2018年1月23日期间投稿的1480篇稿件。
主要发现
- 提供作者利益冲突声明未影响审稿人对稿件质量的均值评分:对照组均值2.70(标准差1.11,满分5分) vs 干预组均值2.74(标准差1.13),均差0.04,95%CI -0.05至0.14。
- 对于存在已公开利益冲突的稿件,两组评分亦无差异:对照组均值2.85(标准差1.12) vs 干预组均值2.96(标准差1.16),均差0.11,95%CI -0.05至0.26。
- 干预对审稿人提交的其他七项质量评分均无影响。
- 审稿人的反事实评分与实际评分无差异:实际评分均值2.69 vs 反事实评分均值2.67,均差0.02,95%CI 0.01至0.02。
- 当存在利益冲突报告时,比较不同来源类型(如政府、营利性企业)未发现效应差异。
临床怎么用
- 原文结论指出,当前伦理标准要求所有科学报告公开利益冲突,但按当前实施方式,该做法对真实审稿人评估真实稿件的各项质量评分均无影响。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: To assess the effect of disclosing authors' conflict of interest declarations to peer reviewers at a medical journal. DESIGN: Randomized controlled trial. SETTING: Manuscript review process at the Annals of Emergency Medicine. PARTICIPANTS: Reviewers (n=838) who reviewed manuscripts submitted between 2 June 2014 and 23 January 2018 inclusive (n=1480 manuscripts). INTERVENTION: Reviewers were randomized to either receive (treatment) or not receive (control) authors' full International Committee of Medical Journal Editors format conflict of interest disclosures before reviewing manuscripts. Reviewers rated the manuscripts as usual on eight quality ratings and were then surveyed to obtain "counterfactual scores"-that is, the scores they believed they would have given had they been assigned to the opposite arm-as well as attitudes toward conflicts of interest. MAIN OUTCOME MEASURE: Overall quality score that reviewers assigned to the manuscript on submitting their review (1 to 5 scale). Secondary outcomes were scores the reviewers submitted for the seven more specific quality ratings and counterfactual scores elicited in the follow-up survey. RESULTS: Providing authors' conflict of interest disclosures did not affect reviewers' mean ratings of manuscript quality (Mcontrol=2.70 (SD 1.11) out of 5; Mtreatment=2.74 (1.13) out of 5; mean difference 0.04, 95% confidence interval -0.05 to 0.14), even for manuscripts with disclosed conflicts (Mcontrol= 2.85 (1.12) out of 5; Mtreatment=2.96 (1.16) out of 5; mean difference 0.11, -0.05 to 0.26). Similarly, no effect of the treatment was seen on any of the other seven quality ratings that the reviewers assigned. Reviewers acknowledged conflicts of interest as an important matter and believed that they could correct for them when they were disclosed. However, their counterfactual scores did not differ from actual scores (Mactual=2.69; Mcounterfactual=2.67; difference in means 0.02, 0.01 to 0.02). When conflicts were reported, a comparison of different source types (for example, government, for-profit corporation) found no difference in effect. CONCLUSIONS: Current ethical standards require disclosure of conflicts of interest for all scientific reports. As currently implemented, this practice had no effect on any quality ratings of real manuscripts being evaluated for publication by real peer reviewers.
引用
- John LK, Loewenstein G, Marder A, et al. Effect of revealing authors' conflicts of interests in peer review: randomized controlled trial. BMJ. 2019. PMID: 31694810. doi:10.1136/bmj.l5896
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。