文献速递医学教育与科研方法

肿瘤学随机对照试验的同行评审报告可能简短且流于表面

Peer review reports of randomized controlled trials in oncology can be short and superficial.
PubMed 文献 · J Clin Epidemiol · 2025-06-30

该研究评估了肿瘤学随机对照试验(RCT)开放同行评审报告的质量,从2021年62种实行开放同行评审的BioMed Central期刊中抽样26项RCT的59份首轮评审报告。评审报告中位字数276字,仅19%为建设性意见,对结论充分性、结果适用性及局限性致谢的关注较少。结论认为这些评审报告简短、流于表面且少有建设性。

要点

  • 肿瘤学RCT开放同行评审报告中位字数仅276字,范围0-1047字。
  • 仅19%(11/59)的评审报告为建设性,提出了问题解决方案。
  • 78%(46/59)的评审者评论了方法学部分,但仅25%(15/59)评论结论充分性。

核心结论

  • 肿瘤学已发表RCT的同行评审报告简短、流于表面且少有建设性,对研究结论、方案偏离、报告完整性或数据可及性关注不足。

研究设计与样本

  • 从2021年发表于62种实行开放同行评审的BioMed Central期刊的已完成平行RCT文章中搜索并抽样,评估其首轮同行评审报告,由两名研究者独立评估,第三作者解决分歧。

主要发现

  • 抽样26项RCT,评估其59份首轮同行评审报告,中位字数为276字(范围=0-1047)。
  • 仅11份报告为建设性(19%),提出了所注意问题的解决方案。
  • 评论方法学部分的评审者(n=46/59,78%)中,74%(n=34/46)涉及方法学适宜性。
  • 评论结论充分性者(n=15/59;25%)、结果适用性者(n=5/59;9%)及作者是否承认研究局限性者(n=11/59;18%)较少。
  • 仅4份(7%)评论了开放研究实践,包括方案偏离、报告完整性和数据与材料共享。

局限性

  • 原文未报告局限性

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: To evaluate the quality of open peer review reports published alongside articles of randomized controlled trials (RCTs) in oncology. METHODS: We searched and sampled from completed parallel RCT articles published in 2021 in 62 BioMed Central journals operating open peer review and evaluated their first-round peer review report. We assessed and described the peer review report content, clarity, and completeness and explored whether reviewers commented on the manuscript's importance, robustness, interpretation, discussion of results, and RCT reporting. Two investigators evaluated the review reports independently, with conflict resolution involving a third author. RESULTS: We sampled 26 RCTs and evaluated their 59 first peer review reports. Median word count was 276 (range = 0-1047). Only 11 reports were constructive (19%), suggesting solutions for the problems noted. Of reviewers commenting on the manuscript's methods section (n = 46/59, 78%), 74% (n = 34/46) addressed the suitability of the methodology. Fewer commented on the adequacy of conclusions (n = 15/59; 25%) or the applicability of results (n = 5/59; 9%), or whether study limitations had been acknowledged by authors (n = 11/59; 18%). Only four (7%) commented on open research practices, including deviations from protocols, completeness of reporting, and sharing of data and materials. CONCLUSION: Peer review reports of published RCTs in oncology were short, superficial, and rarely constructive. Although there is indication that reviewers commented on study methodology, little attention was paid to study conclusions, deviation from study protocols, completeness of reporting, or data availability. Such review reports would be of limited value to authors for improving their trial study manuscripts, or to editors in deciding on manuscript publication. PLAIN LANGUAGE SUMMARY: Clinical trials are research studies that test whether a treatment or action works to help prevent or treat a disease. The results from these studies are important because they help doctors and policy makers decide what care is best for patients. Before the results from a clinical trial are published, other experts, sometimes including members of the public, carefully check the study to make sure it was conducted properly and that the results are trustworthy. This checking process is called "peer review". Reviewers look at things like how the study was carried out, whether the results make sense, and if the conclusions are fair. In our project, we looked at how well this peer review process worked in a selection of medical journals that make their review reports public. We read the reviews for 26 published trials to see what the reviewers said. We found that most of the review reports were very short and did not provide much detail to help the journal editors decide if the study should be published. Some reviews were only one sentence long. Many reviewers did not comment much on how the study was analyzed, and very few said whether the study conclusions were reasonable. Although peer review is supposed to help make sure research is reliable, we found that sometimes the reviews are too brief to be very helpful.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Logullo P, MacCarthy A, Kirtley S, et al. Peer review reports of randomized controlled trials in oncology can be short and superficial. J Clin Epidemiol. 2025. PMID: 40602628. doi:10.1016/j.jclinepi.2025.111893

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。