文献速递医学教育与科研方法流行病学与生物统计

肿瘤学预测模型研究的同行评审亟需改进:对BMC期刊开放同行评审报告的系统综述

Peer review of prediction model studies in oncology needs improvement: A systematic review of open peer review reports from BMC journals.
PubMed 文献 · J Clin Epidemiol · 2025-09-02

该研究评估BioMed Central期刊2021年发表的肿瘤学回归类临床预测模型研究的开放同行评审报告,采用ARCADIA清单(13项)加附加标准由两名研究者独立评价。评审意见简短(中位数243词,范围0-677),多聚焦方法与结果,极少涉及局限性与外推性,无评审者核查TRIPOD等报告指南的依从性。作者认为评审缺乏深度与方法学审查,亟需改革。

要点

  • 评审意见中位数243词(范围0-677),82.7%聚焦方法或结果,关注局限性者不足20%。
  • 无评审者核查对报告指南(如TRIPOD)的依从性,仅1名评审者提及指南使用。
  • 67.3%的评审聚焦表述问题,38.5%评价统计方法,19.2%建议统计修订,不足1%涉及方案偏离或数据可及性。

核心结论

  • 作者认为预测模型的同行评审缺乏深度、方法学审查和对报告标准的执行,可能因有偏模型带来临床危害并造成研究浪费。
  • 作者提出亟需改革,包括实施报告指南(如TRIPOD+AI)、强制评审者培训并将同行评审认可为学术劳动。
  • 作者认为期刊必须在评审中优先重视方法学严谨性,以确保可靠的预测模型并保障患者照护。

研究设计与样本

  • 系统综述,检索2021年发表于BioMed Central(BMC)期刊的肿瘤学领域已发表预测模型研究。
  • 采用ARCADIA清单(13项评审质量评价工具)并附加标准(如字数、评论聚焦的稿件章节)进行数据提取。
  • 两名研究者独立评价所有开放同行评审报告,分歧由第三名研究者参与解决,采用描述性统计与叙述性综合。

主要发现

  • 评审意见简短,字数中位数243词(范围0-677)。
  • 82.7%的评审聚焦方法或结果,但涉及局限性者不足20%,也极少涉及外推性。
  • 无评审者核查对报告指南(如TRIPOD)的依从性,仅1名评审者提及指南使用。
  • 67.3%的评审聚焦表述等表层问题,38.5%评价统计方法。
  • 19.2%的评审建议统计修订,不足1%涉及方案偏离或数据可及性。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: To evaluate the completeness and quality of open peer review reports from BioMed Central (BMC) journals for regression-based clinical prediction model studies in oncology, focusing on adherence to methodological standards, reporting guidelines, and constructive feedback. METHODS: We searched for published prediction model studies in the field of oncology, which were published in BioMed Central journals in 2021. Data extraction used the Assessment of review Reports with a Checklist Available to eDItors and Authors (ARCADIA) checklist (13-item tool assessing review quality) with additional criteria (eg, word count, focus of comments on manuscript sections). Two investigators independently evaluated all open peer reviews, with conflicts resolved involving a third researcher. Descriptive statistics and narrative synthesis were applied. RESULTS: Peer reviews were brief (median: 243 words; range: 0-677), with 82.7% focusing on methods or results but rarely addressing limitations (<20%) or generalizability. No reviewers verified adherence to reporting guidelines (eg, TRIPOD); only one reviewer mentioned guideline use. Reviews prioritized superficial issues (67.3% focused on presentation) over methodological rigor (38.5% evaluated statistical methods). There are 19.2% suggested statistical revisions and <1% addressed protocol deviations or data availability. CONCLUSION: Our findings show that peer reviews of prediction models lack depth, methodological scrutiny, and enforcement of reporting standards. This risks clinical harm from biased models and perpetuates research waste. Reforms are urgently needed, including implementing reporting guidelines (eg, TRIPOD+AI), mandatory reviewer training, and recognition of peer review as scholarly labor. Journals must prioritize methodological rigor in reviews to ensure reliable prediction models and safeguard patient care.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Ma J, MacCarthy A, Kirtley S, et al. Peer review of prediction model studies in oncology needs improvement: A systematic review of open peer review reports from BMC journals. J Clin Epidemiol. 2025. PMID: 40907805. doi:10.1016/j.jclinepi.2025.111967

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。