随机试验摘要中大效应量连续结局的可信度与透明度特征较少
该研究比较了2024年1月至2025年3月在MEDLINE索引的随机对照试验,分为摘要中报告至少一个标准化均数差绝对值≥0.8的大效应量组(152项)和仅报告较小效应量组(175项)。结论提示摘要中报告大效应量的RCT更可能缺乏透明度和可信度特征。
要点
- 摘要报告大效应量的RCT预注册方案比例显著低于非大效应量试验(45% vs 61%)。
- 大效应量试验任何方案注册率更低(74% vs 87%),原始数据公开率均低(6% vs 7%)。
- 大效应量试验较少多中心、较少高收入国家作者或站点、较少发表统计分析计划。
核心结论
- 摘要中报告大效应量的RCT更可能缺乏透明度和可信度特征,可信度风险较高。
研究设计与样本
- 研究纳入2024年1月1日至2025年3月18日MEDLINE索引的RCT,比较大效应量组(152项)与非大效应量组(175项)的方法学特征。
主要发现
- 两组原始数据公开或存放率无差异(6% vs 7%)。
关键数值与推荐
- 大效应量定义:摘要中至少一个标准化均数差绝对值≥0.8。
临床怎么用
- 阅读摘要中报告大效应量的RCT时,应额外审查其预注册、多中心、统计分析计划等透明度特征。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: Large effect sizes (ESs), especially when prominently presented in trial abstracts, draw large attention, but it is important to understand whether they are trustworthy. We aimed to assess indicators of transparency and trustworthiness in randomized controlled trials (RCTs) reporting some large ES for continuous outcomes in their abstract, in comparison with RCTs presenting only nonlarge ESs in their abstract. STUDY DESIGN AND SETTING: We included RCTs indexed in MEDLINE between January 1, 2024 and March 18, 2025, presenting at least one standardized mean differences of absolute value 0.8 or higher (large ES) vs those presenting only smaller absolute standardized mean differences in their abstract. Trial characteristics and methodological features were extracted systematically in large ES and nonlarge ES trials. Primary outcome was prespecified protocol registration, secondary outcomes were any protocol registration and public availability or repository placement of raw data (preregistered protocol: https://osf.io/8xasw). RESULTS: We evaluated 152 trials with large ESs in their abstract and 175 trials with only nonlarge ESs in their abstract. Large ES trials had suggestively lower rates of preregistered protocols (45% vs 61%, P = .0054) and significantly lower rates of any protocol registration (74% vs 87%, P = .0028) than nonlarge ES trials. There was no difference in raw data public availability or repository placement (6% vs 7%). Large ES trials were also less likely to be multicenter (P = .0042), to have high-income country of corresponding author (P = .0001), to be conducted in high-income country site(s) (P = .0003), to have a published statistical analysis plan (P = .0216), to result from between-group comparisons (P < .0001), and tended to report less frequently allocation concealment (P = .0351). Large effects were significantly more likely to involve nondrug/nonpsychological interventions (P = .0001). CONCLUSION: RCTs presenting large ESs in their abstracts are more likely to lack transparency and trustworthiness features and may operate with higher risk of lack of credibility. PLAIN LANGUAGE SUMMARY: When a medical study reports that a treatment has a big effect that naturally grabs attention. However, are impressive-sounding results actually reliable? This study investigated whether clinical trials claiming large treatment effects in their abstracts are as trustworthy as those reporting only more modest results. We compared two groups of recently published randomized controlled trials: 152 trials that reported large effects in their abstracts, and 175 trials that reported only smaller effects. We looked at several markers of good scientific practice, particularly whether researchers had registered their study plans in advance and whether they made their data openly available. We found that trials reporting large effects were less likely to have preregistered their methods and more likely to have no registered protocol at all. The two groups also differed in other aspects of trustworthiness. Large-effect trials were less likely to involve multiple research centers, less likely to have researchers from high-income countries, and less likely to have a published statistical analysis plan. They also tended to test different types of treatments-large effects appeared more often in studies of interventions other than drugs or psychological therapies. Both groups were equally poor at making their raw data publicly available (only about 6%-7%). Overall, when a trial claims to have found impressive treatment effects, some extra scrutiny may be warranted. Before trusting eye-catching results, readers should assess whether trials followed proper scientific checks and transparency safeguards.
引用
- Henssler JF, Reis-Pardal J, Koppel L, et al. Trustworthiness and transparency features were less frequent in randomized trials presenting large effects for continuous outcomes in abstracts. J Clin Epidemiol. 2026. PMID: 41825568. doi:10.1016/j.jclinepi.2026.112215
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。