临床试验中不同计算方法得出的标准化均数差估计存在较大变异
该研究检索PubMed中估算标准化均数差(SMD)的普通医学和精神病学随机对照试验,纳入161篇文章,分析SMD的计算、报告与解读方式,并基于不同均数差(MD)和标准差(SD)重新计算SMD以评估变异。结果显示69.0%的研究未提供足够细节,不同MD和SD所得SMD的绝对差异中位数为0.3(IQR 0.17至0.53),68.3%的研究基于同一参考Cohen经验法则解读SMD,样本量小和报告效应大的研究变异最大。作者认为应预先指定并报告方法并从多角度解读结果。
要点
- 69.0%的研究未提供足够细节说明SMD的计算方法。
- 同一研究内不同MD和SD所得SMD的绝对差异中位数为0.3(IQR 0.17至0.53)。
- 68.3%的研究基于同一参考Cohen经验法则解读SMD。
核心结论
- 使用不同MD和SD计算的SMD可能变异很大,但报告常不充分且解读过于简化。
- 为避免选择性报告偏倚和误读,作者认为宜预先指定并报告方法并从多角度解读结果。
研究设计与样本
- 检索PubMed中估算SMD的普通医学和精神病学随机对照试验,纳入161篇文章。
- 探究SMD的计算与解读方式,并基于不同MD和SD重新计算SMD及评估每项研究的变异。
主要发现
- 各种MD和SD被用于计算SMD,但69.0%的研究未能提供足够细节。
- 同一研究内使用不同MD和SD所得SMD估计的变异可能很大,绝对差异中位数为0.3(IQR 0.17至0.53)。
- 68.3%的研究基于同一参考Cohen经验法则解读SMD。
- 最大变异见于样本量小和报告效应大的研究。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND AND OBJECTIVES: The standardized mean difference (SMD) can be calculated from different mean differences (MDs) and standard deviations (SDs). This study aims to investigate how clinical trials calculated, reported and interpreted the SMD, and to examine the variation between different SMDs. METHODS: We searched the PubMed for randomized controlled trials of general medicine and psychiatry that estimated SMDs. We explored how the SMD was computed and interpreted. We calculated SMDs based on different MDs and SDs, and the variation in these SMD estimates for each study. RESULTS: We included 161 articles. Various MDs and SDs were used to calculate SMDs, yet 69.0% studies failed to provide sufficient details. Variations in SMD estimates using different MDs and SDs in one study could be substantial (median of the absolute differences was 0.3, interquartile range IQR 0.17 to 0.53). However, 68.3% studies interpreted the SMD based on the same reference, Cohen's rule of thumb. The largest variations were observed in studies with small sample sizes and large reported effects. CONCLUSION: SMDs using different MDs and SDs could vary considerably, but the report was often insufficient and the interpretation was oversimplified. To avoid selective reporting bias and misinterpretation, prespecifying and reporting the method and interpreting the result from multiple perspectives are desirable.
引用
- Luo Y, Funada S, Yoshida K, et al. Large variation existed in standardized mean difference estimates using different calculation methods in clinical trials. J Clin Epidemiol. 2022. PMID: 35654267. doi:10.1016/j.jclinepi.2022.05.023
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。