使用全国数据库进行完全随机预测变量-结局配对可频繁获得统计学显著性而无临床意义
该回顾性横断面分析利用大型全国数据库,从955,092例全髋或全膝关节置换病例中随机选取20对预测变量-结局变量进行配对统计检验,发现14对(70%)获得统计学显著结果(P<0.05),但这些关联无临床合理性,纯由样本量驱动,提示大型数据库研究需警惕过度解读显著性。
要点
- 在955,092例关节置换病例中,完全随机配对的20对变量有14对(70%)达到统计学显著(P<0.05)。
- 显著关联包括CPT编码与糖化血红蛋白(r=-0.0435,P=2.14e-40)等无临床逻辑的配对。
- 作者认为大型数据库研究应基于假设驱动方法并重视效应量解读。
核心结论
- 完全随机预测变量-结局配对在大型全国数据库中频繁产生统计学显著结果但无临床相关性,纯由样本量驱动。
- 这凸显了大型数据库研究中过度解读显著性的风险,并强化了假设驱动方法和效应量解读的必要性。
研究设计与样本
- 回顾性横断面分析,利用大型全国数据库,基于Current Procedural Terminology(CPT)编码识别接受全膝关节置换术(TKA)或全髋关节置换术(THA)的患者。
- 共纳入955,092例病例(全髋关节置换术373,528例[39.1%],全膝关节置换术581,564例[60.9%]),平均年龄66岁(范围17至89岁),平均体重指数(BMI)31.8(范围10.0至99.3),女性占58.6%。
- 使用种子随机生成器在数据集所有变量中随机选取20对预测变量-结局变量配对,根据变量类型采用Pearson相关(连续-连续)、Welch双样本t检验(连续-二分类)和卡方检验(二分类-二分类)。
主要发现
- 20对变量中有14对(70%)获得统计学显著结果(P<0.05)。
- CPT编码与糖化血红蛋白:r=-0.0435,P=2.14e-40。
- 身高与慢性阻塞性肺疾病(COPD)病史:变化=0.330,P=1.83e-47。
- 病例识别与CPT编码:r=-0.027,P=3.42e-150。
- 上述显著关联均无 underlying 临床合理性。
临床怎么用
- 作者认为大型数据库研究应基于假设驱动方法并重视效应量解读。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Large national databases have enabled extensive outcomes research in arthroplasty. Their vast sample sizes, however, raise concerns regarding the identification of statistically significant, but clinically meaningless associations. We hypothesized that completely random pairings between database variables, without any clinical rationale, would still frequently yield statistically significant associations, which were driven purely by sample size rather than any meaningful relationship. This study examines the extent of false discovery risk in data-driven analysis of large clinical datasets. METHODS: A retrospective cross-sectional analysis was performed utilizing a large national database. Patients who underwent total knee arthroplasty (TKA) or total hip arthroplasty (THA) were identified based on the Current Procedural Terminology (CPT) codes. There were 20 predictor-outcome variable pairs randomly selected using a seeded random generator applied across all variables in the dataset. Appropriate statistical tests were applied based on the variable types: Pearson correlations for continuous-continuous comparisons, Welch two-sample t-tests for continuous-binary comparisons, and Chi-square tests for binary-binary comparisons. Among 955,092 total cases (total hip arthroplasty: 373,528 [39.1%], total knee arthroplasty: 581,564 [60.9%]), mean age of 66 years (range, 17 to 89); mean body mass index (BMI) of 31.8 (range, 10.0 to 99.3); 58.6% of women, and 20 fully randomized predictor-outcome pairs were analyzed. RESULTS: There were 14 variable pairs (70%) that yielded statistically significant results (P < 0.05), including Current Procedural Terminology code versus hemoglobin A1c (r = -0.0435, P = 2.14e-40), height versus history of chronic obstructive pulmonary disease (COPD) (change = 0.330, P = 1.83e-47), and case identification versus Current Procedural Terminology code (r = -0.027, P = 3.42e-150), despite no underlying clinical rationale. CONCLUSIONS: Fully randomized predictor-outcome pairings in a large national database yielded frequent statistically significant results without clinical relevance, which were driven purely by sample size. This highlights the risk of over-interpreting significance in large database studies and reinforces the need for hypothesis-driven methodology and effect size interpretation.
引用
- Grayson W, Chakraborty A, Brown NM, et al. Fully Randomized Predictor-Outcome Pairings Using a National Database Yield Frequent Statistical Significance Without Clinical Meaning. J Arthroplasty. 2025. PMID: 40885217. doi:10.1016/j.arth.2025.08.053
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。