文献速递流行病学与生物统计真实世界研究与卫生经济

未测量混杂偏倚下P值经验校准的模拟与真实世界评估

Evaluating empirical calibration of P values under unmeasured confounding bias: a simulation study and real-world application.
PubMed 文献 · J Clin Epidemiol · 2026-02-18

该研究通过模拟五种U-可比性场景并应用英国生物银行数据,评估P值经验校准在未测量混杂下控制I/II类错误的效果。标准logistic回归I类错误率最高达44.2%,经验校准通常可将I类错误控制在5%附近,并在理想与真实场景下减少80%-100%的偏倚。

要点

  • 经验校准可降低未测量混杂导致的I类错误膨胀,但依赖阴性对照的有效性与数量。
  • 标准logistic回归在真实U-可比性场景下I类错误率可达44.2%。

核心结论

  • P值经验校准可缓解残余未测量混杂并减少观察性研究中的I类错误膨胀。
  • 其性能取决于阴性对照的有效性和数量。

研究设计与样本

  • 模拟研究设置五种反映U-可比性假设遵循程度的场景:理想、现实、违反U-可比性及两种部分违反的混合场景。
  • 变化样本量、未测量混杂偏倚的方向与强度以及阴性对照数量。
  • 基于英国生物银行数据,应用于2型糖尿病患者中高血压与外周动脉疾病(PAD)的关联评估。

主要发现

  • 标准logistic回归在几乎所有场景下I类错误率膨胀,在现实U-可比性且样本量20,000时最高达44.2%。
  • 经验校准在理想和现实U-可比性下通常将I类错误控制在接近名义5%水平,并减少80%-100%的偏倚。
  • I类错误控制随阴性对照数量增加而改善;II类错误控制受未测量混杂偏倚与真实暴露-结局效应方向是否一致影响。

关键数值与推荐

  • 标准logistic回归I类错误率最高达44.2%(现实U-可比性,样本量20,000)。
  • 经验校准在理想和现实U-可比性下减少偏倚80%-100%。

临床怎么用

  • 在观察性研究中,当存在未测量混杂担忧时,可考虑使用P值经验校准。
  • 应用时需选择与目标暴露共享相同混杂结构的阴性对照,并确保足够数量以稳定结果。
  • 阴性对照选择不当或无关时方法可能失效。

局限性

  • 方法性能依赖于阴性对照的有效性和数量。
  • 当阴性对照选择不当或与目标暴露无关时,校准可能失败。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: To evaluate whether empirical calibration of P values using negative controls can effectively control type I and type II errors under unmeasured confounding bias in both simulated and real-world observational settings. STUDY DESIGN AND SETTING: A simulation study was conducted under five settings reflecting different degrees of adherence to the U-comparability assumption-that is, the extent to which negative controls share the same unmeasured confounding structure as the exposure of interest. These included three primary scenarios (ideal, realistic, and violation of U-comparability) and two mixed scenarios reflecting partial violations. We varied sample size, the direction and strength of unmeasured confounding bias, and the number of negative controls. Based on UK Biobank data, the method was also applied to evaluate the association between hypertension and peripheral artery disease (PAD) in individuals with type 2 diabetes mellitus. RESULTS: Standard logistic regression showed inflated type I error rates across almost all settings, peaking at 44.2% under realistic U-comparability with a sample size of 20,000. In contrast, empirical calibration generally controlled type I error close to the nominal 5% level and reduced bias by 80%-100% under both ideal and realistic U-comparability. Type I error control improved with more negative controls, while type II error control was influenced by whether the unmeasured confounding bias acted in the same or opposite direction as the true exposure-outcome effect. In the UK Biobank case study, 4 of 15 negative controls showed P < .05 after adjustment for measured confounders, indicating residual unmeasured confounding. After empirical calibration with 5, 10, or 15 negative controls, the association between hypertension and PAD remained statistically significant (calibrated P ≈ .004-.006). CONCLUSION: Empirical calibration of P values can mitigate residual unmeasured confounding and reduce type I error inflation in observational studies. Its performance depends on the validity and number of negative controls. PLAIN LANGUAGE SUMMARY: When researchers use large health databases to study whether a treatment or risk factor causes a disease, results can sometimes be misleading. This can happen because of unmeasured confounding-hidden factors that influence both the exposure and the outcome-leading to "false alarms," or false positive findings. We evaluated a statistical method called empirical calibration of P values, designed to correct this bias. The method uses negative controls (exposures known not to have a causal effect on the outcome) to estimate the amount of bias in the data and then adjust the P value for the exposure of interest. Our simulation study showed that this approach effectively reduced the false alarm rate to the expected 5% level, but only under certain conditions. Its success depended on selecting appropriate negative controls that shared the same bias structure as the exposure of interest and on using a sufficient number of controls to ensure stable results. The method failed when the negative controls were poorly chosen or unrelated. When applied to real-world data from the UK Biobank, it successfully corrected for unmeasured bias while still confirming the true, significant link between high blood pressure and PAD. These findings suggest that empirical calibration of P values can make observational research more reliable, provided that enough well-chosen negative controls are available.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Wang M, Li W, Lu Z, et al. Evaluating empirical calibration of P values under unmeasured confounding bias: a simulation study and real-world application. J Clin Epidemiol. 2026. PMID: 41720315. doi:10.1016/j.jclinepi.2026.112188

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。