牙周炎牙齿丢失预测模型的系统评价
该系统评价检索了截至2022年2月12日的MEDLINE、Embase和CENTRAL数据库,共筛选4661条记录并纳入45项研究,评估牙周炎患者牙齿丢失预测模型的方法学与报告质量。仅26项研究报告了性能指标,中位C统计量为0.671(范围0.57-0.97)。所有研究均存在高偏倚风险,主要源于缺失数据处理不当(96%)、模型性能评估不当(92%)及未考虑过拟合(68%)。
要点
- 现有牙周炎牙齿丢失预测模型性能指标可能过于乐观,临床可重复性存疑。
- 所有纳入研究均存在高偏倚风险,主要因缺失数据处理和性能评估不当。
- 本综述无法推荐任何模型用于临床实践,但汇总了外部验证的模型性能与样本量。
核心结论
- 牙周炎牙齿丢失预测模型众多,但评估研究均存在高偏倚风险,性能指标可能过于乐观且难以在临床中重现。
- 本综述无法推荐任何模型用于临床实践,但汇总的模型性能与样本量有助于识别有前景的模型供未来外部验证。
研究设计与样本
- 系统评价,检索MEDLINE via PubMed、Embase和CENTRAL截至2022年2月12日,并追溯引文。
- 共筛选4661条记录,纳入45项研究,包括模型开发或外部验证研究。
- 使用CHARMS清单提取数据,TRIPOD评估报告质量,PROBAST评估偏倚风险。
主要发现
- 仅26项研究报告了任何类型的性能指标。
- 报告的中位C统计量为0.671(范围0.57-0.97)。
- 所有研究均存在高偏倚风险:缺失数据处理不当占96%,模型性能评估不当占92%,未考虑过拟合占68%。
关键数值与推荐
- 纳入标准:探索模型开发或外部验证的研究,针对牙周炎患者牙齿丢失,可用于任何时间点的临床使用,预测期限不限,英文发表。
- 排除标准:模型非用于牙周炎患者、未在任何数据集上开发或验证、预测结局非牙齿丢失、或为预后因素研究。
- 偏倚风险评估采用PROBAST工具,报告质量采用TRIPOD,数据提取采用CHARMS清单。
临床怎么用
- 现有模型性能指标可能过于乐观,临床使用前需谨慎验证。
- 建议关注本综述汇总的外部验证模型性能及样本量,以识别有前景的模型进行进一步外部验证。
局限性
- 仅纳入英文发表的研究。
- 检索截止日期为2022年2月12日,未涵盖此后发表的模型。
- 未报告纳入研究的样本量细节。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
This study reviews and appraises the methodological and reporting quality of prediction models for tooth loss in periodontitis patients, including the use of regression and machine learning models. Studies involving prediction modeling for tooth loss in periodontitis patients were screened. A search was performed in MEDLINE via PubMed, Embase, and CENTRAL up to 12 February 2022, with citation chasing. Studies exploring model development or external validation studies for models assessing tooth loss in periodontitis patients for clinical use at any time point, with all prediction horizons in English, were considered. Studies were excluded if models were not developed for use in periodontitis patients, were not developed or validated on any data set, predicted outcomes other than tooth loss, or were prognostic factor studies. The CHARMS checklist was used for data extraction, TRIPOD to assess reporting quality, and PROBAST to assess the risk of bias. In total, 4,661 records were screened, and 45 studies were included. Only 26 studies reported any kind of performance measure. The median C-statistic reported was 0.671 (range, 0.57-0.97). All studies were at a high risk of bias due to inappropriate handling of missing data (96%), inappropriate evaluation of model performance (92%), and lack of accounting for model overfitting in evaluating model performance (68%). Many models predicting tooth loss in periodontitis are available, but studies evaluating these models are at a high risk of bias. Model performance measures are likely to be overly optimistic and might not be replicated in clinical use. While this review is unable to recommend any model for clinical practice, it has collated the existing models and their model performance at external validation and their associated sample sizes, which would be helpful to identify promising models for future external validation studies.
引用
- Chow DY, Tay JRH, Nascimento GG, et al. Systematic Review of Prognosis Models in Predicting Tooth Loss in Periodontitis. J Dent Res. 2024. PMID: 38726948. doi:10.1177/00220345241237448
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。