Shiny二分类建模平台:面向可重复性的结构化二分类建模软件
本文介绍一款基于R/Shiny的二分类建模平台,将数据准备、预处理保留、候选模型基准比较、最终模型部署、SHAP解释、外部验证支持、模型比较与归档导出整合于同一项目流程。以6383条中药来源化合物记录、12个ADME/理化描述符演示,在分层10折交叉验证下评估113个候选模型设定;作者强调该演示仅代表内部交叉验证,不构成终点特异性毒性预测结论。
要点
- 平台整合预处理、基准比较、部署、SHAP解释与归档导出,提升建模可追溯性。
- 演示仅用内部交叉验证,未使用独立外部验证数据集,性能不代表外部表现。
- 描述符集仅用于跑通软件流程,不应视为全面的终点特异性毒性QSAR特征集。
核心结论
- 该文为软件类文章,演示了整合式基准比较、部署、内部折外报告、经审计的SHAP输出处理、模型比较与可重复导出。
- 外部验证支持与独立预测应用导出已实现,但单数据集演示不支持独立外部性能、部署就绪性或竞争性毒性QSAR的声称。
研究设计与样本
- 研究为R/Shiny应用软件开发与单数据集演示,非终点特异性预测研究。
- 演示数据含6383条中药来源化合物记录、一个来源衍生的纯毒性来源标签及12个ADME/理化描述符。
- 在分层10折交叉验证下评估113个候选模型设定,仅训练折内做多数类下采样,评估折保留原始不平衡分布。
主要发现
- 主要性能汇总模型为Stepglm [both]+RF:双向逐步逻辑回归筛选后接随机森林的两阶段设定。
- 以pure_toxic_label = 1为毒性/阳性类,其合并折外PR-AUC为0.2469。
- 阈值0.5时,毒性类精确率/PPV为0.2288、召回率/灵敏度为0.4091、F1为0.2935、NPV为0.9509。
- 归档的全局与局部SHAP输出经复核:展示的全局输出来自保留的Lasso + RF历史参考项目,展示的局部瀑布输出来自Stepglm [both]+RF主要性能汇总模型。
临床怎么用
- 可用于结构化二分类建模的项目化流程管理与结果归档,便于复现与审计。
- 解读SHAP等解释输出时需核对来源项目与模型,避免跨项目混用。
- 文中数值仅为内部交叉验证结果,不宜直接外推为临床或毒性预测性能。
局限性
- 未使用独立外部验证数据集,所报告性能仅为内部交叉验证。
- 描述符集仅用于演示软件流程,非全面的终点特异性毒性QSAR特征集。
- 单数据集演示不支持独立外部性能、部署就绪性或竞争性毒性QSAR的声称。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Structured binary modeling is often implemented through scattered scripts and temporary files, leaving preprocessing recipes, benchmarks, deployed models, interpretation outputs, and archive materials difficult to trace. This limits practical reproducibility and later reuse. RESULTS: We developed Shiny Binary Modeling Platform, an R/Shiny application that links data setup, preprocessing retention, candidate-model benchmarking, final model deployment, SHAP-based interpretation, external-validation support, model comparison, and archive export in one project workflow. In a demonstration using 6383 traditional Chinese medicine-derived compound records, a source-derived pure-toxic-source label, and 12 ADME/physicochemical descriptors, the platform evaluated 113 candidate model specifications under stratified 10-fold cross-validation. Majority-class downsampling was applied only within training folds; assessment folds retained the original imbalanced distribution. The descriptor set was used to exercise the software workflow and should not be interpreted as a comprehensive endpoint-specific toxicity-QSAR feature set. No independent external validation dataset was used, so reported performance represents internal cross-validation only. Stepglm [both]+RF-a two-stage specification using both-direction stepwise logistic-regression screening followed by random forest-served as the primary performance-summary model for ROC/PR reporting and structured export. With pure_toxic_label = 1 as the toxic/positive class, its merged out-of-fold PR-AUC was 0.2469; at threshold 0.5, toxic-class precision/PPV, recall/sensitivity, F1, and NPV were 0.2288, 0.4091, 0.2935, and 0.9509. Archived global and local SHAP outputs were re-audited separately: the global outputs shown in were traced to the retained Lasso + RF historical reference project, whereas the local waterfall output shown in was traced to the Stepglm [both]+RF primary performance-summary model. CONCLUSION: This is a software article rather than a final endpoint-specific prediction study. The current use case demonstrates integrated benchmarking, deployment, internal OOF reporting, audited SHAP-output handling, model comparison, and reproducible export. External-validation support and standalone prediction-app export are implemented capabilities, but the single-dataset demonstration does not support independent external-performance, deployment-readiness, or competitive toxicity-QSAR claims.
引用
- Du H, Huang X, Liu T, et al. Shiny binary modeling platform: a reproducibility-oriented software platform for structured binary modeling with integrated interpretation, validation support, model comparison, and archive export. Front Pharmacol. 2026. PMID: 42756056. doi:10.3389/fphar.2026.1905644
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。