医学与健康科学中数据与代码共享的流行率及预测因素:基于个体参与者数据的系统综述与Meta分析
该系统综述与个体参与者数据Meta分析纳入105项元研究、覆盖31个专科的2121580篇文章,发现2016至2021年公开数据声明共享率为8%、实际公开率为2%,公开代码声明与实际共享率均不足0.5%;强制数据共享政策的依从率在不同期刊和数据类型间差异很大(0%至100%)。
要点
- 2016至2021年公开数据声明共享率为8%(95%CI 5%至11%),实际公开率为2%(95%CI 1%至3%)。
- 2016年以来公开代码的声明共享率和实际共享率均估计不足0.5%。
- 强制数据共享政策的依从率在不同期刊和数据类型间为0%至100%。
核心结论
- 医学研究中公开代码共享持续处于低水平;数据共享声明率也低但随时间上升,且不总是对应实际数据共享。
- 强制数据共享政策的有效性因期刊和数据类型差异很大,该发现可能为政策制定者设计政策和分配审计合规资源提供参考。
研究设计与样本
- 系统综述与个体参与者数据Meta分析,检索Ovid Medline、Ovid Embase及medRxiv、bioRxiv、MetaArXiv预印本服务器(自建库至2021年7月1日),并于2022年8月30日进行前向引文检索。
- 纳入调查原创医学与健康研究文章中数据或代码共享情况的元研究,共纳入105项元研究、覆盖31个专科的2121580篇文章。
- 纳入研究中位研究数为195篇原创文章(四分位距113至475),中位发表年份为2015年(四分位距2012至2018年)。
- 仅8项研究(8%)被归类为低偏倚风险。
- 采用两阶段个体参与者数据Meta分析方法,比例和风险比采用Hartung-Knapp-Sidik-Jonkman随机效应Meta分析方法合并。
主要发现
- 2016至2021年公开数据声明共享率为8%(95%CI 5%至11%),实际公开数据共享率为2%(95%CI 1%至3%)。
- 2016年以来公开代码的声明共享率和实际共享率均估计不足0.5%。
- Meta回归显示仅公开数据声明共享率的估计值随时间上升。
- 对强制数据共享政策的依从率在不同期刊间为0%至100%,并因数据类型而异。
- 历史上私下向作者获取数据和代码的成功率分别为0%至37%和0%至23%。
局限性
- 仅8项研究(8%)被归类为低偏倚风险。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To synthesise research investigating data and code sharing in medicine and health to establish an accurate representation of the prevalence of sharing, how this frequency has changed over time, and what factors influence availability. DESIGN: Systematic review with meta-analysis of individual participant data. DATA SOURCES: Ovid Medline, Ovid Embase, and the preprint servers medRxiv, bioRxiv, and MetaArXiv were searched from inception to 1 July 2021. Forward citation searches were also performed on 30 August 2022. REVIEW METHODS: Meta-research studies that investigated data or code sharing across a sample of scientific articles presenting original medical and health research were identified. Two authors screened records, assessed the risk of bias, and extracted summary data from study reports when individual participant data could not be retrieved. Key outcomes of interest were the prevalence of statements that declared that data or code were publicly or privately available (declared availability) and the success rates of retrieving these products (actual availability). The associations between data and code availability and several factors (eg, journal policy, type of data, trial design, and human participants) were also examined. A two stage approach to meta-analysis of individual participant data was performed, with proportions and risk ratios pooled with the Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis. RESULTS: The review included 105 meta-research studies examining 2 121 580 articles across 31 specialties. Eligible studies examined a median of 195 primary articles (interquartile range 113-475), with a median publication year of 2015 (interquartile range 2012-2018). Only eight studies (8%) were classified as having a low risk of bias. Meta-analyses showed a prevalence of declared and actual public data availability of 8% (95% confidence interval 5% to 11%) and 2% (1% to 3%), respectively, between 2016 and 2021. For public code sharing, both the prevalence of declared and actual availability were estimated to be <0.5% since 2016. Meta-regressions indicated that only declared public data sharing prevalence estimates have increased over time. Compliance with mandatory data sharing policies ranged from 0% to 100% across journals and varied by type of data. In contrast, success in privately obtaining data and code from authors historically ranged between 0% and 37% and 0% and 23%, respectively. CONCLUSIONS: The review found that public code sharing was persistently low across medical research. Declarations of data sharing were also low, increasing over time, but did not always correspond to actual sharing of data. The effectiveness of mandatory data sharing policies varied substantially by journal and type of data, a finding that might be informative for policy makers when designing policies and allocating resources to audit compliance. SYSTEMATIC REVIEW REGISTRATION: Open Science Framework doi:10.17605/OSF.IO/7SX8U.
引用
- Hamilton DG, Hong K, Fraser H, et al. Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data. BMJ. 2023. PMID: 37433624. doi:10.1136/bmj-2023-075767
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。