德尔菲研究缺乏预注册分析计划易致数据挖掘与共识选择性报告
该研究汇总八个在线改良德尔菲小组数据,计算常用描述性分析流程下达成共识条目的百分比,发现不同分析流程下共识条目百分比范围0%至84%,面板间差异大;结论为未披露的分析灵活性使数据挖掘和选择性报告共识变得容易,建议前瞻性完整注册预分析计划。
要点
- 不同分析流程下共识条目百分比范围0%至84%,分析灵活性高。
- 面板间同一分析流程共识条目百分比范围0至83。
- 200种面板-分析流程组合中2%全部条目达共识,32%无条目达共识。
核心结论
- 未披露的分析灵活性使德尔菲过程中数据挖掘和选择性报告共识变得容易,建议前瞻性完整注册预分析计划。
研究设计与样本
- 汇总八个在线改良德尔菲小组数据,计算常用描述性分析流程下达成共识条目的百分比,并检查面板间变异性。
主要发现
- 汇总所有面板数据,共识条目百分比范围0%至84%,取决于分析流程。
- 比较面板间数据,每种分析流程共识条目百分比变异性范围0至83(例如某分析流程面板范围11%至94%)。
- 200种面板-分析流程组合中,4种(2%)全部条目达共识,64种(32%)无条目达共识。
临床怎么用
- 对共识导向德尔菲过程进行前瞻性、完整的预分析计划注册。
局限性
- 原文未述局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To empirically demonstrate how undisclosed analytic flexibility provides substantial latitude for data mining and selective reporting of consensus in Delphi processes. STUDY DESIGN AND SETTING: Pooling data across eight online modified-Delphi panels, we first calculated the percentage of items reaching consensus according to descriptive analysis procedures commonly used in health research but selected post hoc in this article. We then examined the variability of items reaching consensus across panels. RESULTS: Pooling all panel data, the percentage of items reaching consensus ranged from 0% to 84%, depending on the analysis procedure. Comparing data across panels, variability in the percentage of items reaching consensus for each analysis procedure ranged from 0 (i.e., all panels had the same percentage of items reaching consensus for a given analysis procedure) to 83 (i.e., panels had a range of 11% to 94% of items reaching consensus for a given analysis procedure). Of 200 total panel-by-analysis-procedure configurations, four configurations (2%) had all items and 64 (32%) had no items reaching consensus. CONCLUSION: Undisclosed analytic flexibility makes it unacceptably easy to data mine for and selectively report consensus in Delphi processes. As a solution, we recommend prospective, complete registration of preanalysis plans for consensus-oriented Delphi processes in health research.
引用
- Grant S, Booth M, Khodyakov D, et al. Lack of preregistered analysis plans allows unacceptable data mining for and selective reporting of consensus in Delphi studies. J Clin Epidemiol. 2018. PMID: 29559324. doi:10.1016/j.jclinepi.2018.03.007
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。