改进系统评价实施:过程挖掘视角
该研究模拟一个研究团队1年内开展的12项系统评价的活动和步骤特异性方法,生成包含起止日期、按专长分配评价员及人时的事件日志。应用过程挖掘技术发现流程模型并计算人时与时间线统计,同时分析团队交互的社会网络。结果显示平均每项评价纳入3831条题录/摘要和20项研究,平均完成时间463天、881人时,其中研究选择占26%人时。结论认为事件日志与过程挖掘可帮助研究团队改进和现代化系统评价流程。
要点
- 过程挖掘可可视化、动画化或回放模拟的系统评价活动流程。
- 12项模拟评价平均纳入3831条题录/摘要和20项研究。
- 平均完成时间463天、881人时,研究选择占人时26%。
核心结论
- 事件日志与过程挖掘可成为研究团队改进和现代化系统评价流程的有价值工具。
研究设计与样本
- 模拟一个研究团队1年内开展的12项系统评价的活动和步骤特异性方法,生成包含起止日期、按专长分配评价员及人时的事件日志。
主要发现
- 12项模拟评价平均纳入3831条题录/摘要(范围1565-6368)和20项研究(范围6-42)。
- 平均评价完成时间463天(范围289-629),平均881人时(范围243-1752)。
- 平均各活动人时占比:研究选择26%、数据收集24%、报告准备23%、荟萃分析17%。
- 社会网络分析显示团队成员的组织交互,包括如何共同完成评价任务及完成后交接任务。
临床怎么用
- 研究团队可利用事件日志和过程挖掘可视化、回放系统评价活动,识别流程瓶颈并优化人时分配。
局限性
- 研究基于单一研究团队的模拟评价活动,结论外推需谨慎。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To illustrate the use of process mining concepts, techniques, and tools to improve the systematic review process. STUDY DESIGN AND SETTING: We simulated review activities and step-specific methods in the process for systematic reviews conducted by one research team over 1 year to generate an event log of activities, with start/end dates, reviewer assignment by expertise, and person-hours worked. Process mining techniques were applied to the event log to "discover" process models, which allowed visual display, animation, or replay of the simulated review activities. Summary statistics were calculated for person-time and timelines. We also analyzed the social networks of team interactions. RESULTS: The 12 simulated reviews included an average of 3,831 titles/abstracts (range: 1,565-6,368) and 20 studies (6-42). The average review completion time was 463 days (range: 289-629) (881 person-hours [range: 243-1,752]). The average person-hours per activity were study selection 26%, data collection 24%, report preparation 23%, and meta-analysis 17%. Social network analyses showed the organizational interaction of team members, including how they worked together to complete review tasks and to hand over tasks upon completion. CONCLUSION: Event log and process mining can be valuable tools for research teams interested in improving and modernizing the systematic review process.
引用
- Pham B, Bagheri E, Rios P, et al. Improving the conduct of systematic reviews: a process mining perspective. J Clin Epidemiol. 2018. PMID: 30297037. doi:10.1016/j.jclinepi.2018.06.011
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。