动态系统评价:2. 结合人力与机器效能
本文探讨在动态系统评价中,将人工贡献(包括在线众包和综述作者、信息专家)与机器自动化(如检索、资格评估、全文获取、数据提取和偏倚风险评估)相互强化的方式结合,可提升系统评价的可行性与可持续性,并讨论各项具体任务中人体/机器技术的潜力、局限及未来研发需求。
要点
- 人工与机器自动化相互强化可提升动态系统评价的可行性和可持续性。
- 自动化可辅助检索、资格评估、全文获取、数据提取和偏倚风险评估等任务。
- 需进一步研发以优化动态系统评价中各项任务的人机协作流程。
核心结论
- 采用人工与机器自动化相互强化的新方法,可提升动态系统评价的可行性和可持续性。
研究设计与样本
- 本文为方法学论述,描述并讨论动态系统评价中特定任务的新方式及其潜力与局限。
主要发现
- 人工付出是稀缺且有价值的资源,在自动化不可行或不可取时必需,包括在线社区(众包)的贡献以及综述作者和信息专家的常规贡献。
- 自动化可辅助部分系统评价任务,包括检索、资格评估、全文报告的识别与获取、数据提取和偏倚风险评估。
- 可开发工作流程,使人工付出与机器自动化相互促进,以更有效和高效的方式运作,从而大幅提升系统评价的生产力。
局限性
- 本文讨论新方式的潜力与局限,并指出需要进一步研究与开发的领域。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
New approaches to evidence synthesis, which use human effort and machine automation in mutually reinforcing ways, can enhance the feasibility and sustainability of living systematic reviews. Human effort is a scarce and valuable resource, required when automation is impossible or undesirable, and includes contributions from online communities ("crowds") as well as more conventional contributions from review authors and information specialists. Automation can assist with some systematic review tasks, including searching, eligibility assessment, identification and retrieval of full-text reports, extraction of data, and risk of bias assessment. Workflows can be developed in which human effort and machine automation can each enable the other to operate in more effective and efficient ways, offering substantial enhancement to the productivity of systematic reviews. This paper describes and discusses the potential-and limitations-of new ways of undertaking specific tasks in living systematic reviews, identifying areas where these human/machine "technologies" are already in use, and where further research and development is needed. While the context is living systematic reviews, many of these enabling technologies apply equally to standard approaches to systematic reviewing.
引用
- Thomas J, Noel-Storr A, Marshall I, et al. Living systematic reviews: 2. Combining human and machine effort. J Clin Epidemiol. 2017. PMID: 28912003. doi:10.1016/j.jclinepi.2017.08.011
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。