复杂系统视角下的定性过程评估:系统综述与公共卫生评估者框架
所有评估均使用复杂系统概念分析定性数据,但仅4项明确评估系统随时间的变化。作者提出两阶段框架以指导未来评估系统变化。
要点
- 现有定性复杂系统过程评估多描述单时间点静态系统,缺乏对系统变化的评估。
- 建议采用两阶段框架:先描述系统并形成变化假设,再适应性追踪涌现发现。
核心结论
- 复杂系统视角下定性过程评估尚无共识实践,多数研究描述静态系统而非动态变化。
研究设计与样本
- 系统综述检索2014年1月1日至2019年9月30日Scopus、MEDLINE、Web of Science,辅以引文检索和专家咨询。
- 纳入自我认同采用系统或复杂性导向、整合定性方法、报告实证发现并评估公共卫生干预的过程评估。
- 两名评审独立评估研究,识别与系统思维和复杂性科学传统相关的概念。
主要发现
- 评估在13个国家(9个高收入、4个中等收入)的学校、工作场所和社区等场所进行。
- 所有评估在定性数据分析中均报告使用复杂系统概念;14项评估中复杂系统考虑影响干预设计、评估规划或实地工作。
- 仅4项评估明确利用一系列复杂性概念评估干预实施随时间导致的或同时发生的系统内变化。
临床怎么用
- 建议未来研究采用两阶段框架:第一阶段描述系统并识别系统如何响应干预的变化假设;第二阶段适应性评估追踪涌现发现的路径。
局限性
- 仅纳入英文论文。
- 依赖研究作者报告其对复杂系统概念的使用。
- 评审对每项研究特征概念的主观判断。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Public health evaluation methods have been criticized for being overly reductionist and failing to generate suitable evidence for public health decision-making. A "complex systems approach" has been advocated to account for real world complexity. Qualitative methods may be well suited to understanding change in complex social environments, but guidance on applying a complex systems approach to inform qualitative research remains limited and underdeveloped. This systematic review aims to analyze published examples of process evaluations that utilize qualitative methods that involve a complex systems perspective and proposes a framework for qualitative complex system process evaluations. METHODS AND FINDINGS: We conducted a systematic search to identify complex system process evaluations that involve qualitative methods by searching electronic databases from January 1, 2014-September 30, 2019 (Scopus, MEDLINE, Web of Science), citation searching, and expert consultations. Process evaluations were included if they self-identified as taking a systems- or complexity-oriented approach, integrated qualitative methods, reported empirical findings, and evaluated public health interventions. Two reviewers independently assessed each study to identify concepts associated with the systems thinking and complexity science traditions. Twenty-one unique studies were identified evaluating a wide range of public health interventions in, for example, urban planning, sexual health, violence prevention, substance use, and community transformation. Evaluations were conducted in settings such as schools, workplaces, and neighborhoods in 13 different countries (9 high-income and 4 middle-income). All reported some utilization of complex systems concepts in the analysis of qualitative data. In 14 evaluations, the consideration of complex systems influenced intervention design, evaluation planning, or fieldwork. The identified studies used systems concepts to depict and describe a system at one point in time. Only 4 evaluations explicitly utilized a range of complexity concepts to assess changes within the system resulting from, or co-occurring with, intervention implementation over time. Limitations to our approach are including only English-language papers, reliance on study authors reporting their utilization of complex systems concepts, and subjective judgment from the reviewers relating to which concepts featured in each study. CONCLUSION: This study found no consensus on what bringing a complex systems perspective to public health process evaluations with qualitative methods looks like in practice and that many studies of this nature describe static systems at a single time point. We suggest future studies use a 2-phase framework for qualitative process evaluations that seek to assess changes over time from a complex systems perspective. The first phase involves producing a description of the system and identifying hypotheses about how the system may change in response to the intervention. The second phase involves following the pathway of emergent findings in an adaptive evaluation approach.
引用
- McGill E, Marks D, Er V, et al. Qualitative process evaluation from a complex systems perspective: A systematic review and framework for public health evaluators. PLoS Med. 2020. PMID: 33137099. doi:10.1371/journal.pmed.1003368
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。