试验利益冲突处理工具(TACIT)原型用户体验:访谈与问卷研究
本研究通过虚拟培训模块后的访谈和在线问卷,评估了试验利益冲突处理工具(TACIT)原型的用户体验。11名Cochrane综述者和14个系统综述团队提供反馈,总体印象积极,但建议提升易用性并增加对有限利益冲突信息判断的指导。反馈指导了后续工具调整,包括开发基于Excel的应用,并形成了一份规划工具试用的简短指南。
要点
- TACIT原型用于指导系统综述者收集、处理和解释纳入随机试验的利益冲突信息。
- 11名Cochrane综述者和14个系统综述团队反馈总体印象积极,但建议提升易用性并增加判断指导。
- 14个系统综述团队中,2个评价总体印象为优秀,11个为良好,1个为中性,无差或很差评价。
核心结论
- 试验利益冲突处理工具原型的用户总体体验积极,但建议增加易用性指导以及处理有限利益冲突信息的方法指导。
- 反馈指导了后续工具调整,包括开发基于Excel的应用,并提供了一份规划未来研究评估工具试用的简短指南。
研究设计与样本
- 在两种场景中试用原型工具:一是邀请22名有经验的Cochrane综述者参加虚拟培训模块并在预选试验集上应用工具,通过60分钟小组会议和25-55分钟个体半结构化访谈收集反馈;二是邀请115份2022年系统综述方案的通讯作者在其自身综述纳入的试验上应用工具,通过在线问卷收集反馈。
- 小组会议和访谈录音转录后导入Nvivo 12,反馈采用主题跨案例分析法分析,问卷数据采用定量分析。
主要发现
- 11名有经验的Cochrane综述者和14个系统综述团队提供了反馈。
- 反馈归纳为四个主题:总体印象、工具概念、内容与布局、实际使用。
- 用户总体印象良好,但建议提升用户友好性,并增加关于如何基于有限利益冲突信息做出判断以及何时合理停止搜索额外信息的指导。
- 14个系统综述团队中,2个评价总体印象为优秀,11个为良好,1个为中性,无差或很差评价。
- 指南包含规划研究评估工具试用时需考虑的九个关键问题。
临床怎么用
- 原文未据此给出临床推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To describe and analyze the user experience of a late-phase prototype of Tool for Addressing Conflicts of Interest in Trials (TACIT). The tool was developed primarily for guiding systematic reviewers in collecting, processing, and interpreting information on conflicts of interest in included randomized trials. STUDY DESIGN AND SETTING: A prototype tool was piloted in two settings: 1) We contacted potential participants through our network, social media, and snowball sampling. Twenty-two experienced Cochrane reviewers were invited to a virtual training module applying the tool on a preselected set of trials, and feedback was collected both during a 60-minute group session and in individual semi-structured interviews of 25-55 minutes; 2) We contacted corresponding authors of systematic review protocols from 2022. Authors of 115 protocols were invited to apply the tool on trials included in their own reviews, and feedback was collected using an online questionnaire. Recordings from the group session and interviews were transcribed and imported to Nvivo 12. Feedback was analyzed using thematic cross-case analysis. Questionnaire data were analyzed quantitatively. Based on our experience, we developed a short guide for planning of study appraisal tool piloting. RESULTS: Eleven experienced Cochrane reviewers and 14 systematic review teams provided feedback. Feedback was organized in four themes: general impressions, tool concepts, content and layout, and practical usage. Users generally had a favorable overall impression of the tool but suggested enhancing user friendliness and more guidance on how to make judgments based on limited conflicts of interest information and when it was reasonable to stop searching for additional information. Of 14 systematic review teams, two rated the overall impression as excellent, 11 as good, one as neutral, and no ratings of poor or very poor. The guide included nine key issues to consider when planning study appraisal tool piloting. CONCLUSION: Users of a prototype tool for addressing conflicts of interest in trials generally had a positive experience, but more guidance allowing ease of use and how to deal with limited information on conflicts of interest was suggested. The feedback guided a subsequent tool adjustment, including an Excel-based application, and we provide a short guide for planning piloting of future study appraisal tools. PLAIN LANGUAGE SUMMARY: This study describes user experience of a prototype of a tool for addressing conflicts of interest in randomized clinical trials included in systematic reviews. Eleven participants who had published multiple Cochrane Reviews gave feedback in interviews after using the tool in a virtual training module. Fourteen additional review teams gave feedback via a questionnaire after having used the tool in their own systematic reviews. Users generally had a positive experience, but adaptations to make the tool easier to use were suggested. The feedback guided a subsequent tool adjustment, including development of an Excel-based application. Based on our experience, we also provide a short guide for planning piloting of future study appraisal tools.
引用
- Faltinsen E, Østengaard L, Boutron I, et al. User experience of Tool for Addressing Conflicts of Interest in Trials (TACIT) prototype: interview and questionnaire study. J Clin Epidemiol. 2025. PMID: 41022259. doi:10.1016/j.jclinepi.2025.112003
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。