妊娠结局算法适用性评估工具ACE-IT的开发与优化
研究基于真实世界数据算法验证研究可产生真实世界证据的背景,将原本以缺血性卒中为示例的Algorithm CErtaInty Tool(ACE-IT)优化并定制为妊娠结局版Pregnancy ACE-IT。研究组建药物流行病学与监管专家小组指导开发,并以神经管缺陷为选定妊娠结局制作案例;多数评估者认为该工具可接受且适用,但部分人认为不易使用。
要点
- Pregnancy ACE-IT用于判断妊娠/出生结局算法对特定决策情境是否适用
- 工具由药物流行病学与监管专家小组指导开发,以神经管缺陷为示例结局
核心结论
- Pregnancy ACE-IT是合适、灵活、可接受且内容相关的工具,可用于判断妊娠结局算法对特定决策情境是否适用。
- 未来需让使用者熟悉工具的操作特性,并在其他治疗领域的更多妊娠/出生结局中评估其适用性,以促进更广泛接受并改善易用性。
研究设计与样本
- 研究为工具开发与优化研究,组建药物流行病学与监管专家小组指导Pregnancy ACE-IT的开发,并以神经管缺陷为选定妊娠结局制作案例。
主要发现
- 多数评估者认为Pregnancy ACE-IT可接受且适用,但部分评估者认为其不易使用。
- 评估者使用该工具对选定的神经管缺陷识别算法进行了适用性评价,并判断其能否推广为目标数据源。
临床怎么用
- 临床药学场景中可借助Pregnancy ACE-IT评估基于真实世界数据的妊娠/出生结局算法是否适用于具体决策情境。
- 使用前宜让使用者熟悉工具的操作特性,以减少使用困难。
局限性
- 部分评估者反映工具不易使用,易用性有待改善。
- 工具目前以神经管缺陷为示例结局开发与测试,尚需在其他妊娠/出生结局及不同治疗领域中评估适用性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
Algorithm validation studies of health outcomes using real-world data are used to generate real-world evidence. We developed the Algorithm CErtaInty Tool (ACE-IT) to enable users to appraise whether a given real-world data-based algorithm is fit for purpose for a specific decision context, using the outcome of ischemic stroke as an exemplar. Our objective was to refine, develop, and tailor the ACE-IT to address whether validated algorithms for pregnancy and birth outcomes are fit for purpose for a specific decision context. We also tested the feasibility, acceptability, appropriateness, and content validity of the Pregnancy ACE-IT for the evaluation of an algorithm on pregnancy/birth outcomes. We engaged an expert panel of pharmacoepidemiologists and regulators to guide the development of the Pregnancy ACE-IT. The panel contributed to crafting a vignette on the selected pregnancy outcome of neural tube defects. Twenty-seven external raters used the Pregnancy ACE-IT to appraise whether a selected peer-reviewed algorithm to identify neural tube defects was fit for purpose and generalized as a target data source. Most raters found the Pregnancy ACE-IT acceptable and appropriate, although some did not find it easy to use. The Pregnancy ACE-IT represents a suitable, flexible, acceptable, and appropriate tool with relevant content for determining whether algorithms for pregnancy outcomes are fit for purpose for a specific decision context. Future studies to encourage broader acceptance and improve ease of use will require familiarizing users with the tool's operational characteristics and evaluating its suitability in the context of additional pregnancy/birth outcomes in different therapeutic areas.
引用
- Singh S, Huang HC, Andrade SE, et al. Developing and Refining the Pregnancy Algorithm CErtaInty Tool (ACE-IT) for Validating Pregnancy Outcomes. Clin Pharmacol Ther. 2025. PMID: 40820803. doi:10.1002/cpt.70036
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。