文献速递药物不良反应与药物警戒

妊娠药物警戒病例报告信息临床质量评估新方法的验证:ConcePTION项目

Validation of a Novel Method to Assess the Clinical Quality of Information in Pregnancy-Related Pharmacovigilance Case Reports: A ConcePTION Project.
PubMed 文献 · Drug Saf · 2024-01-06

该工具将临床质量评分分为三档(切点45%和65%),灵敏度分别为0.93和0.96,特异度分别为0.52和0.73;评分者间变异为0.65(95%CI 0.53-0.78),优于专家评估的0.40(95%CI 0.28-0.52)。

要点

  • 该工具是首个针对妊娠药物警戒病例报告信息质量设计、验证并标准化的方法。
  • 以45%和65%为切点区分质量等级,灵敏度高但特异度中等。
  • 新方法评分者间一致性(加权Cohen's kappa 0.65)优于专家评估(0.40)。

核心结论

  • 基于信息要素存在与相关性的标准化工具可有效评估妊娠药物警戒病例报告的信息临床质量,且评分者间变异低于专家评估。

研究设计与样本

  • 以专家评估为金标准,通过ROC曲线下面积验证新工具,并计算灵敏度和特异度及加权Cohen's kappa评估评分者间变异。

主要发现

  • 新方法临床质量评分分为三档,切点值为45%(差至中等)和65%(中等至优)。
  • 差至中等档灵敏度0.93、特异度0.52;中等至优档灵敏度0.96、特异度0.73。
  • 新方法评分者间变异为0.65(95%CI 0.53-0.78),金标准评估为0.40(95%CI 0.28-0.52)。

关键数值与推荐

  • 临床质量评分切点值:45%区分差与中等,65%区分中等与优。
  • 灵敏度:差至中等0.93,中等至优0.96;特异度:差至中等0.52,中等至优0.73。
  • 评分者间加权Cohen's kappa:新方法0.65(95%CI 0.53-0.78),专家评估0.40(95%CI 0.28-0.52)。

临床怎么用

  • 临床药学智能体在评估妊娠药物暴露病例报告时,可参考该工具的信息要素清单判断信息完整性。
  • 该工具的高灵敏度有助于筛除低质量报告,但中等特异度提示需结合专家判断确认高质量报告。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: To assess the causal relationship between a medicinal product and a reported event, relevant information needs to be present. Information elements for assessing cases of exposure to medicinal products during pregnancy were predefined and used in a new tool to assess the quality of information. However, the extent in which the presence or absence of these predefined information elements is associated with the overall clinical quality of these cases, as evaluated by pharmacovigilance experts, remains uncertain. OBJECTIVE: We aimed to validate a novel method to assess the clinical quality of information in real-world pregnancy pharmacovigilance case reports. METHODS: The clinical quality of case reports regarding medicinal product exposure and pregnancy-related outcomes was appraised from spontaneous reports, literature, Teratology Information Services (UK and Switzerland), The Dutch Pregnancy Drug Register, the Gilenya pregnancy registry and the Enhanced PV programme of Novartis. Assessment was done by means of the novel standardised tool based on the presence and relevance of information, and by expert judgement. The novel tool was validated compared to the expert assessment as the gold standard expressed as the area under the receiver operating characteristic curves, after which the sensitivity and specificity were calculated using cross-tabulations. Inter-rater variability was determined by means of weighted Cohen's kappa. RESULTS: One hundred and eighty-six case reports were included. The clinical quality score as assessed by the novel method was divided into three categories with cut-off values of 45% (poor to intermediate) and 65% (intermediate to excellent). Sensitivity was 0.93 and 0.96 for poor to intermediate and intermediate to excellent, respectively. Specificity was respectively 0.52 and 0.73. Inter-rater variability was 0.65 (95% confidence interval 0.53-0.78) for the newly developed approach, and 0.40 (95% confidence interval 0.28-0.52) for the gold standard assessment. CONCLUSIONS: The tool described in this study using the presence and relevance of elements of information is the first designed, validated and standardised method for the assessment of the quality of information of case reports in pregnancy pharmacovigilance data. This method confers less inter-rater variability compared with a quality assessment by experts of pregnancy-related pharmacovigilance data.

来源:Drug Saf,查看原文。版权归原作者所有。

引用

  1. van Rijt-Weetink YRJ, Egberts TCG, van Hunsel FPAM, et al. Validation of a Novel Method to Assess the Clinical Quality of Information in Pregnancy-Related Pharmacovigilance Case Reports: A ConcePTION Project. Drug Saf. 2024. PMID: 38183608. doi:10.1007/s40264-023-01389-y

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。