文献速递医学教育与科研方法流行病学与生物统计

随机试验比较传统与电子标注数据提取法在系统评价中的准确性与效率

A randomized trial provided new evidence on the accuracy and efficiency of traditional vs. electronically annotated abstraction approaches in systematic reviews.
PubMed 文献 · J Clin Epidemiol · 2019-07-11

该在线随机交叉试验纳入26对数据提取者,每对用三种方法各提取2篇文章数据。结果显示DAA验证法错误率17%,常规验证法16%,独立双提取法15%;DAA验证法耗时比常规验证法多20分钟,但比独立双提取法少46分钟。结论提示独立双提取可能仅对复杂数据条目必要,DAA可提供审计轨迹。

要点

  • DAA验证法错误率与常规验证法相近,但耗时更长。
  • 独立双提取法错误率最低,但耗时显著长于DAA验证法。
  • DAA可提供审计轨迹,有利于研究可重复性。

核心结论

  • 独立双提取可能仅对复杂数据条目必要。
  • DAA提供的审计轨迹对可重复研究至关重要。

研究设计与样本

  • 在线随机交叉试验,纳入26对数据提取者,每对提取6篇文章,每种方法2篇。

主要发现

  • 总体错误率:DAA验证法17%,常规验证法16%,独立双提取法15%。
  • 与常规验证法相比,DAA验证法的错误比值比(OR)为1.08(95%CI 0.99-1.17)。
  • 与独立双提取法相比,DAA验证法的错误OR为1.12(95%CI 1.03-1.22)。
  • 每篇文章DAA验证法比常规验证法多耗时20分钟(95%CI 1-40)。
  • 每篇文章DAA验证法比独立双提取法少耗时46分钟(95%CI 26-66)。

临床怎么用

  • 在系统评价数据提取中,可考虑对复杂数据条目采用独立双提取,其余条目使用DAA验证法以平衡效率与准确性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: Data Abstraction Assistant (DAA) is a software for linking items abstracted into a data collection form for a systematic review to their locations in a study report. We conducted a randomized cross-over trial that compared DAA-facilitated single-data abstraction plus verification ("DAA verification"), single data abstraction plus verification ("regular verification"), and independent dual data abstraction plus adjudication ("independent abstraction"). STUDY DESIGN AND SETTING: This study is an online randomized cross-over trial with 26 pairs of data abstractors. Each pair abstracted data from six articles, two per approach. Outcomes were the proportion of errors and time taken. RESULTS: Overall proportion of errors was 17% for DAA verification, 16% for regular verification, and 15% for independent abstraction. DAA verification was associated with higher odds of errors when compared with regular verification (adjusted odds ratio [OR] = 1.08; 95% confidence interval [CI]: 0.99-1.17) or independent abstraction (adjusted OR = 1.12; 95% CI: 1.03-1.22). For each article, DAA verification took 20 minutes (95% CI: 1-40) longer than regular verification, but 46 minutes (95% CI: 26 to 66) shorter than independent abstraction. CONCLUSION: Independent abstraction may only be necessary for complex data items. DAA provides an audit trail that is crucial for reproducible research.

来源:J Clin Epidemiol,查看原文。版权归原作者所有。

引用

  1. Li T, Saldanha IJ, Jap J, et al. A randomized trial provided new evidence on the accuracy and efficiency of traditional vs. electronically annotated abstraction approaches in systematic reviews. J Clin Epidemiol. 2019. PMID: 31302205. doi:10.1016/j.jclinepi.2019.07.005

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。