文献速递技术与安全

影像组学中的自报告检查表和质量评分工具:一项元研究

Self-reported checklists and quality scoring tools in radiomics: a meta-research.
PubMed 文献 · Eur Radiol · 2024-01-05

该元研究随机抽样117篇影像组学原始论文,评估自报告检查表或质量评分工具的使用情况。仅7篇(6%)至少提供一种自报告文档(RQS、TRIPOD或CLAIM),二项检验p<0.001。即使提供文档,条目确认率中位数为81%(IQR 6),质量评分工具记录分高于建议分,平均差-7.2(SD 6.8),提示报告准确性存疑。

要点

  • 影像组学文献中仅6%(7/117)提供至少一种自报告文档,自报告文档严重缺乏。
  • 即使提供文档,条目确认率中位数仅81%,报告准确性可能存疑。
  • 质量评分工具记录分高于建议分,平均差-7.2(SD 6.8),提示评分可能被高估。

核心结论

  • 影像组学发表物常缺乏自报告检查表或质量评分工具;即使提供文档,报告条目或评分的准确性也可能存疑。

研究设计与样本

  • 元研究:在PubMed检索(2023年4月23日),经样本量计算和先验功效分析后随机抽样117篇影像组学原始研究论文;由9名读者组成小组独立评估,每篇论文分配3名读者,辅以自动注释;对提供检查表文档的论文由2名读者独立进行逐条目确认分析。

诊断标准与关键数值

  • 仅7篇(6%)至少有一种自报告文档(RQS、TRIPOD或CLAIM),二项检验p<0.001;三种文档的确认条目率中位数为81%(四分位距6);质量评分工具记录分高于建议分,平均差-7.2(标准差6.8)。

局限性

  • 纳入论文多为回顾性(94%;110/117)。
  • 纳入论文多为单中心(68%;80/117)。
  • 纳入论文多基于私有数据(89%;104/117)。
  • 纳入论文多缺乏外部验证(79%;93/117)。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVE: To evaluate the use of reporting checklists and quality scoring tools for self-reporting purposes in radiomics literature.

METHODS: Literature search was conducted in PubMed (date, April 23, 2023). The radiomics literature was sampled at random after a sample size calculation with a priori power analysis. A systematic assessment for self-reporting, including the use of documentation such as completed checklists or quality scoring tools, was conducted in original research papers. These eligible papers underwent independent evaluation by a panel of nine readers, with three readers assigned to each paper. Automatic annotation was used to assist in this process. Then, a detailed item-by-item confirmation analysis was carried out on papers with checklist documentation, with independent evaluation of two readers.

RESULTS: The sample size calculation yielded 117 papers. Most of the included papers were retrospective (94%; 110/117), single-center (68%; 80/117), based on their private data (89%; 104/117), and lacked external validation (79%; 93/117). Only seven papers (6%) had at least one self-reported document (Radiomics Quality Score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD), or Checklist for Artificial Intelligence in Medical Imaging (CLAIM)), with a statistically significant binomial test (p < 0.001). Median rate of confirmed items for all three documents was 81% (interquartile range, 6). For quality scoring tools, documented scores were higher than suggested scores, with a mean difference of - 7.2 (standard deviation, 6.8).

CONCLUSION: Radiomic publications often lack self-reported checklists or quality scoring tools. Even when such documents are provided, it is essential to be cautious, as the accuracy of the reported items or scores may be questionable.

CLINICAL RELEVANCE STATEMENT: Current state of radiomic literature reveals a notable absence of self-reporting with documentation and inaccurate reporting practices. This critical observation may serve as a catalyst for motivating the radiomics community to adopt and utilize such tools appropriately, thereby fostering rigor, transparency, and reproducibility of their research, moving the field forward.

KEY POINTS: • In radiomics literature, there has been a notable absence of self-reporting with documentation. • Even if such documents are provided, it is critical to exercise caution because the accuracy of the reported items or scores may be questionable. • Radiomics community needs to be motivated to adopt and appropriately utilize the reporting checklists and quality scoring tools.

来源:Eur Radiol,查看原文。版权归原作者所有。

引用

  1. Kocak B, Akinci D'Antonoli T, Ates Kus E, et al. Self-reported checklists and quality scoring tools in radiomics: a meta-research. Eur Radiol. 2024. PMID: 38180530. doi:10.1007/s00330-023-10487-5

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。