文献速递乳腺技术与安全CTMR

实体瘤疗效评价标准1.1版的观察者间差异

Interobserver Variation in Response Evaluation Criteria in Solid Tumors 1.1.
PubMed 文献 · Acad Radiol · 2018-06-20

本研究回顾性分析一项已结束的多中心乳腺癌试验的影像病例报告表,评估两名常规培训放射科医生应用RECIST 1.1的一致性。靶病灶反应、非靶病灶反应和总体反应评估的Kappa值分别为0.477、0.578和0.510,均为中等一致;总体反应百分比一致率为74.39%,差异率为25.6%。差异主要源于对RECIST 1.1解读和影像判读的不同。

要点

  • 两名放射科医生对靶病灶、非靶病灶和总体反应的Kappa值分别为0.477、0.578和0.510,均为中等一致。
  • 总体反应百分比一致率为74.39%,差异率为25.6%;最常见总体反应为部分缓解(医生A 45/82,医生B 63/82)。
  • 差异主要源于对RECIST 1.1的解读和影像判读不同;作者基于发现制定了标准检查表以减少判读误差。

核心结论

  • 尽管观察者间一致性为中等,但部分病例的定性判读差异增加了观察者间变异性。
  • 作者认为裁决等方案是或应成为影像机构标准操作流程的一部分,以减少可避免的不一致。
  • 作者基于发现制定了标准检查表,可能改善裁决前阶段的观察者间一致性,从而提高结果质量并降低每例裁决比率。

研究设计与样本

  • 回顾性审查一项已结束的多中心乳腺癌试验的影像病例报告表,研究获机构质量检查豁免知情同意。
  • 共评估61例、82对数据,其中第5次访视35对,第9次访视47对。
  • 由两名常规培训的放射科医生(A和B)应用RECIST 1.1进行反应评估,采用Cohen kappa评估观察者间一致性。
  • 由一名资深放射科医生重新评估显著差异以推断分歧原因,并确定改善一致性的方法。

诊断标准与关键数值

  • 靶病灶反应:n=82,Kappa=0.477(95%CI 0.314-0.640),中等一致。
  • 非靶病灶反应:n=82,Kappa=0.578(95%CI 0.213-0.944),中等一致。
  • 两次访视的总体反应评估:n=82,Kappa=0.510(95%CI 0.344-0.676),中等一致。
  • 总体反应百分比一致率为74.39%,差异率为25.6%。
  • 部分病例中观察到Kappa的「患病率效应」,导致一致性被低估。

临床应用与阅片要点

  • 作者认为裁决等方案是或应成为影像机构标准操作流程的一部分,以减少可避免的不一致。
  • 作者基于发现制定了标准检查表,可能有助于减少未来研究的判读误差边际。
  • 此类检查表可能改善裁决前阶段的观察者间一致性,从而提高结果质量并降低每例裁决比率。
  • 作者指出,提高使用RECIST 1.1时的数据可靠性将反映在更好的癌症临床试验结局中;检查表可用于影像中心评估和改善自身流程。

局限性

  • 部分病例中观察到Kappa的「患病率效应」,导致一致性被低估。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

PURPOSE: Response Evaluation Criteria in Solid Tumors (RECIST 1.1) is the gold standard for imaging response evaluation in cancer trials. We sought to evaluate consistency of applying RECIST 1.1 between 2 conventionally trained radiologists, designated as A and B; identify reasons for variation; and reconcile these differences for future studies.

METHODS: The study was approved as an institutional quality check exercise. Since no identifiable patient data was collected or used, a waiver of informed consent was granted. Imaging case report forms of a concluded multicentric breast cancer trial were retrospectively reviewed. Cohen's kappa was used to rate interobserver agreement in Response Evaluation Data (target response, nontarget response, new lesions, overall response). Significant variations were reassessed by a senior radiologist to extrapolate reasons for disagreement. Methods to improve agreement were similarly ascertained.

RESULTS: Sixty one cases with total of 82 data-pairs were evaluated (35 data-pairs in visit 5, 47 in visit 9). Both radiologists showed moderate agreement in target response (n = 82; ĸ = 0.477; 95% confidence interval [CI]: 0.314-0.640-), nontarget response (n = 82; ĸ = 0.578; 95% CI: 0.213-0.944) and overall response evaluation in both visits (n = 82; ĸ = 0.510; 95% CI: 0.344-0.676). Further assessment demonstrated "Prevalence effect" of Kappa in some cases which led to underestimation of agreement. Percent agreement of overall response was 74.39% while percent variation was 25.6%. Differences in interpreting RECIST 1.1 and in radiological image interpretation were the primary sources of variation. The commonest overall response was "Partial Response" (Rad A:45/82; Rad B:63/82).

CONCLUSION: Inspite of moderate interobserver agreement, qualitative interpretation differences in some cases increased interobserver variability. Protocols such as Adjudication, to reduce easily avoidable inconsistencies are or should be a part of the Standard Operating Procedure in imaging institutions. Based on our findings, a standard checklist has been developed to help reduce the interpretation error-margin for future studies. Such check-lists may improve interobserver agreement in the preadjudication phase thereby improving quality of results and reducing adjudication per case ratio.

CLINICAL RELEVANCE: Improving data reliability when using RECIST 1.1 will reflect in better cancer clinical trial outcomes. A checklist can be of use to imaging centers to assess and improve their own processes.

来源:Acad Radiol,查看原文。版权归原作者所有。

引用

  1. Karmakar A, Kumtakar A, Sehgal H, et al. Interobserver Variation in Response Evaluation Criteria in Solid Tumors 1.1. Acad Radiol. 2018. PMID: 29934024. doi:10.1016/j.acra.2018.05.017

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。