基于共识的分割在影像组学特征可重复性中的可靠性(REMIND):一个警示
该回顾性研究纳入乳腺癌、肾细胞癌和垂体大腺瘤各30例,由12名阅片者进行分割,评估基于共识的分割对影像组学特征可重复性的影响。在ICC阈值0.90且考虑95%置信区间下限时,共识间分析中至少61%的特征不可重复,且与独立单阅片者分析相比,共识分析未显著提高可重复特征率。作者提醒共识分割本身存在显著可重复性问题,应避免单独使用,除非进行可靠性分析。
要点
- 共识分割并非万能,ICC阈值0.90时至少61%的影像组学特征在共识间分析中不可重复。
- 更换一名阅片者后,至少54%的特征变为不可重复。
- 与独立单阅片者分析相比,共识分析未显著提高可重复特征率。
核心结论
- 尽管「共识」一词有正面含义,但必须提醒:基于共识的分割存在显著的可重复性问题,应避免单独使用,除非进行可靠性分析,即使在临床环境中不实用。
研究设计与样本
- 回顾性研究,纳入乳腺癌(n=30)、肾细胞癌(n=30)和垂体大腺瘤(n=30)三个肿瘤数据集,乳腺和垂体数据集使用MRI,肾脏数据集使用CT,12名阅片者参与分割,通过在前一个感兴趣区或感兴趣体积上进行修正来创建共识分割,设计四个实验评估影像组学特征的可重复性,采用组内相关系数(ICC)评估可靠性,截断值为0.75和0.9。
诊断标准与关键数值
- 采用ICC评估可靠性,截断值为0.75和0.9;考虑95%置信区间下限和ICC阈值0.90时,共识间分析中至少61%的影像组学特征不可重复;易感性实验中,当第一位阅片者被不同阅片者替换时,至少一半(54%)变为不可重复;共识内分析中,同一第二阅片者在两周后对同一第一阅片者的分割图像进行分割时,至少约三分之一(32%)不可重复。
临床应用与阅片要点
- 作者认为,应避免单独使用基于共识的分割,除非进行可靠性分析,即使在临床环境中不实用。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVE: To evaluate the reliability of consensus-based segmentation in terms of reproducibility of radiomic features.
METHODS: In this retrospective study, three tumor data sets were investigated: breast cancer (n = 30), renal cell carcinoma (n = 30), and pituitary macroadenoma (n = 30). MRI was utilized for breast and pituitary data sets, while CT was used for renal data set. 12 readers participated in the segmentation process. Consensus segmentation was created by making corrections on a previous region or volume of interest. Four experiments were designed to evaluate the reproducibility of radiomic features. Reliability was assessed with intraclass correlation coefficient (ICC) with two cut-off values: 0.75 and 0.9.
RESULTS: Considering the lower bound of the 95% confidence interval and the ICC threshold of 0.90, at least 61% of the radiomic features were not reproducible in the inter-consensus analysis. In the susceptibility experiment, at least half (54%) became non-reproducible when the first reader is replaced with a different reader. In the intra-consensus analysis, at least about one-third (32%) were non-reproducible when the same second reader segmented the image over the same first reader two weeks later. Compared to inter-reader analysis based on independent single readers, the inter-consensus analysis did not statistically significantly improve the rates of reproducible features in all data sets and analyses.
CONCLUSIONS: Despite the positive connotation of the word "consensus", it is essential to REMIND that consensus-based segmentation has significant reproducibility issues. Therefore, the usage of consensus-based segmentation alone should be avoided unless a reliability analysis is performed, even if it is not practical in clinical settings.
引用
- Kocak, Yardimci, Nazli, et al. REliability of consensus-based segMentatIoN in raDiomic feature reproducibility (REMIND): A word of caution. Eur J Radiol. 2023. PMID: 37285646. doi:10.1016/j.ejrad.2023.110893
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。