文献速递甲状腺疾病

基于人工智能的决策支持系统对甲状腺结节诊断及ACR TI-RADS分类的临床评估

Clinical Evaluation of an Artificial Intelligence-Based Decision Support System for the Diagnosis and American College of Radiology Thyroid Imaging Reporting and Data System Classification of Thyroid Nodules.
PubMed 文献 · Thyroid · 2024-03-19

本研究回顾性分析2021年6月至2022年12月甲状腺结节门诊172例有组织学结果的甲状腺结节患者,评估AI决策支持系统Koios DS对6名阅片者ACR TI-RADS分类诊断效能的影响。结果显示使用AI后AUROC从0.776升至0.817,敏感度、特异度、阴性预测值、阳性预测值和诊断准确率均提高,观察者间一致性改善,AI将81.4%的TI-RADS 3类和24.5%的TI-RADS 4类结节重新分类为更低风险类别。

要点

  • 使用AI决策支持系统后AUROC从0.776升至0.817(p < 0.001)。
  • AI将81.4%的ACR TI-RADS 3类和24.5%的4类结节重分类为更低风险类别。
  • 使用AI后观察者间一致性r从0.741升至0.981(p < 0.001)。

核心结论

  • 使用基于人工智能的决策支持系统与超声诊断效能整体改善相关,包括AUROC、敏感度、特异度、阴性预测值、阳性预测值和诊断准确率提高,观察者间变异性降低且与AI的一致性程度增加。
  • AI将超过一半的中等ACR TI-RADS评分结节重新分类为更低风险类别。

研究设计与样本

  • 回顾性超声研究,纳入2021年6月至2022年12月甲状腺结节门诊所有有组织学结果的甲状腺结节。
  • 共评估172例患者(83.1%为女性),平均年龄52.3 ± 15.3岁,结节平均最大直径2.9 ± 1.2 cm,其中11.0%为分化型甲状腺癌。
  • 由6名阅片者在使用AI决策支持系统前后分别进行ACR TI-RADS分类,并与AI本身及组织学诊断比较诊断效能。

主要发现

  • 使用AI后AUROC从0.776升至0.817(p < 0.001)。
  • 使用AI后平均敏感度从82.3%升至86.5%,特异度从38.3%升至54.8%。
  • 使用AI后阴性预测值从94.5%升至96.4%,阳性预测值从14.0%升至16.1%,诊断准确率从43.0%升至49.3%。
  • 基于ACR TI-RADS评分,使用AI后观察者间一致性显著改善(单纯超声r = 0.741 vs 超声联合AI决策支持系统r = 0.981,p < 0.001)。
  • 初始分类为ACR TI-RADS 3和4的结节中,AI分别将81.4%和24.5%重新分类为更低风险类别。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

Background: This study aimed to evaluate the clinical impact of an artificial intelligence (AI)-based decision support system (DSS), Koios DS, on the analysis of ultrasound imaging and suspicious characteristics for thyroid nodule risk stratification. Methods: A retrospective ultrasound study was conducted on all thyroid nodules with histological findings from June 2021 to December 2022 in a thyroid nodule clinic. The diagnostic performance of ultrasound imaging was evaluated by six readers on the American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) before and after the use of the AI-based DSS and by AI itself. Results: A total of 172 patients (83.1% women) with a mean age of 52.3 ± 15.3 years were evaluated. The mean maximum nodular diameter was 2.9 ± 1.2 cm, with 11.0% being differentiated thyroid carcinomas. Among the nodules initially classified as ACR TI-RADS 3 and 4, AI reclassified 81.4% and 24.5% into lower risk categories, respectively. Receiver operating characteristic (ROC) curve analysis was performed to evaluate the diagnostic performance of the readers and the AI-based DSS versus histological diagnosis. There was an increase in the area under the ROC curve (AUROC) after the use of AI (0.776 vs. 0.817, p < 0.001). The AI-based DSS improved the mean sensitivity (Sens) (82.3% vs. 86.5%) and specificity (Spe) (38.3% vs. 54.8%), produced a high negative predictive value (94.5% vs. 96.4%), and increased the positive predictive value (PPV) (14.0% vs. 16.1%) and diagnostic precision (43.0% vs. 49.3%). Based on the ACR TI-RADS score, there was significant improvement in interobserver agreement after the use of AI (r = 0.741 for ultrasound imaging alone vs. 0.981 for ultrasound imaging and the AI-based DSS, p < 0.001). Conclusions: The use of an AI-based DSS was associated with overall improvement in the diagnostic efficacy of ultrasound imaging, based on the AUROC, as well as an increase in Sens, Spe, negative and PPVs, and diagnostic accuracy. There was also a reduction in interobserver variability and an increase in the degree of concordance with the use of AI. AI reclassified more than half of the nodules with intermediate ACR TI-RADS scores into lower risk categories.

来源:Thyroid,查看原文。版权归原作者所有。

引用

  1. Fernández Velasco P, Pérez López P, Torres Torres B, et al. Clinical Evaluation of an Artificial Intelligence-Based Decision Support System for the Diagnosis and American College of Radiology Thyroid Imaging Reporting and Data System Classification of Thyroid Nodules. Thyroid. 2024. PMID: 38368560. doi:10.1089/thy.2023.0603

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。