文献速递头颈外科

使用人工智能提取口咽癌分期健康记录

Oropharyngeal Cancer Staging Health Record Extraction Using Artificial Intelligence.
PubMed 文献 · JAMA Otolaryngol Head Neck Surg · 2024-01-01

这项回顾性诊断研究纳入806例口咽鳞状细胞癌患者,评估人工智能引擎按AJCC第八版指南提取TNM分期和p16状态的准确性。结果显示T分期准确率55.9%,N分期56.0%,M分期87.6%,p16状态92.1%,局部与晚期区分准确率80.7%。作者认为T和N分期准确性尚可至良好,M分期和p16状态优秀,但需进一步模型优化和外部验证。

要点

  • AI引擎对M分期(87.6%)和p16状态(92.1%)的提取准确率最高。
  • T分期和N分期的准确率分别为55.9%和56.0%,为尚可至良好。
  • 局部(1-2期)与晚期(3-4期)区分准确率为80.7%。

核心结论

  • 本研究发现肿瘤和淋巴结分期准确性为尚可至良好,转移分期和p16状态准确性优秀,在分配最佳治疗和减少毒性暴露方面具有临床相关性。
  • 需要进一步模型优化和在不同机构电子健康记录中进行外部验证,以提高算法准确性和临床适用性。

研究设计与样本

  • 这项回顾性诊断研究在单中心三级医疗中心于2010年1月1日至2020年8月1日期间就诊的口咽鳞状细胞癌患者便利样本中进行,共806例。
  • 开发了包含135条规则(涵盖p16状态、肿瘤、淋巴结和转移分期)的真实癌症分期数据集和综合分期规则手册。
  • 训练了4个不同模型:模型T(实体关系提取)用于解剖位置和侵犯状态,模型S(数值提取)用于病灶大小,模型M(序贯分类)用于转移检测,以及p16模型用于p16状态。
  • 验证时将结果与专家评审建立的真实值比较,报告准确率;数据分析时间为2023年3月至11月。

主要发现

  • 806例口咽癌患者平均(SD)年龄63.6(10.6)岁,男性651例(80.8%),421例(52.2%)人乳头瘤病毒阳性。
  • 人工智能引擎对肿瘤分期的准确率为55.9%(95%CI,52.5%-59.3%),淋巴结分期为56.0%(95%CI,52.5%-59.4%),转移分期为87.6%(95%CI,85.1%-89.7%),p16状态为92.1%(95%CI,88.5%-94.6%)。
  • 区分局部(1-2期)与晚期(3-4期)癌症的准确率为80.7%(95%CI,77.8%-83.2%)。

局限性

  • 需要进一步模型优化和在不同机构电子健康记录中进行外部验证,以提高算法准确性和临床适用性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

IMPORTANCE: Accurate, timely, and cost-effective methods for staging oropharyngeal cancers are crucial for patient prognosis and treatment decisions, but staging documentation is often inaccurate or incomplete. With the emergence of artificial intelligence in medicine, data abstraction may be associated with reduced costs but increased efficiency and accuracy of cancer staging. OBJECTIVE: To evaluate an algorithm using an artificial intelligence engine capable of extracting essential information from medical records of patients with oropharyngeal cancer and assigning tumor, nodal, and metastatic stages according to American Joint Committee on Cancer eighth edition guidelines. DESIGN, SETTING, AND PARTICIPANTS: This retrospective diagnostic study was conducted among a convenience sample of 806 patients with oropharyngeal squamous cell carcinoma. Medical records of patients with oropharyngeal squamous cell carcinomas who presented to a single tertiary care center between January 1, 2010, and August 1, 2020, were reviewed. A ground truth cancer stage dataset and comprehensive staging rule book consisting of 135 rules encompassing p16 status, tumor, and nodal and metastatic stage were developed. Subsequently, 4 distinct models were trained: model T (entity relationship extraction) for anatomical location and invasion state, model S (numerical extraction) for lesion size, model M (sequential classification) for metastasis detection, and a p16 model for p16 status. For validation, results were compared against ground truth established by expert reviewers, and accuracy was reported. Data were analyzed from March to November 2023. MAIN OUTCOMES AND MEASURES: The accuracy of algorithm cancer stages was compared with ground truth. RESULTS: Among 806 patients with oropharyngeal cancer (mean [SD] age, 63.6 [10.6] years; 651 males [80.8%]), 421 patients (52.2%) were positive for human papillomavirus. The artificial intelligence engine achieved accuracies of 55.9% (95% CI, 52.5%-59.3%) for tumor, 56.0% (95% CI, 52.5%-59.4%) for nodal, and 87.6% (95% CI, 85.1%-89.7%) for metastatic stages and 92.1% (95% CI, 88.5%-94.6%) for p16 status. Differentiation between localized (stages 1-2) and advanced (stages 3-4) cancers achieved 80.7% (95% CI, 77.8%-83.2%) accuracy. CONCLUSION AND RELEVANCE: This study found that tumor and nodal staging accuracies were fair to good and excellent for metastatic stage and p16 status, with clinical relevance in assigning optimal treatment and reducing toxic effect exposures. Further model refinement and external validation with electronic health records at different institutions are necessary to improve algorithm accuracy and clinical applicability.

来源:JAMA Otolaryngol Head Neck Surg,查看原文。版权归原作者所有。

引用

  1. Baran E, Lee M, Aviv S, et al. Oropharyngeal Cancer Staging Health Record Extraction Using Artificial Intelligence. JAMA Otolaryngol Head Neck Surg. 2024. PMID: 38754135. doi:10.1001/jamaoto.2024.1201

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。