开放架构AI模型用于乳腺手术CPT编码:开发、验证与前瞻性测试
该研究开发并验证了一种基于Transformer的开放架构AI模型,用于从乳腺手术记录自由文本中提取CPT代码。模型在3259份手术记录上训练验证,紧凑版AUPRC为0.976(0.970, 0.983),大版为0.981(0.977, 0.986),均优于外科医生(0.937),并在268份前瞻性记录中证实了实际性能。
要点
- 开放架构AI模型可高精度从乳腺手术记录中提取CPT代码。
- 模型交叉验证AUPRC优于外科医生手工编码。
- 前瞻性测试证实模型在真实世界中的性能。
核心结论
- 开放架构AI模型在自动化CPT代码提取方面表现出高性能,提供了可扩展且透明的解决方案以提高手术编码效率。
研究设计与样本
- 纳入2017年7月至2023年12月所有机构乳腺手术记录,由专家编码员手动审核并验证外科医生分配的CPT代码作为参考标准。
- 性能评估采用精确率-召回率曲线下面积(AUPRC),并在2024年5月至10月的手术记录上进行前瞻性测试。
主要发现
- 数据集包含3259份手术记录和8036个CPT代码。
- 外科医生编码差异存在于12%的病例中(过度编码8%,编码不足10%)。
- 交叉验证中,紧凑版AUPRC为0.976(0.970, 0.983),大版为0.981(0.977, 0.986),均优于外科医生(AUPRC 0.937)。
- 前瞻性测试在268份记录上证实了强大的实际性能。
临床怎么用
- 该AI模型可辅助乳腺手术编码,提高效率和准确性,减少编码差异和合规风险。
局限性
- 未来工作需要评估AI在准确性和可靠性上能否超越人类编码员。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: To develop, validate, and prospectively test an open-architecture, transformer-based artificial Intelligence (AI) model to extract procedure codes from free-text breast surgery operative notes. BACKGROUND: Operative note coding is time-intensive and error-prone, leading to lost revenue and compliance risks. Although AI offers potential solutions, adoption has been limited due to proprietary, closed-source systems lacking transparency and standardized validation. METHODS: We included all institutional breast surgery operative notes from July 2017 to December 2023. Expert medical coders manually reviewed and validated surgeon-assigned Current Procedural Terminology (CPT) codes, establishing a reference standard. We developed and validated an AI model to predict CPT codes from operative notes using 2 versions of the pretrained GatorTron clinical language model: a compact 345 million-parameter model and a larger 3.9 billion-parameter model, each fine-tuned on our labeled data-set. Performance was evaluated using the area under the precision-recall curve (AUPRC). Prospective testing was conducted on operative notes from May to October 2024. RESULTS: Our data set included 3259 operative notes with 8036 CPT codes. Surgeon coding discrepancies were present in 12% of cases (overcoding: 8%, undercoding: 10%). The AI model showed strong alignment with the reference standard [compact version AUPRC: 0.976 (0.970, 0.983), large version AUPRC: 0.981 (0.977, 0.986)] on cross-validation, outperforming surgeons (AUPRC: 0.937). Prospective testing on 268 notes confirmed strong real-world performance. CONCLUSIONS: Our open-architecture AI model demonstrated high performance in automating CPT code extraction, offering a scalable and transparent solution to improve surgical coding efficiency. Future work will assess whether AI can surpass human coders in accuracy and reliability.
引用
- El Moheb M, Putman K, Sears O, et al. An Open-architecture AI Model for CPT Coding in Breast Surgery: Development, Validation, and Prospective Testing. Ann Surg. 2025. PMID: 40518998. doi:10.1097/SLA.0000000000006793
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。