深度学习用于预测分析小儿耳鼻咽喉科个人陈述:一项初步研究
本研究为回顾性队列研究,使用BERT对115名小儿耳鼻咽喉科专科培训申请者的个人陈述进行聚类分析。个人陈述嵌入可聚为4类,其中2类聚焦培训/研究,2类聚焦个人/患者故事;仅用文档嵌入的模型预测申请者与机构匹配度与使用申请者特征和陈述聚类模型相当;所有预测模型对培训后每年发表论文数预测均较差。
要点
- 个人陈述文档嵌入可聚为4类,2类聚焦培训/研究,2类聚焦个人/患者故事。
- 仅用文档嵌入的模型预测申请者-机构匹配度与使用申请者特征和陈述聚类模型相当。
- 所有预测模型对培训后每年发表论文数预测均较差。
核心结论
- 文档嵌入能够捕获小儿耳鼻咽喉科专科培训申请者个人陈述中的有意义信息。
- 更大规模的研究可进一步区分个人陈述聚类并评估文档嵌入的预测潜力。
研究设计与样本
- 回顾性队列研究,单中心小儿三级保健中心,数据来自115名申请本专科培训项目者的个人陈述,取自San Francisco Match。
- 使用BERT生成文档嵌入进行聚类,采用回归和机器学习模型评估个人陈述与培训后每年发表论文数的关系,并控制发表论文数、 board scores、Alpha Omega Alpha状态、性别和住院医师培训。
主要发现
- 个人陈述文档嵌入经K-means聚类分为4个不同组:2个聚焦「培训/研究」,2个聚焦「个人/患者故事」。
- 培训聚类1和2在单变量分析中与申请者-机构匹配度相关,但在多变量分析中不相关。
- 仅用文档嵌入的模型预测申请者-机构匹配度的受试者工作特征曲线下面积分别为0.763和0.750 vs 0.419;P值>.05,与使用申请者特征和仅用个人陈述聚类的模型相比无显著差异。
- 所有预测模型对培训后每年发表论文数预测均较差。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVE: The personal statement is often an underutilized aspect of pediatric otolaryngology fellowship applications. In this pilot study, we use deep learning language models to cluster personal statements and elucidate their relationship to applicant rank position and postfellowship research output. STUDY DESIGN: Retrospective cohort. SETTING: Single pediatric tertiary care center. METHODS: Data and personal statements from 115 applicants to our fellowship program were retrieved from San Francisco Match. BERT (Bidirectional Encoder Representations From Transformers) was used to generate document embeddings for clustering. Regression and machine learning models were used to assess the relationship of personal statements to number of postfellowship publications per year when controlling for publications, board scores, Alpha Omega Alpha status, gender, and residency. RESULTS: Document embeddings of personal statements were found to cluster into 4 distinct groups by K-means clustering: 2 focused on "training/research" and 2 on "personal/patient anecdotes." Training clusters 1 and 2 were associated with an applicant-organization fit by a single pediatric otolaryngology fellowship program on univariate but not multivariate analysis. Models utilizing document embeddings alone were able to equally predict applicant-organization fit (receiver operating characteristic areas under the curve, 0.763 and 0.750 vs 0.419; P values >.05) as compared with models utilizing applicant characteristics and personal statement clusters alone. All predictive models were poor predictors of postfellowship publications per year. CONCLUSION: We demonstrate ability for document embeddings to capture meaningful information in personal statements from pediatric otolaryngology fellowship applicants. A larger study can further differentiate personal statement clusters and assess the predictive potential of document embeddings.
引用
- Chillakuru YR, Preciado DA, Cha J, et al. Deep Learning for Predictive Analysis of Pediatric Otolaryngology Personal Statements: A Pilot Study. Otolaryngol Head Neck Surg. 2022. PMID: 35259040. doi:10.1177/01945998221082535
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。