文献速递神经康复

机器学习自动评估获得性脑损伤步态障碍的主观临床评分:图像提取与分类系统同专家评分的比较

Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury - a comparison of an image extraction and classification system to expert scoring.
PubMed 文献 · J Neuroeng Rehabil · 2024-07-23

本研究利用获得性脑损伤患者(n=42)和健康对照(n=34)的额面步态视频,训练两级机器学习模型自动识别解剖标志并计算二维关节角度,以预测三位神经康复临床医生对步行中手臂运动异常的ICF量表评分。结果显示机器学习预测与人类评估者的一致性相似,四种训练比例网络间无显著差异,但存在小效应量的低估。

要点

  • 机器学习模型评估手臂运动异常与经验丰富的临床医生评分一致性相似,无统计学显著差异。
  • 使用50%、75%、90%、100%参与者训练的四网络预测无显著差异(F=0.119;p=0.949)。
  • 四网络均存在小效应量低估评分(p范围0.007–0.040;Cohen's d范围0.156–0.217)。

核心结论

  • 机器学习在主观评估获得性脑损伤患者步行中手臂运动异常方面,表现与经验丰富的临床医生相似。
  • 样本量相对较小可能导致部分评分被低估,但效应量小。

研究设计与样本

  • 研究使用额面步态视频训练机器学习模型,纳入获得性脑损伤患者42例和健康对照34例。
  • 训练四种网络,分别使用50%、75%、90%、100%的参与者数据。
  • 使用DeepLabCut™自动识别解剖标志并计算二维运动学关节角度。
  • 以三位经验丰富的神经康复临床医生的评估分数为参考,训练随机森林网络并进行嵌套交叉验证。
  • 采用二次加权kappa比较未参与训练的测试组预测与每位评估者评分的一致性。

主要发现

  • 机器学习预测与经验丰富的人类评估者的一致性相似,任何匹配列联均无统计学显著差异(p<0.05)。
  • 四种网络之间的预测无统计学显著差异(F=0.119;p=0.949)。
  • 四种网络均低估评分,效应量小(p范围=0.007至0.040;Cohen's d范围=0.156至0.217)。

临床怎么用

  • 该技术有望自动化ICF量表对步行中手臂运动异常的评估,减少主观评分者间信度仅中等的问题。
  • 未来可探索智能手机和边缘机器学习在本地及远程康复评估中的客观自动动态运动评估应用。

局限性

  • 样本量相对较小,可能导致部分评分被低估。
  • 需要更大样本研究以客观自动评估动态运动,减少测量误差和医疗可及性不平等。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Walking impairment is a common disability post acquired brain injury (ABI), with visually evident arm movement abnormality identified as negatively impacting a multitude of psychological factors. The International Classification of Functioning, Disability and Health (ICF) qualifiers scale has been used to subjectively assess arm movement abnormality, showing strong intra-rater and test-retest reliability, however, only moderate inter-rater reliability. This impacts clinical utility, limiting its use as a measurement tool. To both automate the analysis and overcome these errors, the primary aim of this study was to evaluate the ability of a novel two-level machine learning model to assess arm movement abnormality during walking in people with ABI. METHODS: Frontal plane gait videos were used to train four networks with 50%, 75%, 90%, and 100% of participants (ABI: n = 42, healthy controls: n = 34) to automatically identify anatomical landmarks using DeepLabCut™ and calculate two-dimensional kinematic joint angles. Assessment scores from three experienced neurorehabilitation clinicians were used with these joint angles to train random forest networks with nested cross-validation to predict assessor scores for all videos. Agreement between unseen participant (i.e. test group participants that were not used to train the model) predictions and each individual assessor's scores were compared using quadratic weighted kappa. One sample t-tests (to determine over/underprediction against clinician ratings) and one-way ANOVA (to determine differences between networks) were applied to the four networks. RESULTS: The machine learning predictions have similar agreement to experienced human assessors, with no statistically significant (p < 0.05) difference for any match contingency. There was no statistically significant difference between the predictions from the four networks (F = 0.119; p = 0.949). The four networks did however under-predict scores with small effect sizes (p range = 0.007 to 0.040; Cohen's d range = 0.156 to 0.217). CONCLUSIONS: This study demonstrated that machine learning can perform similarly to experienced clinicians when subjectively assessing arm movement abnormality in people with ABI. The relatively small sample size may have resulted in under-prediction of some scores, albeit with small effect sizes. Studies with larger sample sizes that objectively and automatically assess dynamic movement in both local and telerehabilitation assessments, for example using smartphones and edge-based machine learning, to reduce measurement error and healthcare access inequality are needed.

来源:J Neuroeng Rehabil,查看原文。版权归原作者所有。

引用

  1. Mobbs A, Kahn M, Williams G, et al. Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury - a comparison of an image extraction and classification system to expert scoring. J Neuroeng Rehabil. 2024. PMID: 39039594. doi:10.1186/s12984-024-01406-w

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。