第一人称视频:捕捉脊髓损伤患者居家手部使用的新工具
本研究开发了一种基于计算机视觉的可穿戴第一人称摄像头系统,用于在居家和社区环境中监测颈段脊髓损伤(cSCI)患者的功能性手部使用。算法在9名cSCI参与者的居家模拟实验室视频中评估,左右手F1分数分别为0.74±0.15和0.73±0.15,提取的手部使用指标与人工标注呈中度显著相关。结果表明该系统有潜力在居家环境中定量捕捉手部使用。
要点
- 可穿戴第一人称摄像头能自动检测手与物体的功能性交互。
- 算法检测左右手F1分数分别为0.74±0.15和0.73±0.15。
- 提取的手部使用指标与人工标注呈中度显著相关(ρ=0.40、0.54、0.55)。
核心结论
- 可穿戴第一人称摄像头系统有潜力在居家环境中定量捕捉cSCI患者的手部使用。
研究设计与样本
- 基于计算机视觉算法的可穿戴第一人称摄像头系统,在居家模拟实验室中对9名cSCI参与者的视频记录进行评估。
主要发现
- 算法输出与人工标注比较,左手F1分数为0.74±0.15,右手为0.73±0.15。
- 提取的总交互时间百分比、平均交互时长和每小时交互次数与人工标注比较,相关系数分别为ρ=0.40、0.54和0.55,呈中度显著相关。
关键数值与推荐
- 系统对每帧视频产生二值的手-物体交互判断,基于反映手部运动线索、手形和场景颜色特征的特征。
- 功能性手部使用指标包括总交互时间占测试时间的百分比、平均交互时长(秒)和每小时交互次数。
临床怎么用
- 该技术有望用于临床环境外监测cSCI患者居家和社区环境中的功能性手部使用。
局限性
- 评估基于居家模拟实验室的视频记录,非真实居家环境;样本量为9名cSCI参与者。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Current upper extremity outcome measures for persons with cervical spinal cord injury (cSCI) lack the ability to directly collect quantitative information in home and community environments. A wearable first-person (egocentric) camera system is presented that aims to monitor functional hand use outside of clinical settings. METHODS: The system is based on computer vision algorithms that detect the hand, segment the hand outline, distinguish the user's left or right hand, and detect functional interactions of the hand with objects during activities of daily living. The algorithm was evaluated using egocentric video recordings from 9 participants with cSCI, obtained in a home simulation laboratory. The system produces a binary hand-object interaction decision for each video frame, based on features reflecting motion cues of the hand, hand shape and colour characteristics of the scene. RESULTS: The output from the algorithm was compared with a manual labelling of the video, yielding F1-scores of 0.74 ± 0.15 for the left hand and 0.73 ± 0.15 for the right hand. From the resulting frame-by-frame binary data, functional hand use measures were extracted: the amount of total interaction as a percentage of testing time, the average duration of interactions in seconds, and the number of interactions per hour. Moderate and significant correlations were found when comparing these output measures to the results of the manual labelling, with ρ = 0.40, 0.54 and 0.55 respectively. CONCLUSIONS: These results demonstrate the potential of a wearable egocentric camera for capturing quantitative measures of hand use at home.
引用
- Likitlersuang J, Sumitro ER, Cao T, et al. Egocentric video: a new tool for capturing hand use of individuals with spinal cord injury at home. J Neuroeng Rehabil. 2019. PMID: 31277682. doi:10.1186/s12984-019-0557-1
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。