文献速递耳科与耳神经小儿耳鼻咽喉

视觉语音识别:人工智能改善噪声下言语感知

Visual Speech Recognition: Improving Speech Perception in Noise through Artificial Intelligence.
PubMed 文献 · Otolaryngol Head Neck Surg · 2020-05-26

使用基于红外摄像与神经网络的视觉语音识别程序后,高噪声条件下两组言语感知均显著提高,且差异消失。

要点

  • 高噪声下正常听力者言语感知优于听力损失者(38.7% vs 25.0%)。
  • 视觉语音识别程序使两组言语感知均显著提高。
  • 使用视觉语音识别后两组言语感知无显著差异。

核心结论

  • 视觉语音识别程序显著提高正常听力者和听力损失者在高噪声条件下的言语感知,并消除两组间的感知准确率差异。

主要发现

  • 无视觉语音识别时,70-75 dBA高噪声下正常听力者言语感知显著高于听力损失者(38.7% vs 25.0%,P = .02)。
  • 正常听力者使用视觉语音识别后言语感知显著提高(75.5% vs 38.7%,P < .0001)。
  • 听力损失者使用视觉语音识别后言语感知显著提高(70.4% vs 25.0%,P < .0001)。
  • 使用视觉语音识别后,正常听力者与听力损失者言语感知无显著差异(75.5% vs 70.4%,P = .15)。

关键数值与推荐

  • 非视觉语音识别条件下,扬声器以50 A计权分贝呈现40句BKB-SIN测试句,多人嘈杂噪声50至75 dBA。
  • 视觉语音识别条件下,红外相机实时追踪口唇周围35个点,神经网络将唇动数据转换为语音文本。
  • 视觉语音识别条件下,以42句BKB-SIN测试句评估言语感知,并将程序输出显示在屏幕上。
  • 言语感知定义为正确识别词语的百分比。

临床怎么用

  • 视觉语音识别程序可作为提高噪声下言语感知的辅助工具,尤其适用于听力损失者。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: To compare speech perception (SP) in noise for normal-hearing (NH) individuals and individuals with hearing loss (IWHL) and to demonstrate improvements in SP with use of a visual speech recognition program (VSRP). STUDY DESIGN: Single-institution prospective study. SETTING: Tertiary referral center. SUBJECTS AND METHODS: Eleven NH and 9 IWHL participants in a sound-isolated booth facing a speaker through a window. In non-VSRP conditions, SP was evaluated on 40 Bamford-Kowal-Bench speech-in-noise test (BKB-SIN) sentences presented by the speaker at 50 A-weighted decibels (dBA) with multiperson babble noise presented from 50 to 75 dBA. SP was defined as the percentage of words correctly identified. In VSRP conditions, an infrared camera was used to track 35 points around the speaker's lips during speech in real time. Lip movement data were translated into speech-text via an in-house developed neural network-based VSRP. SP was evaluated similarly in the non-VSRP condition on 42 BKB-SIN sentences, with the addition of the VSRP output presented on a screen to the listener. RESULTS: In high-noise conditions (70-75 dBA) without VSRP, NH listeners achieved significantly higher speech perception than IWHL listeners (38.7% vs 25.0%, P = .02). NH listeners were significantly more accurate with VSRP than without VSRP (75.5% vs 38.7%, P < .0001), as were IWHL listeners (70.4% vs 25.0% P < .0001). With VSRP, no significant difference in SP was observed between NH and IWHL listeners (75.5% vs 70.4%, P = .15). CONCLUSIONS: The VSRP significantly increased speech perception in high-noise conditions for NH and IWHL participants and eliminated the difference in SP accuracy between NH and IWHL listeners.

来源:Otolaryngol Head Neck Surg,查看原文。版权归原作者所有。

引用

  1. Raghavan AM, Lipschitz N, Breen JT, et al. Visual Speech Recognition: Improving Speech Perception in Noise through Artificial Intelligence. Otolaryngol Head Neck Surg. 2020. PMID: 32453650. doi:10.1177/0194599820924331

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。