文献速递耳科与耳神经小儿耳鼻咽喉

看到说话者的嘴部可降低人工耳蜗使用者感知言语和修复知觉错误的聆听努力

Seeing a Talker's Mouth Reduces the Effort of Perceiving Speech and Repairing Perceptual Mistakes for Listeners With Cochlear Implants.
PubMed 文献 · Ear Hear · 2025-06-16

研究比较人工耳蜗(CI)使用者与年龄匹配的典型听力(TH)者各20例,用瞳孔测量法评估视听言语的聆听努力。CI组视觉线索带来的努力缓解更大更持久,且需修复缺失词时更明显;CI者更多注视嘴部,TH者仅在缺失词后增加注视。

要点

  • CI使用者从视觉线索中获得的聆听努力缓解大于且久于TH者。
  • CI组中视觉线索在需心理修复缺失词时比语音完整时更大程度降低努力。
  • CI者整体更多注视嘴部(即使模糊),TH者仅在缺失词后增加注视。

核心结论

  • 整合说话者嘴部的视觉线索不仅改善言语可懂度,也降低聆听努力,尤其对CI使用者;对CI者而言,当需心理纠正缺失词时这些视觉获益被放大。

研究设计与样本

  • 研究纳入CI使用者与年龄匹配的典型年龄校正听力组各20例,用瞳孔测量法评估聆听努力的大小与时间进程。
  • 半数区块中说话者嘴部被选择性模糊以严重降级语音视觉线索,同时保留刺激亮度以便瞳孔测量比较视觉条件。
  • 每个区块混合语音完整试次与目标词被噪声替代的试次,后者要求参与者在复述句子时心理重建目标词。
  • 瞳孔与注视数据用广义加性混合效应模型分析,识别努力或注视策略在条件间差异的时间段。

主要发现

  • CI使用者较TH者视觉释放努力更大且持续时间更长。
  • CI组内,需修复缺失词时视觉线索降低努力的程度大于语音完整时。
  • 看到说话者嘴部也改善CI使用者的言语可懂度,包括减少需修复时的不连贯言语反应数量。
  • 两个听力组在感知视听言语时采用不同注视策略:CI者整体更多注视嘴部(即使模糊),TH者倾向于在听觉刺激缺失词后时刻增加注视嘴部。

临床怎么用

  • 作者认为结果强调在聆听努力研究中纳入听力损失参与者的重要性,并提示谨慎假设TH听者的结果可推广至听力损失者。
  • 作者指出视觉言语信息具有潜在临床相关性,可用于咨询患者及家属,并可能用于开发降低聆听努力的视听策略。

局限性

  • 原文未报告局限性

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVES: Seeing a talker's mouth improves speech intelligibility, particularly for listeners who use cochlear implants (CIs). However, the impacts of visual cues on listening effort for listeners with CIs remain poorly understood, as previous studies have focused on listeners with typical hearing (TH) and featured stimuli that do not invoke effortful cognitive speech perception challenges. This study directly compared the effort of perceiving audiovisual speech between listeners who use CIs and those with TH. Visual cues were hypothesized to yield more relief from listening effort in a cognitively challenging speech perception condition that required listeners to mentally repair a missing word in the auditory stimulus. Eye gaze was simultaneously measured to examine whether the tendency to look toward a talker's mouth would increase during these moments of uncertainty about the speech stimulus. DESIGN: Participants included listeners with CIs and an age-matched group of participants with typical age-adjusted hearing (N = 20 in both groups). The magnitude and time course of listening effort were evaluated using pupillometry. In half of the blocks, phonetic visual cues were severely degraded by selectively blurring the talker's mouth, which preserved stimulus luminance so visual conditions could be compared using pupillometry. Each block included a mixture of trials in which the sentence audio was intact, and trials in which a target word in the auditory stimulus was replaced by noise; the latter required participants to mentally reconstruct the target word upon repeating the sentence. Pupil and gaze data were analyzed using generalized additive mixed-effects models to identify the stretches of time during which effort or gaze strategy differed between conditions. RESULTS: Visual release from effort was greater and lasted longer for listeners with CIs compared with those with TH. Within the CI group, visual cues reduced effort to a greater extent when a missing word needed to be repaired than when the speech was intact. Seeing the talker's mouth also improved speech intelligibility for listeners with CIs, including reducing the number of incoherent verbal responses when repair was required. The two hearing groups deployed different gaze strategies when perceiving audiovisual speech. CI listeners looked more at the mouth overall, even when it was blurred, while TH listeners tended to increase looks to the mouth in the moment following a missing word in the auditory stimulus. CONCLUSIONS: Integrating visual cues from a talker's mouth not only improves speech intelligibility but also reduces listening effort, particularly for listeners with CIs. For listeners with CIs (but not those with TH), these visual benefits are magnified when a missed word needs to be mentally corrected-a common occurrence during everyday speech perception for individuals with hearing loss. These results underscore the importance of including participants with hearing loss in listening effort studies and suggest caution in assuming results from TH listeners will generalize to those with hearing loss. They also highlight the potential clinical relevance of visual speech information, for counseling patients and families and potentially for the development of audiovisual strategies to reduce listening effort.

来源:Ear Hear,查看原文。版权归原作者所有。

引用

  1. Fleming JT, Winn MB. Seeing a Talker's Mouth Reduces the Effort of Perceiving Speech and Repairing Perceptual Mistakes for Listeners With Cochlear Implants. Ear Hear. 2025. PMID: 40518561. doi:10.1097/AUD.0000000000001683

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。