文献速递耳科与耳神经

基于深度学习的降噪方法提高人工耳蜗植入者语音可懂度

Deep Learning-Based Noise Reduction Approach to Improve Speech Intelligibility for Cochlear Implant Recipients.
PubMed 文献 · Ear Hear · 2018-01-01

本研究探讨了基于深度学习的降噪方法在低信噪比和挑战性噪声类型下对普通话人工耳蜗植入者的临床有效性。该方法由噪声分类器和深度降噪自编码器组成,在客观评估和9名植入者的听力学测试中,其可懂度得分均高于两种传统降噪技术。结果表明该方法可潜在地集成到现有人工耳蜗信号处理器中。

要点

  • 深度学习降噪方法在匹配和不匹配训练-测试条件下均优于传统降噪技术。
  • 该方法对关键语音包络信息失真更小,噪声抑制能力更强。
  • 结果提示可集成到人工耳蜗信号处理器中以克服噪声导致的言语感知下降。

核心结论

  • 在挑战性聆听条件下,所提出的噪声分类器+深度降噪自编码器降噪方法比两种传统降噪技术具有更优的噪声抑制能力和更小的关键语音包络失真,从而更有效地提高普通话人工耳蜗植入者的言语识别能力。

研究设计与样本

  • 研究采用噪声分类器与深度降噪自编码器两模块组成的深度学习降噪方法,在0和5 dB信噪比下,用双人语噪和施工凿岩机噪声处理普通话句子,并进行客观评估和9名普通话人工耳蜗植入者的言语识别测试。

主要发现

  • 客观评估和听力学测试结果表明,在挑战性聆听条件下,所提出的噪声分类器+深度降噪自编码器方法在匹配和不匹配训练-测试条件下均比两种传统降噪技术获得更高的可懂度得分。

关键数值与推荐

  • 测试集包含0和5 dB信噪比下的普通话句子,受双人语噪和施工凿岩机噪声污染。
  • 客观评估采用归一化协方差度量测试各降噪方法处理后的语句可懂度。
  • 言语识别测试由9名普通话人工耳蜗植入者使用其临床言语处理器完成。

临床怎么用

  • 所提出的基于深度学习的降噪方法可潜在地集成到现有人工耳蜗信号处理器中,以克服噪声引起的言语感知下降。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: We investigate the clinical effectiveness of a novel deep learning-based noise reduction (NR) approach under noisy conditions with challenging noise types at low signal to noise ratio (SNR) levels for Mandarin-speaking cochlear implant (CI) recipients. DESIGN: The deep learning-based NR approach used in this study consists of two modules: noise classifier (NC) and deep denoising autoencoder (DDAE), thus termed (NC + DDAE). In a series of comprehensive experiments, we conduct qualitative and quantitative analyses on the NC module and the overall NC + DDAE approach. Moreover, we evaluate the speech recognition performance of the NC + DDAE NR and classical single-microphone NR approaches for Mandarin-speaking CI recipients under different noisy conditions. The testing set contains Mandarin sentences corrupted by two types of maskers, two-talker babble noise, and a construction jackhammer noise, at 0 and 5 dB SNR levels. Two conventional NR techniques and the proposed deep learning-based approach are used to process the noisy utterances. We qualitatively compare the NR approaches by the amplitude envelope and spectrogram plots of the processed utterances. Quantitative objective measures include (1) normalized covariance measure to test the intelligibility of the utterances processed by each of the NR approaches; and (2) speech recognition tests conducted by nine Mandarin-speaking CI recipients. These nine CI recipients use their own clinical speech processors during testing. RESULTS: The experimental results of objective evaluation and listening test indicate that under challenging listening conditions, the proposed NC + DDAE NR approach yields higher intelligibility scores than the two compared classical NR techniques, under both matched and mismatched training-testing conditions. CONCLUSIONS: When compared to the two well-known conventional NR techniques under challenging listening condition, the proposed NC + DDAE NR approach has superior noise suppression capabilities and gives less distortion for the key speech envelope information, thus, improving speech recognition more effectively for Mandarin CI recipients. The results suggest that the proposed deep learning-based NR approach can potentially be integrated into existing CI signal processors to overcome the degradation of speech perception caused by noise.

来源:Ear Hear,查看原文。版权归原作者所有。

引用

  1. Lai YH, Tsao Y, Lu X, et al. Deep Learning-Based Noise Reduction Approach to Improve Speech Intelligibility for Cochlear Implant Recipients. Ear Hear. 2018. PMID: 29360687. doi:10.1097/AUD.0000000000000537

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。