Project A1 - Assessment and modelling of human speech intelligibility and listening effort

Project A1 - Assessment and modelling of human speech intelligibility and listening effort

In many situations human speech communication is considerably affected due to hearing impairment and interfering sounds. This project will assess speech intelligibility and listening effort and will compare the perceptual data to model predictions for evaluating sound presentation and speech enhancement methods developed in the CRC.

Existing prediction models will be extended to supra-threshold processing for predicting listening effort and will be revised in order to work non-intrusively (enabling processing mixed and enhanced signals). Furthermore a real-time model will be developed allowing for direct feedback of temporally resolved model predictions to adaptive speech enhancement algorithms enabling in-the-loop applications.

Publications

2023

  • Sinha R, Scherer A-C, Doclo S, Rollwage C, Rennies J (2023) Subjective performance evaluation of single-channel speaker-conditioned target speaker extraction algorithms for complex acoustic scenes. Proc. ITG Conference on Speech Communication, Aachen, Germany, Sep. 2023, pp. 101-105. DOI: 10.30420/456164019

2022

  • Krüger M, Schulte M, Brand T (2022) Assessing and modeling spatial release from listening effort in listeners with normal hearing: reference ranges and effects of noise direction and age. Trends in Hearing 26:2331216522112940, 19 pages. DOI: 10.1177/23312165221129407
  • Rennies J, Röttges S, Huber R, Hauth CF, Brand T (2022) A joint framework for blind prediction of binaural speech intelligibility and perceived listening effort. Hearing Research 426, 108598, 13 pages. DOI: 10.1016/j.heares.2022.108598
  • Rennies J, Warzybok A, Kollmeier B, Brand T (2022) Spatio-temporal integration of speech reflections in hearing-impaired listeners, Trends in Hearing 26: 23312165221143901 (18 pages). DOI: 10.1177/23312165221143901
  • Roßbach J, Huber R, Röttges S, Hauth CF, Biberger T, Brand T, Meyer BT, Rennies J (2022) Speech intelligibility prediction for hearing-impaired listeners with the LEAP model. Proc. Interspeech 2022, (Seoul, South Corea), 3498-3502. DOI: 10.21437/Interspeech.2022-10460
  • Röttges S, Hauth CF, Rennies J, Brand T (2022) Using a blind EC mechanism for modelling the interaction between binaural and temporal speech processing. Acta Acustica 6:21, 14 pages. DOI: 10.1051/aacus/2022009
  • Strasser E, Brand T, Rennies J (2022) MASAVE: A mobile test system for audio-visual experiments at home. Acta Acustica 6:54, 13 pages. DOI: https://doi.org/10.1051/aacus/2022049

2021

  • Brand T, Hauth CF, Röttges S, Rennies J (2021) Review of the Binaural Speech Intelligibility Model (BSIM). Proceedings DAGA 2021, Wien 15.-18.08.2021, pp 1225-1228. https://pub.dega-akustik.de/DAGA_2021/data/articles/000595.pdf
  • Hülsmeier D, Hauth CF, Röttges S, Kranzusch P, Roßbach J, Schädler MR, Meyer BT, Warzybok A, Brand T (2021) Towards non-intrusive prediction of speech recognition thresholds in binaural conditions. 14th ITG Conference on Speech Communication, Kiel, 29 September-1 October 2021, 199-203. ieeexplore.ieee.org/abstract/document/9657531
  • Rennies J, Krüger M, Best V, Roverud E, Kidd Jr G (2021) Release from energetic and informational masking as revealed by listeing effort and speech intelligibility. Proceedings DAGA 2021, Wien 15.-18.08.2021, pp 1214-1216. https://pub.dega-akustik.de/DAGA_2021/data/articles/000080.pdf
  • Rennies J, Warzybok A, Kollmeier B, Brand T (2021) Spatio-temporal integration of speech reflections in listeners with sensorineural hearing loss. Proceedings DAGA 2021, Wien 15.-18.08.2021, pp 449-450. https://pub.dega-akustik.de/DAGA_2021/data/articles/000079.pdf
  • Roßbach J, Röttges S, Hauth CF, Brand T, Meyer BT (2021) Non-intrusive binaural prediction of speech intelligibility based on phoneme classification. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp 396-400.
    DOI: 10.1109/ICASSP39728.2021.9413874
  • Strasser E, Rennies J, Brand (2021) Comparing a BMVDR with an IBM regarding SRT and subjective listening effort. Proceedings DAGA 2021, Wien 15.-18.08.2021, pp 1233-1236. https://pub.dega-akustik.de/DAGA_2021/data/articles/000613.pdf
  • Warzybok A, Rennies J, Kollmeier B (2021) Contribution of low-level acoustic and higher-level lexical-semantic cues to speech recognition in noise and reverberation. Front. Built Environ. 7:689388. DOI: 10.3389/fbuil.2021.689388

2020

  • Bederna F, Schepker H, Rollwage C, Doclo S, Pusch A, Bitzer J, Rennies J (2020) Adaptive compressive onset-enhancement for improved speech intelligibility in noise and reverberation. Proc. Interspeech 2020, 1351-1355. DOI: 10.21437/Interspeech.2020-2640
  • Hauth CF, Berning SC, Kollmeier B, Brand T (2020) Modeling binaural unmasking of speech using a blind binaural processing stage. Trends Hear 24: 2331216520975630, 1-16. DOI: 10.1177/2331216520975630
  • Rennies J, Schepker H, Valentini-Botinhao C, Cooke M (2020) Intelligibility-enhancing speech modifications – The Hurricane Challenge 2.0. Proc. Interspeech 2020, 1341-1345. DOI: 10.21437/Interspeech.2020-1641

2019

  • Rennies J, Warzybok A, Brand T, Kollmeier B (2019) Measurement and prediction of binaural-temporal integration of speech reflections. Trends Hear 23: 2331216519854267, 1-22. DOI: 10.1177/2331216519854267
(Changed: 02 Dec 2024)  | 
Zum Seitananfang scrollen Scroll to the top of the page