Project B1 - The immersive hearing device
In current hearing device technology, the largest speech communication benefit in adverse listening conditions is typically achieved by directional filters. However, to utilize this benefit, hearing aid users may need to change their natural head motion behavior and loose the sense of immersion in the sound environment.
The aim of this project is to develop an immersive hearing device that provides the large benefit of directional filters without their disruptive influence on user behavior, and to include the user's hearing wish in the signal processing. For this, methods from computational auditory scene analysis (CASA) are combined with an automatic estimation of the hearing wish based on user motion, gaze direction and attention.
Figure 1: Schematic flow chart of the immersive hearing aid. Key to the concept is a combination of acoustic and image analysis (scene analysis block) with an analysis of sensor signals (behavior analysis block) to detect the hearing wish, i.e., the attended source if interest, and to optimally enhance the attended source (signal enhancement block).
Figure 2: A typical evaluation environment