Multimodal hearing assistance devices and systems

Abstract

Hearing assistance systems, devices and methods including obtaining, by the device, multiple brain and bio-signals indicative of the auditory and visual attentional focus of the user, obtaining a mixed sound signal from multiple sound sources and applying, by the device, speech-separation and enhancement processing to the mixed sound signal to derive a plurality of separated signals that each contains signals corresponding to different groups of the multiple sound sources, and selecting one of the pluralities of separated signals either solely based on the obtained brain signals, or on a combination of bio-signals, including but not limited to eye gaze direction, head, neck and trunk orientation, etc. The separated signals may then be processed (i.e., amplified, attenuated) based on the needs of the user.

Dependencies are inferred from the claim text.