A system for providing hearing protection and situational awareness, the system comprising:
- a wearable device comprising hearing members, wherein the hearing members comprise a left hearing member configured to be disposed on a left ear of a user, and a right hearing member configured to be disposed on a right ear of the user;
- one or more speakers disposed at an inner location of each of the hearing members of the wearable device;
- a sound source localization unit operably coupled to the left hearing member and the right hearing member of the wearable device, the sound source localization unit comprising:
- a plurality of beamformers, each configured to generate one acoustic beam pattern pointing to one direction;
- an array of four or more outer microphones comprising two or more microphones disposed at outer locations of each of the left hearing member and the right hearing member of the wearable device, wherein the array of four or more outer microphones is configured to capture sound from the plurality of acoustic beam patterns, pointing to outside of the hearing members, and wherein each of the plurality of beamformers is configured to output a sound track, each sound track associated with the captured sound in the direction of the corresponding acoustic beam pattern;
- a pair of inner microphones comprising one inner microphone disposed at an inner location of each of the left hearing member and the right hearing member of the wearable device, wherein the pair of inner microphones is configured to facilitate active noise cancelation;
- a computation unit disposed in one or more of the hearing members of the wearable device and operably coupled to the array of four or more outer microphones and the pair of inner microphones disposed at an inner location of each of the hearing members of the wearable device, the computation unit comprising:
- at least one processor;
- a memory unit operably and communicatively coupled to the at least one processor, wherein the memory unit is configured to store a database of head-related transfer function filters, and computer program instructions defined by a plurality of signal processing modules and executable by the at least one processor;
- the signal processing modules comprising at least one sound generator configured to:
- for each of the plurality of beamformers, retrieve a pair of head-related transfer function filters associated with the direction of the plurality of acoustic beam patterns generated by each of the plurality of beamformers, from the database;
- apply the retrieved corresponding pair of head-related transfer function filters to the output sound track from each of the plurality of beamformers, to generate a pair of filtered sound tracks, one for the left ear and another one for the right ear, wherein each of the filtered sound tracks represents the sound captured from the direction of the corresponding acoustic beam pattern;
- combine the filtered sound tracks generated for the left ear into a left sound channel to drive at least one of the one or more speakers in the left hearing member of the wearable device, and combine the filtered sound tracks generated for the right ear into a right sound channel to drive at least one of the one or more speakers in the right hearing member of the wearable device, thereby generating a binaural sound comprising cues of the sound source directions, wherein the one or more speakers in the each of the hearing members of the wearable device reproduce real sound outside of the wearable device, whereby output sounds from the wearable device comprise a cue of at least one of one or more sound source directions;
- the signal processing modules further comprising an artificial intelligence-enabled sound identification module configured to automatically recognize characteristics of the captured sound and identify categories of the captured sound using one or more pretrained artificial intelligence models;
- the signal processing modules further comprising a voice assistant operably coupled to the one or more speakers and, in communication with the artificial intelligence-enabled sound identification module and the sound source localization unit, configured to determine one or more sound source locations from the output sound track of each of the plurality of beamformers and to report the identified categories of the captured sound and a direction of the captured sound with voice assistance via one of the one or more speakers and one or more other interface devices;
- and
- the signal processing modules further comprising a set of active noise cancellation units and a set of noise reduction units for utilizing information in both a spatial domain and a temporal domain to cancel and/or reduce noise, thereby ensuring hearing protection and improving signal-to-noise ratio.