Personalized, real-time audio processing

A device associated with a user comprising:

• at least one processor;
• and
• memory storing instructions that, when executed by the at least one processor, cause the device to:
• detect a direction of a gaze of the user;
• based at least in part on determining that the direction of the gaze of the user is different from directions of a plurality of sound signals:
• receive one or more image signals from an environment surrounding the user;
• and
• detect, based on the one or more image signals, a sound source emitting one or more sounds in a direction of the user;
• and
• perform a noise cancelling algorithm on a first sound signal, of the plurality of sound signals, arriving from a direction different from a direction of the sound source.

A non-transitory, computer-readable medium storing instructions that, when executed by at least one processor of a device, cause the device to perform operations comprising:

• detecting a direction of a gaze of a user associated with the device;
• based at least in part on determining that the direction of the gaze of the user is different from directions of a plurality of sound signals:
• receiving one or more image signals from an environment surrounding the user;
• and
• detecting, based on the one or more image signals, a sound source emitting one or more sound signals in a direction of the user;
• and
• performing a noise cancelling algorithm on a first sound signal, of the plurality of sound signals, arriving from a direction different from a direction of the sound source.