Back to results
US 11,778,366 B2Granted
Gaze-guided audio
AssigneeMeta Platforms Technologies, LLC
InventorsSebastian Sztuk, Salvael Ortega Estrada
Life of this patent
Estimating the term…
Abstract
A gaze direction of a user is determined by an eye-tracking system of a head mounted device. Audio data generated by at least one microphone is captured. Gaze-guided audio is generated from the audio data based on the gaze direction of the user.
Claims14
A head mounted device comprising:
- an eye-tracking system including one or more sensors configured to determine a gaze direction of an eye in an eyebox region of the head mounted device;
- a first microphone configured to record first audio data from first sound waves, wherein the first microphone is oriented to receive the first sound waves originating from a first audio zone of an external environment of the head mounted device;
- a second microphone configured to record second audio data from second sound waves, wherein the second microphone is oriented to receive the second sound waves originating from a second audio zone of an external environment of the head mounted device;
- and
- processing logic configured to:
- receive the gaze direction from the eye-tracking system;
- and
- select a primary microphone between the first microphone and the second microphone to generate gaze-guided audio, wherein the primary microphone is selected based on the gaze direction received from the eye-tracking system, wherein the primary microphone is selected based in part on a gaze vector representative of the gaze direction being closest to a middle of a selected audio zone of the primary microphone.
5 more elements
A head mounted device comprising:
- an eye-tracking system including one or more sensors configured to determine a gaze direction of an eye in an eyebox region of the head mounted device;
- a first microphone configured to record first audio data from first sound waves, wherein the first microphone is oriented to receive the first sound waves originating from a first audio zone of an external environment of the head mounted device;
- a second microphone configured to record second audio data from second sound waves, wherein the second microphone is oriented to receive the second sound waves originating from a second audio zone of an external environment of the head mounted device;
- and
- processing logic configured to:
- receive the gaze direction from the eye-tracking system;
- select a primary microphone between the first microphone and the second microphone to generate gaze-guided audio, wherein the primary microphone is selected based on the gaze direction received from the eye-tracking system;
- receive a subsequent-gaze direction from the eye-tracking system;
- and
- select a subsequent-primary microphone that is different from the primary microphone when a subsequent-gaze vector representative of the subsequent-gaze direction becomes closer to a subsequent-selected audio zone of the subsequent-primary microphone that is different from an audio zone of the primary microphone.
7 more elements
Dependencies are inferred from the claim text.