# US 10,873,825 B2 · Audio spatialization and reinforcement between multiple headsets > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,873,825 B2 - Document ID: US10873825B2 - Status: Granted - Kind: B2 - Application number: 16/883,796 - Filed: 2020-05-26 - Published: 2020-11-12 - Granted: 2020-12-22 - Earliest claimed: 2019-05-07 - Assignees: Facebook Technologies, LLC - Applicants: Facebook Technologies, LLC - Inventors: William Owen Brimijoin, II; Philip Robinson; Andrew Lovitt - Web page: https://patentgrep.com/patent/US10873825B2 ## CPC - H04S 7/304: {For headphones} - G06F 3/012: {Head tracking input arrangements} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/16: Sound input; Sound output (speech processing G10L) - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - H04R 2201/107: Monophonic and stereophonic headphones with microphone for two-way hands free communication - H04R 2499/15: Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops - H04S 7/306: {For headphones} - H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) - H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems - H04S 2420/00: Techniques used stereophonic systems covered by H04S but not provided for in its groups - H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] - H04S: STEREOPHONIC SYSTEMS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract A shared communication channel allows for the transmitting and receiving audio content between multiple users. Each user is associated with a headset configured to transmit and receive audio data to and from headsets of other users. After the headset of a first user receives audio data corresponding to a second user, the headset spatializes the audio data based upon the relative positions of the first and second users such that when the audio data is presented to the first user, the sounds of the audio data appear to originate at a location corresponding to the second user. The headset reinforces the audio data based upon a deviation between the location of the second user and a gaze direction of the first user, allowing for the first user to more clearly hear audio data from other users that they are paying attention to. ## Claims ### Claim 1 A audio system comprising: a gaze determination circuit configured to determine a gaze direction of a first user of the audio system; a transceiver configured to receive an audio signal associated with an audio system of a second user; processing circuitry configured to: determine a position of the second user; determine a deviation between the position of the second user and a reinforcement direction of the first user based at least in part upon the gaze direction of the first user; and adjust an amplitude of the audio signal, based at least in part upon the determined deviation; and a speaker assembly configured to project a sound based upon the adjusted audio signal. ### Claim 2 (depends on 1) The audio system of claim 1, wherein the processing circuitry is further configured to spatialize the audio signal based upon the position of the second user relative to the first user. ### Claim 3 (depends on 2) The audio system of claim 2, wherein the processing circuitry is further configured to: determine a relative direction of the position of the second user relative to a head orientation of the first user; spatialize the audio signal based upon the relative direction. ### Claim 4 (depends on 2) The audio system of claim 2, wherein the processing circuitry is configured to spatialize the audio output signal based upon whether there is line of sight between the first user and the second user. ### Claim 5 (depends on 1) The audio system of claim 1, further comprising a microphone array comprising a plurality of microphones arranged in a plurality of different locations, the microphone array configured to capture sound in a local area of the first user and generate an audio input signal. ### Claim 6 (depends on 5) The audio system of claim 5, wherein the processing circuitry is further configured to: analyze the audio input signal to identify sounds originating from a particular region in the local area of the first user; and generate a user audio signal from the audio input signal by reinforcing a portion of the audio input signal corresponding to the sounds originating from the particular region. ### Claim 7 (depends on 1) The audio system of claim 1, wherein the transceiver is further configured to receive positional information of the second user. ### Claim 8 (depends on 1) The audio system of claim 1, further comprising an antenna array configured to determine a relative position of the second user relative to the first user. ### Claim 9 (depends on 1) The audio system of claim 1, wherein the receiver is further configured to receive a second audio signal from a third user, and the processing circuitry is further configured to: determine a deviation between a position of the third user and the reinforcement direction of the first user; compare the deviation associated with the third user to the deviation associated with the second user; and reinforce an amplitude of the second audio signal based upon a result of the comparison. ### Claim 10 A method comprising: determining, at an audio system associated with a first user, a gaze direction of the first user; receiving, at the audio system, an audio signal associated with an audio system associated with a second user; identifying a position associated with the second user; determining a deviation between the position of the second user and a reinforcement direction of the first user, the reinforcement direction based at least in part upon the gaze direction of the first user; adjusting an amplitude of the audio signal, based at least in part upon the determined deviation; and projecting, at the audio system, a sound based upon the adjusted audio signal. ### Claim 11 (depends on 10) The method of claim 10, further comprising spatializing the audio signal based upon the position of the second user relative to the first user. ### Claim 12 (depends on 11) The method of claim 11, further comprising: determining a relative direction of the position of the second user relative to a head orientation of the first user; spatializing the audio signal based upon the relative direction. ### Claim 13 (depends on 11) The method of claim 11, wherein the audio signal is spatialized based upon whether there is line of sight between the first user and the second user. ### Claim 14 (depends on 10) The method of claim 10, further comprising: capturing, by a microphone array comprising a plurality of microphones arranged in a plurality of different locations, sound in a local area of the first user, and generating an audio input signal based on the captured sound. ### Claim 15 (depends on 14) The method of claim 14, further comprising: analyzing the audio input signal to identify sounds originating from a particular region in the local area of the first user; and generating a user audio signal from the audio input signal by reinforcing a portion of the audio input signal corresponding to the sounds originating from the particular region. ### Claim 16 (depends on 10) The method of claim 10, further comprising receiving positional information of the second user via a transceiver. ### Claim 17 (depends on 10) The method of claim 10, further comprising determining a relative position of the second user relative to the first user. ### Claim 18 (depends on 10) The method of claim 10, further comprising: receiving a second audio signal associated with a third user; determining a deviation between a position of the third user and the reinforcement direction of the first user; comparing the deviation associated with the third user to the deviation associated with the second user; and reinforcing an amplitude of the second audio signal based upon a result of the comparison. ### Claim 19 A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising: determining, at an audio system associated with a first user, a gaze direction of the first user; receiving, at the audio system, an audio signal associated with an audio system associated with a second user; identifying a position associated with the second user; determining a deviation between the position of the second user and a reinforcement direction of the first user, the reinforcement direction based at least in part upon the gaze direction of the first user; adjusting an amplitude of the audio signal, based at least in part upon the determined deviation; and projecting, at the audio system, a sound based upon the adjusted audio signal. ### Claim 20 (depends on 19) The non-transitory computer-readable medium of claim 19, further comprising: determining a relative direction of the position of the second user relative to a head orientation of the first user; spatializing the audio signal based upon the determined relative direction.