# US 2024/0406665 A1 · Dynamic audio spatialization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0406665 A1
- Document ID: US20240406665A1
- Status: Published application
- Kind: A1
- Application number: 18/325,486
- Filed: 2023-05-30
- Published: 2024-12-05
- Earliest claimed: 2023-05-30
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Rashed MOHAMMED; Preetam Singh RANAWAT; Krithi AIYAPPA; Prakash KATRAGADDA
- Web page: https://patentgrep.com/patent/US20240406665A1

## CPC

- H04S 7/304: {For headphones}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- G06T 2207/30196: Human being; Person
- H04R 2420/07: Applications of wireless loudspeakers or wireless microphones
- H04R 2499/13: Acoustic transducers and sound field adaptation in vehicles
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems
- H04S: STEREOPHONIC SYSTEMS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

A device includes one or more processors configured to obtain, based on a wireless transmission from an audio headset, location data indicative of a location of the audio headset relative to the device. The one or more processors are configured to adjust one or more gain values associated with one or more channels of a virtual speaker array to generate adjusted spatial audio data that emulates positioning of the audio headset relative to the virtual speaker array based on the location data. The one or more processors are also configured to send audio data corresponding to the adjusted spatial audio data to the audio headset.

## Claims

### Claim 1

A device comprising:
one or more processors configured to:
obtain, based on a wireless transmission from an audio headset, location data indicative of a location of the audio headset relative to the device;
adjust one or more gain values associated with one or more channels of a virtual speaker array to generate adjusted spatial audio data that emulates positioning of the audio headset relative to the virtual speaker array based on the location data; and
send audio data corresponding to the adjusted spatial audio data to the audio headset.

### Claim 2 (depends on 1)

The device of claim 1, wherein the audio data includes a binauralized version of the adjusted spatial audio data.

### Claim 3 (depends on 1)

The device of claim 1, wherein the audio data includes the adjusted spatial audio data.

### Claim 4 (depends on 1)

The device of claim 1, wherein the location data includes angle data indicative of an angle of the audio headset relative to the device, the angle data including an angle of arrival of the wireless transmission from the audio headset to the device.

### Claim 5 (depends on 1)

The device of claim 1, wherein the location data includes distance data indicative of a linear distance between the audio headset and the device, the distance data based at least on a signal strength measurement of the wireless transmission from the audio headset to the device.

### Claim 6 (depends on 1)

The device of claim 1, wherein the location data is based on at least one of an angle of arrival or a received signal strength indicator obtained from a BLUETOOTH Low Energy-type receiver that receives the wireless transmission.

### Claim 7 (depends on 1)

The device of claim 1, wherein the one or more processors are configured to:
obtain the location data of the audio headset at a first time;
modify a reference point of a spatial audio field based on the audio headset remaining at a particular location for a period of time following the first time, the period of time exceeding a threshold duration; and
update an arrangement of the virtual speaker array based at least on the reference point of the spatial audio field.

### Claim 8 (depends on 1)

The device of claim 1, further comprising a modem coupled to the one or more processors, the modem configured to transmit the audio data to the audio headset.

### Claim 9 (depends on 1)

The device of claim 1, further comprising an antenna array coupled to the one or more processors, the antenna array configured to receive the wireless transmission from the audio headset and to enable determination, by the one or more processors, of an angle of arrival of the wireless transmission.

### Claim 10 (depends on 1)

The device of claim 1, further comprising a display device coupled to the one or more processors, the display device configured to output video corresponding to the audio data.

### Claim 11 (depends on 1)

The device of claim 1, wherein the one or more processors are integrated in at least one of a mobile phone, a tablet computer device, or a wearable electronic device.

### Claim 12 (depends on 1)

The device of claim 1, wherein the one or more processors are integrated in a television.

### Claim 13 (depends on 1)

The device of claim 1, further comprising a camera coupled to the one or more processors, the camera configured to identify an orientation of a user of the device, and wherein the one or more processors are further configured to generate orientation data indicative of an orientation of the audio headset relative to the device, the orientation data based at least on the orientation of the user of the device.

### Claim 14 (depends on 1)

The device of claim 1, wherein the one or more processors are integrated in a vehicle.

### Claim 15

A method comprising:
obtaining, at one or more processors and based on a wireless transmission from an audio headset, location data indicative of a location of the audio headset relative to a computing device;
adjusting, at the one or more processors, one or more gain values associated with one or more channels of a virtual speaker array to generate adjusted spatial audio data that emulates positioning of the audio headset relative to the virtual speaker array based on the location data; and
sending audio data corresponding to the adjusted spatial audio data to the audio headset.

### Claim 16 (depends on 15)

The method of claim 15, wherein the audio data includes a binauralized version of the adjusted spatial audio data.

### Claim 17 (depends on 15)

The method of claim 15, wherein the audio data includes the adjusted spatial audio data.

### Claim 18 (depends on 15)

The method of claim 15, wherein the location data includes angle data indicative of an angle of the audio headset relative to the computing device, the angle data including an angle of arrival of the wireless transmission from the audio headset to the computing device.

### Claim 19 (depends on 15)

The method of claim 15, wherein the location data includes distance data indicative of a linear distance between the audio headset and the computing device, the distance data based at least on a signal strength measurement of the wireless transmission from the audio headset to the computing device.

### Claim 20 (depends on 15)

The method of claim 15, wherein the location data is based on at least one of an angle of arrival or a received signal strength indicator obtained from a BLUETOOTH Low Energy-type receiver that receives the wireless transmission.

### Claim 21 (depends on 15)

The method of claim 15, further comprising:
receiving the location data from the audio headset at a first time;
modifying a reference point of a spatial audio field based on the audio headset remaining at a particular location for a period of time following the first time, the period of time exceeding a threshold duration; and
updating an arrangement of the virtual speaker array based at least on the reference point of the spatial audio field.

### Claim 22

A headset device comprising:
one or more processors configured to:
determine location data indicative of a location of the headset device relative to a streaming source;
receive spatial audio data from the streaming source;
adjust one or more gain values associated with one or more channels of a virtual speaker array to generate adjusted spatial audio data from the spatial audio data, the one or more gain values emulating a position of the headset device relative to the virtual speaker array based on the location data; and
generate binaural audio data corresponding to the adjusted spatial audio data for playout at earphone speakers.

### Claim 23 (depends on 22)

The headset device of claim 22, wherein the location data includes angle data indicative of an angle of the headset device relative to the streaming source, the angle data including an angle of arrival of a wireless transmission from the headset device to the streaming source.

### Claim 24 (depends on 22)

The headset device of claim 22, wherein the location data includes distance data indicative of a linear distance between the headset device and the streaming source, the distance data based at least on a signal strength measurement of a wireless transmission from the headset device to the streaming source.

### Claim 25 (depends on 22)

The headset device of claim 22, wherein the location data is based on at least one of an angle of arrival or a received signal strength indicator obtained from a BLUETOOTH Low Energy-type receiver that receives a wireless transmission from the headset device to the streaming source.

### Claim 26 (depends on 22)

The headset device of claim 22, wherein the one or more processors are configured to:
determine the location data at a first time;
modify a reference point of a spatial audio field based on the headset device remaining at a particular location for a period of time following the first time, the period of time exceeding a threshold duration; and
update an arrangement of the virtual speaker array based at least on the reference point of the spatial audio field.

### Claim 27 (depends on 22)

The headset device of claim 22, further comprising a modem coupled to the one or more processors, the modem configured to receive the spatial audio data from the streaming source.

### Claim 28 (depends on 22)

The headset device of claim 22, further comprising the earphone speakers coupled to the one or more processors and configured to output the binaural audio data.

### Claim 29

A method comprising:
receiving, at one or more processors of a headset device and via a wireless transmission from a streaming source, spatial audio data corresponding to one or more channels of a virtual speaker array;
determining, at the one or more processors and based on the wireless transmission, location data indicative of a location of the headset device relative to the streaming source;
adjusting, at the one or more processors, one or more gain values associated with the one or more channels to generate adjusted spatial audio data from the spatial audio data, the one or more gain values emulating a position of the headset device relative to the virtual speaker array based on the location data; and
generating binaural audio data corresponding to the adjusted spatial audio data for playout at earphone speakers.

### Claim 30 (depends on 29)

The method of claim 29, wherein the location data is based on at least one of an angle of arrival or a received signal strength indicator obtained from a BLUETOOTH Low Energy-type receiver that receives the wireless transmission.
