# US 11,910,183 B2 · Multi-application audio rendering

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,910,183 B2
- Document ID: US11910183B2
- Status: Granted
- Kind: B2
- Application number: 17/174,287
- Filed: 2021-02-11
- Published: 2021-08-19
- Granted: 2024-02-20
- Earliest claimed: 2020-02-14
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Remi Samuel Audfray; Mark Brandon Hertensteiner; Samuel Charles Dicker; Blaine Ivin Wood; Michael Z. Land
- Web page: https://patentgrep.com/patent/US11910183B2

## CPC

- H04S 7/306: {For headphones}
- H04S 7/304: {For headphones}
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S: STEREOPHONIC SYSTEMS

## Abstract

Disclosed herein are systems and methods for efficiently rendering audio. A method may include receiving a request to present a first audio track, wherein the first audio track is based on a first audio model comprising a shared model component and a first model component; receiving a request to present a second audio track, wherein the second audio track is based on a second audio model comprising the shared model component and a second model component; rendering a sound based on the first audio track, the second audio track, the shared model component, the first model component, and the second model component; and presenting, via one or more speakers, the an audio signal comprising the rendered sound.

## Claims

### Claim 1

A system comprising:
a head-wearable device;
one or more speakers; and
one or more processors configured to execute a method comprising:
receiving, at an audio service, from a first application associated with the head-wearable device, a request to present a first audio track;
determining, based on a location of the head-wearable device in a mixed reality environment, a shared model component, wherein the shared model component is associated with an acoustic property of the mixed reality environment;
creating a copy of the shared model component;
determining whether to update the shared model component;
in accordance with a determination to update the shared model component, updating the copy of the shared model component;
in accordance with a determination to not update the shared model component, forgoing updating the copy of the shared model component;
determining a first model component corresponding to the first application;
rendering a first sound based on the first audio track and based further on a first audio model comprising the shared model component and further comprising the first model component, wherein the rendering the first sound is based on an output of a calculation, via the shared model component, of the acoustic property;
receiving, at the audio service, from a second application associated with the head-wearable device, a request to present a second audio track;
determining a second model component corresponding to the second application;
rendering a second sound based on the second audio track and based further on a second audio model comprising the shared model component and further comprising the second model component, wherein the rendering the second sound is based on the output of the calculation, via the shared model component, of the acoustic property;
in accordance with the determination to update the shared model component, updating the shared model component after said rendering the first sound and said rendering the second sound;
in accordance with the determination to not update the shared model component, forgoing updating the shared model component; and
presenting, via the one or more speakers, an audio signal comprising the first sound and the second sound.

### Claim 2 (depends on 1)

The system of claim 1, wherein the first audio model comprises material data associated with one or more objects associated with the first application.

### Claim 3 (depends on 2)

The system of claim 2, wherein the material data comprises one or more of an audio reflectivity parameter, a transmissivity parameter, an absorption parameter, a scattering parameter, and a diffraction parameter.

### Claim 4 (depends on 1)

The system of claim 1, wherein the first audio model further comprises data associated with a virtual sound source.

### Claim 5 (depends on 1)

The system of claim 1, wherein the method further comprises storing, via the audio service, an association between the first application and the first audio model.

### Claim 6 (depends on 1)

The system of claim 1, wherein the first audio model is based on a physical environment of the head-wearable device.

### Claim 7 (depends on 1)

The system of claim 1, wherein the acoustic property comprises direct path acoustic behavior.

### Claim 8 (depends on 1)

The system of claim 1, wherein the acoustic property comprises reflective acoustic behavior.

### Claim 9 (depends on 1)

The system of claim 1, wherein the acoustic property comprises reverberant acoustic behavior.

### Claim 10 (depends on 1)

The method of claim 1, wherein the determining whether to update the shared model component comprises determining whether a threshold condition is met.

### Claim 11

A method comprising:
receiving, at an audio service, from a first application associated with a head-wearable device, a request to present a first audio track;
determining, based on a location of the head-wearable device in a mixed reality environment, a shared model component, wherein the shared model component is associated with an acoustic property of the mixed reality environment;
creating a copy of the shared model component;
determining whether to update the shared model component;
in accordance with a determination to update the shared model component, updating the copy of the shared model component;
in accordance with a determination to not update the shared model component, forgoing updating the copy of the shared model component;
determining a first model component corresponding to the first application;
rendering a first sound based on the first audio track and based further on a first audio model comprising the shared model component and further comprising the first model component, wherein the rendering the first sound is based on an output of a calculation, via the shared model component, of the acoustic property;
receiving, at the audio service, from a second application associated with the head-wearable device, a request to present a second audio track;
determining a second model component corresponding to the second application;
rendering a second sound based on the second audio track and based further on a second audio model comprising the shared model component and further comprising the second model component, wherein the rendering the second sound is based on the output of the calculation, via the shared model component, of the acoustic property;
in accordance with the determination to update the shared model component, updating the shared model component after said rendering the first sound and said rendering the second sound;
in accordance with the determination to not update the shared model component, forgoing updating the shared model component; and
presenting, via one or more speakers of the head-wearable device, an audio signal comprising the first sound and the second sound.

### Claim 12 (depends on 11)

The method of claim 11, wherein the first audio model comprises material data associated with one or more objects associated with the first application.

### Claim 13 (depends on 12)

The method of claim 12, wherein the material data comprises one or more of an audio reflectivity parameter, a transmissivity parameter, an absorption parameter, a scattering parameter, and a diffraction parameter.

### Claim 14 (depends on 11)

The method of claim 11, wherein the first audio model further comprises data associated with a virtual sound source.

### Claim 15 (depends on 11)

The method of claim 11, further comprising storing, via the audio service, an association between the first application and the first audio model.

### Claim 16 (depends on 11)

The method of claim 11, wherein the first audio model is based on a physical environment of the head-wearable device.

### Claim 17 (depends on 11)

The method of claim 11, wherein the acoustic property comprises direct path acoustic behavior.

### Claim 18 (depends on 11)

The method of claim 11, wherein the acoustic property comprises reflective acoustic behavior.

### Claim 19 (depends on 11)

The method of claim 11, wherein the acoustic property comprises reverberant acoustic behavior.

### Claim 20

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to execute a method comprising:
receiving, at an audio service, from a first application associated with a head-wearable device, a request to present a first audio track;
determining, based on a location of the head-wearable device in a mixed reality environment, a shared model component, wherein the shared model component is associated with an acoustic property of the mixed reality environment;
creating a copy of the shared model component;
determining whether to update the shared model component;
in accordance with a determination to update the shared model component, updating the copy of the shared model component;
in accordance with a determination to not update the shared model component, forgoing updating the copy of the shared model component;
determining a first model component corresponding to the first application;
rendering a first sound based on the first audio track and based further on a first audio model comprising the shared model component and further comprising the first model component, wherein the rendering the first sound is based on an output of a calculation, via the shared model component, of the acoustic property;
receiving, at the audio service, from a second application associated with the head-wearable device, a request to present a second audio track;
determining a second model component corresponding to the second application;
rendering a second sound based on the second audio track and based further on a second audio model comprising the shared model component and further comprising the second model component, wherein the rendering the second sound is based on the output of the calculation, via the shared model component, of the acoustic property;
in accordance with the determination to update the shared model component, updating the shared model component after said rendering the first sound and said rendering the second sound;
in accordance with the determination to not update the shared model component, forgoing updating the shared model component; and
presenting, via one or more speakers of the head-wearable device, an audio signal comprising the first sound and the second sound.

### Claim 21 (depends on 20)

The non-transitory computer-readable medium of claim 20, wherein the first audio model comprises material data associated with one or more objects associated with the first application.

### Claim 22 (depends on 20)

The non-transitory computer-readable medium of claim 20, wherein the material data comprises one or more of an audio reflectivity parameter, a transmissivity parameter, an absorption parameter, a scattering parameter, and a diffraction parameter.

### Claim 23 (depends on 20)

The non-transitory computer-readable medium of claim 20, wherein the first audio model further comprises data associated with a virtual sound source.

### Claim 24 (depends on 20)

The non-transitory computer-readable medium of claim 20, wherein the method further comprises storing, via the audio service, an association between the first application and the first audio model.

### Claim 25 (depends on 20)

The non-transitory computer-readable medium of claim 20, wherein the first audio model is based on a physical environment of the head-wearable device.

### Claim 26 (depends on 20)

The non-transitory computer-readable medium of claim 20, wherein the acoustic property comprises direct path acoustic behavior.

### Claim 27 (depends on 20)

The non-transitory computer-readable medium of claim 20, wherein the acoustic property comprises reflective acoustic behavior.

### Claim 28 (depends on 20)

The non-transitory computer-readable medium of claim 20, wherein the acoustic property comprises reverberant acoustic behavior.
