US 11,910,183 B2Granted

Multi-application audio rendering

AssigneeMagic Leap, Inc.

InventorsRemi Samuel Audfray, Mark Brandon Hertensteiner, Samuel Charles Dicker, Blaine Ivin Wood, Michael Z. Land

Life of this patent

Estimating the term…

Loading patent…

Abstract

Disclosed herein are systems and methods for efficiently rendering audio. A method may include receiving a request to present a first audio track, wherein the first audio track is based on a first audio model comprising a shared model component and a first model component; receiving a request to present a second audio track, wherein the second audio track is based on a second audio model comprising the shared model component and a second model component; rendering a sound based on the first audio track, the second audio track, the shared model component, the first model component, and the second model component; and presenting, via one or more speakers, the an audio signal comprising the rendered sound.

Claims28

Dependent claims

A system comprising:

a head-wearable device;
one or more speakers;
and
one or more processors configured to execute a method comprising:
receiving, at an audio service, from a first application associated with the head-wearable device, a request to present a first audio track;
determining, based on a location of the head-wearable device in a mixed reality environment, a shared model component, wherein the shared model component is associated with an acoustic property of the mixed reality environment;
creating a copy of the shared model component;
determining whether to update the shared model component;
in accordance with a determination to update the shared model component, updating the copy of the shared model component;
in accordance with a determination to not update the shared model component, forgoing updating the copy of the shared model component;
determining a first model component corresponding to the first application;
rendering a first sound based on the first audio track and based further on a first audio model comprising the shared model component and further comprising the first model component, wherein the rendering the first sound is based on an output of a calculation, via the shared model component, of the acoustic property;
receiving, at the audio service, from a second application associated with the head-wearable device, a request to present a second audio track;
determining a second model component corresponding to the second application;
rendering a second sound based on the second audio track and based further on a second audio model comprising the shared model component and further comprising the second model component, wherein the rendering the second sound is based on the output of the calculation, via the shared model component, of the acoustic property;
in accordance with the determination to update the shared model component, updating the shared model component after said rendering the first sound and said rendering the second sound;
in accordance with the determination to not update the shared model component, forgoing updating the shared model component;
and
presenting, via the one or more speakers, an audio signal comprising the first sound and the second sound.

16 more elements

A method comprising:

receiving, at an audio service, from a first application associated with a head-wearable device, a request to present a first audio track;
determining, based on a location of the head-wearable device in a mixed reality environment, a shared model component, wherein the shared model component is associated with an acoustic property of the mixed reality environment;
creating a copy of the shared model component;
determining whether to update the shared model component;
in accordance with a determination to update the shared model component, updating the copy of the shared model component;
in accordance with a determination to not update the shared model component, forgoing updating the copy of the shared model component;
determining a first model component corresponding to the first application;
rendering a first sound based on the first audio track and based further on a first audio model comprising the shared model component and further comprising the first model component, wherein the rendering the first sound is based on an output of a calculation, via the shared model component, of the acoustic property;
receiving, at the audio service, from a second application associated with the head-wearable device, a request to present a second audio track;
determining a second model component corresponding to the second application;
rendering a second sound based on the second audio track and based further on a second audio model comprising the shared model component and further comprising the second model component, wherein the rendering the second sound is based on the output of the calculation, via the shared model component, of the acoustic property;
in accordance with the determination to update the shared model component, updating the shared model component after said rendering the first sound and said rendering the second sound;
in accordance with the determination to not update the shared model component, forgoing updating the shared model component;
and
presenting, via one or more speakers of the head-wearable device, an audio signal comprising the first sound and the second sound.

12 more elements

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to execute a method comprising:

receiving, at an audio service, from a first application associated with a head-wearable device, a request to present a first audio track;
determining, based on a location of the head-wearable device in a mixed reality environment, a shared model component, wherein the shared model component is associated with an acoustic property of the mixed reality environment;
creating a copy of the shared model component;
determining whether to update the shared model component;
in accordance with a determination to update the shared model component, updating the copy of the shared model component;
in accordance with a determination to not update the shared model component, forgoing updating the copy of the shared model component;
determining a first model component corresponding to the first application;
rendering a first sound based on the first audio track and based further on a first audio model comprising the shared model component and further comprising the first model component, wherein the rendering the first sound is based on an output of a calculation, via the shared model component, of the acoustic property;
receiving, at the audio service, from a second application associated with the head-wearable device, a request to present a second audio track;
determining a second model component corresponding to the second application;
rendering a second sound based on the second audio track and based further on a second audio model comprising the shared model component and further comprising the second model component, wherein the rendering the second sound is based on the output of the calculation, via the shared model component, of the acoustic property;
in accordance with the determination to update the shared model component, updating the shared model component after said rendering the first sound and said rendering the second sound;
in accordance with the determination to not update the shared model component, forgoing updating the shared model component;
and
presenting, via one or more speakers of the head-wearable device, an audio signal comprising the first sound and the second sound.

12 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/174,287Filed 11 Feb 2021 · us provisional application
Priority: 14 Feb 2020
Published: US 2021/0258715 A119 Aug 2021
Granted: 20 Feb 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification5 codes

H04S 7/306
Electronic adaptation of stereophonic audio signals to reverberation of the listening space: for headphones
H04S 7/304
Tracking of listener position or orientation: for headphones
H04S 2400/11
Details of stereophonic systems covered by H04S but not provided for in its groups: positioning of individual sound objects, e.g. moving airplane,…
H04S 2420/01
Techniques used stereophonic systems covered by H04S but not provided for in its groups: enhancing the perception of the sound image or of the…

Family

Application62/976,569Us provisional application · filed 14 Feb 2020
US 2021/0258715 A1Pre-grant publication · published 19 Aug 2021
US 11,910,183 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key