US 2026/0230668 A1 · MIXED REALITY VIRTUAL REVERBERATION

Abstract

This disclosure describes techniques for presenting an audio signal in a mixed reality environment, for example through a system including a wearable head device that presents visual elements of the mixed reality environment. A first audio signal (e.g., a real audio signal) in the mixed reality environment is detected, and a virtual object is identified that is intersected by the first audio signal. A position of a user in the mixed reality environment is determined, and a listener coordinate associated with the user can be determined based on the position. In some examples, the listener coordinate is spatially offset from the user position. A transfer function is determined based on the virtual object and the listener coordinate, and the transfer function is applied to the first audio signal to produce a second audio signal that is presented to the user through the system.

Claims20

Dependent claims

A method of presenting an audio signal to a user of a mixed reality environment, the method comprising:

detecting a first audio signal in the mixed reality environment, where the first audio signal is a real audio signal;
identifying a virtual object intersected by the first audio signal in the mixed reality environment;
identifying, via one or more inertial measurement units of a wearable head device, a position of the user in the mixed reality environment, wherein the one or more inertial measurement units are configured for six-degree-of-freedom tracking of a head pose of the user;
identifying a listener coordinate associated with the user based on the position of the user, wherein the listener coordinate is spatially offset from the identified user position;
determining, using the virtual object and the listener coordinate, a transfer function;
applying the transfer function to the first audio signal to produce a second audio signal;
and
presenting, to the user, the second audio signal.

5 more elements

A system comprising:

a wearable head device including:
a display for displaying a mixed reality environment to a user, the display comprising a transmissive eyepiece through which a real environment is visible;
a microphone;
a speaker;
one or more inertial measurement units (IMUs);
and
a sensor configured to detect an orientation of the wearable head device in the mixed reality environment;
and
one or more processors configured to perform:
detecting, via the microphone, a first audio signal in the mixed reality environment, where the first audio signal is a real audio signal;
identifying a virtual object intersected by the first audio signal in the mixed reality environment;
presenting, to the user via the display, the virtual object;
identifying, via the one or more inertial measurement units, a position of the wearable head device in the mixed reality environment, wherein the one or more one or more inertial measurement units are configured for six-degree-of-freedom tracking of a head pose of the user;
identifying a listener coordinate using the position of the wearable head device, wherein the listener coordinate is spatially offset from the identified position of the wearable head device;
determining, using the virtual object and the listener coordinate, a transfer function;
applying the transfer function to the first audio signal to produce a second audio signal;
and
presenting, to the user via the speaker, the second audio signal.

15 more elements

Dependencies are inferred from the claim text.

Mixed reality virtual reverberation

Life of this patent

Mixed reality virtual reverberation

Life of this patent

Abstract

Claims20