Surface appropriate collisions
AssigneeMagic Leap, Inc.
InventorsAnastasia Andreyevna Tajik, Colby Nelson Leider, Omer Perry
Life of this patent
Estimating the term…
Abstract
Disclosed herein are systems and methods for presenting an audio signal associated with presentation of a virtual object colliding with a surface. The virtual object and the surface may be associated with a mixed reality environment. Generation of the audio signal may be based on at least one of an audio stream from a microphone and a video stream form a sensor. In some embodiments, the collision between the virtual object and the surface is associated with a footstep on the surface.
Claims20
A system comprising:
- a microphone;
- a sensor;
- a display;
- an audio output;
- and
- one or more processors configured to execute a method comprising:
- at a first time, detecting a footstep, of a user, on a surface;
- in response to detecting the footstep, determining, via the microphone, an acoustic property of the surface;
- receiving, via the microphone, an audio stream;
- receiving, via the sensor, a video stream;
- at a second time, detecting a trigger event, the trigger event comprising a collision with the surface;
- in accordance with the detection of the trigger event:
- identifying a timestamp associated with the trigger event;
- identifying a portion of the audio stream based on the timestamp;
- identifying a portion of the video stream based on the timestamp;
- presenting to the user, on the display, a view of a virtual object colliding with the surface;
- generating an audio signal based on at least one of the portion of the audio stream or the portion of the video stream, and based further on the acoustic property of the surface;
- and
- presenting to the user, via the audio output, concurrently with presenting the view of the virtual object, the audio signal.
A method comprising:
- receiving, via a microphone of a wearable head device, an audio stream;
- receiving, via a sensor of the wearable head device, a video stream;
- at a first time, detecting a footstep, of a user, on a surface;
- in response to detecting the footstep, determining, via the microphone, an acoustic property of the surface;
- at a second time, detecting a trigger event, the trigger event comprising a collision with the surface;
- in accordance with a the detection of the trigger event:
- identifying a timestamp associated with the trigger event;
- identifying a portion of the audio stream based on the timestamp;
- identifying a portion of the video stream based on the timestamp;
- presenting, to the user via a display of the wearable head device, a view of a virtual object colliding with the surface;
- generating an audio signal based on at least one of the portion of the audio stream or the portion of the video stream, and based further on the acoustic property of the surface;
- and
- presenting, to the user, concurrently with presenting the view of the virtual object, the audio signal.
A non-transitory computer-readable medium storing one or more instructions, which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
- receiving, via a microphone of a wearable head device, an audio stream;
- receiving, via a sensor of the wearable head device, a video stream;
- at a first time, detecting a footstep, of a user, on a surface;
- in response to detecting the footstep, determining, via the microphone, an acoustic property of the surface;
- at a second time, detecting a trigger event, the trigger event comprising a collision with the surface;
- in accordance with the detection of the trigger event:
- identifying a timestamp associated with the trigger event;
- identifying a portion of the audio stream based on the timestamp;
- identifying a portion of the video stream based on the timestamp;
- presenting, to the user via a display of the wearable head device, a view of a virtual object colliding with the surface;
- generating an audio signal based on at least one of the portion of the audio stream or the portion of the video stream, and based further on the acoustic property of the surface;
- and
- presenting, to the user, concurrently with presenting the view of the virtual object, the audio signal.
Dependencies are inferred from the claim text.