Virtual and real object recording in mixed reality device
AssigneeMagic Leap, Inc.
InventorZiqiang HUANG
Life of this patent
Estimating the term…
Abstract
A virtual image generation system for use by an end user comprises memory, a display subsystem, an object selection device configured for receiving input from the end user and persistently selecting at least one object in response to the end user input, and a control subsystem configured for rendering a plurality of image frames of a three-dimensional scene, conveying the image frames to the display subsystem, generating audio data originating from the at least one selected object, and for storing the audio data within the memory.
Claims20
A virtual image generation system for use by a playback user, comprising:
- memory configured for storing audio content data and video content data originating from at least one object in an original spatial environment;
- a plurality of speakers;
- a display subsystem;
- a control subsystem configured for retrieving the audio content data and video content data from the memory, respectively rendering audio and video from the retrieved audio content data and video content data in a new spatial environment different from the original spatial environment, and synchronously conveying the rendered audio to the speakers and the generated video data to the display subsystem.
A method of operating a virtual image generation system by a playback user to play back audio and video of at least one object previously recorded in an original spatial environment as audio content data and video content data, the method comprising:
- retrieving the audio content data and video content data from memory;
- respectively rendering audio and video from the retrieved audio content data and video content data in a new spatial environment different from the original spatial environment;
- respectively transforming the audio and video into sound and image frames;
- and
- synchronously conveying the sound and image frames to the playback user.
Dependencies are inferred from the claim text.