Technique for recording augmented reality data
AssigneeMagic Leap, Inc.
InventorsReza Nourai, Michael Harold Liebenow, Robert Blake Taylor, Robert Wyatt
Life of this patent
Estimating the term…
Abstract
Disclosed is an improved approach for generated recordings from augmented reality systems from the perspective of a camera within the system. Instead of re-using rendered virtual content from the perspective of the user's eyes for AR recordings, additional virtual content is rendered from an additional perspective specifically for the AR recording. That additional virtual content is combined with image frames generated by a camera to form the AR recording.
Claims20
A method for generating an image recording, comprising
- capturing a camera image frame with a camera;
- obtaining pose data that corresponds to the camera image frame, the pose data comprising user pose data and camera pose data, wherein the user pose data is from a different perspective from the camera pose data;
- rendering user pose virtual content for immediate display to a user in an augmented reality (AR) device, wherein the user pose virtual content corresponds to first virtual content from the user's perspective;
- warping the user pose virtual content based on the camera pose data to generate camera pose virtual content, where the camera pose virtual content corresponds to second virtual content from the camera's perspective;
- and
- composing the image recording by combining the camera image frame with the camera pose virtual content,
- wherein a single graphics processing unit (GPU) renders the user pose virtual content and warps the user pose virtual content.
A computer program product embodied on a non-transitory computer readable medium, the non-transitory computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes the processor to execute a method for generating an image recording comprising:
- capturing a camera image frame with a camera;
- obtaining pose data that corresponds to the camera image frame, the pose data comprising user pose data and camera pose data, wherein the user pose data is from a different perspective from the camera pose data;
- rendering user pose virtual content for immediate display to a user in an augmented reality (AR) device, wherein the user pose virtual content corresponds to first virtual content from the user's perspective;
- warping the user pose virtual content based on the camera pose data to generate camera pose virtual content, where the camera pose virtual content corresponds to second virtual content from the camera's perspective;
- and
- composing the image recording by combining the camera image frame with the camera pose virtual content,
- wherein a single graphics processing unit (GPU) renders the user pose virtual content and warps the user pose virtual content.
A system for generating an image recording, comprising
- an augmented reality display device that displays three dimensional content;
- a camera that captures a camera image frame;
- a single inertial measurement unit (IMU) that obtains pose data corresponding to the camera image frame, the pose data comprising user pose data and camera pose data, wherein the user pose data is from a different perspective from the camera pose data;
- one or more graphics processing units (GPU) that:
- renders user pose virtual content for immediate display to a user in the augmented reality (AR) device, wherein the user pose virtual content corresponds to first virtual content from the user's perspective, and
- warps the user pose virtual content based on the camera pose data to generate camera pose virtual content, where the camera pose virtual content corresponds to second virtual content from the camera's perspective;
- and
- a compositor that composes the image recording by combining the camera image frame with the camera pose virtual content.
Dependencies are inferred from the claim text.