Methods and systems for creating virtual and augmented reality
AssigneeMagic Leap, Inc.
InventorsGary R. Bradski, Samuel A. Miller, Rony Abovitz
Life of this patent
Estimating the term…
Abstract
Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise an image capturing device to capture one or more images, the one or more images corresponding to a field of the view of a user of a head-mounted augmented reality device, and a processor communicatively coupled to the image capturing device to extract a set of map points from the set of images, to identify a set of sparse points and a set of dense points from the extracted set of map points, and to perform a normalization on the set of map points.
Claims19
A system for generating a three-dimensional (3D) model of a face of a user,
- the system comprising:
- a head-mounted display (HMD) configured to present virtual content to a user;
- an inward-facing imaging system comprising at least one eye camera, wherein the inward-facing imaging system is configured to image at least a portion of the face of the user while the user is wearing the HMD;
- an inertial measurement unit (IMU) associated with the HMD and configured to detect movements of the HMD;
- and
- a hardware processor programmed to:
- detect a trigger to initiate imaging of a face of the user, wherein the trigger comprises a movement detected by the IMU involving putting the HMD onto a head of the user or taking the HMD off of the head of the user;
- activate, in response to detecting the trigger, the at least one eye camera to acquire images;
- detect a stopping condition for stopping the imaging based on data acquired from at least one of the IMU or the inward-facing imaging system;
- analyze the images acquired by the at least one eye camera with a stereo vision algorithm;
- and
- fuse the images to generate a face model of the user's face based at least partly on an output of the stereo vision algorithm.
A method for generating a three-dimensional (3D) model of a face of a user, the method comprising:
- receiving a request for generating a face model of a user;
- accessing images of the user's head acquired by an inward-facing imaging system of a wearable device, wherein the inward-facing imaging system comprises at least one eye camera;
- identifying a plurality of pairs of images from the accessed images;
- analyze the images by applying a stereo vision algorithm to the plurality of pairs of images;
- and
- fusing outputs obtained from said analyzing step to create a face model,
- wherein the images are acquired as the wearable is being put on or taken off from the user.
Dependencies are inferred from the claim text.