Augmented reality content rendering via albedo models, systems and methods
AssigneeNant Holdings IP, LLC
InventorsMatheen Siddiqui, Kamil Wnuk
Life of this patent
Estimating the term…
Abstract
Methods for rendering augmented reality (AR) content are presented. An a priori defined 3D albedo model of an object is leveraged to adjust AR content so that is appears as a natural part of a scene. Disclosed devices recognize a known object having a corresponding albedo model. The devices compare the observed object to the known albedo model to determine a content transformation referred to as an estimated shading (environmental shading) model. The transformation is then applied to the AR content to generate adjusted content, which is then rendered and presented for consumption by a user.
Claims35
1-35. (canceled)
A method of rendering augmented reality content, comprising:
- obtaining, by a rendering device, an albedo model related to a patient in a medical environment, the albedo model comprising portions corresponding to portions of the patient, wherein each portion of the albedo model includes lighting rules selected based on a reflective nature of a corresponding portion of the patient;
- obtaining, by the rendering device, augmented reality (AR) content related to the patient;
- deriving, by the rendering device, a pose of the patient or of one or more portions of the patient from a digital representation of the patient;
- aligning, by the rendering device, the albedo model with the pose;
- deriving, by the rendering device, observed shading data from the digital representation and the albedo model;
- deriving an estimated object shading model using the albedo model and the observed shading data;
- generating, by the rendering device, environmentally adjusted AR content by applying the estimated object shading model to the AR content;
- and
- rendering, by the rendering device, the environmentally adjusted AR content.
A computer program product embedded in a non-transitory computer-readable medium comprising instructions for rendering augmented reality content, which, when executed, configure one or more computer processors to perform a method comprising:
- obtaining an albedo model related to a patient in a medical environment, the albedo model comprising portions corresponding to portions of the patient, wherein each portion of the albedo model includes lighting rules selected based on a reflective nature of a corresponding portion of the patient;
- obtaining augmented reality (AR) content related to the patient;
- deriving a pose of the patient from a digital representation of the patient;
- aligning the albedo model with the pose;
- deriving observed shading data from the digital representation and the albedo model;
- deriving an estimated object shading model using the albedo model and the observed shading data;
- generating environmentally adjusted AR content by applying the estimated object shading model to the AR content;
- and
- rendering the environmentally adjusted AR content.
Dependencies are inferred from the claim text.