Augmented reality content rendering via albedo models, systems and methods
AssigneeNant Holdings IP, LLC
InventorsMatheen Siddiqui, Kamil Wnuk
Life of this patent
Estimating the term…
Abstract
Methods for rendering augmented reality (AR) content are presented. An a priori defined 3D albedo model of an object is leveraged to adjust AR content so that is appears as a natural part of a scene. Disclosed devices recognize a known object having a corresponding albedo model. The devices compare the observed object to the known albedo model to determine a content transformation referred to as an estimated shading (environmental shading) model. The transformation is then applied to the AR content to generate adjusted content, which is then rendered and presented for consumption by a user.
Claims36
1-35. (canceled)
A method of rendering augmented reality content associated with an object in digital imagery, comprising:
- obtaining, by a rendering device, an albedo model related to the object in an environment represented by the digital imagery, the albedo model comprising portions corresponding to at least some features of the object, wherein each portion of the albedo model includes lighting rules selected based on corresponding features of the object;
- obtaining, by the rendering device, augmented reality (AR) content;
- determining, by the rendering device, an environmental error map based on differences derived from aligning known reference features within the albedo model corresponding to observed environmental features derived from the digital representation;
- deriving, by the rendering device, an estimated environmental impact based on the albedo model and the environmental error map;
- generating, by the rendering device, an environmentally adjusted AR content by adjusting the AR content according to the estimated environmental impact;
- and
- rendering, by the rendering device, the environmentally adjusted AR content.
A computer program product embedded in a non-transitory computer-readable medium comprising instructions for rendering augmented reality content associated with an object in digital imagery, which, when executed, configure one or more computer processors to perform a method comprising:
- obtaining, by a rendering device, an albedo model related to the object in an environment represented by the digital imagery, the albedo model comprising portions corresponding to at least some features of the object, wherein each portion of the albedo model includes lighting rules selected based on corresponding features of the object;
- obtaining, by the rendering device, augmented reality (AR) content;
- determining, by the rendering device, an environmental error map based on differences derived from aligning known reference features within the albedo model corresponding to observed environmental features derived from the digital representation;
- deriving, by the rendering device, an estimated environmental impact based on the albedo model and the environmental error map;
- generating, by the rendering device, an environmentally adjusted AR content by adjusting the AR content according to the estimated environmental error map;
- and
- rendering, by the rendering device, the environmentally adjusted AR content.
An augmented reality content rendering system comprising:
- a tangible, non-transitory, computer-readable memory configured to store software instructions for augmented reality content rendering;
- and
- at least one processor coupled with the memory and, upon execution of the software instructions for augmented reality content rendering, is configured to operate as a rendering device to:
- obtain an albedo model related to an object in an environment represented by the digital imagery, the albedo model comprising portions corresponding to at least some features of the object, wherein each portion of the albedo model includes lighting rules selected based on corresponding features of the object;
- obtain augmented reality (AR) content;
- determine, by the rendering device, an environmental error map based on differences derived from aligning known reference features within the albedo model corresponding to observed environmental features derived from the digital representation;
- derive an estimated environmental impact based on the albedo model and the environmental error map;
- generate an environmentally adjusted AR content by adjusting the AR content according to the estimated environmental impact;
- and
- render the environmentally adjusted AR content.
Dependencies are inferred from the claim text.