Image based tracking in augmented reality systems
AssigneeSnap Inc.
InventorsNathan Jurgenson, Linjie Luo, Jonathan M. Rodriguez, II, Rahul Bhupendra Sheth, Jia Li, Xutao Lv
Life of this patent
Estimating the term…
Abstract
Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
Claims20
A method comprising:
- obtaining, by a computing system including memory and one or more processors, image data corresponding to an image of an environment, wherein the image includes a building and a graphic and the image is captured by an image sensor;
- retrieving, by the one or more processors, building location information describing one or more location points for at least a first building;
- processing, using the one or more processors, the image data with respect to the building location information to identify a match between at least a portion of the image that includes the building and one or more location points of the building;
- determining, by the one or more processors, alignment information based on the graphic, the alignment information including at least one of position information, elevation information, or size information of the graphic;
- and
- calculating, using the one or more processors, a position estimate of the image sensor based on the alignment information and the match between the at least the portion of the image data that includes the building and the one or more location points of the first building.
A system comprising:
- memory;
- and
- one or more processors coupled to the memory, the one or more processors configured to perform operations comprising:
- obtaining image data corresponding to an image of an environment, wherein the image includes a building and a graphic and the image is captured by an image sensor;
- retrieving building location information describing one or more location points for at least a first building;
- processing the image data with respect to the building location information to identify a match between at least a portion of the image that includes the building and the one or more location points of the building;
- determining alignment information based on the graphic, the alignment information including at least one of position information, elevation information, or size information of the graphic;
- and
- calculating a position estimate of the image sensor based on the alignment information and the match between the at least the portion of the image data that includes the building and the one or more location points of the first building.
A non-transitory computer readable medium comprising instructions that, when executed by one or more processors of a device, cause the device to perform operations comprising:
- obtaining image data corresponding to an image of an environment, wherein the image includes a building and a graphic and the image is captured by an image sensor;
- retrieving building location information describing one or more location points for at least a first building;
- processing the image data with respect to the building location information to identify a match between at least a portion of the image that includes the building and one or more location points of the building;
- determining alignment information based on the graphic, the alignment information including at least one of position information, elevation information, or size information of the graphic;
- and
- calculating a position estimate of the image sensor based the alignment information and the match between the at least the portion of the image data that includes the building and the one or more location points of the first building.
Dependencies are inferred from the claim text.