Image based tracking in augmented reality systems
AssigneeSnap Inc.
InventorsNathan Jurgenson, Linjie Luo, Jonathan M Rodriguez, II, Rahul Sheth, Jia Li, Xutao Lv
Life of this patent
Estimating the term…
Abstract
Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
Claims20
A method for determining a device location comprising:
- determining, using a first positioning system, a first position estimate for the device;
- accessing, based on the first position estimate, a set of structure facade data describing one or more structure facades associated with the first position estimate;
- capturing, by an image sensor of the device, a first image of an environment;
- identifying, using the set of structure facade data, a first structure facade portion of the first image of the environment, wherein the first structure façade portion matches first structure façade data of the set of structure façade data;
- and
- calculating, based at least in part on the first structure facade portion of the first image of the environment, a second position estimate of the device.
A system comprising:
- a first positioning module configured to determine a first position estimate;
- an image based location system module configured to:
- access, based on the first position estimate, a set of structure facade data describing one or more structure facades associated with the first position estimate;
- access a first image of an environment;
- identify, using the set of structure facade data, a first structure facade portion of the first image of the environment, wherein the first structure façade portion matches first structure façade data of the set of structure façade data;
- and
- calculate, based at least in part on the first structure facade portion of the first image of the environment, a second position estimate of the device.
A non-transitory computer readable medium comprising instructions that, when performed by a device, cause the device to perform a method comprising:
- determining a first position estimate using a first positioning system of the device;
- accessing, based on the first position estimate, a set of structure facade data describing one or more structure facades associated with the first position estimate;
- accessing a first image of an environment;
- identifying, using the set of structure facade data, a first structure facade portion of the first image of the environment, wherein the first structure façade portion matches first structure façade data of the set of structure façade data;
- and
- calculating, based at least in part on the first structure facade portion of the first image of the environment, a second position estimate of the device.
Dependencies are inferred from the claim text.