Using image content to facilitate navigation in panoramic image data
AssigneeGoogle Inc.
InventorsJiajun Zhu, Daniel Filip, Luc Vincent
Life of this patent
Estimating the term…
Abstract
The present invention relates to using image content to facilitate navigation in panoramic image data. In an embodiment, a computer-implemented method for navigating in panoramic image data includes: (1) determining an intersection of a ray and a virtual model, wherein the ray extends from a camera viewport of an image and the virtual model comprises a plurality of facade planes; (2) retrieving a panoramic image; (3) orienting the panoramic image to the intersection; and (4) displaying the oriented panoramic image.
Claims16
A computer implemented method for navigating in panoramic image data, comprising:
- (1) creating a three-dimensional virtual model, by one or more computer systems, from contents of a plurality of two-dimensional images, the three-dimensional virtual model including a plurality of façade planes, the creating comprising:
- (a) determining a plurality of pairs of matching features, including a first feature in a first image and a second feature in a second image, such that the first feature matches the second feature, wherein the first and second images are selected from the plurality of two-dimensional images, and
- (b) using the plurality of pairs of matching features to create at least a portion of the three-dimensional model;
- (2) determining an intersection of a ray, extended from a position on a camera viewport of the first image, and the three-dimensional virtual model created in step (1), wherein the position is selected by a user;
- (3) retrieving a panoramic image located according to a location of the intersection determined in step (2);
- (4) orienting the panoramic image retrieved in step (3) to face the intersection;
- and
- (5) displaying the oriented panoramic image oriented in step (4) to the user.
A system for navigating in panoramic image data using a three-dimensional virtual model, wherein the three-dimensional virtual model was created from a plurality of two-dimensional images, comprising:
- a computing device;
- a processing pipeline server that creates a three-dimensional virtual model from a plurality of two-dimensional images, wherein the processing pipeline server comprises:
- a feature matcher that determines a plurality of pairs of matching features, including a first feature in a first image and a second feature in a second image, such that the first feature matches the second feature, wherein the first and second images are selected from the plurality of two-dimensional images, and
- a surface estimator that uses the plurality of pairs of matching features to create at least a portion of the three-dimensional model;
- a server, implemented on the computing device, that includes a navigation controller that determines an intersection of a ray, extended from a position on a camera viewport of the first image, and the three-dimensional virtual model created by the processing pipeline server, wherein the three-dimensional virtual model comprises a plurality of facade planes and the position is selected by a user, retrieves a panoramic image located according to a position of the determined intersection and orients the retrieved panoramic image to face the intersection.
Dependencies are inferred from the claim text.