US 8,542,911 B1Granted

Photogrammetry engine for model construction

OwnerCarl Phillip Korobkininventor

Life of this patent

Estimating the term…

Loading patent…

Abstract

A system and methods for accessing 2D digital images and 3D geometric models over a network (preferably the Internet) and transforming and composing that media along with 2D digital image and 3D geometric model media, acquired by other means, into enhanced 2D image and 3D model representations for virtual reality visualization and simulation is disclosed. Digital images and models from a network and other sources are incorporated and manipulated through an interactive graphical user interface. A photogrammetric media processing engine automatically extracts virtual sensor (camera) and geometric models from imagery. Extracted information is used by a reconstruction processor to automatically and realistically compose images and models. A rendering system provides real-time visualization and simulation of the constructed media. A client-server processing model for deployment of the media processing engine system over a network is disclosed.

Claims16

Dependent claims

A computer implemented method of generating remote presentation of products in situ for a user, said computer comprising one or more processor, memory, one or more user input device, one or more data output device, and one or more data storage device, the method comprising the steps of:

(a) prompting the user to acquire a digital image of a space in which a product not of the space is to be viewed in context;
(b) accepting a product representation representing a product for which a three-dimensional geometric model exists or can be created;
(c) determining at least one dimension reference, wherein a dimension reference is a measurement of a distance in the space corresponding to a separation of two points on the digital image;
(d) calculating, from the image, the at least one dimension reference and reference information, camera parameters for a camera in the space from which the image was captured, wherein the camera parameters include at least a camera position and a focal length;
(e) accepting an input of a product location, the product location being a location in the space where the product is to be displayed in situ;
(f) transforming the geometric model of the product not of the space based on at least the camera position and the product location to form a transformed geometric model;
and
(g) combining the transformed geometric model and the digital image to form a modified image of space where the modified image has been modified to show the identified product in situ in the image with a proper proportion and perspective;
wherein said steps are performed on said computer.

6 more elements

A computer system for generating remote presentation of products in situ for a user, said computer system comprising:

one or more processor for performing instructions for:
(a) prompting the user to acquire a digital image of a space in which a product not of the space is to be viewed in context;
(b) prompting the user to select a product from a plurality of products
(c) prompting the user to indicate a product location, the product location being a location in the space where the product is to be displayed in situ;
(d) accepting the selected product representation representing a product for which a three-dimensional geometric model exists or can be created;
(e) calculating, from the image and reference information, camera parameters for a camera in the space from which the image was captured, wherein the camera parameters include at least a camera position and a focal length;
(f) transforming the geometric model of the product not of the space based on at least the camera position and the product location to form a transformed geometric model;
and
(g) combining the transformed geometric model and the digital image to form a modified image of space where the modified image has been modified to show the identified product in situ in the image with a proper proportion and perspective;
and one or more data storage device for storing said instructions.

7 more elements

An electronic commerce merchandise visualization and information system for generating remote presentations of products in situ for a user comprising:

space representation storage for storing a space representation, wherein a space representation comprises at least one digital image of a space in which a product is to be viewed in situ, operable to prompt the user to acquire a digital image of a space in which a product not of the space is to be viewed in context;
product representation storage for storing a product representation, wherein a product representation is at least a product image taken of a three-dimensional product operable to prompt the user to accept a product representation representing a product for which a three-dimensional geometric model exists or can be created;
parameter storage for storing at least one dimension reference, wherein a dimension reference is a measurement of a distance in the space corresponding to a separation of two points on the digital image, operable to determine at least one dimension reference;
a photogrammetric modeling unit operable to calculate from the image, the at least one dimension reference and reference information, camera parameters for a camera in the space from which the image was captured, wherein the camera parameters include at least a camera position and a focal length;
product location storage, wherein a product location is a location in the space where the product is to be displayed in situ, and operable to accept an input of a product location;
a visual reconstruction unit operable to transform the geometric model of the product not of the space based on at least the camera position and the product location to form a transformed geometric model;
and
a rendering unit operable to combine the transformed geometric model and the digital image to form a modified image of space where the modified image has been modified to show the identified product in situ in the image with a proper proportion and perspective.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application: 13/726,490Filed 24 Dec 2012 · continuation
Priority: 26 Jun 1998
Granted: 24 Sep 2013
Term ends: Not estimatedThe source records don’t support an estimate.

Classification3 codes

G06T 17/10
Three-dimensional [3D] modelling for computer graphics: constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
G06T 15/20
Geometric effects: perspective computation
G06T
Image data processing or generation, in general

Family

Application60/090,749Us provisional application · filed 26 Jun 1998
Application09/344,814Parent of this continuation · filed 25 Jun 1999
Application11/168,141Parent of this continuation · filed 27 Jun 2005
US 6,921,293 B2Parent of this continuation · filed 28 Jun 2005
Application12/701,434Parent of this continuation · filed 5 Feb 2010
US 7,720,276 B1Parent of this continuation · filed 18 May 2010
US 8,369,610 B1Parent of this continuation
US 6,912,293 B1Related patent
US 8,542,911 B1This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key