# US 2008/0279447 A1 · Computational Solution Of A Building Of Three Dimensional Virtual Models From Aerial Photographs

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0279447 A1
- Document ID: US20080279447A1
- Status: Published application
- Kind: A1
- Application number: 11/576,150
- Filed: 2005-10-16
- Published: 2008-11-13
- Earliest claimed: 2004-10-15
- Assignees: Ofek Aerial Photography International Ltd.
- Inventors: Ilan Friedlander; Haim Shoham
- Web page: https://patentgrep.com/patent/US20080279447A1

## CPC

- G01C 11/06: by comparison of two or more pictures of the same area
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/30184: Infrastructure
- G06T 2207/30244: Camera pose
- G06T 2210/04: Architectural design, interior design
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method for processing in a computer a plurality of digital images stored in the computer. The digital images are from respective photographs (301) of a geographic region. The photographs were taken from different directions. The method includes displaying the images (311) and upon selecting an image point in an oblique image, synchronizing a corresponding image point in the digital images so that the selected image point in the first image and the corresponding synchronized image point in other images have substantially identical world coordinates. The method is useful for performing a geographic measurement (319) on an oblique by selecting an image ground point below a first image point; calculating world coordinates in a vertical line segment which extends vertically from the image ground, and upon selecting the first image point on the vertical line segment, calculating world coordinates at the first image point based on the world coordinate in the vertical line segment.

## Claims

### Claim 1

A method for processing in a computer a plurality of digital images stored in the computer, the digital images being derived from a plurality of respective photographs of a geographic region, wherein the photographs were photographed from a plurality of directions, the method comprising the steps of:
(a) displaying a first image of said digital images, said first image corresponding to a first photograph of the photographs; wherein said first photograph was photographed at an oblique angle;
(b) simultaneously displaying at least one other of the digital images corresponding to at least one other of the photographs; and
(c) upon selecting an image point in said first image, synchronizing a corresponding image point in at least one other of the digital images, wherein said selected image point in said first image and said corresponding synchronized image point in said at least one other image have substantially identical world coordinates.

### Claim 2 (depends on 1)

The method, according to claim 1, further comprising the step of, prior to said selecting and said synchronizing, for at least one of the respective digital images:
(d) calculating camera coordinates of said at least one photograph based on at least three control points in said at least one respective digital image, wherein geographic coordinates of said at least three control points are previously known.

### Claim 3 (depends on 1)

The method, according to claim 1, further comprising the step of:
(d) simultaneously calculating said world coordinates for said image point and said corresponding image point.

### Claim 4 (depends on 1)

The method, according to claim 1, further comprising the step of:
(d) creating an exportable object by selecting at least one other image point in at least one of said displayed digital images.

### Claim 5 (depends on 1)

The method, according to claim 1, wherein said selecting and said synchronizing include the step of iteratively estimating geographic coordinates of said selected image point, wherein an estimated elevation value is received from a digital elevation model of the region based on said estimated geographic coordinates, wherein said digital elevation model is previously stored in memory of the computer, wherein respective camera coordinates of said first photograph and said at least one other photograph are previously determined.

### Claim 6 (depends on 1)

The method, according to claim 1, further comprising the step of:
(d) storing a raster digital elevation model in memory of said computer, wherein upon inputting any geographic coordinates to said raster digital elevation model, said raster digital elevation model returns a corresponding elevation value.

### Claim 7 (depends on 6)

The method, according to claim 6, further comprising the steps of, prior to said selecting and said synchronizing, for at least one of the digital images and at least one of the respective photographs:
(e) selecting at least three control points in said at least one digital image, wherein respective geographic coordinates of said at least three control points are previously determined and respective elevation values are obtained from said raster digital elevation model; and
(f) calculating camera coordinates of the camera which photographed said at least one photograph based on said at least three control points.

### Claim 8 (depends on 1)

The method, according to claim 1, further comprising the steps of:
(f) determining a photograph direction of at least one of the digital images, wherein said photograph direction is substantially determined by a vector between a camera position of said at least one digital image to said selected image point; and
(e) choosing from the plurality of digital images at least one of the digital images wherein said choosing is based on comparing a geographic direction to said photograph direction.

### Claim 9 (depends on 1)

The method, according to claim 1, further comprising the step of:
(d) performing a measurement in at least one of said displayed images between a first image point and a second image point, wherein said performing includes the sub-steps of:
(i) selecting an image ground point below said first image point;
(ii) calculating at least one world coordinate in a vertical line segment, wherein said vertical line segment extends vertically from said image ground point; and
(iii) upon selecting said first image point on said vertical line segment, calculating at least one world coordinate at said first image point based on said at least one world coordinate in said vertical line segment.

### Claim 10 (depends on 9)

The method, according to claim 9, wherein said measurement is a horizontal distance measurement, said performing further includes the sub step of:
(iv) upon selecting said second image point, calculating geographic coordinates of said second image point.

### Claim 11 (depends on 9)

The method, according to claim 9, wherein said measurement is a vertical distance measurement, said performing further includes the sub step of:
(iv) upon selecting said second image point, calculating an elevation of said second image point.

### Claim 12 (depends on 1)

The method, according to claim 1, wherein said selected image point is on a three dimensional entity at least partially visible in said first image, wherein said displaying and said simultaneously displaying show a plurality of different views from different directions of said three dimensional entity, the method further comprising the step of:
(d) selecting in at least one of said displayed images a plurality of other image points on said three dimensional entity, thereby synchronizing said other image points in said at least one displayed image, and displaying a three dimensional object over said three dimensional entity.

### Claim 13

A method for performing a measurement related to an image point in a digital image using a computer which stores and displays the digital image, the digital image being derived from a photograph taken at an oblique angle, the method comprising the steps of:
(a) selecting an image ground point below said first image point;
(b) calculating at least one world coordinate in a vertical line segment, wherein said vertical line segment extends vertically from said image ground point; and
(c) upon selecting said first image point on said vertical line segment, calculating at least one world coordinate at said first image point based on said at least one world coordinate in said vertical line segment.

### Claim 14 (depends on 13)

The method, according to claim 13, further comprising the step of:
(d) displaying said vertical line segment over said one displayed image.

### Claim 15 (depends on 13)

The method, according to claim 13, wherein said calculating includes iteratively estimating geographic coordinates, wherein an estimated elevation value is received from a digital elevation model based on said estimated geographic coordinates, wherein said digital elevation model is previously stored in memory of the computer, wherein respective camera coordinates of said photograph are previously determined.

### Claim 16 (depends on 13)

The method, according to claim 13, further comprising the step of
(d) upon selecting a second image point related to the measurement, calculating at least one world coordinate of said second image point.

### Claim 17

A method for building three dimensional models in a computer, wherein a plurality of digital images are stored in the computer, the digital images being derived from a plurality of respective photographs of a geographic region, wherein the photographs were photographed from a plurality of directions, the method comprising the steps of:
(a) choosing from the plurality of stored digital images a plurality of displayed digital images and simultaneously displaying said displayed digital images each including at least a partial view from a different direction of a three dimensional entity;
(b) selecting in at least one of said displayed digital images a plurality of image points on said three dimensional entity, thereby synchronizing other image points in at least one other said displayed digital image, and thereby displaying a three dimensional object.

### Claim 18 (depends on 17)

The method, according to claim 17, wherein said image points include a plurality of vertices of a plurality of facades of said three dimensional object, further comprising the step of:
(c) building said three dimensional object while preserving connectivity of at least two said facades displayed in at least two said displayed digital images.

### Claim 19 (depends on 17)

The method, according to claim 17, wherein said image points include a plurality of vertices of a plurality of facades of said three dimensional entity, further comprising the step of:
(c) cropping said facades as respective polygons with said vertices, by calculating at least one world coordinate respectively of said vertices;
(d) pasting at least one said facade onto said three dimensional object, thereby incorporating said facade in said three dimensional object.

### Claim 20 (depends on 17)

The method, according to claim 17, further comprising the steps of:
(c) exporting said three dimensional object to selectably either a new display window or another application of the computer.

### Claim 21 (depends on 17)

The method, according to claim 17, wherein for at least one said image point, further comprising the steps of:
(c) selecting an image ground point below said at least one image point;
(d) calculating at least one world coordinate in a vertical line segment, wherein said vertical line segment extends vertically from said image ground point; and
(e) upon selecting said at least one image point on said vertical line segment, calculating at least one world coordinate at said at least one image point based on said at least one world coordinate in said vertical line segment.

### Claim 22 (depends on 17)

The method, according to claim 17, wherein for at least one said image point, further comprising the step of:
(c) iteratively estimating geographic coordinates of said at least one image point, wherein an estimated elevation value is received from a digital elevation model of the region based on said estimated geographic coordinates, wherein said digital elevation model is previously stored in memory of the computer, wherein respective camera coordinates of said photographs are previously determined.

### Claim 23

A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform a method for processing in a computer a plurality of digital images stored in the computer, the digital images being derived from a plurality of respective photographs of a geographic region, wherein the photographs were photographed from a plurality of directions, the method comprising the steps of:
(a) displaying a first image of said digital images, said first image corresponding to a first photograph of the photographs; wherein said first photograph was photographed at an oblique angle;
(b) simultaneously displaying at least one other of the digital images corresponding to at least one other of the photographs; and
(c) upon selecting an image point in said first image, synchronizing a corresponding image point in at least one other of the digital images, wherein said selected image point in said first image and said corresponding synchronized image point in said at least one other image have substantially identical world coordinates.

### Claim 24

A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform a method, for performing a measurement related to an image point in a digital image using a computer which stores and displays the digital image, the digital image being derived from a photograph taken at an oblique angle, the method comprising the steps of:
(a) selecting an image ground point below said first image point;
(b) calculating at least one world coordinate in a vertical line segment, wherein said vertical line segment extends vertically from said image ground point; and
(c) upon selecting said first image point on said vertical line segment, calculating at least one world coordinate at said first image point based on said at least one world coordinate in said vertical line segment.

### Claim 25

A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform a method for building three dimensional models in a computer, wherein a plurality of digital images are stored in the computer, the digital images being derived from a plurality of respective photographs of a geographic region, wherein the photographs were photographed from a plurality of directions, the method comprising the steps of:
(a) choosing from the plurality of stored digital images a plurality of displayed digital images and simultaneously displaying said displayed digital images each including at least a partial view from a different direction of a three dimensional entity;
(b) selecting in at least one of said displayed digital images a plurality of image points on said three dimensional entity, thereby synchronizing other image points in at least one other said displayed digital image, and thereby displaying a three dimensional object.
