# US 2016/0260195 A1 · Post capture imagery processing and deployment systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0260195 A1
- Document ID: US20160260195A1
- Status: Published application
- Kind: A1
- Application number: 15/058,958
- Filed: 2016-03-02
- Published: 2016-09-08
- Earliest claimed: 2015-03-02
- Assignees: Aerial Sphere, LLC
- Applicants: Aerial Sphere, LLC
- Inventors: Dennis J. Vegh; John C. Femiani; Michael Katic; Anshuman Razdan
- Web page: https://patentgrep.com/patent/US20160260195A1

## CPC

- G06T 3/18: Image warping, e.g. rearranging pixels individually
- G06F 16/29: Geographical information databases
- G06F 16/50: of still image data
- G06T 3/14: Transformations for image registration, e.g. adjusting or mapping for alignment of images
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A post capture imagery processing system is provided. The system is for use with aerial imagery and includes a server having a processor and a memory and a software application providing instruction to the server to process the captured aerial imagery, such as spherical imagery. The server further includes instructions to geo-rectify the spherical imagery. The geo rectifying of the spherical imagery may include one of use of a third party GIS map to associate corresponding data with the spherical imagery in order to produce a geo-referenced spherical image, or calculate the geo-references by a software application performing particular operations on the server.

## Claims

### Claim 1

A post capture imagery processing system for use with aerial spherical imagery, the system comprising:
a server comprising a memory, a database stored in the memory, and a processor, wherein the database contains data for a spherical image and data for a reference map; and
a computer coupled to the server wherein a user interfaces with the server through the computer, wherein the server is programmed to:
automatically create a non-linear warp from a reference geodetic coordinate system to a pan and tilt coordinates in an equirectangular image;
display the equirectangular image on a display of the computer;
automatically retrieving a georectified location of a point in the equirectanular image in response to receiving a signal from the computer.

### Claim 2 (depends on 1)

The system of claim 1, wherein to automatically create the non-linear warp the server is further programmed to automatically perform a registration process.

### Claim 3 (depends on 2)

The system of claim 2, wherein the registration process is a manual registration process using a thin plate spline warping process.

### Claim 4 (depends on 2)

The system of claim 2, wherein the registration process is an automated registration process.

### Claim 5 (depends on 1)

The system of claim 1, wherein to automatically create the nonlinear warp, the server is further programmed to convert a non-warped geographic map to a WGS84 Geodedic coordinate system.

### Claim 6 (depends on 5)

The system of claim 5, wherein the server is further programmed to convert from the WGS84 Geodedic coordinate system to Earth-Centered-Earth-Fixed coordinate system.

### Claim 7 (depends on 6)

The system of claim 6, wherein the server is further programmed to convert from the Earth-Centered-Earth-Fixed coordinate system to an East-North-Up local coordinate system.

### Claim 8 (depends on 7)

The system of claim 7, wherein the server is further programmed to convert from the East-North-Up local coordinate system to a spherical image, wherein the conversion georectifies the spherical image.

### Claim 9

A method of using a post capture imagery processing system to georectify an aerial spherical image, the method comprising:
storing data for a spherical image and data for a reference map in a database of a server comprising a memory and a processor, wherein the database is stored in the memory;
coupling the server to a computer, wherein a user interfaces with the server through the computer;
automatically creating at the server a non-linear warp from a reference geodetic coordinate system to a pan and tilt coordinates in an equirectangular image;
display at the computer from the server the equirectangular image;
automatically retrieving a georectified location of a point in the equirectanular image by the server in response to receiving a signal from the computer.

### Claim 10 (depends on 9)

The method of claim 9, further comprising performing a registration process at the server.

### Claim 11 (depends on 10)

The method of claim 10, wherein performing the registration process comprises performing a manual registration process using a thin plate spline warping process.

### Claim 12 (depends on 10)

The method of claim 10, wherein performing the registration process comprises performing an automated registration process.

### Claim 13 (depends on 9)

The method of claim 9, wherein automatically creating the non-linear warp further comprises converting a non-warped geographic map to a WGS84 Geodedic coordinate system at the server.

### Claim 14 (depends on 13)

The method of claim 13, further comprising converting from the WGS84 Geodedic coordinate system to Earth-Centered-Earth-Fixed coordinate system at the server.

### Claim 15 (depends on 14)

The method of claim 14, further comprising converting from the Earth-Centered-Earth-Fixed coordinate system to an East-North-Up local coordinate system at the server.

### Claim 16 (depends on 15)

The method of claim 15, further comprising converting from the East-North-Up local coordinate system to a spherical image at the server, wherein the conversion georectifies the spherical image.

### Claim 17

A system providing deployment interface for utilizing georectified aerial spherical imagery, the system comprising:
a server comprising a memory, a database stored in the memory, and a processor, wherein the database contains data for a georectified spherical image and data for a reference map; and
a computer coupled to the server wherein a user interfaces with the server through the computer, wherein the server is programmed to:
automatically send data for a georectified spherical image from the server to the computer to display of the computer the georectified spherical image;
receive a signal from the computer at the server in response to the user selecting a point in the georectified spherical image using the computer;
automatically perform a reverse warp process to determine a true geo location of the selected point; and
automatically displaying at the computer using the deployment interface the true geo location of the point on a reference map in response to the server sending data of the reference map and the true geo location of the point to the computer.

### Claim 18 (depends on 19)

The system of claim 19, wherein to automatically perform a reverse warp, the server is further programmed to create a vector by connecting a center of the georectified spherical image with the point, wherein the vector is represented in the East-North-Up coordinate system.

### Claim 19 (depends on 18)

The system of claim 18, wherein the server is further programmed to transform the selected point to Earth-Centered-Earth-Fixed coordinate system.

### Claim 20 (depends on 19)

The system of claim 19, wherein the server is further programmed to use the vector and project it with a WGS84 ellipsoid representing earth to obtain the spherical image point.

### Claim 21 (depends on 20)

The system of claim 20, wherein the server is further programmed to convert from the East-North-Up local coordinate system to a spherical image, wherein the conversion georectifies the spherical image.

### Claim 22 (depends on 21)

The system of claim 21, wherein the server is further programmed to:
convert from the spherical image to the East-North-Up local coordinate system;
convert from the East-North-Up local coordinate system to the Earth-Centered-Earth-Fixed coordinate system;
convert from the Earth-Centered-Earth-Fixed coordinate system to the WGS84 Geodedic coordinate system to; and
convert the WGS84 Geodedic coordinate system to a non-warped geographic map.
