# US 10,121,223 B2 · Post capture imagery processing and deployment systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,121,223 B2
- Document ID: US10121223B2
- Status: Granted
- Kind: B2
- Application number: 15/058,958
- Filed: 2016-03-02
- Published: 2016-09-08
- Granted: 2018-11-06
- Earliest claimed: 2015-03-02
- Assignees: Aerial Sphere, LLC
- Applicants: Aerial Sphere, LLC
- Inventors: Dennis J. Vegh; John C. Femiani; Michael Katic; Anshuman Razdan
- Web page: https://patentgrep.com/patent/US10121223B2

## CPC

- G06T 3/18: Image warping, e.g. rearranging pixels individually
- G06F 16/29: Geographical information databases
- G06F 16/50: of still image data
- G06T 3/14: Transformations for image registration, e.g. adjusting or mapping for alignment of images
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A post capture imagery processing system is provided. The system is for use with aerial imagery and includes a server having a processor and a memory and a software application providing instruction to the server to process the captured aerial imagery, such as spherical imagery. The server further includes instructions to geo-rectify the spherical imagery. The geo rectifying of the spherical imagery may include one of use of a third party GIS map to associate corresponding data with the spherical imagery in order to produce a geo-referenced spherical image, or calculate the geo-references by a software application performing particular operations on the server.

## Claims

### Claim 1

A post capture imagery processing system for use with aerial spherical imagery, the system comprising:
a server comprising a memory, a database stored in the memory, and a processor, wherein the database contains data for a spherical image and data for a reference map; and
a computer coupled to the server wherein a user interfaces with the server through the computer, wherein the server is programmed to:
automatically create a non-linear warp from a reference geodetic coordinate system to a pan and tilt coordinates in an equirectangular image;
display the equirectangular image on a display of the computer;
automatically retrieving a georectified location of a point in the equirectangular image in response to receiving a signal from the computer;
automatically create the nonlinear warp, the server is further programmed to convert a non-warped geographic map to a WGS84 Geodedic coordinate system;
convert from the WGS84 Geodedic coordinate system to Earth-Centered-Earth-Fixed coordinate system;
convert from the Earth-Centered-Earth-Fixed coordinate system to an East-North-Up local coordinate system; and
convert from the East-North-Up local coordinate system to a spherical image, wherein the conversion georectifies the spherical image.

### Claim 2 (depends on 1)

The system of claim 1, wherein to automatically create the non-linear warp the server is further programmed to automatically perform a registration process.

### Claim 3 (depends on 2)

The system of claim 2, wherein the registration process is a manual registration process using a thin plate spline warping process, wherein the system provides a user interface that interactively prompts and displays information to the user to guide the user through the manual registration process.

### Claim 4 (depends on 2)

The system of claim 2, wherein the registration process is an automated registration process.

### Claim 5

A method of using a post capture imagery processing system to georectify an aerial spherical image, the method comprising:
storing data for a spherical image and data for a reference map in a database of a server comprising a memory and a processor, wherein the database is stored in the memory;
coupling the server to a computer, wherein a user interfaces with the server through the computer;
automatically creating at the server a non-linear warp from a reference geodetic coordinate system to a pan and tilt coordinates in an equirectangular image;
display at the computer from the server the equirectangular image;
automatically retrieving a georectified location of a point in the equirectangular image by the server in response to receiving a signal from the computer; wherein automatically creating the non-linear warp further comprises converting a non-warped geographic map to a WGS84 Geodedic coordinate system at the server;
converting from the WGS84 Geodedic coordinate system to Earth-Centered-Earth-Fixed coordinate system at the server;
converting from the Earth-Centered-Earth-Fixed coordinate system to an East-North-Up local coordinate system at the server; and
converting from the East-North-Up local coordinate system to a spherical image at the server, wherein the conversion georectifies the spherical image.

### Claim 6 (depends on 5)

The method of claim 5, further comprising performing a registration process at the server.

### Claim 7 (depends on 6)

The method of claim 6, wherein performing the registration process comprises performing a manual registration process using a thin plate spline warping process, wherein the system provides a user interface that interactively prompts and displays information to the user to guide the user through the manual registration process.

### Claim 8 (depends on 6)

The method of claim 6, wherein performing the registration process comprises performing an automated registration process.