# US 2018/0025543 A1 · Synthetic Geotagging for Computer-Generated Images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025543 A1
- Document ID: US20180025543A1
- Status: Published application
- Kind: A1
- Application number: 15/213,727
- Filed: 2016-07-19
- Published: 2018-01-25
- Earliest claimed: 2016-07-19
- Assignees: The Boeing Company
- Applicants: The Boeing Company
- Inventors: James J. Troy; Christopher D. Esposito; Vladimir Karakusevic
- Web page: https://patentgrep.com/patent/US20180025543A1

## CPC

- G06T 19/003: {Navigation within 3D models or images}
- G06T 15/20: Perspective computation
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 2219/004: Annotating, labelling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods for constructing and saving files containing computer-generated image data with associated virtual camera location data during 3-D visualization of an object (e.g., an aircraft). The process tags computer-generated images with virtual camera location and settings information selected by the user while navigating a 3-D visualization of an object. The virtual camera location data in the saved image file can be used later as a way to return the viewpoint to the virtual camera location in the 3-D environment from where the image was taken. For example, these tagged images can later be drag-and-dropped onto the display screen while the 3-D visualization application is running to activate the process of retrieving and displaying a previously selected image. Multiple images can be loaded and then used to determine the relative viewpoint offset between images.

## Claims

### Claim 1

A method for adding virtual camera location data to computer-generated images, comprising:
storing digital data representing three-dimensional models of objects in a nontransitory tangible computer-readable storage medium;
opening a three-dimensional visualization application on a computer system;
retrieving digital data representing a three-dimensional model of an object from the nontransitory tangible computer-readable storage medium;
displaying a default image of at least a first portion of the object as pixels on a display device using the three-dimensional visualization application to process the digital data representing the selected three-dimensional model, the default image having a default viewpoint;
navigating from the default viewpoint to a first viewpoint of interest using the three-dimensional visualization application to process the digital data representing the selected three-dimensional model until a first image of a second portion of the object appears on the display device;
selecting the first image of the second portion of the object for storage in the nontransitory tangible computer-readable storage medium;
in response to selection of the first image, constructing a first digital image file containing first digital image data corresponding to the first image and first metadata comprising digital data representing a first location of a virtual camera that captured the first image with the first viewpoint of interest; and
after the first digital image file has been constructed, storing the first digital image file in the nontransitory tangible computer-readable storage medium.

### Claim 2 (depends on 1)

The method as recited in claim 1, further comprising:
navigating from the first viewpoint of interest to a second viewpoint of interest different than the first viewpoint of interest using the three-dimensional visualization application to process the digital data representing the selected three-dimensional model until a second image of a third portion of the object appears on the display device;
selecting the second image of the third portion of the object for storage in the nontransitory tangible computer-readable storage medium;
in response to selection of the second image,
constructing a second digital image file containing second digital image data corresponding to the second image and second metadata comprising digital data representing a second location of the virtual camera that captured the second image with the second viewpoint of interest; and
after the second digital image file has been constructed, storing the second digital image file in the nontransitory tangible computer-readable storage medium.

### Claim 3 (depends on 1)

The method as recited in claim 1, wherein the first metadata is stored in Exchangeable Image File Format.

### Claim 4 (depends on 1)

The method as recited in claim 1, wherein the first metadata comprises x, y and z coordinates of the virtual camera in a frame of reference of the object and a look direction of the virtual camera.

### Claim 5 (depends on 4)

The method as recited in claim 4, wherein the first metadata further comprises a field-of-view of the virtual camera.

### Claim 6 (depends on 2)

The method as recited in claim 2, further comprising computing a position and orientation representation of a relative offset between the first and second viewpoints of interest.

### Claim 7 (depends on 1)

The method as recited in claim 1, further comprising:
retrieving the first digital image file from the nontransitory tangible computer-readable storage medium;
extracting the first metadata from the first digital image file; and
re-creating and displaying the first image of the second portion of the object on a display screen using the three-dimensional visualization application to process three-dimensional model data, the re-created first image having the first viewpoint of interest.

### Claim 8

A system for adding virtual camera location data to computer-generated images, comprising a nontransitory tangible computer-readable storage medium that stores digital data representing a three-dimensional model of an object, an input device, a display device and a computer system, wherein the computer system is configured to perform the following operations:
(a) controlling the display device to display a default image of at least a first portion of the object as pixels using the three-dimensional visualization application to process the digital data representing the three-dimensional model of the object, the default image having a default viewpoint;
(b) controlling the display device to change the default viewpoint using the three-dimensional visualization application to process the digital representing the selected three-dimensional model data in response to movement of the input device by a user, the viewpoint being changed until a first image of a second portion of the object having a first viewpoint of interest different than the default viewpoint is displayed;
(c) constructing a first digital image file containing first digital image data corresponding to the first image and first metadata comprising digital data representing a first location of a virtual camera that captured the first image with the first viewpoint of interest; and
(d) storing the first digital image file in the nontransitory tangible computer-readable storage medium.

### Claim 9 (depends on 8)

The system as recited in claim 8, wherein the computer system is configured to perform operations (a) through (c) in response to user inputs.

### Claim 10 (depends on 8)

The system as recited in claim 8, wherein the computer system is further configured to perform the following operations:
(e) controlling the display device to change the first viewpoint of interest using the three-dimensional visualization application to process the digital data representing the selected three-dimensional model in response to movement of the input device by a user, the viewpoint being changed until a second image of a third portion of the object having a second viewpoint of interest different than the first viewpoint of interest is displayed;
(f) constructing a second digital image file containing second digital image data corresponding to the second image and second metadata comprising digital data representing a second location of a virtual camera that captured the second image with the second viewpoint of interest; and
(g) storing the second digital image file in the nontransitory tangible computer-readable storage medium.

### Claim 11 (depends on 8)

The system as recited in claim 8, wherein the first metadata is stored in Exchangeable Image File Format.

### Claim 12 (depends on 8)

The system as recited in claim 8, wherein the first metadata comprises x, y and z coordinates of the virtual camera in a frame of reference of the object and a look direction of the virtual camera.

### Claim 13 (depends on 12)

The system as recited in claim 12, wherein the first metadata further comprises a field-of-view of the virtual camera.

### Claim 14 (depends on 10)

The system as recited in claim 10, wherein the computer system is further configured to compute an offset matrix representing a relative offset between the first and second viewpoints of interest in response to a user input.

### Claim 15 (depends on 8)

The system as recited in claim 8, wherein the computer system is further configured to perform the following operations:
retrieving the first digital image file from the nontransitory tangible computer-readable storage medium;
extracting the first metadata from the first digital image file; and
re-creating and displaying the first image of the second portion of the object using the three-dimensional visualization application to process three-dimensional model data, the re-created first image having the first viewpoint of interest.

### Claim 16

A method for adding virtual camera location data to computer-generated images, comprising:
displaying a first image having a first viewpoint of interest using a three-dimensional visualization application to process digital data representing a three-dimensional model of an object;
selecting the first image for storage in a nontransitory tangible computer-readable storage medium;
constructing a first digital image file containing first digital image data corresponding to the first image and first metadata comprising digital data representing a first location of a virtual camera that captured the first image with the first viewpoint of interest; and
storing the first digital image file in the nontransitory tangible computer-readable storage medium.

### Claim 17 (depends on 16)

The method as recited in claim 16, further comprising:
navigating from the first viewpoint of interest to a second viewpoint of interest different than the first viewpoint of interest using the three-dimensional visualization application to process the digital data representing the three-dimensional model;
selecting a second image for storage in the nontransitory tangible computer-readable storage medium;
constructing a second digital image file containing second digital image data corresponding to the second image and second metadata comprising digital data representing a second location of the virtual camera that captured the second image with the second viewpoint of interest; and
storing the second digital image file in the nontransitory tangible computer-readable storage medium.

### Claim 18 (depends on 17)

The method as recited in claim 17, further comprising computing a position and orientation representation of a relative offset between the first and second viewpoints of interest.

### Claim 19 (depends on 16)

The method as recited in claim 16, further comprising:
retrieving the first digital image file from the nontransitory tangible computer-readable storage medium;
extracting the first metadata from the first digital image file; and
displaying a re-created first image of a portion of the object using the three-dimensional visualization application to process the digital data representing the three-dimensional model of the object, the re-created first image having the first viewpoint of interest.

### Claim 20 (depends on 16)

The method as recited in claim 16, wherein the first metadata comprises x, y and z coordinates of the virtual camera in a frame of reference of the object and a look direction of the virtual camera.
