# US 2026/0065590 A1 · Visualization of non-composite oblique imagery scene views using three-dimensional model data for manipulation of annotation feature overlays

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065590 A1
- Document ID: US20260065590A1
- Status: Published application
- Kind: A1
- Application number: 18/824,862
- Filed: 2024-09-04
- Published: 2026-03-05
- Earliest claimed: 2024-09-04
- Assignees: Fnv IP B.V.
- Applicants: Fnv IP B.V.
- Inventors: Justin RICHWAGEN; Guy MEIRON; Azhar IBRAHIM; Michael WERNAU
- Web page: https://patentgrep.com/patent/US20260065590A1

## CPC

- G06T 15/20: Perspective computation
- G06T 17/05: Geographic models
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- G06T 2219/004: Annotating, labelling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Described are systems and techniques for visualization and manipulation of non-composite oblique aerial imagery. Information can be obtained for an annotation feature for overlay on a displayed oblique image with an oblique viewpoint of a scene within a geographic area. Three-dimensional (3D) model data can be obtained for a portion of the geographic area and including 3D information of object surfaces within the scene. A 3D representation of the annotation feature can be generated using the 3D model data and georeferenced coordinates determined for the annotation feature. An oblique projection of the 3D representation of the annotation feature into the oblique viewpoint of the scene can be generated to include portions of the annotation feature unobstructed by the object surfaces within the scene. The oblique projection of the annotation feature can be output as a two-dimensional (2D) overlay on the displayed oblique image.

## Claims

### Claim 1

A method comprising:
obtaining information corresponding to an annotation feature for overlay on a displayed oblique image, wherein the displayed oblique image is included in a plurality of oblique aerial images of a geographic area, and wherein the displayed oblique image is an oblique viewpoint of a scene within the geographic area;
obtaining three-dimensional (3D) model data corresponding to at least a portion of the geographic area, wherein the 3D model data includes 3D information of object surfaces within the scene;
generating a 3D representation of the annotation feature based on the 3D model data and one or more georeferenced coordinates determined for the annotation feature;
obtaining an oblique projection of the 3D representation of the annotation feature into the oblique viewpoint of the scene associated with the displayed oblique image, wherein the oblique projection includes one or more portions of the annotation feature that are unobstructed by the object surfaces within the scene; and
outputting the oblique projection of the 3D representation of the annotation feature as a two-dimensional (2D) overlay on the displayed oblique image.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
obtaining a user input indicative of an updated oblique viewpoint of the scene, wherein the updated oblique viewpoint corresponds to a second oblique image different from the displayed oblique image; and
generating an updated oblique projection of the 3D representation of the annotation feature for the updated oblique viewpoint of the scene.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
outputting the second oblique image and the updated oblique projection of the 3D representation of the annotation feature as a 2D overlay on the second oblique image.

### Claim 4 (depends on 2)

The method of claim 2, wherein generating the updated oblique projection comprises reprojecting the 3D representation of the annotation feature from a 3D space of the 3D model data to a 2D oblique space corresponding to the updated oblique viewpoint of the scene.

### Claim 5 (depends on 1)

The method of claim 1, wherein the oblique viewpoint of the scene is based on an image frame center coordinate of the displayed oblique image and a georeferenced boundary information associated with one or more of the displayed oblique image or the scene within the geographic area.

### Claim 6 (depends on 1)

The method of claim 1, wherein the oblique viewpoint of the scene is based on an orientation angle or heading information of the displayed oblique image.

### Claim 7 (depends on 1)

The method of claim 1, wherein the one or more portions of the annotation feature that are unobstructed by the object surfaces are determined based on intersecting the 3D representation of the annotation feature with the 3D information of the object surfaces within the scene.

### Claim 8 (depends on 7)

The method of claim 7, wherein the one or more portions of the annotation feature that are unobstructed by the object surfaces are further determined based on parameterizing a 3D to 2D projection of the 3D representation of the annotation feature based on orientation angle or heading information included in the oblique viewpoint of the scene.

### Claim 9 (depends on 1)

The method of claim 1, wherein the oblique projection does not include one or more portions of the annotation feature that are obstructed by the object surfaces within the scene.

### Claim 10 (depends on 1)

The method of claim 1, wherein the 3D representation of the annotation feature is generated in a same 3D coordinate system as the 3D model data, based on transforming the one or more georeferenced coordinates to the 3D coordinate system.

### Claim 11 (depends on 1)

The method of claim 1, wherein the oblique projection comprises a 3D-to-2D projection.

### Claim 12 (depends on 1)

The method of claim 1, wherein the 3D model data comprises Digital Surface Model (DSM) 3D data corresponding to one or more objects or elements included within the scene within the geographic area.

### Claim 13 (depends on 1)

The method of claim 1, wherein the 3D model data includes supplemental 3D information indicative of one or more surfaces and corresponding georeferenced coordinates of one or more objects or elements included within the scene within the geographic area.

### Claim 14 (depends on 1)

The method of claim 1, wherein the annotation feature comprises at least one of an annotation point, a line, a polyline, text data, a polygon, or an enclosed area within the scene.

### Claim 15

A system comprising:
one or more processors; and
one or more computer-readable storage media having computer-readable instructions stored thereon, wherein the computer-readable instructions, when executed by the one or more processors, cause the one or more processors to:
obtain information corresponding to an annotation feature for overlay on a displayed oblique image, wherein the displayed oblique image is included in a plurality of oblique aerial images of a geographic area, and wherein the displayed oblique image is an oblique viewpoint of a scene within the geographic area;
obtain three-dimensional (3D) model data corresponding to at least a portion of the geographic area, wherein the 3D model data includes 3D information of object surfaces within the scene;
generate a 3D representation of the annotation feature based on the 3D model data and one or more georeferenced coordinates determined for the annotation feature;
obtain an oblique projection of the 3D representation of the annotation feature into the oblique viewpoint of the scene associated with the displayed oblique image, wherein the oblique projection includes one or more portions of the annotation feature that are unobstructed by the object surfaces within the scene; and
output the oblique projection of the 3D representation of the annotation feature as a two-dimensional (2D) overlay on the displayed oblique image.
