# US 2018/0025538 A1 · Labeling for Three-Dimensional Occluded Shapes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025538 A1
- Document ID: US20180025538A1
- Status: Published application
- Kind: A1
- Application number: 15/722,679
- Filed: 2017-10-02
- Published: 2018-01-25
- Earliest claimed: 2014-12-23
- Assignees: Google Inc.
- Applicants: Google Inc.
- Inventors: Jonah Jones
- Web page: https://patentgrep.com/patent/US20180025538A1

## CPC

- G06T 17/05: Geographic models
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 2219/004: Annotating, labelling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods for displaying labels in conjunction with geographic imagery provided, for instance, by a geographic information system, such as a mapping service or a virtual globe application are provided. Candidate positions for displaying labels in conjunction with geographic imagery can be determined based at least in part on a virtual camera viewpoint. The candidate positions can be associated with non-occluded points on three-dimensional models corresponding to the labels. Adjusted positions for labels can be determined form the plurality of candidate positions. The labels can be provided for display in conjunction with the geographic imagery at the adjusted positions.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A computer-implemented method for displaying a two-dimensional view of a geographic area from a virtual camera viewpoint, the method comprising:
receiving, by a computing system, data indicative of a request to view two-dimensional geographic imagery of a geographic area from a virtual camera viewpoint;
identifying, by the computing system, a label for each of two or more points of interest in the two-dimensional geographic imagery, each label having an initial position in the two-dimensional geographic imagery corresponding to a location of the respective point of interest;
displaying, by the computing system, a three-dimensional view of the geographic imagery from the virtual camera viewpoint, on a display device, by rendering one or more three-dimensional models corresponding to the two-dimensional geographic imagery;
identifying, by the computing system, a plurality of candidate positions on an edge of the one or more three-dimensional models, the plurality of candidate positions having a direct line of sight from the virtual camera viewpoint;
determining, by the computing system, an adjusted position for each label based at least in part on a distance between the initial position of the label in the two-dimensional geographic imagery and each of the plurality of candidate positions; and
displaying, by the computing system, each label at the adjusted position in the three-dimensional view of the geographic imagery from the virtual camera viewpoint, on the display device.

### Claim 22 (depends on 21)

The computer-implemented method of claim 21, wherein the one or more three-dimensional models are representative of one or more buildings.

### Claim 23 (depends on 21)

The computer-implemented method of claim 21, wherein identifying the plurality of candidate positions comprises:
accessing, by the computing system, the one or more three-dimensional models;
identifying, by the computing system, a plurality of candidate points on the one or more three-dimensional models;
determining, by the computing system, a plurality of non-occluded points from the plurality of candidate points based at least in part on the virtual camera viewpoint; and
identifying, by the computing system, the plurality of non-occluded points as the plurality of candidate points.

### Claim 24 (depends on 23)

The computer-implemented method of claim 23, wherein the plurality of non-occluded points are determined from a wireframe representation of the one or more three-dimensional models.

### Claim 25 (depends on 24)

The computer-implemented method of claim 24, wherein the plurality of non-occluded points include at least one point located on an edge of a top surface of the wireframe representation, and at least one point located on an edge of a bottom surface of the wireframe representation.

### Claim 26 (depends on 21)

The computer-implemented method of claim 21, wherein the adjusted position is determined as the closest candidate position to the initial position of each label.

### Claim 27 (depends on 21)

The computer-implemented method of claim 21, wherein determining the adjusted position for each label comprises:
accessing, by the computing system, a three-dimensional model associated with a point of interest that corresponds to the label;
determining, by the computing system, a candidate position from the plurality of candidate positions as the adjusted position, wherein the candidate position is on an edge of the three-dimensional model associated with the point of interest that corresponds to the label.

### Claim 28 (depends on 21)

The computer-implemented method of claim 21, wherein determining the adjusted position for each label comprises:
accessing, by the computing system, a three-dimensional model associated with a point of interest that corresponds to the label;
determining, by the computing system, the adjusted position as the initial position of the label when each of a first and second candidate point on an edge of a top surface and a bottom surface of the three-dimensional model, respectively, that are closest to the initial position of the label, are occluded from the virtual camera viewpoint.

### Claim 29 (depends on 28)

The computer-implemented method of claim 28, wherein displaying each label at the adjusted position comprises:
displaying, by the computing system, the label with indicia indicative of occlusion.

### Claim 30 (depends on 21)

The computer-implemented method of claim 21, wherein each label comprises a text annotation.

### Claim 31

A computer system, comprising:
one or more processors; and
one or more non-transitory computer-readable media that, when executed by the one or more processors, cause the computer system to perform operations, the operations comprising:
receiving data indicative of a request to view two-dimensional geographic imagery of a geographic area from a virtual camera viewpoint;
identifying a label for each of two or more points of interest, each label having an initial position in the two-dimensional geographic imagery corresponding to a location of a respective point of interest,
displaying a three-dimensional view of the geographic imagery from the virtual camera viewpoint on a display device, by rendering one or more three-dimensional models corresponding to the two-dimensional geographic imagery;
identifying a plurality of candidate positions on an edge of the one or more three-dimensional models, the plurality of candidate positions having a direct line of sight from the virtual camera viewpoint;
determining an adjusted position for each label based at least in part on a distance between the initial position of the label in the two-dimensional geographic imagery and each of the plurality of candidate positions; and
displaying each label at the adjusted position in the three-dimensional view of the geographic imagery from the virtual camera viewpoint on the display device.

### Claim 32 (depends on 31)

The computer-implemented method of claim 31, wherein the one or more three-dimensional models are representative of a building.

### Claim 33 (depends on 31)

The computer-implemented method of claim 31, wherein identifying the plurality of candidate positions comprises:
accessing the one or more three-dimensional models;
identifying a plurality of candidate points on the one or more three-dimensional models;
determining a plurality of non-occluded points from the plurality of candidate points based at least in part on the virtual camera viewpoint; and
identifying the plurality of non-occluded points as the plurality of candidate points.

### Claim 34 (depends on 33)

The computer-implemented method of claim 33, wherein the plurality of non-occluded points are determined from a wireframe representation of the one or more three-dimensional models.

### Claim 35 (depends on 34)

The computer-implemented method of claim 34, wherein the plurality of non-occluded points include at least one point located on an edge of a top surface of the wireframe representation, and at least one point located on an edge of a bottom surface of the wireframe representation.

### Claim 36 (depends on 31)

The computer-implemented method of claim 31, wherein the adjusted position is determined as the closest candidate position to the initial position of each label.

### Claim 37 (depends on 31)

The computer-implemented method of claim 31, wherein determining the adjusted position for each label comprises:
identifying a three-dimensional model from the one or more three-dimensional models, the three-dimensional model associated with a point of interest that corresponds to the label;
determining a candidate position from the plurality of candidate positions as the adjusted position, wherein the candidate position is on an edge of the three-dimensional model associated with the point of interest that corresponds to the label.

### Claim 38 (depends on 31)

The computer-implemented method of claim 31, wherein determining the adjusted position for each label comprises:
determining the adjusted position as the initial position of the label when each of a first and second candidate point on an edge of a top surface and a bottom surface of the three-dimensional model, respectively, that are closest to the initial position of the label, are occluded from the virtual camera viewpoint.

### Claim 39 (depends on 38)

The computer-implemented method of claim 38, wherein displaying each label at the adjusted position comprises:
displaying the label with indicia indicative of occlusion.

### Claim 40 (depends on 31)

The computer-implemented method of claim 31, wherein each label comprises a text annotation.
