# US 10,769,863 B2 · Annotating three-dimensional displays of a particular view of a 3D model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,769,863 B2
- Document ID: US10769863B2
- Status: Granted
- Kind: B2
- Application number: 16/102,870
- Filed: 2018-08-14
- Published: 2018-12-13
- Granted: 2020-09-08
- Earliest claimed: 2014-08-26
- Assignees: Honeywell International Inc.
- Applicants: Honeywell International Inc.
- Inventors: Henry Chen; Tom Plocher; Jian Geng Du; Liana M. Kiff
- Web page: https://patentgrep.com/patent/US10769863B2

## CPC

- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 17/005: {Tree description, e.g. octree, quadtree}
- G06T 17/05: Geographic models
- G06T 2200/04: involving 3D image data
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2219/004: Annotating, labelling
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Methods, systems, and devices for annotating three-dimensional displays are described herein. One method includes displaying, by a computing device, a particular view of a 3D model of a facility, the 3D model including a plurality of objects, each object associated with a respective annotation, determining a context associated with the 3D model, and displaying a subset of the plurality of annotations associated with a respective subset of the plurality of objects based on the context.

## Claims

### Claim 1

A method for annotating a three-dimensional (3D) display, comprising:
displaying, by a computing device, a particular view of a 3D model of at least a portion of a building, the 3D model including a plurality of objects, each object associated with a respective annotation;
determining a context associated with the 3D model; and
displaying a subset of the plurality of annotations associated with a respective subset of the plurality of objects based on the context.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the context associated with the 3D model includes determining a portion of the plurality of objects visible in the particular view.

### Claim 3 (depends on 1)

The method of claim 1, wherein the 3D model is a 3D model of a facility, and wherein the method includes determining the context associated with the 3D model includes receiving information from a subsystem of a building management system associated with the facility.

### Claim 4 (depends on 3)

The method of claim 3, wherein the method includes determining an abnormal status associated with the subsystem based on the received information, and wherein the subset of the plurality of objects includes at least one object associated with the subsystem.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining the context associated with the 3D model includes receiving an indication, made by a user, associated with a particular portion of the 3D model.

### Claim 6 (depends on 5)

The method of claim 5, wherein the indication is made by an actuation of an input device.

### Claim 7 (depends on 5)

The method of claim 5, wherein the indication is made by an input device remaining within the particular portion of the 3D model for a period of time exceeding a particular time threshold.

### Claim 8 (depends on 1)

The method of claim 1, wherein the method includes:
determining whether a particular object of the plurality of objects is visible in the particular view; and
not displaying an annotation associated with the particular object responsive to a determination that the object is not visible in the particular view.

### Claim 9 (depends on 1)

The method of claim 1, wherein the method includes dimming an annotation of the plurality of annotations not included in the subset of the plurality of annotations associated with the respective subset of the plurality of objects based on the context.

### Claim 10 (depends on 1)

The method of claim 1, wherein the method includes determining a color of a particular object of the subset of the plurality of objects and displaying an annotation associated with the particular object using the color.

### Claim 11

A computing device for annotating a display, comprising:
a memory; and
a processor configured to execute instructions stored on the memory to:
display a particular view of a Building Information Model (BIM), the Building Information Model (BIM) including a plurality of objects, each object associated with a respective annotation;
prioritize the plurality of annotations according to a context associated with the Building Information Model (BIM);
determine a subset of the prioritized plurality of annotations associated with objects visible in the particular view; and
display the subset of the prioritized plurality of annotations such that each annotation of the subset of the prioritized plurality of annotations does not occlude another annotation of the subset of the prioritized plurality of annotations.

### Claim 12 (depends on 11)

The computing device of claim 11, wherein the processor is configured to execute instructions stored on the memory to:
determine a respective occlusion weight for each annotation of the subset of the prioritized plurality of annotations;
sort the subset of the prioritized plurality of annotations according to the respective occlusion weights;
determine an occlusion tree according to an annotation of the subset of the prioritized plurality of annotations having a highest occlusion weight; and
modify a display aspect of an annotation of the subset of the prioritized plurality of annotations not having the highest occlusion weight.

### Claim 13 (depends on 12)

The computing device of claim 12, wherein the instructions to modify the display aspect of the annotation of the subset of the prioritized plurality of annotations not having the highest occlusion weight include instructions to dim the annotation of the subset of the prioritized plurality of annotations not having the highest occlusion weight.

### Claim 14 (depends on 12)

The computing device of claim 12, wherein the instructions to modify a display aspect of the annotation of the subset of the prioritized plurality of annotations not having the highest occlusion weight include instructions to offset the annotation of the subset of the prioritized plurality of annotations not having the highest occlusion weight.

### Claim 15 (depends on 14)

The computing device of claim 14, wherein the instructions to offset the annotation of the subset of the prioritized plurality of annotations not having the highest occlusion weight include instructions to display a line connecting the annotation of the subset of the prioritized plurality of annotations not having the highest occlusion weight with an object associated with the annotation of the subset of the prioritized plurality of annotations not having the highest occlusion weight.

### Claim 16

A non-transitory computer-readable medium having instructions stored thereon executable by a processor to:
cause a display of a particular view of a 3D model that includes at least some building components, the 3D model including a plurality of objects, each object associated with a respective annotation;
determine a respective occlusion weight for each annotation of the plurality of annotations;
sort the plurality of annotations according to the respective occlusion weight;
determine an occlusion tree according to an annotation of the plurality of annotations having a highest occlusion weight;
determine an occluded annotation that is occluded by the annotation of the plurality of annotations having the highest occlusion weight; and
offset the occluded annotation responsive to a determination that offsetting the occluded annotation will not cause the occluded annotation to occlude any other annotation of the plurality of annotations.

### Claim 17 (depends on 16)

The computer-readable medium of claim 16, including instructions to dim the occluded annotation responsive to a determination that offsetting the occluded annotation will cause the occluded annotation to occlude any other annotation of the plurality of annotations.

### Claim 18 (depends on 16)

The computer-readable medium of claim 16, including instructions to offset the occluded annotation in a particular direction determined based, at least in part, on a relationship between a center of the occluded annotation and a center of the annotation having the highest occlusion weight.

### Claim 19 (depends on 16)

The computer-readable medium of claim 16, including instructions to offset the occluded annotation by a particular distance such that a particular space is displayed between the offset occluded annotation and the annotation of the plurality of annotations having the highest occlusion weight.

### Claim 20 (depends on 16)

The computer-readable medium of claim 16, including instructions to display each of the plurality of annotations enclosed in a respective rectangle.
