# US 2019/0172261 A1 · Digital project file presentation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172261 A1
- Document ID: US20190172261A1
- Status: Published application
- Kind: A1
- Application number: 15/833,918
- Filed: 2017-12-06
- Published: 2019-06-06
- Earliest claimed: 2017-12-06
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Gregory L. ALT; Laura K. SUGDEN; Shih-Sang Carnaven CHIU; Maxime OUELLET; Denise NG
- Web page: https://patentgrep.com/patent/US20190172261A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 27/017: {Head mounted}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2219/004: Annotating, labelling
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Examples are disclosed that relate to representing a digital project file. One example provides a computing device comprising a logic device and a storage device holding instructions executable to obtain a digital project file comprising a geometric representation of a real physical space, and a user-created annotation associated with a location in the representation. The instructions are further executable to display a representation of the file in a first rendering format, receive a request to display a representation of the file in a second rendering format in which one or more real surfaces of the real physical space are displayed as a virtual rendering, the one or more real surfaces not being displayed as the virtual rendering the first digital rendering format, and, in response to the request, display the representation of the file in the second format.

## Claims

### Claim 1

A computing device, comprising:
a logic device; and
a storage device holding instructions executable by the logic device to
obtain a digital project file, the digital project file comprising
a geometric representation of a real physical space, and
a user-created annotation associated with a location in the geometric representation of the real physical space;
display a representation of the digital project file in a first digital rendering format;
receive a request to display a representation of the digital project file in a second digital rendering format in which one or more real surfaces of the real physical space are displayed as a virtual rendering, the one or more real surfaces not being displayed as the virtual rendering the first digital rendering format; and
in response to the request, display the representation of the digital project file including the annotation in the second digital rendering format.

### Claim 2 (depends on 1)

The computing device of claim 1, wherein the instructions are executable to display the representation of the digital project file in the first digital rendering format as three-dimensional imagery via a mixed reality head-mounted display device.

### Claim 3 (depends on 1)

The computing device of claim 1, wherein the instructions are executable to display the representation of the digital project file in the second digital rendering format as three-dimensional imagery via a virtual reality head-mounted display device.

### Claim 4 (depends on 1)

The computing device of claim 1, wherein the instructions are executable to display the representation of the digital project file in the second digital rendering format as two-dimensional imagery via a two-dimensional display device.

### Claim 5 (depends on 4)

The computing device of claim 4, wherein the instructions are executable to display the representation of the digital project file in the second digital rendering format as a plan view.

### Claim 6 (depends on 5)

The computing device of claim 5, wherein the plan view comprises a representation of the annotation.

### Claim 7 (depends on 1)

The computing device of claim 1, wherein the digital project file further comprises image data that is spatially associated with the geometric representation of the real physical space, and wherein the one or more real surfaces of the real physical space are displayed using the image data.

### Claim 8 (depends on 1)

The computing device of claim 1, wherein the instructions are executable to display the representation of the digital project file in the second digital rendering format from the perspective of a virtual camera.

### Claim 9 (depends on 1)

The computing device of claim 1, wherein the digital project file further comprises a virtual object associated with a location in the geometric representation of the real physical space, the virtual object being displayable as a mixed reality virtual image.

### Claim 10 (depends on 9)

The computing device of claim 9, wherein the annotation is associated with the virtual object.

### Claim 11 (depends on 1)

The computing device of claim 1, wherein the annotation further comprises a control selectable to output a representation of a voice recording.

### Claim 12 (depends on 11)

The computing device of claim 11, wherein the instructions executable to output the representation of the voice recording are executable to
when the voice recording meets a first condition, playback the voice recording, and
when the voice recording meets a second condition, display a text transcription of the voice recording.

### Claim 13

On a computing device, a method, comprising:
obtaining a digital project file, the digital project file comprising
a geometric representation of a real physical space, and
a user-created annotation associated with a location in the geometric representation of the real physical space;
displaying a representation of the digital project file in a first digital rendering format;
receiving a request to display a representation of the digital project file in a second digital rendering format in which one or more real surfaces of the real physical space are displayed as a virtual rendering, the one or more real surfaces not being displayed as the virtual rendering the first digital rendering format; and
in response to the request, displaying the representation of the digital project file in the second digital rendering format including the annotation, wherein one or more real surfaces of the real physical space are displayed as a virtual rendering in the second digital rendering format and not in the first digital rendering format.

### Claim 14 (depends on 13)

The method of claim 13, wherein the representation of the digital project file in the first digital rendering format is displayed on a see-through display device.

### Claim 15 (depends on 13)

The method of claim 13, wherein the representation of the digital project file in the first digital rendering format is displayed on an opaque display device.

### Claim 16 (depends on 13)

The method of claim 13, wherein the digital project file further comprises image data that is spatially associated with the geometric representation of the real physical space, and wherein the one or more real surfaces of the real physical space are displayed as the virtual rendering using the image data in the second digital rendering format.

### Claim 17 (depends on 13)

The method of claim 13, wherein the annotation further comprises a control selectable to output a representation of a voice recording.

### Claim 18 (depends on 17)

The method of claim 17, wherein outputting the representation of the voice recording comprises,
when the voice recording meets a first condition, playing back the voice recording, and
when the voice recording meets a second condition, displaying a text transcription of the voice recording.

### Claim 19

A computing device, comprising:
a logic device; and
a storage device holding instructions executable by the logic device to
obtain a digital project file, the digital project file comprising
a geometric representation of a real physical space, and
a user-created annotation associated with a location in the geometric representation of the real physical space;
receive a request to display a representation of the digital project file;
based on a first condition, present the annotation in a first annotation format; and
based on a second condition that is different from the first condition, present the annotation in a second annotation format.

### Claim 20 (depends on 19)

The computing device of claim 19, wherein the instructions executable to present the annotation in the first annotation format are executable to playback a voice recording associated with the annotation, and wherein the instructions executable to present the annotation in the second annotation format are executable to display a text transcription of the voice recording.
