# US 2018/0321894 A1 · Virtual content displayed with shared anchor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0321894 A1
- Document ID: US20180321894A1
- Status: Published application
- Kind: A1
- Application number: 15/586,721
- Filed: 2017-05-04
- Published: 2018-11-08
- Earliest claimed: 2017-05-04
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Jonathan Gustav PAULOVICH; John COPIC; Karim Audrey LUCCIN; Haley Nicole EISENSHTADT
- Web page: https://patentgrep.com/patent/US20180321894A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G03H 1/2249: {Holobject properties}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0174: {holographic}
- G03H 2001/2252: {Location of the holobject}
- G03H 2226/02: Computing or processing means, e.g. digital signal processor [DSP]
- G03H 2226/04: Transmission or communication means, e.g. internet protocol
- G03H 2226/05: Means for tracking the observer
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00})
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Methods, computing devices and display devices are disclosed for displaying virtual content at a target location that is determined relative to a shared anchor. Image data of a physical environment may be captured. A shared anchor tag may be identified in the image data. Based on identifying the shared anchor tag, shared anchor tag image data may be transmitted to a server. Based at least on data retrieved by the server, a data packet comprising a shared anchor associated with a second display device is received, wherein the shared anchor defines a three-dimensional location in the physical environment. A hologram is displayed at a target location determined relative to the location of the shared anchor.

## Claims

### Claim 1

At a first display device, a method comprising:
capturing image data of a physical environment;
identifying a shared anchor tag in the image data;
transmitting the shared anchor tag image data to a server computing device;
based at least on data retrieved by the server computing device using the shared anchor tag, receiving a data packet comprising a shared anchor that is associated with a second display device, wherein the shared anchor defines a three-dimensional location in the physical environment; and
displaying a hologram at a target location that is determined relative to the location of the shared anchor.

### Claim 2 (depends on 1)

The method of claim 1, wherein the second display device is displaying the hologram at the target location in an orientation relative to the shared anchor, and wherein displaying the hologram further comprises displaying the hologram in the orientation relative to the shared anchor.

### Claim 3 (depends on 2)

The method of claim 2, wherein the second display device is participating in an application session, the method further comprising:
joining the application session; and
receiving display data for the hologram from one or more of the server computing device and the second display device.

### Claim 4 (depends on 1)

The method of claim 1, wherein the data packet comprises tracking information, the method further comprising determining the three dimensional location of the shared anchor using the tracking information.

### Claim 5 (depends on 1)

The method of claim 1, wherein the second display device is displaying the hologram at another location in another physical environment that is outside a field of view of the first display device.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first display device comprises a head-mounted display device comprising an at least partially see-through display.

### Claim 7 (depends on 1)

The method of claim 1, wherein the shared anchor tag is a first shared anchor tag, the method further comprising:
identifying a second shared anchor tag in the image data; and
based at least on identifying the first shared anchor tag before identifying the second shared anchor tag, displaying the hologram at the target location determined relative to the location of the shared anchor.

### Claim 8 (depends on 1)

The method of claim 1, wherein the shared anchor tag is a first shared anchor tag, the method further comprising:
identifying a second shared anchor tag in the image data; and
based at least on determining that the first shared anchor tag is closer to the first display device than the second shared anchor tag, displaying the hologram at the target location determined relative to the location of the shared anchor.

### Claim 9 (depends on 1)

The method of claim 1, wherein the shared anchor tag is a first shared anchor tag, the method further comprising:
identifying a second shared anchor tag in the image data; and
displaying one or more conflict resolution indicators to enable selection of the first shared anchor tag or the second shared anchor tag.

### Claim 10

A computing device for displaying virtual content via a first display device, the computing device comprising:
a processor; and
a memory holding instructions executable by the processor to:
capture image data of a physical environment;
identify a shared anchor tag in the image data;
transmit the shared anchor tag image data to a server computing device;
based at least on data retrieved by the server computing device using the shared anchor tag, receive a data packet comprising a shared anchor that is associated with a second display device, wherein the shared anchor defines a three-dimensional location in the physical environment; and
display a hologram at a target location that is determined relative to the location of the shared anchor.

### Claim 11 (depends on 10)

The computing device of claim 10, wherein the second display device is displaying the hologram at the target location in an orientation relative to the shared anchor, and wherein the instructions are executable to display the hologram in the orientation relative to the shared anchor.

### Claim 12 (depends on 11)

The computing device of claim 11, wherein the second display device is participating in an application session, and the instructions are executable to:
join the application session; and
receive display data for the hologram from one or more of the server computing device and the second display device.

### Claim 13 (depends on 10)

The computing device of claim 10, wherein the data packet comprises tracking information, and the instructions are executable to determine the three-dimensional location of the shared anchor using the tracking information.

### Claim 14 (depends on 10)

The computing device of claim 10, wherein the second display device is displaying the hologram at another location in another physical environment that is outside a field of view of the first display device.

### Claim 15 (depends on 10)

The computing device of claim 10, wherein the first display device comprises a head-mounted display device comprising an at least partially see-through display.

### Claim 16 (depends on 10)

The computing device of claim 10, wherein the shared anchor tag is a first shared anchor tag, and the instructions are executable to:
identify a second shared anchor tag in the image data; and
based at least on identifying the first shared anchor tag before identifying the second shared anchor tag, transmit the first shared anchor tag image data to the server computing device.

### Claim 17 (depends on 10)

The computing device of claim 10, wherein the shared anchor tag is a first shared anchor tag, and the instructions are executable to:
identify a second shared anchor tag in the image data; and
based at least on determining that the first shared anchor tag is closer to the first display device than the second shared anchor tag, transmit the first shared anchor tag image data to the server computing device.

### Claim 18 (depends on 10)

The computing device of claim 10, wherein the shared anchor tag is a first shared anchor tag, and the instructions are executable to:
identify a second shared anchor tag in the image data; and
display one or more conflict resolution indicators to enable selection of the first shared anchor tag or the second shared anchor tag.

### Claim 19

A head-mounted display device, comprising:
an at least partially see-through display;
a processor; and
a memory holding instructions executable by the processor to:
capture image data of a physical environment;
identify a shared anchor tag in the image data;
transmit the shared anchor tag image data to a server computing device;
based at least on data retrieved by the server computing device using the shared anchor tag, receive a data packet comprising a shared anchor that is associated with another display device, wherein the shared anchor defines a three-dimensional location in the physical environment and the other display device is displaying a hologram at a target location that is determined relative to the location of the shared anchor; and
display the hologram at the target location.

### Claim 20 (depends on 19)

The head-mounted display device of claim 19, wherein the other display device is participating in an application session, and the instructions are executable to:
join the application session; and
receive display data for the hologram from one or more of the server computing device and the second display device.