# US 2020/0402316 A1 · Virtual location selection for virtual content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0402316 A1
- Document ID: US20200402316A1
- Status: Published application
- Kind: A1
- Application number: 16/909,489
- Filed: 2020-06-23
- Published: 2020-12-24
- Earliest claimed: 2019-06-24
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Silas Warren; Omar Khan; Samuel A. Miller; Tushar Arora
- Web page: https://patentgrep.com/patent/US20200402316A1

## CPC

- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G02B 2027/014: {comprising information/image processing systems}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for placing content in an augmented reality system. A notification is received regarding availability of new content to display in the augmented reality system. A confirmation is received that indicates acceptance of the new content. Three dimensional information that describes the physical environment is provided, to an external computing device, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content. Location information is received, from the external computing device, that indicates the assigned location. A display location on a display system of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment is determined, based on the location information. The new content is displayed on the display system at the display location.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving a notification regarding availability of new content to display in an augmented reality system, wherein the augmented reality system is configured to present content on a display system so that the content appears to a user to be affixed at an assigned location in a physical environment of the user;
receiving a confirmation input that indicates acceptance of the new content;
in response to receiving the confirmation input, providing, to an external computing device external to the augmented reality system, three dimensional information that describes the physical environment, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content;
receiving, from the external computing device, location information that indicates the assigned location in the physical environment for the new content;
determining, based on the location information, a display location on the display system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment; and
displaying the new content on the display system at the display location.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the external computing device is a mobile device.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the notification is received from an external source that is external to the augmented reality system.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the notification is received as a result of an internal determination by the augmented reality system that new content is available.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising displaying the notification on the display system.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, further comprising removing the notification from the display system in response to receiving the confirmation input.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining candidate assigned locations in the physical environment for the new content;
wherein the three dimensional information provided to the external computing device includes three dimensional information for the candidate assigned locations.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein determining the three dimensional information comprises:
determining a current perspective of the user as seen through the display system; and
generating the three dimensional information based on the current perspective.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, further comprising:
determining that the current perspective of the user has changed to a new perspective;
determining updated three dimensional information based on the new perspective; and
providing the updated three dimensional information to the external computing device.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the three dimensional information corresponds to a static representation of the physical environment of the user.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining existing content currently being displayed by the display system; and
determining assigned locations for the existing content;
wherein the three dimensional information provided to the external computing device includes assigned location information for the existing content.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, further comprising:
receiving, from the external computing device, an updated assigned location for a first existing content item;
determining, based on the updated assigned location, an updated display location on the display system at which to display the first existing content item so that the first existing content item appears to the user to be displayed as an updated overlay at the updated assigned location in the physical environment; and
displaying the first existing content item on the display system at the updated display location.

### Claim 13

An augmented reality system, comprising:
a frame structure comprising a display system configured to display content so that the content appears to a user to be affixed at an assigned location in a physical environment of the user; and
a processor coupled to the frame structure, the processor configured to:
receive a notification regarding availability of new content to display on the display system;
receive a confirmation input that indicates acceptance of the new content;
in response to receiving the confirmation input, provide, to an external computing device external to the augmented reality system, three dimensional information that describes the physical environment, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content;
receive, from the external computing device, location information that indicates the assigned location in the physical environment for the new content;
determine, based on the location information, a display location on the display system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment; and
display the new content on the display system at the display location.

### Claim 14 (depends on 13)

The augmented reality system of claim 13, wherein the external computing device is a mobile device.

### Claim 15 (depends on 13)

The augmented reality system of claim 13, wherein the notification is received from an external source that is external to the augmented reality system.

### Claim 16 (depends on 13)

The augmented reality system of claim 13, wherein the notification is received as a result of an internal determination by the augmented reality system that new content is available.

### Claim 17

A non-transitory computer-readable storage medium comprising instructions, which, when executed by one or more computer processors, cause the one or more computer processors to perform operations comprising:
receiving a notification regarding availability of new content to display in an augmented reality system, wherein the augmented reality system is configured to present content on a display system so that the content appears to a user to be affixed at an assigned location in a physical environment of the user;
receiving a confirmation input that indicates acceptance of the new content;
in response to receiving the confirmation input, providing, to an external computing device external to the augmented reality system, three dimensional information that describes the physical environment, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content;
receiving, from the external computing device, location information that indicates the assigned location in the physical environment for the new content;
determining, based on the location information, a display location on the display system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment; and
displaying the new content on the display system at the display location.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein the external computing device is a mobile device.

### Claim 19 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein the notification is received from an external source that is external to the augmented reality system.

### Claim 20 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein the notification is received as a result of an internal determination by the augmented reality system that new content is available.
