# US 2025/0164805 A1 · Systems and methods for augmented reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0164805 A1
- Document ID: US20250164805A1
- Status: Published application
- Kind: A1
- Application number: 19/030,887
- Filed: 2025-01-17
- Published: 2025-05-22
- Earliest claimed: 2017-02-16
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Michael Janusz Woods; Andrew Rabinovich; Richard Leslie Taylor
- Web page: https://patentgrep.com/patent/US20250164805A1

## CPC

- G02B 27/0172: {characterised by optical features}
- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/25: Output arrangements for video game devices
- A63F 13/5255: according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
- G02B 27/017: {Head mounted}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Methods and systems for triggering presentation of virtual content based on sensor information. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergences. The system may monitor information detected via the sensors, and based on the monitored information, trigger access to virtual content identified in the sensor information. Virtual content can be obtained, and presented as augmented reality content via the display system. The system may monitor information detected via the sensors to identify a QR code, or a presence of a wireless beacon. The QR code or wireless beacon can trigger the display system to obtain virtual content for presentation.

## Claims

### Claim 1

A method, performed by a display system that includes a head-mounted augmented reality display device that is worn by a user and that presents virtual content to the user; one or more sensors; and one or more processors, and computer storage media storing instructions that when executed by the display system, cause the display system to perform the method, the method comprising:
obtaining information, detected via the one or more sensors of the display system, and identifying an optical code within a field of view of display system or a wireless transmitter proximate to the display system, wherein the optical code or wireless transmitter trigger access to virtual content;
accessing user profile information associated with the user, the user profile information including customized settings associated with presentation of virtual content, wherein the customized settings are set by the user, and wherein the customized settings include: one or more types of virtual content which are disallowed for presentation to the user, a maximum size associated with presented virtual content, and a maximum number of virtual objects presented at a same time to the user;
estimating a depth of the optical code or the wireless transmitter, the depth representing an estimated distance of the display system to the optical code or wireless transmitter;
obtaining, via the triggered access, virtual content to be presented via the display system, the virtual content being presented as augmented reality content visible within an ambient environment, wherein the ambient environment includes a real-world object which is detectable by the processors via the one or more sensors and is associated with the virtual content, and wherein the obtained virtual content is indicated as being allowable for presentation based on the customized settings;
selecting a depth plane of a plurality of depth planes at which to present the virtual content, the depth plane selected based on the estimated depth of the optical code or the wireless transmitter, and the depth plane corresponding to the estimated depth; and
presenting, via the head-mounted augmented reality display device, the virtual content at the selected depth plane in accordance with the customized settings, wherein the real-world object is an input device, and wherein movement of the real-world object causes corresponding movement of the virtual content as presented at the selected depth plane.

### Claim 2 (depends on 1)

The method of claim 1, wherein a particular sensor of the one or more sensors is a camera.

### Claim 3 (depends on 2)

The method of claim 2, wherein the optical code is a QR code, and wherein triggering access to virtual content comprises:
identifying, based on images obtained via the camera, the QR code; and
determining identifications of one or more network locations encoded in the QR code, wherein the network locations store the virtual content.

### Claim 4 (depends on 2)

The method of claim 2, wherein the optical code is a QR code, and wherein the estimated depth is based on a size associated with the QR code as included in one or more images obtained by the camera.

### Claim 5 (depends on 1)

The method of claim 1, wherein a particular sensor of the one or more sensors is a wireless receiver.

### Claim 6 (depends on 5)

The method of claim 5, wherein triggering access to virtual content comprises:
identifying, based on the wireless receiver, wireless information being provided via the wireless transmitter; and
determining one or more network locations specified in the wireless information, wherein the network locations store the virtual content.

### Claim 7 (depends on 1)

The method of claim 1, wherein triggering access to the virtual content comprises triggering access to a network location, and wherein the network location indicates a server at which the virtual content is stored, or wherein the network location indicates access to the wireless transmitter, and wherein the wireless transmitter stores the virtual content.

### Claim 8 (depends on 1)

The method of claim 1, wherein triggering access comprises:
obtaining identifying information associated with virtual content; and
accessing internal memory, and identifying storage of the virtual content.

### Claim 9 (depends on 8)

The method of claim 8, wherein virtual content is pre-loaded onto the display system based on user account information associated with the user, the user account information indicating virtual content of interest to the user.

### Claim 10 (depends on 9)

The method of claim 9, wherein virtual content is periodically pre-loaded onto the display system, and wherein the display system is pushed virtual content, from one or more outside systems, for storage, or the display system requests virtual content, from the one or more outside systems, to be pre-loaded.

### Claim 11 (depends on 1)

The method of claim 1, wherein the head-mounted augmented reality display device comprises:
a plurality of stacked waveguides forming a display area and providing a view of an ambient environment through the display area, wherein at least some waveguides of the plurality of stacked waveguides output light with different wavefront divergence than other waveguides, each waveguide being associated with a depth plane at which virtual content appears in focus.

### Claim 12 (depends on 11)

The method of claim 11, wherein presenting the virtual content comprises:
selecting a waveguide to output the virtual content; and
presenting, via the selected waveguide, the virtual content.

### Claim 13 (depends on 12)

The method of claim 12, wherein selecting a waveguide comprises selecting the waveguide associated with the selected depth plane.

### Claim 14 (depends on 1)

The method of claim 1, wherein presenting the virtual content comprises:
identifying satisfaction of a trigger, and presenting the virtual content, wherein a trigger comprises a particular action performed by a user.

### Claim 15 (depends on 14)

The method of claim 14, wherein identifying satisfaction of a trigger comprises one or more of: identifying that a particular visual feature is within a field of view of the display system, obtaining particular input via an input device in communication with the display system, or identifying particular movement of the user.

### Claim 16 (depends on 15)

The method of claim 15, wherein identifying satisfaction of a trigger comprises identifying that an arm or hand of a user has performed particular movement.

### Claim 17 (depends on 1)

The method of claim 1, wherein the method further comprises:
updating the estimated depth of the optical code or the wireless transmitter; and
updating selection of a depth plane of the plurality of depth planes at which to present the virtual content.

### Claim 18

A method, performed by an augmented reality display device that is worn by a user and that presents virtual content in an ambient environment of the user, the augmented reality display device including: a plurality of stacked waveguides forming a display area and providing a view of the ambient environment through the display area, wherein at least some waveguides of the plurality of stacked waveguides output light with different wavefront divergence than other waveguides, each waveguide being associated with a depth at which virtual content appears in focus; one or more cameras that obtain images of the ambient environment; and one or more processors, and computer storage media storing instructions that when executed by the augmented reality display device, cause the augmented reality display device to perform the method, the method comprising:
obtaining at least one image of the ambient environment, the at least one image being determined to include a QR code, wherein the ambient environment includes a real-world object which is detectable by the processors via the cameras;
accessing user profile information associated with the user, the user profile information including customized settings associated with presentation of virtual content, wherein the customized settings are set by the user, and wherein the customized settings include: one or more types of virtual content which are disallowed for presentation to the user; a maximum size associated with presented virtual content; and a maximum number of virtual objects presented at a same time to the user;
estimating a depth of the QR code, the depth representing an estimated distance of the augmented reality display device to the QR code;
decoding the QR code, and obtaining an indication of a network location;
providing a request to the network location for virtual content, wherein the virtual content is indicated as being allowable for presentation based on the customized settings;
selecting a waveguide of the plurality of stacked waveguides at which to present virtual content, the selected waveguide being associated with the estimated depth; and
presenting, via the selected waveguide, virtual content received in response to the request in accordance with the customized settings, wherein the real-world object is an input device, and wherein movement of the real-world object causes corresponding movement of the virtual content as presented at a selected depth plane.

### Claim 19 (depends on 18)

The method of claim 18, wherein the method further comprises:
detecting indicia of the QR code in images obtained via the one or more cameras, and
in response to detecting indicia of the QR code in the at least one image, decoding the QR code.

### Claim 20 (depends on 18)

The method of claim 18, wherein presentation of the virtual content causes presentation of a second user as virtual content to the user, such that the second user can appear to be in the ambient environment.

### Claim 21 (depends on 18)

The method of claim 18, wherein the method further comprises:
updating the estimated depth of the QR code; and
updating selection of the waveguide based on the updated estimated depth.

### Claim 22 (depends on 18)

The method of claim 18, wherein the estimated depth is based on a size associated with the QR code included in the at least one image.
