# US 2024/0004458 A1 · Massive simultaneous remote digital presence world

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004458 A1
- Document ID: US20240004458A1
- Status: Published application
- Kind: A1
- Application number: 18/306,387
- Filed: 2023-04-25
- Published: 2024-01-04
- Earliest claimed: 2011-05-06
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Rony Abovitz
- Web page: https://patentgrep.com/patent/US20240004458A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- A63F 2300/10: characterized by input arrangements for converting player-generated signals into game device control signals
- A63F 2300/8082: Virtual reality
- G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
- G09G 2340/125: wherein one of the images is motion video
- G09G 2340/14: Solving problems related to the presentation of information to be displayed
- G09G 2354/00: Aspects of interface with display user
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Various methods and apparatus are described herein for enabling one or more users to interface with virtual or augmented reality environments. An example system includes a computing network having computer servers interconnected through high bandwidth interfaces to gateways for processing data and/or for enabling communication of data between the servers and one or more local user interface devices. The servers include memory, processing circuitry, and software for designing and/or controlling virtual worlds, as well as for storing and processing user data and data provided by other components of the system. One or more virtual worlds may be presented to a user through a user device for the user to experience and interact. A large number of users may each use a device to simultaneously interface with one or more digital worlds by using the device to observe and interact with each other and with objects produced within the digital worlds.

## Claims

### Claim at position 1

1-11. (canceled)

### Claim 12

A system for enabling one or more users to interact with a virtual world, the system comprising:
a wearable user device:
memory;
processing circuitry;
software stored in the memory and executable by the processing circuitry to render at least a portion of the virtual world from virtual world data received, at least in part, from a computer network;
a structure that is attachable to body part of a person;
a display operable to present the virtual world to the user,
a communications interface operable to communicate at least a portion of the virtual world data over a data network; and
a sensing system operable to sense at least one of the user, a physical object, or a physical environment around the user,
wherein the processing circuitry is operable to execute the software to render a change in the virtual world in response to at least one of the sensed user, a sensed physical object, and a sensed physical environment.

### Claim 13 (depends on 12)

The system according to claim 12, wherein the change in the virtual world comprises a virtual object having a predetermined relationship with the sensed user, physical object, or physical environment.

### Claim 14 (depends on 13)

The system according to claim 13, wherein the communications interface is operable to communicate the virtual object to the computer network.

### Claim 15 (depends on 12)

The system according to claim 12, wherein the virtual world is presented in at least one of a two-dimensional format or three-dimensional format.

### Claim 16 (depends on 12)

The system according to claim 12, wherein the user device enables interaction in at least one of an augmented reality mode, a virtual reality mode, or a combination of augmented and virtual reality mode.

### Claim 17 (depends on 12)

The system according to claim 12, wherein the user device further comprises a device for providing a haptic or tactile feedback.

### Claim 18 (depends on 12)

The system according to claim 12, wherein at least a portion of the virtual world data is communicated between a gateway.

### Claim at position 9

19-25. (canceled)

### Claim 26 (depends on 12)

The system according to claim 12, further comprising:
a computer network comprising one or more computer servers, the one or more computer servers comprising memory, processing circuitry, and software stored in the memory and executable by the processing circuitry to process at least a portion of the virtual world data, the computer network operable to transmit the virtual world data to a wearable user device for presentation to a first user.

### Claim 27 (depends on 26)

The system according to claim 26, further comprising:
a gateway operatively coupled to, and distinct from, the wearable user device and the computer network and configured to monitor and regulate an exchange of virtual world data between the wearable user device and the computer network to allow an optimum data processing of the wearable user device, wherein the optimum data processing comprises prioritizing a plurality of renderings, such that processing a rendering of a dynamic virtual object is prioritized over a rendering of a static virtual object and processing a rendering of data in a field of view having less than sixty degrees forward of the angular measurement of the user's pupil is prioritized over a rendering of data outside the field of view, where the plurality of renderings are performed by the gateway device and transmitted to the wearable user device.

### Claim 28 (depends on 26)

The system according to claim 26, wherein the sensing system is connected to the wearable user device and includes a camera positioned to detect an angular measurement of a pupil of an eye of the user.

### Claim 29 (depends on 26)

The system of claim 26, wherein the sensing system is an environment-sensing system coupled to the wearable user device configured to obtain data from the physical environment around a user.

### Claim 30 (depends on 29)

The system of claim 29, wherein the environment-sensing system detects key features of the static physical object external to the user.

### Claim 31 (depends on 30)

The system of claim 30, wherein the computer network receives data from the environment-sensing system to trigger a transmission of the virtual world data to the wearable user device.

### Claim 32 (depends on 12)

The system according to claim 12, wherein the system is configured such that at least a portion of the virtual world changes in response to a change in the virtual world data.

### Claim 33 (depends on 32)

The system according to claim 32, wherein, in conjunction with the virtual world changes in response to a change in the virtual world data, at least a portion of the virtual world data is changed in response to a static physical object external to the user and sensed by the wearable user device.

### Claim 34 (depends on 33)

The system according to claim 33, wherein the static physical object external to the user comprises a mapped object in a physical environment in vicinity of the user.

### Claim 35 (depends on 32)

The system according to claim 32, wherein the change in virtual world data represents rendering at least one of the dynamic virtual object and the static virtual object with the static physical object external to the user according to a predetermined relationship.

### Claim 36 (depends on 12)

The system according to claim 12, wherein the change in virtual world data is presented to a second user device for presentation to a second user according to the predetermined relationship.

### Claim 37 (depends on 12)

The system according to claim 12, wherein the virtual world is operable to be rendered by at least one of the computer servers or the wearable user device.

### Claim 38 (depends on 12)

The system according to claim 12, wherein the virtual world is presented in at least one of a two-dimensional format or three-dimensional format.

### Claim 39 (depends on 12)

The system according to claim 12, wherein the wearable user device is operable to provide an interface for enabling interaction between a user and the virtual world in at least one of an augmented reality mode, a virtual reality mode, or a combination of augmented and virtual reality mode.

### Claim 40 (depends on 12)

The system of claim 12, wherein the a structure that is attachable to body part of a person is configured to be a head-worn structure.
