# US 2022/0019470 A1 · Optimization of Resource Usage in Cross-Reality Sessions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0019470 A1
- Document ID: US20220019470A1
- Status: Published application
- Kind: A1
- Application number: 16/929,586
- Filed: 2020-07-15
- Published: 2022-01-20
- Earliest claimed: 2020-07-15
- Assignees: AT&T Intellectual Property I, L.P.
- Applicants: AT&T Intellectual Property I, L.P.
- Inventors: Yupeng Jia; James Pratt; Eric Zavesky
- Web page: https://patentgrep.com/patent/US20220019470A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 8/65: Updates (security arrangements therefor G06F21/57)
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 9/54: Interprogram communication
- G06F 2209/545: Gui
- G06T 2210/08: Bandwidth reduction
- G06T 2210/36: Level of detail
- H04L 41/40: using virtualisation of network functions or resources, e.g. SDN or NFV entities
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Concepts and technologies are disclosed herein for optimization of resource usage in cross-reality sessions. A computer can receive a request for a cross-reality session, determine entities to be included in the cross-reality session, and optimize resource usage during the cross-reality session. Optimized cross-reality session data can be provided to a device to generate a cross-reality environment that can include the one entity of the entities rendered in the first level of detail. Attention data that can describe interactions in the cross-reality environment can be obtained. The resource usage can be re-optimized based on the attention data. Re-optimizing the resource usage can include determining that the one entity of the entities is to be rendered in a second level of detail that is greater than the first level of detail. An update can be delivered to the device, which can use the update to update the cross-reality environment.

## Claims

### Claim 1

A system comprising:
a processor; and
a memory that stores computer-executable instructions that, when executed by the processor, cause the processor to perform operations comprising
determining entities to be included in a cross-reality session,
optimizing resource usage during the cross-reality session, wherein the resource usage relates to resources comprising network resources and computing resources, and wherein optimizing the resource usage comprises identifying one entity of the entities that is to be rendered in a first level of detail that is less than a maximum level of detail,
providing, to a device, optimized cross-reality session data, wherein the device uses the optimized cross-reality session data to generate a cross-reality environment, and wherein the cross-reality environment includes the one entity of the entities rendered in the first level of detail,
obtaining, from the device, attention data that describes a manipulation of the one entity of the entities within the cross-reality environment,
determining, based on the attention data, that the one entity of the entities is to be rendered in a second level of detail that is greater than the first level of detail, and
delivering, to the device, an update, wherein the device uses the update to update the cross-reality environment, and wherein the cross-reality environment includes the one entity of the entities rendered in the second level of detail.

### Claim 2 (depends on 1)

The system of claim 1, wherein delivering the update further comprises generating the update.

### Claim 3 (depends on 1)

The system of claim 1, wherein the attention data further describes a focus of attention of a user of the device, the focus of attention comprising the one entity of the entities.

### Claim 4 (depends on 1)

The system of claim 1, wherein the device stores a local library that comprises a definition of a material, and wherein delivering the update comprises delivering a reference to the material to the device.

### Claim 5 (depends on 4)

The system of claim 4, wherein the device is configured to receive the update and retrieve the definition from the local library without accessing an external device.

### Claim 6 (depends on 1)

The system of claim 1, wherein optimizing the resource usage comprises:
predicting, based on story data, the computing resources and the networking resources that are to be used to provide the cross-reality session, wherein the story data describes a path of a user during the cross-reality session, and wherein the path defines a first distance between the user and the one entity of the entities in the cross-reality session at a first time and a second distance between the user and the one entity of the entities at a second time;
predicting an availability of the computing resources and the networking resources during the cross-reality session;
predicting an attention of the user during the cross-reality session; and
determining, for the one entity of the entities, a first rendering level for the first time and a second rendering level for the second time, the first rendering level and the second rendering level being based on the story data, and the availability of the computing resources and the networking resources.

### Claim 7 (depends on 1)

The system of claim 1, wherein the computer-executable instructions, when executed by the processor, cause the processor to perform operations further comprising:
receiving feedback from the device, the feedback describing network performance and attention of a user of the device during the cross-reality session; and
updating, based on the feedback, an optimization of the cross-reality session.

### Claim 8 (depends on 1)

The system of claim 1, further comprising cross-reality equipment comprising a cross-reality headset comprising a display, a camera, and a sensory interface, wherein the one entity of the entities is displayed on the display, wherein the manipulation is captured by the camera, and wherein the cross-reality environment comprises an output from the sensory interface.

### Claim 9

A method comprising:
determining, at a computer comprising a processor, entities to be included in a cross-reality session;
optimizing, by the processor, resource usage during the cross-reality session, wherein the resource usage relates to resources comprising network resources and computing resources, and wherein optimizing the resource usage comprises identifying one entity of the entities that is to be rendered in a first level of detail that is less than a maximum level of detail;
providing, by the processor and to a device, optimized cross-reality session data, wherein the device uses the optimized cross-reality session data to generate a cross-reality environment, and wherein the cross-reality environment includes the one entity of the entities rendered in the first level of detail;
obtaining, by the processor and from the device, attention data that describes a manipulation of the one entity of the entities within the cross-reality environment;
determining, based on the attention data and by the processor, that the one entity of the entities is to be rendered in a second level of detail that is greater than the first level of detail; and
delivering, by the processor and to the device, an update, wherein the device uses the update to update the cross-reality environment, and wherein the cross-reality environment includes the one entity of the entities rendered in the second level of detail.

### Claim 10 (depends on 9)

The method of claim 9, wherein the attention data further describes a focus of attention of a user of the device, the focus of attention comprising the one entity of the entities.

### Claim 11 (depends on 9)

The method of claim 9, wherein the device stores a local library that comprises a definition of a material, and wherein delivering the update comprises delivering a reference to the material to the device.

### Claim 12 (depends on 11)

The method of claim 11, wherein the device is configured to receive the update and retrieve the definition from the local library without accessing an external device.

### Claim 13 (depends on 9)

The method of claim 9, wherein optimizing the resource usage comprises:
predicting, based on story data, the computing resources and the networking resources that are to be used to provide the cross-reality session, wherein the story data describes a path of a user during the cross-reality session, and wherein the path defines a first distance between the user and the one entity of the entities in the cross-reality session at a first time and a second distance between the user and the one entity of the entities at a second time;
predicting an availability of the computing resources and the networking resources during the cross-reality session;
predicting an attention of the user during the cross-reality session; and
determining, for the one entity of the entities, a first rendering level for the first time and a second rendering level for the second time, the first rendering level and the second rendering level being based on the story data, and the availability of the computing resources and the networking resources.

### Claim 14 (depends on 9)

The method of claim 9, further comprising:
receiving feedback from the device, the feedback describing network performance and attention of a user of the device during the cross-reality session; and
updating, based on the feedback, an optimization of the cross-reality session.

### Claim 15

A computer storage medium having computer-executable instructions stored thereon that, when executed by a processor, cause the processor to perform operations comprising:
determining entities to be included in a cross-reality session;
optimizing resource usage during the cross-reality session, wherein the resource usage relates to resources comprising network resources and computing resources, and wherein optimizing the resource usage comprises identifying one entity of the entities that is to be rendered in a first level of detail that is less than a maximum level of detail;
providing, to a device, optimized cross-reality session data, wherein the device uses the optimized cross-reality session data to generate a cross-reality environment, and wherein the cross-reality environment includes the one entity of the entities rendered in the first level of detail;
obtaining, from the device, attention data that describes a manipulation of the one entity of the entities within the cross-reality environment;
determining, based on the attention data, that the one entity of the entities is to be rendered in a second level of detail that is greater than the first level of detail; and
delivering, to the device, an update, wherein the device uses the update to update the cross-reality environment, and wherein the cross-reality environment includes the one entity of the entities rendered in the second level of detail.

### Claim 16 (depends on 15)

The computer storage medium of claim 15, wherein the attention data further describes a focus of attention of a user of the device, the focus of attention comprising the one entity of the entities.

### Claim 17 (depends on 15)

The computer storage medium of claim 15, wherein the device stores a local library that comprises a definition of a material, and wherein delivering the update comprises delivering a reference to the material to the device.

### Claim 18 (depends on 17)

The computer storage medium of claim 17, wherein the device is configured to receive the update and retrieve the definition from the local library without accessing an external device.

### Claim 19 (depends on 15)

The computer storage medium of claim 15, wherein optimizing the resource usage comprises:
predicting, based on story data, the computing resources and the networking resources that are to be used to provide the cross-reality session, wherein the story data describes a path of a user during the cross-reality session, and wherein the path defines a first distance between the user and the one entity of the entities in the cross-reality session at a first time and a second distance between the user and the one entity of the entities at a second time;
predicting an availability of the computing resources and the networking resources during the cross-reality session;
predicting an attention of the user during the cross-reality session; and
determining, for the one entity of the entities, a first rendering level for the first time and a second rendering level for the second time, the first rendering level and the second rendering level being based on the story data and the availability of the computing resources and the networking resources.

### Claim 20 (depends on 15)

The computer storage medium of claim 15, wherein the computer-executable instructions, when executed by the processor, cause the processor to perform operations further comprising:
receiving feedback from the device, the feedback describing network performance and attention of a user of the device during the cross-reality session; and
updating, based on the feedback, an optimization of the cross-reality session.
