# US 2021/0343260 A1 · Synchronization of environments during extended reality experiences

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343260 A1
- Document ID: US20210343260A1
- Status: Published application
- Kind: A1
- Application number: 17/373,717
- Filed: 2021-07-12
- Published: 2021-11-04
- Earliest claimed: 2018-12-27
- Assignees: AT&T Intellectual Property I, L.P.
- Applicants: At&T Intellectual Property I, L.P.
- Inventors: Eric Zavesky; Zhu Liu; David Crawford Gibbon; Behzad Shahraray; Paul Triantafyllou; Tan Xu
- Web page: https://patentgrep.com/patent/US20210343260A1

## CPC

- G09G 5/12: Synchronisation between the display unit and other units, e.g. other display units, video-disc players
- H04L 12/282: {based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204)}
- G06F 3/147: using display panels
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G09G 2354/00: Aspects of interface with display user
- G09G 2370/022: Centralised management of display operation, e.g. in a server instead of locally
- H04L 12/2816: {Controlling appliance services of a home automation network by calling their functionalities (arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station; in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00)}
- H04L 12/66: Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In one example, a method includes monitoring conditions in a real environment in which a user is present, wherein the monitoring is performed by collecting data about the conditions from a plurality of sensors located in the real environment, transmitting the data about the conditions to an extended reality device that is present in the real environment, where the extended reality device is configured to render a virtual environment, interpolating between the real environment and the virtual environment, based at least in part on the conditions, to determine an actual extended reality environment that is being presented to the user, and sending a signal to a device that is located in the real environment, based on the interpolating, wherein the signal instructs the device to take an action that modifies at least one of the conditions in the real environment.

## Claims

### Claim 1

A method comprising:
monitoring, by a processing system, conditions in a real environment in which a user is present, wherein the monitoring is performed by collecting data about the conditions from a plurality of sensors located in the real environment;
transmitting, by the processing system, the data about the conditions to an extended reality device that is present in the real environment, where the extended reality device is configured to render a virtual environment;
interpolating, by the processing system, between the real environment and the virtual environment, based at least in part on the conditions, to determine an actual extended reality environment that is being presented to the user;
identifying, by the processing system, that the user wishes to exit the actual extended reality environment;
determining, by the processing system, a modification to at least one of the conditions to ease a transition of the user from the actual extended reality environment to the real environment, wherein the modification comprises adjusting a speed of a fitness equipment being used by the user over a period of time; and
sending, by the processing system, a first signal to the fitness equipment, based on the interpolating, wherein the first signal instructs the fitness equipment to adjust a speed of the fitness equipment.

### Claim 2 (depends on 1)

The method of claim 1, wherein at least some sensors of the plurality of sensors are integrated into the extended reality device.

### Claim 3 (depends on 1)

The method of claim 1, wherein at least some sensors of the plurality of sensors are integrated into a connected home device.

### Claim 4 (depends on 1)

The method of claim 1, wherein at least some sensors of the plurality of sensors are integrated into a wearable device worn by the user.

### Claim 5 (depends on 1)

The method of claim 1, wherein the virtual environment is initialized based on a stored user preference.

### Claim 6 (depends on 1)

The method of claim 1, wherein the virtual environment is initialized based on knowledge of the real environment inferred from the data about the conditions.

### Claim 7 (depends on 1)

The method of claim 1, wherein the interpolating comprises:
identifying, by the processing system, a target extended reality environment that should be presented to the user; and
determining, by the processing system, a difference between the actual extended reality environment that is being presented to the user and the target extended reality environment that should be presented to the user,
wherein the adjusting the speed of the fitness equipment is expected to minimize the difference.

### Claim 8 (depends on 7)

The method of claim 7, wherein the target extended reality environment is characterized by a predefined set of ideal parameters.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
sending, by the processing system, a second signal to the extended reality device based on the interpolating, wherein the second signal instructs the extended reality device to move a digital object from a first location in the virtual environment to a second location in the virtual environment, wherein a movement of the digital object is expected to further to ease a transition of the user from the actual extended reality environment to the real environment.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
sending, by the processing system, a second signal to a smart thermostat based on the interpolating, wherein the second signal instructs the smart thermostat to adjust a temperature of the real environment, wherein an adjustment of the temperature is expected to further to ease a transition of the user from the actual extended reality environment to the real environment.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
sending, by the processing system, a second signal to a smart lighting system based on the interpolating, wherein the second signal instructs the smart lighting system to adjust a lighting level of the real environment, wherein an adjustment of the lighting level is expected to further to ease a transition of the user from the actual extended reality environment to the real environment.

### Claim 12 (depends on 11)

The method of claim 11, wherein the adjustment to the lighting level of the real environment is made over the period of time.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
sending, by the processing system, a second signal to a smart lighting system based on the interpolating, wherein the second signal instructs the smart lighting system to adjust a location in the real environment in which lighting is provided, wherein an adjustment of the location in the real environment in which the lighting is provided is expected to further to ease a transition of the user from the actual extended reality environment to the real environment.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
sending, by the processing system, a second signal to a smart audio system based on the interpolating, wherein the second signal instructs the smart audio system to adjust a volume level of audio content being played in the real environment, wherein an adjustment of the volume level is expected to further to ease a transition of the user from the actual extended reality environment to the real environment.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
intercepting, by the processing system, an alert from software external to the processing system; and
modulating, by the processing system, a signal containing the alert to minimize an impact of the alert on the actual extended reality environment.

### Claim 16 (depends on 15)

The method of claim 15, wherein the alert is a message received on a phone.

### Claim 17 (depends on 1)

The method of claim 1, wherein the processing system connects to the plurality of sensors via a home gateway.

### Claim 18

A non-transitory computer-readable medium storing instructions which, when executed by a processor, cause the processor to perform operations, the operations comprising:
monitoring conditions in a real environment in which a user is present, wherein the monitoring is performed by collecting data about the conditions from a plurality of sensors located in the real environment;
transmitting the data about the conditions to an extended reality device that is present in the real environment, where the extended reality device is configured to render a virtual environment;
interpolating between the real environment and the virtual environment, based at least in part on the conditions, to determine an actual extended reality environment that is being presented to the user;
identifying that the user wishes to exit the actual extended reality environment;
determining a modification to at least one of the conditions to ease a transition of the user from the actual extended reality environment to the real environment, wherein the modification comprises adjusting a speed of a fitness equipment being used by the user over a period of time; and
sending a first signal to the fitness equipment, based on the interpolating, wherein the first signal instructs the fitness equipment to adjust a speed of the fitness equipment.

### Claim 19

A device comprising:
a processor; and
a computer-readable medium storing instructions which, when executed by the processor, cause the processor to perform operations, the operations comprising:
monitoring conditions in a real environment in which a user is present, wherein the monitoring is performed by collecting data about the conditions from a plurality of sensors located in the real environment;
transmitting the data about the conditions to an extended reality device that is present in the real environment, where the extended reality device is configured to render a virtual environment;
interpolating between the real environment and the virtual environment, based at least in part on the conditions, to determine an actual extended reality environment that is being presented to the user;
identifying that the user wishes to exit the actual extended reality environment;
determining a modification to at least one of the conditions to ease a transition of the user from the actual extended reality environment to the real environment, wherein the modification comprises adjusting a speed of a fitness equipment being used by the user over a period of time; and
sending a first signal to the fitness equipment, based on the interpolating, wherein the first signal instructs the fitness equipment to adjust a speed of the fitness equipment.

### Claim 20 (depends on 19)

The device of claim 19, wherein the interpolating comprises:
identifying a target extended reality environment that should be presented to the user; and
determining a difference between the actual extended reality environment that is being presented to the user and the target extended reality environment that should be presented to the user,
wherein the adjusting the speed of the fitness equipment is expected to minimize the difference.
