# US 2022/0020204 A1 · Virtual-World Simulator

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0020204 A1
- Document ID: US20220020204A1
- Status: Published application
- Kind: A1
- Application number: 16/929,912
- Filed: 2020-07-15
- Published: 2022-01-20
- Earliest claimed: 2020-07-15
- Assignees: Disney Enterprises, Inc.
- Applicants: Disney Enterprises, Inc.
- Inventors: Dane M. Coffey; Evan M. Goldberg; Steven M. Chapman; Daniel L. Baker; Matthew Deuel; Mark R. Mine
- Web page: https://patentgrep.com/patent/US20220020204A1

## CPC

- G06T 15/20: Perspective computation
- G05B 19/4155: characterised by program execution, i.e. part program or machine function execution, e.g. selection of a program
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 15/005: {General purpose rendering architectures}
- G05B 2219/37074: Projection device, monitor, track tool, workpiece form, process on display
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

In one implementation, a virtual-world simulator includes a computing platform having a hardware processor and a memory storing a software code, a tracking system communicatively coupled to the computing platform, and a projection device communicatively coupled to the computing platform. The hardware processor is configured to execute the software code to obtain a map of a geometry of a real-world venue including the virtual-world simulator, to identify one or more virtual effects for display in the real-world venue, and to use the tracking system to track a moving perspective of one of a user in the real-world venue or a camera in the real-world venue. The hardware processor is further configured to execute the software code to control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

## Claims

### Claim 1

A virtual-world simulator in a real-world venue, the virtual-world simulator comprising:
a computing platform including a hardware processor and a memory storing a software code;
a tracking system communicatively coupled to the computing platform; and
a handheld device configured for use by a user in the real-world venue and communicatively coupled to the computing platform;
the hardware processor configured to execute the software code to:
obtain a map of a geometry of the real-world venue;
identify one or more virtual effects for display in the real-world venue;
track, using the tracking system, a moving perspective of one of the user in the real-world venue or a camera in the real-world venue; and
control the handheld device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

### Claim 2 (depends on 1)

The virtual-world simulator of claim 1, wherein the map is a three-dimensional (3D) map of the geometry of the real-world venue.

### Claim 3 (depends on 1)

The virtual-world simulator of claim 1, further comprising a mapping device communicatively coupled to the computing platform, wherein the hardware processor is further configured to execute the software code to generate, using the mapping device, the map of the geometry of the real-world venue.

### Claim 4 (depends on 3)

The virtual-world simulator of claim 3, wherein the mapping device comprises at least one of a mapping camera or a light detection and ranging (LIDAR) device.

### Claim 5 (depends on 1)

The virtual-world simulator of claim 1, wherein the map of the geometry of the real-world venue comprises a three-dimensional (3D) map of the geometry of the real-world venue.

### Claim 6 (depends on 1)

The virtual-world simulator of claim 1, wherein the tracked moving perspective is the moving perspective of the user in the real-world venue, and wherein the hardware processor is further configured to execute the software code to:
track a second moving perspective of a second user in the real-world venue; and
control the handheld device to further simulate the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the second moving perspective of the second user while concurrently simulating the virtual-world from the present vantage point of the moving perspective of the user.

### Claim 7 (depends on 1)

The virtual-world simulator of claim 1, wherein the tracked moving perspective is the moving perspective of the user in the real-world venue, and wherein the hardware processor is further configured to execute the software code to:
detect a user device utilized by a second user in the real-world venue;
track a second moving perspective of the second user in the real-world venue;
generate a simulation of the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the second moving perspective of the second user; and
transmit the generated simulation to the user device for display to the second user while concurrently simulating the virtual-world from the present vantage point of the moving perspective of the user.

### Claim 8 (depends on 1)

The virtual-world simulator of claim 1, wherein the tracked moving perspective is the moving perspective of the camera, and wherein the camera is configured to obtain an image of the user in the simulated virtual-world.

### Claim 9 (depends on 1)

The virtual-world simulator of claim 1, wherein the handheld device is a projection device.

### Claim 10

(canceled)

### Claim 11

A method for use by a virtual-world simulator in a real-world venue, the virtual-world simulator including a computing platform having a hardware processor and a memory storing a software code, the computing platform communicatively coupled to a tracking system and a handheld device configured for use by a user in the real-world venue, the method comprising:
obtaining, by the software code executed by the hardware processor, a map of a geometry of the real-world venue;
identifying, by the software code executed by the hardware processor, one or more virtual effects for display in the real-world venue;
tracking, by the software code executed by the hardware processor and using the tracking system, a moving perspective of one of the user in the real-world venue or a camera in the real-world venue; and
controlling, by the software code executed by the hardware processor, the handheld device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

### Claim 12 (depends on 11)

The method of claim 11, wherein the map is a three-dimensional (3D) map of the geometry of the real-world venue.

### Claim 13 (depends on 11)

The method of claim 11, wherein the virtual-world simulator further comprises a mapping device communicatively coupled to the computing platform, the method further comprising:
generating, by the software code executed by the hardware processor and using the mapping device, the map of the geometry of the real-world venue.

### Claim 14 (depends on 13)

The method of claim 13, wherein the mapping device comprises at least one of a mapping camera or a light detection and ranging (LIDAR) device.

### Claim 15 (depends on 11)

The method of claim 11, wherein the map of the geometry of the real-world venue comprises a three-dimensional (3D) map of the geometry of the real-world venue.

### Claim 16 (depends on 11)

The method of claim 11, wherein the tracked moving perspective is the moving perspective of the user in the real-world venue, the method further comprising:
tracking, by the software code executed by the hardware processor and using the tracking system, a second moving perspective of a second user in the real-world venue; and
controlling, by the software code executed by the hardware processor, the handheld device to further simulate the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the second moving perspective of the second user while concurrently simulating the virtual-world from the present vantage point of the moving perspective of the user.

### Claim 17 (depends on 11)

The method of claim 11, wherein the tracked moving perspective is a moving perspective of the user in the real-world venue, the method further comprising:
detecting, by the software code executed by the hardware processor, a user device utilized by a second user in the real-world venue;
tracking, by the software code executed by the hardware processor and using the tracking system, a second moving perspective of the second user in the real-world venue;
generating, by the software code executed by the hardware processor, a simulation of the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the second moving perspective of the second user; and
transmitting, by the software code executed by the hardware processor, the generated simulation to the user device for display to the second user while concurrently simulating the virtual-world from the present vantage point of the moving perspective of the user.

### Claim 18 (depends on 11)

The method of claim 11, wherein the tracked moving perspective is the moving perspective of the camera, and wherein the camera is configured to obtain an image of the user in the simulated virtual-world.

### Claim 19 (depends on 11)

The method of claim 11, wherein the handheld device is a projection device.

### Claim 20

(canceled)

### Claim 21

A virtual-world simulator in a real-world venue, the virtual-world simulator comprising:
a computing platform including a hardware processor and a memory storing a software code;
a tracking system communicatively coupled to the computing platform; and
a projection device communicatively coupled to the computing platform;
the hardware processor configured to execute the software code to:
obtain a map of a geometry of the real-world venue;
identify one or more virtual effects for display in the real-world venue;
track, using the tracking system, a first moving perspective of a first user in the real-world venue;
track, using the tracking system, a second moving perspective of a second user in the real-world venue; and
control the projection device to concurrently simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a first present vantage point of the tracked first moving perspective and a second present vantage point of the tracked second moving perspective.

### Claim 22

A virtual-world simulator in a real-world venue, the virtual-world simulator comprising:
a computing platform including a hardware processor and a memory storing a software code;
a tracking system communicatively coupled to the computing platform; and
a projection device communicatively coupled to the computing platform;
the hardware processor configured to execute the software code to:
obtain a map of a geometry of the real-world venue;
identify one or more virtual effects for display in the real-world venue;
track, using the tracking system, a first moving perspective of a first user in the real-world venue;
control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a first present vantage point of the tracked first moving perspective;
detect a user device utilized by a second user in the real-world venue;
track, using the tracking system, a second moving perspective of a second user in the real-world venue;
generate a simulation of the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the tracked second moving perspective; and
transmit the generated simulation to the user device for display to the second user while concurrently simulating the virtual-world from the first vantage point of the tracked first moving perspective.

### Claim 23

A virtual-world simulator in a real-world venue, the virtual-world simulator comprising:
a computing platform including a hardware processor and a memory storing a software code;
a tracking system communicatively coupled to the computing platform; and
a projection device communicatively coupled to the computing platform;
the hardware processor configured to execute the software code to:
obtain a map of a geometry of the real-world venue;
identify one or more virtual effects for display in the real-world venue;
track, using the tracking system, a moving perspective of a camera in the real-world venue; and
control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective, wherein the camera is configured to obtain an image of the user in the simulated virtual-world.

### Claim 24

A method for use by a virtual-world simulator in a real-world venue, the virtual-world simulator including a computing platform having a hardware processor and a memory storing a software code, the computing platform communicatively coupled to a tracking system and a projection device, the method comprising:
obtaining, by the software code executed by the hardware processor, a map of a geometry of the real-world venue;
identifying, by the software code executed by the hardware processor, one or more virtual effects for display in the real-world venue;
tracking, by the software code executed by the hardware processor and using the tracking system, a first moving perspective of a first user in the real-world venue;
tracking, by the software code executed by the hardware processor and using the tracking system, a second moving perspective of a second user in the real-world venue; and
controlling, by the software code executed by the hardware processor, the projection device to concurrently simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a first present vantage point of the tracked first moving perspective and a second present vantage point of the tracked second moving perspective.

### Claim 25

A method for use by a virtual-world simulator in a real-world venue, the virtual-world simulator including a computing platform having a hardware processor and a memory storing a software code, the computing platform communicatively coupled to a tracking system and a projection device, the method comprising:
obtaining, by the software code executed by the hardware processor, a map of a geometry of the real-world venue;
identifying, by the software code executed by the hardware processor, one or more virtual effects for display in the real-world venue;
tracking, by the software code executed by the hardware processor and using the tracking system, a first moving perspective of a first user in the real-world venue;
controlling, by the software code executed by the hardware processor, the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a first present vantage point of the tracked first moving perspective;
detecting, by the software code executed by the hardware processor, a user device utilized by a second user in the real-world venue;
tracking, by the software code executed by the hardware processor and using the tracking system, a second moving perspective of a second user in the real-world venue;
generating, by the software code executed by the hardware processor, a simulation of the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the tracked second moving perspective; and
transmitting, by the software code executed by the hardware processor, the generated simulation to the user device for display to the second user while concurrently simulating the virtual-world from the first vantage point of the tracked first moving perspective.

### Claim 26

A method for use by a virtual-world simulator in a real-world venue, the virtual-world simulator including a computing platform having a hardware processor and a memory storing a software code, the computing platform communicatively coupled to a tracking system and a projection device, the method comprising:
obtaining, by the software code executed by the hardware processor, a map of a geometry of the real-world venue;
identifying, by the software code executed by the hardware processor, one or more virtual effects for display in the real-world venue;
tracking, by the software code executed by the hardware processor and using the tracking system, a moving perspective of a camera in the real-world venue;
tracking, by the software code executed by the hardware processor and using the tracking system, a second moving perspective of a second user in the real-world venue; and
controlling, by the software code executed by the hardware processor, the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective, wherein the camera is configured to obtain an image of the user in the simulated virtual-world.
