# US 2024/0005618 A1 · Volumetric heat maps for intelligently distributing virtual objects of interest

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005618 A1
- Document ID: US20240005618A1
- Status: Published application
- Kind: A1
- Application number: 17/856,561
- Filed: 2022-07-01
- Published: 2024-01-04
- Earliest claimed: 2022-07-01
- Assignees: MSG Entertainment Group, LLC
- Applicants: MSG Entertainment Group, LLC
- Inventors: Stephen Hitchcock; Emily Saunders
- Web page: https://patentgrep.com/patent/US20240005618A1

## CPC

- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed herein are system, method, and computer program product embodiments for intelligently distributing virtual objects within a 3D virtual space using a voxel-based heat map. The approach is highly flexible and scalable, and a designer may guide the placement of virtual objects using parameters that reference the voxel-based heat map. This technique affords designers expansive creative control over a wide-array of scenarios that involve placing a virtual object into a virtual 3D space.

## Claims

### Claim 1

A computer-implemented method for placing a virtual object in a 3D virtual space, comprising:
partitioning the 3D virtual space into a plurality of voxels;
determining at least one field of view for at least one virtual camera viewing the 3D virtual space;
assigning a plurality of weights to the plurality of voxels based on the at least one field of view;
creating a heat map of the 3D virtual space based on the plurality of weights; and
placing the virtual object into the 3D virtual space using the heat map and a user-configured parameter.

### Claim 2 (depends on 1)

The method of claim 1, the creating the heat map further comprising:
sampling the plurality of weights as a moving average, wherein a weight assigned to a voxel outside of the at least one field of view decays based on a time decay factor.

### Claim 3 (depends on 1)

The method of claim 1, the placing the virtual object into the 3D virtual space further comprising:
determine a voxel in the plurality of voxels having a highest value in the heat map; and
placing the virtual object at the voxel having the highest value.

### Claim 4 (depends on 1)

The method of claim 1, the placing the virtual object into the 3D virtual space further comprising:
determining a voxel in the plurality of voxels having a lowest value in the heat map; and
placing the virtual object at the voxel having the lowest value.

### Claim 5 (depends on 1)

The method of claim 1, the assigning a plurality of weights to the plurality of voxels comprising:
receiving an initial weight for each of the plurality of voxels from a designer;
assigning a vision weight to each of the voxels in the plurality of voxels based on the at least one field of view; and for each voxel in the plurality of voxels, adding the initial weight to the vision weight to determine the weight to assign to each of the plurality of voxels.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
providing a user interface that allows the designer to enter the plurality of initial weights and the user-configured parameter to exhibit creative control over the placing of the virtual object into the 3D virtual space.

### Claim 7 (depends on 1)

The method of claim 1, wherein the user-configured parameter indicates a time to place the virtual object and whether to place the virtual object in a region of the heat map having a high or low density.

### Claim 8 (depends on 1)

The method of claim 1, wherein the at least one virtual camera is associated with a VR headset, AR glasses, or a mobile device.

### Claim 9 (depends on 1)

The method of claim 1, the assigning the plurality of weights further comprising:
determining a center of the at least one field of view;
increasing the plurality of weights when a voxel in the plurality of weights is at or near the at least one center of the at least one field of view.

### Claim 10 (depends on 1)

The method of claim 1, wherein the at least one virtual camera is associated with a display in an installation that provides a viewpoint into the 3D virtual space.

### Claim 11 (depends on 10)

The method of claim 10, wherein the installation is a spherical electronic visual display device.

### Claim 12 (depends on 10)

The method of claim 10, wherein the installation is in a building lobby, restaurant, stadium, theatre, casino, cruise ship, immersive installation, music festival, theme park, attraction queue, aircraft, airport, yacht, simulator, escape room, doctor's office, aquarium, zoo, science center, or video conferencing room.

### Claim 13 (depends on 10)

The method of claim 10, further comprising:
installing a tracking mechanism in the installation that gathers data on locations of at least one person in the installation, wherein the user-configured parameter considers the data on locations of at least one person for use when placing the virtual object.

### Claim 14 (depends on 13)

The method of claim 13, wherein the tracking mechanism includes at least one of: blob tracking, eye tracking, face tracking, and volume level.

### Claim 15 (depends on 13)

The method of claim 13, further comprising:
recording a history of user attention using the tracking mechanism; and
determining an effectiveness of placing the virtual object into the 3D virtual space based on the history of user attention.

### Claim 16

A system, comprising:
a memory; and
at least one processor coupled to the memory and configured to:
partition the 3D virtual space into a plurality of voxels;
determine at least one field of view for at least one virtual camera viewing the 3D virtual space;
assign a plurality of weights to the plurality of voxels based on the at least one field of view;
create a heat map of the 3D virtual space based on the plurality of weights; and
place the virtual object into the 3D virtual space using the heat map and a user-configured parameter.

### Claim 17 (depends on 16)

The system of claim 16, wherein to place the virtual object the at least one processor further is configured to:
determine a voxel in the plurality of voxels having a highest value in the heat map; and
place the virtual object at the voxel having the highest value.

### Claim 18 (depends on 16)

The system of claim 16, wherein to place the virtual object the at least one processor further is configured to:
determine a voxel in the plurality of voxels having a lowest value in the heat map; and
place the virtual object at the voxel having the lowest value.

### Claim 19 (depends on 16)

The system of claim 16, wherein to place the virtual object the at least one processor further is configured to:
consider a plurality of initial weights when creating the heat map of the 3D virtual space, wherein the plurality of initial weights can be user-configured or initialized to zero.

### Claim 20

A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
partitioning the 3D virtual space into a plurality of voxels;
determining at least one field of view for at least one virtual camera viewing the 3D virtual space;
assigning a plurality of weights to the plurality of voxels based on the at least one field of view;
creating a heat map of the 3D virtual space based on the plurality of weights; and
placing the virtual object into the 3D virtual space using the heat map and a user-configured parameter.
