# US 2023/0274480 A1 · Method and system for populating a digital environment using a semantic map

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274480 A1
- Document ID: US20230274480A1
- Status: Published application
- Kind: A1
- Application number: 18/087,616
- Filed: 2022-12-22
- Published: 2023-08-31
- Earliest claimed: 2020-04-21
- Assignees: Unity IPR ApS
- Inventors: Gregory Lionel Xavier Jean Palmaro; Charles Janusz Migos; Gerald James Williams Orban; Pierre-Luc Loyer; Dominic Laflamme; Sylvio Herve Drouin
- Web page: https://patentgrep.com/patent/US20230274480A1

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- A63F 13/57: Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game (A63F13/56 takes precedence)
- A63F 13/60: Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
- G06T 7/11: Region-based segmentation
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/20081: Training; Learning
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

A method of populating a digital environment with digital content is disclosed. Environment data describing the digital environment is accessed. Populator data describing a populator digital object is accessed. The populator data includes semantic data describing the populator digital object. The populator digital object is placed within the digital environment. A semantic map representation of the populator digital object is generated. The semantic map representation is divided into a plurality of cells. A target cell of the plurality of cells is selected as a placeholder in the digital environment for a digital object that is optionally subsequently instantiated. The selecting of the target cell is based on an analysis of the environment data, the populator data, and the semantic map representation. Placeholder data is recorded in the semantic map representation. The placeholder data includes properties corresponding to the digital object that is optionally subsequently instantiated.

## Claims

### Claim 1

(canceled)

### Claim 2

A system comprising:
one or more computer processors;
one or more computer memories;
a set of instructions stored in the one or more computer memories, the set of instructions configuring the one or more computer processors to perform operations, the operations comprising:
generating a semantic map representation of a digital object;
generating an updated semantic map representation of the digital object based on a modification to at least one of a dimension of the digital object and a location of the digital object within an environment;
dividing the semantic map into a first plurality of cells;
dividing the updated semantic map into a second plurality of cells;
mapping a cell in the first plurality of cells to a cell in the second plurality of cells based on a similarity of properties between the cell of the first plurality of cells to the cell in the second plurality of cells; and
transferring data from the cell in the first plurality of cells to the cell in the second plurality of cells.

### Claim 3 (depends on 2)

The system of claim 2, the operations further including:
selecting a second digital object from a plurality of digital objects based on a matching of the second digital object to placeholder data or environment data, the environment data describing a digital environment into which the second digital object is placed;
determining to perform an optional instantiating of the second digital object; and
automatically placing the selected and instantiated second digital object at a selected cell within the first plurality of cells.

### Claim 4 (depends on 3)

The system of claim 3, wherein the selecting of the second digital object is based on application of a machine-learned model trained by previous manual user actions.

### Claim 5 (depends on 3)

The system of claim 3, wherein the semantic map representation includes a topology associated with an intersection of the environment and the digital object, and the selecting of the second digital object is additionally based on a matching of the second digital object to the topology.

### Claim 6 (depends on 2)

The system of claim 2, wherein the operations further include:
generating a semantic map representation of a second digital object;
assigning a first set of priorities to the semantic map representation of the digital object;
assigning a second set of priorities to the semantic map representation of the second digital object; and
compositing the semantic map representation of the first digital object and the semantic map representation of the second digital object into a single composited semantic map representation based the assigned first set of priorities and the assigned second set of priorities.

### Claim 7 (depends on 2)

The system of claim 2, the operations further comprising selecting a target cell in the plurality of cells based on application of a machine-learned model trained by previous manual user actions.

### Claim 8 (depends on 3)

The system of claim 3, the operations further comprising placeholder data in the semantic map representation, the placeholder data including properties corresponding to at least one of the digital object and the environment.

### Claim 9

A non-transitory computer-readable storage medium storing a set of instructions that, when executed by one or more computer processors, cause the one or more computer processors to perform operations, the operations comprising:
generating a semantic map representation of a digital object;
generating an updated semantic map representation of the digital object based on a modification to at least one of a dimension of the digital object and a location of the digital object within an environment;
dividing the semantic map into a first plurality of cells;
dividing the updated semantic map into a second plurality of cells;
mapping a cell in the first plurality of cells to a cell in the second plurality of cells based on a similarity of properties between the cell in the first plurality of cells to the cell in the second plurality of cells; and
transferring data from the cell in the first plurality of cells to the cell in the second plurality of cells.

### Claim 10 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, the operations further including:
selecting a second digital object from a plurality of digital objects based on a matching of the digital object to environment data, the environment data describing a digital environment into which the second digital object is placed;
determining to perform an optional instantiating of the second digital object; and
automatically placing the selected and instantiated second digital object at a selected cell within the first plurality of cells.

### Claim 11 (depends on 10)

The non-transitory computer-readable storage medium of claim 10, wherein the selecting of the second digital object is based on application of a machine-learned model trained by previous manual user actions.

### Claim 12 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the semantic map representation includes a topology of a digital environment at an intersection of the digital environment and the second digital object.

### Claim 13 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the operations further include:
generating a semantic map representation of a second digital object;
assigning a first set of priorities to the semantic map representation of the digital object;
assigning a second set of priorities to the semantic map representation of the second digital object; and
compositing the semantic map representation of the first digital object and the semantic map representation of the second digital object into a single composited semantic map representation based the assigned first set of priorities and the assigned second set of priorities.

### Claim 14 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, the operations further comprising selecting a target cell in the plurality of cells based on application of a machine-learned model trained by previous manual user actions.

### Claim 15 (depends on 10)

The non-transitory computer-readable storage medium of claim 10, the operations further comprising recording placeholder data in the semantic map representation, the placeholder data including properties corresponding to the digital object.

### Claim 16

A method comprising:
generating a semantic map representation of a digital object;
generating an updated semantic map representation of the digital object based on a modification to at least one of a dimension of the digital object and a location of the digital object within an environment;
dividing the semantic map into a first plurality of cells;
dividing the updated semantic map into a second plurality of cells;
mapping a cell in the first plurality of cells to a cell in the second plurality of cells based on a similarity of properties between the cell in the first plurality of cells to the cell in the second plurality of cells; and
transferring data from the cell in the first plurality of cells to the cell in the second plurality of cells.

### Claim 17 (depends on 16)

The method of claim 16, the operations further including:
selecting a second digital object from a plurality of digital objects based on a matching of the digital object to environment data, the environment data describing a digital environment into which the second digital object is placed;
determining to perform an optional instantiating of the second digital object; and
automatically placing the selected and instantiated second digital object at a selected cell within the first plurality of cells.

### Claim 18 (depends on 17)

The method of claim 17, wherein the selecting of the digital object is based on application of a machine-learned model trained by previous manual user actions.

### Claim 19 (depends on 16)

The method of claim 16, wherein the semantic map representation includes a topology of a digital environment at an intersection of the digital environment and the second digital object.

### Claim 20 (depends on 16)

The method of claim 16, wherein the operations further include:
generating a semantic map representation of a second digital object;
assigning a first set of priorities to the semantic map representation of the digital object;
assigning a second set of priorities to the semantic map representation of the second digital object; and
compositing the semantic map representation of the first digital object and the semantic map representation of the second digital object into a single composited semantic map representation based the assigned first set of priorities and the assigned second set of priorities.

### Claim 21 (depends on 16)

The method of claim 16, the operations further comprising selecting a target cell in the plurality of cells based on application of a machine-learned model trained by previous manual user actions.
