# US 12,602,355 B2 · LLM-based game schema generation, cross-referencing, and instantiation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,602,355 B2
- Document ID: US12602355B2
- Status: Granted
- Kind: B2
- Application number: 18/809,705
- Filed: 2024-08-20
- Published: 2026-02-26
- Granted: 2026-04-14
- Earliest claimed: 2024-08-20
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment LLC
- Inventors: Joseph Logan Olson
- Web page: https://patentgrep.com/patent/US12602355B2

## CPC

- G06F 16/211: {Schema design and management}
- A63F 13/60: Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
- G06F 8/30: Creation or generation of source code
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

In one aspect, schemas for interactive content creation may be created using large language models (LLMs). The schemas may refer to one another and may be used to build schema instances off the schemas themselves. The schema instances may also refer to each other. Computer code for actions in the interactive content can then be written in a given programming language to refer to the schemas and schema instances, enabling quick code creation with less chances of crashing due to the strongly-typed language being used, including the schema references to each other. The interactive content might be video game content or another type of interactive content.

## Claims

### Claim 1

An apparatus, comprising:
at least one processor system configured to perform operations comprising:
receiving a first text prompt, the first text prompt indicating a request to create a first schema for a first game object of a video game;
providing the first text prompt to a large language model (LLM);
receiving a first output from the LLM, the first output indicating first structured data for the first schema according to the first text prompt;
receiving a second text prompt, the second text prompt indicating a request to create a second schema for a second game object of the video game;
determining whether the second text prompt refers to the first game object;
in response to determining that the second text prompt refers to the first game object, providing, to the LLM, the second text prompt and an identifier for the first schema;
receiving a second output from the LLM, the second output indicating second structured data for the second schema according to the second text prompt with the second structured data referring to the first schema; and
converting the first structured data and the second structured data into a machine-readable format configured to instantiate the first game object and the second game object in the video game.

### Claim 2 (depends on 1)

The apparatus of claim 1, the operations comprising:
receiving a third text prompt, the third text prompt indicating a request to create a first schema instance based on the first schema;
providing the third text prompt to the LLM;
receiving a third output from the LLM, the third output indicating third structured data for the first schema instance according to the third text prompt; and
representing the third structured data on a display.

### Claim 3 (depends on 2)

The apparatus of claim 2, the operations comprising:
receiving a fourth text prompt, the fourth text prompt indicating a request to create a second schema instance based on the second schema;
providing the fourth text prompt to the LLM;
receiving a fourth output from the LLM, the fourth output indicating fourth structured data for the second schema instance according to the fourth text prompt; and
representing the fourth structured data on the display.

### Claim 4 (depends on 3)

The apparatus of claim 3, the operations comprising:
receiving a fifth text prompt, the fifth text prompt indicating a game action to write in Javascript;
providing the fifth text prompt to the LLM;
receiving a fifth output from the LLM, the fifth output indicating Javascript code for the game action; and
representing the Javascript code on the display.

### Claim 5 (depends on 4)

The apparatus of claim 4, the operations comprising:
receiving a command to modify the Javascript code to refer to the first and second schema instances in relation to the game action; and
based on the command, modifying the Javascript code to refer to the first and second schema instances in relation to the game action.

### Claim 6 (depends on 5)

The apparatus of claim 5, the operations comprising:
saving the modified Javascript code for incorporation, according to a plot of the video game, into video game code of the video game.

### Claim 7 (depends on 4)

The apparatus of claim 4, wherein the LLM uses a Javascript generator to output the Javascript code.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the first and second structured data are output by the LLM in JavaScript Object Notation (JSON) format.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the first and second schemas relate to one or more of: a character for the video game, a weapon for the video game, an inventory asset for the video game, a location within a game world of the video game.

### Claim 10

A method, comprising:
receiving a first text prompt, the first text prompt indicating a request to create a first schema for a first game object of a video game;
providing the first text prompt to a model;
receiving a first output from the model, the first output indicating first structured data for the first schema according to the first text prompt;
receiving a second text prompt, the second text prompt indicating a request to create a second schema for a second game object of the video game;
determining whether the second text prompt refers to the first game object;
in response to determining that the second text prompt refers to the first game object, providing, to the model, the second text prompt and an identifier for the first schema;
receiving a second output from the model, the second output indicating second structured data for the second schema according to the second text prompt, the second structured data referring to the first schema; and
converting the first structured data and the second structured data into a machine-readable format configured to instantiate the first game object and the second game object in the video game.

### Claim 11 (depends on 10)

The method of claim 10, wherein the model comprises a large language model (LLM).

### Claim 12 (depends on 10)

The method of claim 10, comprising:
receiving a third text prompt, the third text prompt indicating a request to create a first schema instance based on the first schema;
providing the third text prompt to the model;
receiving a third output from the model, the third output indicating the first schema instance according to the third text prompt; and
representing the first schema instance on a display.

### Claim 13 (depends on 12)

The method of claim 12, comprising:
receiving a fourth text prompt, the fourth text prompt indicating a request to create a second schema instance based on the second schema;
providing the fourth text prompt to the model;
receiving a fourth output from the model, the fourth output indicating the second schema instance according to the fourth text prompt; and
representing the second schema instance on the display.

### Claim 14 (depends on 13)

The method of claim 13, comprising:
receiving a fifth text prompt, the fifth text prompt indicating a game action to write in programming code;
providing the fifth text prompt to a programming code generator;
receiving a fifth output from the programming generator, the fifth output indicating programming code for the game action; and
representing the programming code on the display.

### Claim 15 (depends on 14)

The method of claim 14, comprising:
tailoring the programming code to refer to the first and second schema instances in relation to the game action.

### Claim 16 (depends on 13)

The method of claim 13, wherein the first, second, third, and fourth structured data are output by the model in JavaScript Object Notation (JSON) format.

### Claim 17

An apparatus, comprising:
at least one processor system configured to perform operations comprising:
receiving a first text prompt, the first text prompt indicating a request to create a first schema for a first game object of a video game;
providing the first text prompt to a large language model (LLM);
receiving a first output from the LLM, the first output indicating first structured data for the first schema according to the first text prompt;
receiving a second text prompt, the second text prompt indicating a request to create a second schema for a second game object of the video game with the second schema referring to the first schema;
providing the second text prompt to the LLM;
receiving a second output from the LLM, the second output indicating second structured data for the second schema according to the second text prompt with the second structured data referring to the first schema;
converting the first structured data and the second structured data into a machine-readable format configured to instantiate the first game object and the second game object in the video game;
receiving a third text prompt, the third text prompt indicating a request to create a first schema instance based on the first schema;
providing the third text prompt to the LLM;
receiving a third output from the LLM, the third output indicating third structured data for the first schema instance according to the third text prompt; and
representing the third structured data on a display.