# US 2019/0172265 A1 · Interactive video game system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172265 A1
- Document ID: US20190172265A1
- Status: Published application
- Kind: A1
- Application number: 16/149,563
- Filed: 2018-10-02
- Published: 2019-06-06
- Earliest claimed: 2017-12-06
- Assignees: Universal City Studios LLC
- Applicants: Universal City Studios LLC
- Inventors: Travis Jon Cossairt; Wei Cheng Yeh; Neil Andrew Leiba; Erica Lynn McCay
- Web page: https://patentgrep.com/patent/US20190172265A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
- A63F 13/655: by importing photos, e.g. of the player
- A63F 13/843: involving concurrently two or more players on the same game device, e.g. requiring the use of a plurality of controllers or of a specific view of game data for each player
- G06F 3/005: {Input arrangements through a video camera}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An interactive video game system includes at least one sensor and at least one display device disposed near a play area. The system also includes a controller communicatively coupled to the at least one sensor and the at least one display device, wherein the controller is configured to: receive, from the at least one sensor, the scanning data of the player in the play area; generate at least one model from the scanning data of the player; identify an action of the player in the play area based on the at least one model; generate the virtual representation for the player based on the at least one model and the action of the player; and present, on the display device, the virtual representation of the player in a virtual environment, wherein an action of the virtual representation is augmented relative to the action of the player.

## Claims

### Claim 1

An interactive video game system, comprising:
at least one sensor disposed near a play area and configured to collect scanning data of a player positioned in the play area;
at least one display device disposed near the play area and configured to present a virtual representation associated with the player; and
a controller communicatively coupled to the at least one sensor and the at least one display device, wherein the controller is configured to:
receive, from the at least one sensor, the scanning data of the player in the play area;
generate at least one model based on the received scanning data of the player;
identify an action of the player in the play area based on the generated at least one model;
generate the virtual representation for the player based on the generated at least one model and the identified action of the player; and
present, on the at least one display device, the generated virtual representation of the player in a virtual environment, wherein an action of the presented virtual representation is augmented relative to the action of the player.

### Claim 2 (depends on 1)

The interactive video game system of claim 1, wherein the generated at least one model includes a shadow model, and wherein the controller is configured to generate the virtual representation for the player based on the shadow model of the player.

### Claim 3 (depends on 1)

The interactive video game system of claim 1, wherein the generated at least one model includes a skeletal model, and wherein the controller is configured to identify the action of the player based on the skeletal model of the player.

### Claim 4 (depends on 1)

The interactive video game system of claim 1, wherein the controller is configured to:
generate an animal-based virtual representation of the player based on the generated at least one model and the identified action of the player; and
present, on the display device, the animal-based virtual representation of the player in the virtual environment, wherein the action of the animal-based virtual representation is augmented relative to the identified action of the player and corresponds with a type of movement associated with the animal-based virtual representation.

### Claim 5 (depends on 4)

The interactive video game system of claim 4, wherein the type of movement associated with the animal-based virtual representation comprises at least flying, swimming, or leaping.

### Claim 6 (depends on 1)

The interactive video game system of claim 1, wherein the generated virtual representation is associated with a super human ability that is triggered by the identified action of the player, and wherein the controller is configured to:
present, on the display device, the generated virtual representation of the player in the virtual environment, wherein the action of the virtual representation is augmented relative to the identified action of the player and corresponds with the super human ability.

### Claim 7 (depends on 6)

The interactive video game system of claim 6, wherein the super human ability comprises jumping, shrinking, growing, stretching, or a combination thereof.

### Claim 8

A method of operating an interactive video game system, comprising:
receiving, via processing circuitry of a controller of the interactive video game system, scanning data of a player positioned within a play area;
generating, via the processing circuitry, a shadow model and a skeletal model of the player based on the received scanning data;
generating, via the processing circuitry, a virtual representation for the player based on the generated shadow model, wherein the virtual representation is associated with an augmented ability;
identifying, via the processing circuitry, an action of the player in the play area based on the generated skeletal model, wherein the action triggers the augmented ability associated with the virtual representation; and
presenting, via a display device of the interactive video game system, the generated virtual representation in a virtual environment performing the augmented ability.

### Claim 9 (depends on 8)

The method of claim 8, wherein the generated virtual representation comprises an animal-based virtual representation, and wherein the augmented ability comprises at least flying, leaping, or swimming.

### Claim 10 (depends on 8)

The method of claim 8, wherein the augmented ability comprises a super human ability, and wherein the super human ability comprises shrinking, growing, stretching, or a combination thereof.

### Claim 11 (depends on 8)

The method of claim 8, comprising:
receiving, via the processing circuitry, second scanning data for a second player positioned within the play area;
generating, via the processing circuitry, a second shadow model and a second skeletal model of the second player based on the received second scanning data;
generating, via the processing circuitry, a second virtual representation for the second player based on the generated second shadow model, wherein the second virtual representation is associated with a second augmented ability;
identifying, via the processing circuitry, a second action of the second player in the play area based on the generated second skeletal model, wherein the second action triggers the second augmented ability associated with the generated second virtual representation; and
presenting, via the display device, the generated second virtual representation in the virtual environment performing the second augmented ability.

### Claim 12

An interactive video game system, comprising a controller configured to:
receive, from at least one sensor of the interactive video game system, scanning data of a player in a play area;
generate a shadow model and a skeletal model from the received scanning data of the player;
generate a virtual representation for the player based on the generated shadow model;
identify an action of the player in the play area based on the generated skeletal model of the player, wherein the action triggers an augmented ability associated with the generated virtual representation; and
present, on a display device of the interactive video game system, the generated virtual representation in a virtual environment performing the triggered augmented ability.

### Claim 13 (depends on 12)

The interactive video game system of claim 12, wherein the generated virtual representation comprises an animal-based virtual representation, and the triggered augmented ability comprises a method of moving that is associated with the animal-based virtual representation.

### Claim 14 (depends on 13)

The interactive video game system of claim 13, wherein the animal-based virtual representation comprises a flying animal, and the triggered augmented ability comprises flying.

### Claim 15 (depends on 13)

The interactive video game system of claim 13, wherein the animal-based virtual representation comprises an aquatic animal, and the triggered augmented ability is swimming.

### Claim 16 (depends on 13)

The interactive video game system of claim 13, wherein the animal-based virtual representation is a leaping animal, and the triggered augmented ability is leaping.

### Claim 17 (depends on 12)

The interactive video game system of claim 12, wherein the triggered augmented ability is a super human ability that is associated with the generated virtual representation.

### Claim 18 (depends on 17)

The interactive video game system of claim 17, wherein the super human ability comprises shrinking, growing, stretching, or a combination thereof.

### Claim 19 (depends on 12)

The interactive video game system of claim 12, wherein the controller is configured to:
activate one or more physical effects devices of the interactive video game system in response to identifying the action of the player.

### Claim 20 (depends on 19)

The interactive video game system of claim 19, wherein the activated one or more physical effects devices comprise a thermal physical effects device configured to warm or cool a portion of the player in response to identifying the action of the player.

### Claim 21 (depends on 19)

The interactive video game system of claim 19, wherein the activated one or more physical effects devices comprise a ultrasonic haptic physical effects device configured to provide a touch sensation to a portion of the player in response to identifying the action of the player.

### Claim 22 (depends on 12)

The interactive video game system of claim 12, activate one or more robotic devices near the play area in response to identifying the action of the player.