# US 10,864,440 B2 · Augmented reality gaming systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,864,440 B2
- Document ID: US10864440B2
- Status: Granted
- Kind: B2
- Application number: 16/361,742
- Filed: 2019-03-22
- Published: 2019-07-18
- Granted: 2020-12-15
- Earliest claimed: 2014-09-05
- Assignees: Trigger Global Inc.
- Applicants: Trigger Global Inc.
- Inventors: Jason Yim; Mikayel Saryan
- Web page: https://patentgrep.com/patent/US10864440B2

## CPC

- A63F 13/52: involving aspects of the displayed game scene
- A63F 3/00643: {Electric board games; Electric features of board games (electric word or number games A63F3/0421; computer chess G06F; electric raffle games A63F3/081)}
- A63F 3/00697: {Playing pieces}
- A63F 13/23: for interfacing with the game device, e.g. specific interfaces between game controller and console
- A63F 13/235: using a wireless connection, e.g. infrared or piconet
- A63F 13/24: Constructional details thereof, e.g. game controllers with detachable joystick handles
- A63F 13/25: Output arrangements for video game devices
- A63F 13/40: Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- A63F 13/44: involving timing of operations, e.g. performing an action within a time slot
- A63F 13/53: involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
- A63F 13/537: using indicators, e.g. showing the condition of a game character on screen
- A63F 13/5375: for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game
- A63F 13/5378: for displaying an additional top view, e.g. radar screens or maps
- A63F 13/57: Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game (A63F13/56 takes precedence)
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- A63F 13/655: by importing photos, e.g. of the player
- A63F 13/95: Storage media specially adapted for storing game information, e.g. video game cartridges
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- A63F 2009/2482: {Electromotor}
- A63F 2009/2486: {the computer being an accessory to a board game}
- A63F 2009/2488: {Remotely playable}
- A63F 2300/308: Details of the user interface
- A63F 2300/8082: Virtual reality
- G06F 2203/0383: Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An augmented reality (AR) game system is disclosed wherein real-world objects are transformed into AR terrain elements and AR events generate real-world impact. The game environment is set up using real-world objects that include everyday objects and game pieces on a field of play. When viewed on the screen of a computing device executing the modules of the game system, the everyday objects are transformed into elements of an AR terrain while the game pieces can be augmented with various controls. Multiple viewing modes, for example, a third person view, a first person view or “POV” view from a selected game piece or a split screen view are contemplated for viewing the field of play. A subset of the augmented controls can be activated by the user to execute AR events some of which can have real-world impact. The AR events are executed based on game rules.

## Claims

### Claim 1

A method comprising:
receiving, by a computing device, a selection of a game piece situated within a field of play;
displaying, on a display of the computing device, one or more actions that can be effectuated for the game piece by the computing device, the actions comprising user interface elements overlaid on an image of the game piece and selectable by the user;
receiving, by the computing device, a selection of a selected action in the one or more actions;
calculating, by the computing device, one or more attribute changes of the game piece based on the selected action;
executing, by the computing device, the selected action, the executing the selection action resulting in one or more changes to the field of play or to the game piece; and
updating, by the computing device, the field of play or the game piece based on the one or more changes.

### Claim 2 (depends on 1)

The method of claim 1, the displaying the one or more actions comprising selecting the one or more actions based on a set of game rules and current game conditions.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
determining, by the computing device, that the selected action necessitates selection of a second game element; and
receiving, by the computing device, a second selection of the second game element.

### Claim 4 (depends on 1)

The method of claim 1, the updating the field of play or the game piece comprising physically modifying one or more of the field of play or the game piece.

### Claim 5 (depends on 4)

The method of claim 4, the updating the field of play or the game piece based on the one or more changes comprising physically moving the game piece.

### Claim 6 (depends on 4)

The method of claim 4, the updating the field of play or the game piece based on the one or more changes comprising physically modifying the game piece.

### Claim 7 (depends on 1)

The method of claim 1, the selected action comprising an instruction to move the game piece, the executing the selected action comprising sending, by the computing device, a signal to the game piece upon determining that the game piece is motorized, the signal causing the game piece to move according to the instruction.

### Claim 8 (depends on 1)

The method of claim 1, the executing the selected action comprising:
determining, by the computing device, that the selected action is a point-of-view (POV) interaction;
displaying, on the display of the computing device, the POV interaction in a POV display on the display of the computing device upon determining the computing device is in a POV mode;
displaying, on the display of the computing device, the POV interaction in conjunction with a display of the field of play upon determining the computing device is in augmented reality (AR) mode.

### Claim 9

A device comprising:
a display;
a processor; and
a storage medium for tangibly storing thereon program logic for execution by the processor, the stored program logic comprising:
logic, executed by the processor, for receiving a selection of a game piece situated with a field of play,
logic, executed by the processor, for displaying, on the display, one or more actions that can be effectuated for the game piece by the device, the actions comprising user interface elements overlaid on an image of the game piece and selectable by the user,
logic, executed by the processor, for receiving a selection of a selected action in the one or more actions,
logic, executed by the processor, for calculating one or more attribute changes of the game piece based on the selected action,
logic, executed by the processor, for executing the selected action, the executing the selection action resulting in one or more changes to the field of play or to the game piece, and
logic, executed by the processor, for updating the field of play or the game piece based on the one or more changes.

### Claim 10 (depends on 9)

The device of claim 9, the logic for displaying the one or more actions comprising logic, executed by the processor, for selecting the one or more actions based on a set of game rules and current game conditions.

### Claim 11 (depends on 9)

The device of claim 9, the stored program logic further comprising:
logic, executed by the processor, for determining that the selected action necessitates selection of a second game element; and
logic, executed by the processor, for receiving a second selection of the second game element.

### Claim 12 (depends on 9)

The device of claim 9, the logic for updating the field of play or the game piece comprising physically modifying one or more of the field of play or the game piece, the physically modifying comprising an action selected from the group consisting of physically moving the game piece and physically modifying the game piece.

### Claim 13 (depends on 9)

The device of claim 9, the selected action comprising an instruction to move the game piece, the logic for executing the selected action comprising logic, executed by the processor, for sending a signal to the game piece upon determining that the game piece is motorized, the signal causing the game piece to move according to the instruction.

### Claim 14 (depends on 9)

The device of claim 9, the logic for executing the selected action comprising:
logic, executed by the processor, for determining that the selected action is a point-of-view (POV) interaction;
logic, executed by the processor, for displaying, on the display, the POV interaction in a POV display on the display of the computing device upon determining the device is in a POV mode;
logic, executed by the processor, for displaying, on the display, the POV interaction in conjunction with a display of the field of play upon determining the device is in augmented reality (AR) mode.

### Claim 15

A non-transitory computer readable storage medium for tangibly storing computer program instructions capable of being executed by a computer processor, the computer program instructions defining the steps of:
receiving a selection of a game piece situated with a field of play;
displaying, on a display, one or more actions that can be effectuated for the game piece by the computer processor, the actions comprising user interface elements overlaid on an image of the game piece and selectable by the user;
receiving a selection of a selected action in the one or more actions;
calculating one or more attribute changes of the game piece based on the selected action;
executing the selected action, the executing the selection action resulting in one or more changes to the field of play or to the game piece; and
updating the field of play or the game piece based on the one or more changes.

### Claim 16 (depends on 15)

The non-transitory computer readable storage medium of claim 15, the displaying the one or more actions comprising selecting the one or more actions based on a set of game rules and current game conditions.

### Claim 17 (depends on 15)

The non-transitory computer readable storage medium of claim 15, the instructions further defining the steps of:
determining that the selected action necessitates selection of a second game element; and
receiving a second selection of the second game element.

### Claim 18 (depends on 15)

The non-transitory computer readable storage medium of claim 15, the updating the field of play or the game piece comprising physically modifying one or more of the field of play or the game piece, the physically modifying comprising an action selected from the group consisting of physically moving the game piece and physically modifying the game piece.

### Claim 19 (depends on 15)

The non-transitory computer readable storage medium of claim 15, the selected action comprising an instruction to move the game piece, the executing the selected action comprising sending a signal to the game piece upon determining that the game piece is motorized, the signal causing the game piece to move according to the instruction.

### Claim 20 (depends on 15)

The non-transitory computer readable storage medium of claim 15, the executing the selected action comprising:
determining that the selected action is a point-of-view (POV) interaction;
displaying, on the display, the POV interaction in a POV display on the display upon determining the computer processor is in a POV mode;
displaying, on the display, the POV interaction in conjunction with a display of the field of play upon determining the computer processor is in augmented reality (AR) mode.