US 11,110,353 B2Granted

Distributed training for machine learning of AI controlled virtual entities on video game clients

AssigneeElectronic Arts Inc.

InventorsCaedmon Somers, Jason Rupert, Igor Borovikov, Ahmad Beirami, Yunqi Zhao, Mohsen Sardari, John Kolen, Navid Aghdaie, Kazi Atif-Uz Zaman

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

System and methods for utilizing a video game console to monitor the player's video game, detect when a particular gameplay situation occurs during the player's video game experience, and collect game state data corresponding to how the player reacts to the particular gameplay situation or an effect of the reaction. In some cases, the video game console can receive an exploratory rule set to apply during the particular gameplay situation. In some cases, the video game console can trigger the particular gameplay situation. A system can receive the game state data from many video game consoles and train a rule set based on the game state data. Advantageously, the system can save computational resources by utilizing the players' video game experience to train the rule set.

Claims14

Dependent claims

A computer implemented method for managing updates of rule sets of non-player characters comprising:

monitoring gameplay of a game application during runtime of the game application, wherein the game application comprises game data, the game data comprising (i) a plurality of rule sets for defining actions to be performed by one or more non-player characters of the game application during a first during the runtime of the game application, and (ii) a plurality of data collection rules defining types of game state data to collect and when to collect game state data during the runtime of the game application;
obtaining a first exploratory rule set defining one or more first actions to be performed by the one or more non-player characters, the first exploratory rule set being different than at least one of the plurality of rule sets;
identifying, during the monitoring, an occurrence of a first triggering game state during the runtime of the game application, the identifying being based on defined game conditions within the game application;
responsive to the identifying of the occurrence of the first triggering game state, applying the first exploratory rule set during the runtime of the game application causing the one or more non-player characters to perform the one or more first actions;
collecting, based on the plurality of data collection rules, first game state data during a first runtime state of the game application in which the exploratory rule set has been applied to the one or more non-player characters, the first game state data indicating gameplay behaviors of a player-controlled character in response to the application of the first exploratory rule set during the first runtime state;
generating feedback based on the first game state data, the feedback resulting from an evaluation of the application of the first exploratory rule set during the first runtime state;
and
updating the plurality of rule sets in response to the first game state data and the feedback.

5 more elements

A system for managing updates of rule sets of non-player characters comprising:

one or more processors configured with computer-readable instructions to:
monitor gameplay of a game application during runtime of the game application, wherein the game application comprises game data, the game data comprising (i) a plurality of rule sets defining actions to be performed by one or more non-player characters of the game application during the runtime of the game application and (ii) a plurality of data collection rules defining types of game state data to collect and when to collect game state data during the runtime of the game application;
obtain a first exploratory rule set defining one or more first actions to be performed by the one or more non-player characters, the first exploratory rule set being different than at least one of the plurality of rule sets;
identify, during the monitoring, an occurrence of a first triggering game state during the runtime of the game application, the identifying being based on defined game conditions within the game application;
responsive to identification of the occurrence of the first triggering game state, apply the first exploratory rule set during the runtime of the game application causing the one or more non-player characters to perform the one or more first actions;
collect, based on the plurality of data collection rules, first game state data during a first runtime state of the game application in which the first exploratory rule set has been applied to the one or more non-player characters, the first game state data indicating gameplay behaviors of a player-controlled character in response to the application of the first exploratory rule set during the first runtime state;
generate feedback based on the first game state data, the feedback resulting from an evaluation of the application of the first exploratory rule set during the first runtime state;
and
update the plurality of rule sets in response to the first game state data and the feedback.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/507,864Filed 10 Jul 2019
Published: US 2021/0008456 A114 Jan 2021
Granted: 7 Sep 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification6 codes

A63F 13/67
Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or…:…
A63F 13/69
Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or…:…
A63F 13/35
Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection…: details…
A63F 13/58
Controlling game characters or game objects based on the game progress: by computing conditions of game characters, e.g. stamina, strength,…