# US 11,077,367 B1 · Systems and methods for using natural language processing (NLP) to control automated gameplay > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,077,367 B1 - Document ID: US11077367B1 - Status: Granted - Kind: B1 - Application number: 16/949,016 - Filed: 2020-10-09 - Granted: 2021-08-03 - Earliest claimed: 2020-10-09 - Assignees: Mythical, Inc. - Applicants: Mythical, Inc. - Inventors: Cameron Thacker; John Linden - Web page: https://patentgrep.com/patent/US11077367B1 ## CPC - A63F 13/42: by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle - G06F 40/216: using statistical methods - A63F 13/215: comprising means for detecting acoustic signals, e.g. using a microphone - A63F 13/35: Details of game servers - A63F 13/63: by the player, e.g. authoring using a level editor - A63F 13/67: adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use - G06F 40/289: Phrasal analysis, e.g. finite state techniques or chunking - G06F 40/30: Semantic analysis - G06N 3/045: Combinations of networks - G06N 3/0499: Feedforward networks - G06N 3/09: Supervised learning - G06N 20/00: Machine learning - A63F 13/56: Computing the motion of game characters with respect to other game characters, game objects or elements of the game scene, e.g. for simulating the behaviour of a group of virtual soldiers or for path finding - A63F 2300/1081: Input via voice recognition - A63F 2300/6045: for mapping control signals received from the input arrangement into game commands - G06N 3/08: Learning methods - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract Systems and methods for using natural language processing (NLP) to control automated gameplay in one or more online games within an online gaming platform are disclosed. Exemplary implementations may: train a pretrained text-based system to generate sequences indicating one or more activities, wherein activities are associated with characteristics of user-controllable characters such that a particular user-controllable character having a particular characteristic may perform, within the online gaming platform, one or more activities from a particular set that is associated with the particular characteristic; receive user input describing one or more commands; generate, using the pretrained text-based system, a sequence indicating one or more activities based on the user input; transfer the generated sequence to the online gaming platform; effectuate automated execution of activities by the particular user-controllable character in accordance with the generated sequence. ## Claims ### Claim 1 A system configured to use natural language processing (NLP) to control automated gameplay in an online game within an online gaming platform, the system comprising: electronic storage configured to electronically store information, wherein the information includes sets of in-game activities in the online game, wherein an individual one of the sets of in-game activities is associated with an individual activity-defining characteristic of one or more user-controllable characters, wherein the individual activity-defining characteristic defines in-game activities in the individual one of the sets of in-game activities available to be performed during the automated gameplay; one or more hardware processors configured by machine-readable instructions to: select a user-controllable character from the one or more user-controllable characters; determine a particular activity-defining characteristic for the user-controllable character, wherein the particular activity-defining characteristic defines a particular characteristic-specific set of in-game activities available to be performed during the automated gameplay by the user-controllable character; determine, based on the stored information, the particular characteristic-specific set of in-game activities associated with the particular activity-defining characteristic, wherein in-game activities in the particular characteristic-specific set of in-game activities are available to be performed during the automated gameplay by the user-controllable character; train a pretrained text-based system, using prompts, to generate sequences indicating in-game activities from the particular characteristic-specific set of in-game activities, wherein individual ones of the prompts are based on a combination of (i) a textual description of an individual in-game activity that is included in the particular characteristic-specific set of in-game activities and (ii) the individual in-game activity; receive, from a user, a user input, wherein the user input represents a user-provided textual description describing multiple commands for the user-controllable character, wherein the user-provided textual description further describes a condition to be evaluated by the user-controllable character during the automated gameplay by the user-controllable character, wherein at least one of the multiple commands is controlled by the condition; generate, using the trained pretrained text-based system, a sequence indicating the condition and at least a first in-game activity and a second in-game activity, wherein generation of the generated sequence is based on the user-provided textual description; transfer the generated sequence to the online gaming platform; and effectuate automated execution of in-game activities by the user-controllable character in accordance with the generated sequence, wherein the automated execution includes an evaluation of the condition, wherein, subsequent to and depending on the evaluation of the condition by the user-controllable character during the automated gameplay by the user-controllable character, either the first in-game activity or the second in-game activity is automatically executed during the automated gameplay. ### Claim 2 (depends on 1) The system of claim 1, wherein at least part of the online game takes place in a virtual space, and wherein the evaluation of the condition is independent and separate from the first in-game activity and from the second in-game activity. ### Claim 3 (depends on 1) The system of claim 1, wherein the multiple commands include one or more commands directed to a given user-controllable character, wherein the one or more hardware processors are further configured to: determine a given activity-defining characteristic for the given user-controllable character, wherein the given activity-defining characteristic is different from the particular activity-defining characteristic; determine, based on the stored information, an appropriate characteristic-specific set of in-game activities for the given user-controllable character; and generate, using the trained pretrained text-based system, a given sequence of given in-game activities selected from the appropriate characteristic-specific set of in-game activities; wherein the given sequence is different from the generated sequence. ### Claim 4 (depends on 1) The system of claim 1, wherein a first individual activity-defining characteristic of at least one of the user-controllable characters is associated with a first characteristic-specific set of in-game activities, wherein a second individual activity-defining characteristic of the at least one of the user-controllable characters is associated with a second characteristic-specific set of in-game activities, and wherein the first characteristic-specific set of in-game activities is different from the second characteristic-specific set of in-game activities. ### Claim 5 (depends on 1) The system of claim 1, wherein individual sets of in-game activities are specific to individual online games within the online gaming platform. ### Claim 6 (depends on 1) The system of claim 1, wherein the sets of in-game activities are associated with activity-defining characteristics of user-controllable characters, wherein one or more of the activity-defining characteristics of the user-controllable characters correspond to individual races and/or species of the user-controllable characters. ### Claim 7 (depends on 1) The system of claim 1, wherein the user-provided textual description corresponds to a first particular in-game activity responsive to the given user-controllable character having a first activity-defining characteristic, and wherein the user-provided textual description corresponds to a second particular in-game activity responsive to the given user-controllable character having a second activity-defining characteristic that is different from the first activity-defining characteristic, wherein the first particular in-game activity is different from the second particular in-game activity. ### Claim 8 (depends on 1) The system of claim 1, wherein the pretrained text-based system is Generative Pretrained Transformer 3 (GPT-3). ### Claim 9 (depends on 1) The system of claim 1, wherein the user input is received through a user interface. ### Claim 10 A method to use natural language processing (NLP) to control automated gameplay in one or more online games within an online gaming platform, the method being implemented in a computer system, the method comprising: electronically storing information, wherein the information includes sets of in-game activities, wherein an individual one of the sets of in-game activities is associated with an individual activity-defining characteristic of one or more user-controllable characters, wherein the individual activity-defining characteristic defines in-game activities in the individual one of the sets of in-game activities available to be performed during the automated gameplay; selecting a user-controllable character from the one or more user-controllable characters; determining a particular activity-defining characteristic for the user-controllable character, wherein the particular activity-defining characteristic defines a particular characteristic-specific set of in-game activities available to be performed during the automated gameplay by the user-controllable character; determining, based on the stored information, the particular characteristic-specific set of in-game activities associated with the particular activity-defining characteristic, wherein in-game activities in the particular characteristic-specific set of in-game activities are available to be performed during the automated gameplay by the user-controllable character; training a pretrained text-based system, using prompts, to generate sequences indicating in-game activities from the particular characteristic-specific set of in-game activities, wherein individual ones of the prompts are based on a combination of (i) a textual description of an individual in-game activity that is included in the particular characteristic-specific set of in-game activities and (ii.) the individual in-game activity; receiving, from a user, a user input, wherein the user input represents a user-provided textual description describing multiple commands for the user-controllable character, wherein the user-provided textual description further describes a condition to be evaluated by the user-controllable character during the automated gameplay by the user-controllable character, wherein at least one of the multiple commands is controlled by the condition; generating, using the trained pretrained text-based system, a sequence indicating the condition and at least a first in-game activity and a second in-game activity, wherein generation of the generated sequence is based on the user-provided textual description; transferring the generated sequence to the online gaming platform; and effectuating automated execution of in-game activities by the user-controllable character in accordance with the generated sequence, wherein the automated execution includes an evaluation of the condition, wherein, subsequent to and depending on the evaluation of the condition by the user-controllable character during the automated gameplay by the user-controllable character, either the first in-game activity or the second in-game activity is automatically executed during the automated gameplay. ### Claim 11 (depends on 10) The method of claim 10, wherein at least part of the online game takes place in a virtual space, and wherein the evaluation of the condition is independent and separate from the first in-game activity and from the second in-game activity. ### Claim 12 (depends on 10) The method of claim 10, wherein the multiple commands include one or more commands directed to a given user-controllable character, the method further comprising: determining a given activity-defining characteristic for the given user-controllable character, wherein the given activity-defining characteristic is different from the particular activity-defining characteristic; determining, based on the stored information, an appropriate characteristic-specific set of in-game activities for the given user-controllable character; and generating, using the trained pretrained text-based system, a given sequence of given in-game activities selected from the appropriate characteristic-specific set of in-game activities; wherein the given sequence is different from the generated sequence. ### Claim 13 (depends on 10) The method of claim 10, wherein a first individual activity-defining characteristic of at least one of the user-controllable characters is associated with a first characteristic-specific set of in-game activities, wherein a second individual activity-defining characteristic of the at least one of the user-controllable characters is associated with a second characteristic-specific set of in-game activities, and wherein the first characteristic-specific set of in-game activities is different from the second characteristic-specific set of in-game activities. ### Claim 14 (depends on 10) The method of claim 10, wherein individual sets of in-game activities are specific to individual online games within the online gaming platform. ### Claim 15 (depends on 10) The method of claim 10, wherein the sets of in-game activities are associated with activity-defining characteristics of user-controllable characters, wherein one or more of the activity-defining characteristics of the user-controllable characters correspond to individual races and/or species of the user-controllable characters. ### Claim 16 (depends on 10) The method of claim 10, wherein the user-provided textual description corresponds to a first particular in-game activity responsive to the given user-controllable character having a first activity-defining characteristic, and wherein the user-provided textual description corresponds to a second particular in-game activity responsive to the given user-controllable character having a second activity-defining characteristic that is different from the first activity-defining characteristic, wherein the first particular in-game activity is different from the second particular in-game activity. ### Claim 17 (depends on 10) The method of claim 10, wherein the pretrained text-based system is Generative Pretrained Transformer 3 (GPT-3). ### Claim 18 (depends on 10) The method of claim 10, wherein the user input is received through a user interface.