Method, etc. for generating trained model for predicting action to be selected by user

A method comprising:

• determining a plurality of weights for a plurality of individual history-data element groups included in history data concerning a computer game based on user information associated with the plurality of individual history-data element groups;
• generating game state text data and action text data based on the computer game, wherein the game state text data and the action text data are expressed in a prescribed format corresponding to a plurality of game states and a plurality of actions included in the plurality of individual history-data element groups included in the history data;
• generating training data using the game state text data and the action text data,
• wherein the training data comprises a plurality of pairs of game state text and action text, and
• wherein a respective pair among the plurality of pairs corresponds to a single game state and an action selected in the single game state;
• generating a trained transformer neural network using the training data and a pretrained natural language model,
• wherein the pretrained natural language model is configured in advance to understand a plurality of grammatical structures and a plurality of text-to-text relationships concerning a natural language,
• wherein the training data comprises a number of items of game state text,
• wherein the items of game state text have different orders of a plurality of text elements, and
• wherein the number of items of game state text is based on a weight among the plurality of weights that is determined for a history-data element group among the plurality of individual history-data element groups;
• displaying, on a display device and by a user terminal device comprising an input device and a computer processor, a plurality of game screens for the computer game;
• receiving, during the computer game and by the input device, a player input from a player that is operating the computer game in response to displaying at least one game screen among a plurality of game screens;
• determining, by the user terminal device, a first game state within the computer game based on the player input and in response to receiving the player input from the input device;
• determining, using the trained transformer neural network, a predicted user action in the computer game using the first game state as an input to the trained transformer neural network;
• determining, by the user terminal device, a second game state within the computer game using the predicted user action;
• and
• executing, by the user terminal device, the computer game based on the second game state that is determined using the predicted user action.